Internet Archive | Senior Datacenter Network Infrastructure Engineer | On-site SF Preferred | https://archive.org
The Internet Archive is looking for a datacenter & network engineering to help us with our physical datacenters (one is a converted church in SF!) and networking stack. We have a global site pushing 100s of gigabits out of on-prem and bare metal, adding 150TB a day of new data.
I'm curious as to why with a system like Scylla (that I assume shares the same replication properties as Cassandra which my experience is based off of here) you can't just use the local SSDs and absorb the disk failures. If you space things out across AZs you wouldn't expect to lose quorum and can rebuild dead servers without issue. Is this to run things with a replication factor of 1 or something?
I've done this in past roles on AWS with their i3, etc. family with local attached storage and didn't use EBS.
We don't have a normal CDN, we have Fastly. They are really incredible at what they do, and this would not have been possible with our previous CDN partners.
> The database would be a custom program that would:
Creating a "custom database program" is not a small task.
We like to use boring technologies that we know work well. We were already using Cassandra, had some experience with Redis, and had a lot of confidence in our CDN.
If anything, it should make you trust reddit more! I don't know the exact details as to why your account may have been locked, but generally it will be because we're being proactive and have some signal that your account is using a weak or reused password.
That would be unrelated to this. We haven't taken any action on any accounts because of this issue and have no plans to, as we (reddit.com) were unaffected.
The Internet Archive is looking for a datacenter & network engineering to help us with our physical datacenters (one is a converted church in SF!) and networking stack. We have a global site pushing 100s of gigabits out of on-prem and bare metal, adding 150TB a day of new data.
More info and application at https://workforcenow.adp.com/mascsr/default/mdf/recruitment/... , but please email me at [email protected] for more info or a quick chat about the position!