Are you saying that on IOS 18 if you enable developer mode then each time you forgot the network it gets a new Mac? But without developer mode it does not get a new Mac each time you forget it? The Apple docs linked elsewhere in this thread suggest it only gets a new Mac once per 24 hours when you forget the network normally. I’m going on a long boat trip in the next week where this trick might work for me if so!
Ah ok - so googling a bit on this, you do specify the size when creating the namespace. So if you have multiple namespaces, they appear as separate devices on the OS, and then you can mkfs and mount each as if its a different disk. Then you get the different IO queues at the hardware level, unlike with traditional partitioning.
> local enterprise-grade SSDs support multiple namespaces (with their own internal queues)
What do you mean by namespaces here? Are they created by having different partitions or LVM volumes? As you mentioned consumer grade SSDs only have a single namespace, I am guessing this is something that needs some config when mounting the drive?
Over the last few months I have been seeing a push toward using Sqlite in production, where appropriate. Some of this has been coming from 37 Signals with their "Once" products, which use Rails and a SqliteDB.
Sqlite can go pretty far if you have fast SSD disk. The biggest problem is that your app is constrained to a single host. For many apps, with backups and a failover plan, that may be OK. For other its a non starter.
One reason we have so many poor engineering managers is because the top engineers get promoted to management. The skills for the two jobs are very different.
I’m sure many good engineers have tried management and found it to be not for them. Have an open discussion with your manager and see where it goes, as if you don’t you will likely end up applying for an engineering role elsewhere and leave anyway.
I was interest in a position at Aiven some time back. Did a recruiter screen and then a manager screen and then got asked to do a 20 hour take home assignment in Python that was to be completed in a single week. I politely declined at that point. Is that still part of the hiring pipeline?
I’m kind of similar. I write up how I set something up or some strange problem I solved mainly for my own reference but if it also helps someone else, great. Once or twice I’ve Googled a problem and landed on the solution in my own blog or a stack overflow post I made years ago!
For a job that needs to access 100's of thousands of small files, the ability to read the meta data quickly is very important.
This is the wider issue with small files. On HDFS each file uses up some namenode memory, but if there are jobs that need to touch 100k+ files (which I have seen plenty of), that puts a real strain on the Namenode too.
I have no experience with S3 to know how it would behave in terms of metadata queries for lots of small objects.
Apache Ozone https://hadoop.apache.org/ozone/ is an attempt to make a more scalable (for small files / metadata) HDFS compatible object store with a S3 interface. Solving the meta data problem in the HDFS namenode will probably never happen now. Too much of the Namenode code expects all the meta data to be in memory. Efforts to overcome the NN scalability have been around "read from standby", which offers impressive results.
The meta data is not the only problem with small files. Massive parallel jobs that need to read tiny files will always be slower than if the files were larger. The overhead of getting the metadata for the file, setting up a connection to do the read is quite large to read only a few 100kb or a few MB.
The other issue with the HDFS namenode, is that it has a single read/write lock to protect all the in memory data. Breaking that lock into a more fine grained set of locks would be a big win, but quite tricky at this stage.
I got my current job through LinkedIn too. Hadoop / big data position. I've got quite a few recruiter spam type messages though, but the one I got the job through was an in house recruiter for the company. I figured they were just doing key word searches as my profile isn't anything special. In my profile I put a good paragraph about each of my past positions highlighting experience with the technologies I wanted to work with. 5 or 6 months later this job came up.
I live in Belfast so I can either use a UK airport (Belfast), or Dublin. In my previous job, we flew business class from the UK to San Fran fairly regularly. It was often £500 - £1000 cheaper to fly Dublin to SFO connecting through London than Belfast -> London -> SFO. Infact, even pricing the London to SFO on the same flight (leaving out the Belfast leg), it was £500 cheaper to start in Dublin.
The price difference was all tax - and lots of it!
From the research I have been doing over the past year or two, the UK stock market has shown about 5% real return (after inflation) over the long term. I think the USA stock market is slightly better.
I am a total novice, and have fairly little invested, but those are the sort of numbers that pension projects are based on.
If you can keep you personal burn rate low, and over time invest a significant amount of money at 5% return for 10 years, the interest really starts to snowball.
1 in 4 likely means you are on call 24 hours a day for 1 week out of each 4 weeks. The support is then shared between 4 people. That's a fairly typical arrangement in largish companies.
I really enjoyed the Honor Harrington series by David Webber. I've also read most of the Safehold series, also by Webber, which has been excellent so far.
Currently half way through the Lost Fleet Series, which is pretty good too.
Quite different from the 3 series above, the Rho Agenda was very good.
I'm pretty sure the Halifax card I mentioned gives the Visa wholesale rate too. I generally get same rate as quoted on FX sites anytime I've checked it.
It would be great if you could set the points threshold on the RSS feed link too. That would allow all the stories that only make it onto the front page for a tiny amount of time to be skipped from the feed.