Apache Ozone has multiple 100+ petabyte clusters in production. The capacity is on HDDs and metadata is on SSDs. Updated docs (staging for new docs): https://kerneltime.github.io/ozone-site/
https://github.com/oneconcern/datamon
Had written this git for data tool few years back (works with GCS but can be made to work with S3)
1. No server side
2. Immutable data (via GCS policies)
3. Ability to mount data sets as filesystems
4. Integrated with k8s.
It was built to work for the needs of the startup funding it, but I would love it if it could be extended.
That is the share of value capture from the market that they just made real. There are legitimate scenarios where first movers do not have an advantage.
The tag line within SDM was that it is a program for those who want to lead engineering and not leave engineering (MBA)
I think the meta framework for thinking and being able to step away from the madness of releasing a v1 product and having tools for thinking about the bigger picture.
Also, MIT.. it is a very rewarding ecosystem to be in.
ESD.34 ESD.342 16.863J 15.871 15.783J ESD.33 to name a few
Also, 15.965 my favorite and offered by my thesis advisor Michael A. M. Davies: Based on which it is likely that OpenAI won't be walking away with the cake.
MIT has an amazing program for System Design and Management. Dan and I are both graduates of this program. Some of the courses I would recommend include System Architecture, System Safety, and System Dynamics. Most of the content is available on OCW.
What is taught is not software-specific, but is entirely applicable to software, outside of the world of 'throw everything on the wall and see what sticks' as long as the venture capitalist can be shown growth at all costs. I wish more software developers were mindful of complexity and architecture.
Note the word competent.. Also, insurance companies will often have opinions on what tests were valid and might reject paying for tests. So if a DB admin spins up a cluster to debug his hunch of a SQL Compiler issue, that bill will be paid by the customer and not the insurance and might bankrupt the customer..
I had an apt with a cardiologist where he literally read a standard template of care and when I tried to see if he is interested diving deeper into inflammation causes, tests and ways to avoid the standard medications which only deal with symptoms he was least interested as it all dealt with metabolic issues and not the heart per se.. the system is run to see how can a patient be billed and who owns the organ. Insurance companies have swim lanes and medical practitioners are educated and trained to remain in those swim lanes.. as long as things are kept simple for prescribed cures and billing, the gravy train continues.. it not in their best interest to solve the problem. Have you ever been to a annual physical where god forbid you discuss issues that are not part of the normal annual health checkup? You will actually be asked to schedule a separate appointment as the billing for that is separate..
A lot of "functional medicine" happens outside of insurance payment coverage.
Some more interesting things to follow:
https://cholesterolcode.com/https://cynthialimd.com/faqs/
I recently came across a term "Functional Medicine" https://www.ifm.org which looks at the body as a whole and tries to root cause metabolic issues which can often result in IBS cures.. most older medicinal practices always considered the body as a unified system which make sense in terms of how it is engineered but modern medicine tries to break things down and often misses the cross specialization impacts. Best of luck!
Wow! Allegations without context or material. Who would have thought someone on twitter would sling mud!
If the Indian government is going to implement the Aadhaar card.. I rather would like folks such as Viral Shah on the team to make sure the implementation is headed in the right direction.. The scale and operational challenges faced are significant. The context for that twitter thread is a leak of private data that occurred. If competent engineers are not involved, it will only get worse.
This is analogous to the US Govt implementing a plan to provide universal healthcare but random developers getting angry when a competent engineer works to make sure it is done right..
My LG washer dryer app needs to know my location... why? They won’t let me add it without giving app location access.. so does the YI camera now.. this is getting a bit out of hand.
I have been tracking luthiers and it is fascinating how detailed and varied each builder is.. the likelihood that the instrument will sound good is well correlated to how much time the luthier puts into refining his process.
I don’t understand the rational for not wanting to learn DS/Algos this is just one part of it, there is also the whole business/customer side of writing code. There is a difference between never getting a demanding customer who understands the difference between a good instrument and something glued together and not wanting to know how to do something more than glueing it together is appalling. As a coder if you want to learn DS/Algos and you do not find a job the values that maybe there is more to learn so that find a job that values it. It will be competitive and you can fail but it is not wasted.
A good wood worker tends to know the tools of the trades and more importantly know when to not use a tool and when to invent a new one.. That said not every cabinet is a work of art some are just there to be functional for long enough to justify their creation.
I feel system interviews that dive deep about decisions and insights are far more useful than hitting a leetcode jackpot. Though it puts a high bar on the interviewer as well.
Your comment does not make any sense.. there is a difference in choosing where you will be while attending college vs. being required to leave the country. Many students do not avail of dorms post freshman year.
I think this is the case of kettle self reflection? Unless any one who differs cannot be an American? The original author, many of us who comment here, are we reflecting on our own policies?