Healthcare is one of the last places I think about for GenAI but maybe I have that totally wrong. Seemingly factual accuracy is a premium in that industry. I guess protein generation is a little different.
On the other side of this, understanding usage based consumption billing as a customer is very tough. First got exposure to this working on https://ec2instances.info.
These looks fantastic. Very slight weirdness in some movement, hands, etc. But the main thing that strikes me is the cinematic tracking shots. I guess that's why they use "scenes". It doesn't seem like a movie could be generated with this involving actors talking.
This only applies if these developers move to the new terms it looks like. So these large apps can stay with their existing setups and not pay the fee.
Yeah. In an infrastructure as code setup there's some more rigor that can be applied, at least in terms of tagging what's going out. But I've generally seen the finops team come in and optimize ex post facto.
This post, along with this Simon Wardley thread, https://twitter.com/swardley/status/1088780650860158978?s=20, attracted me to finops as an engineering problem. Consumption based pricing is really tough for a lot of orgs to handle at the $1M+ range, so much so that it requires dedicated software to line things up.
I started helping maintain https://ec2instances.info in my spare time and the code base is literally full of IF statements to paper over AWS billing quirks. Later, I joined Vantage, one of the companies linked in the article.
It's a little bit undecided whether finops will have the growth that devops did but the problem is seemingly felt very acutely.
I absolutely love LIGO. YC actually did a great interview with one of the lead physicists on the project where he described some of the technical hardware and software challenges - https://www.youtube.com/watch?v=1D2j8nTjOZ4
I know at AWS they drill into folks that spot capacity isn’t guaranteed capacity. I didn’t even think about more demand for spot reducing supply or additionally AWS just simply not investing in as much hardware to accommodate spot because of lack of growth. That said, we're seeing leading indicators that this trend will reverse in as cloud growth returns, https://www.vantage.sh/cloud-cost-report/2023-q1
Usage-based pricing in the cloud is a blessing and a curse. To take best advantage of it you need a third party tool. At least, this is the thesis behind my current employer (https://vantage.sh).
My personal next step with LLMs is to use them as completion engines versus just asking them questions. Few shot prompting is another intermediate skill I want to incorporate more.
I have essentially given up the idea of discovering something meaningful. During my first company I believed we were on the cusp of unlocking some new methods of video action recognition. Now I know that our approach was way off and that the great leaps would be made several years later by google et al. I still think I am acquiring skills which will help me form a company or build products with other people who might unlock a breakthrough but I doubt I will be the one to discover it.
The original promise of the cloud was that it was cheaper than on prem. For many companies this has turned out not to be the case. Having worked on a cost optimization product for the past year (https://vantage.sh) my belief is that the cloud _is_ cheaper than on prem but it is difficult to configure it to be so.
In particular it is difficult and stressful to understand all the knobs to turn within each cloud provider. It's a very AWS thing to put a lot of effort into lowering their customers' bills and I do think it makes for longer lasting business relationships.