Benchmarks aren’t broken, the models can learn anything. If we give them true real world data (physics engine), they will learn the real world. We are going to see artificial general intelligence in our lifetime
Once the business hits a certain level of revenue, the mvp is finished etc, whoever is the face of the company, I.e. CEO has way more power. CTO if they have shipped a complete product that’s getting paying customers can be replaced with an engineering manager. But not before
Getting the product to some level of completion is a monumental lift
Honestly, o3 has completely blown my mind in terms of ability to come up with useful abstractions beyond what I would normally build. Most people claiming LLMs are limited just arent using the tools enough, and cant see the trajectory of increasing ability
Living in NYC, I have been around a TON of venture backed startups with the classic non technical CEO, technical CTO. Some HUGE percentage of startups see the CTO fired once the tech stack and revenue are stabilized.
The incentive from the CEOs perspective to remove a contender as well as claw back the equity is huge. Early stage the CTO is the most critical, but after real traction they can be replaced far easier than most want to admit.
My advice for technical founders is to always place themselves first, from a legal and organizational perspective. For a technical founder with social skills, a non technical founder brings very little value relative to their vesting in the early stage.
Engineers at ai labs just come from prestigious schools and don’t have technical depth. They are smart, but they simply aren’t qualified to do deep technical innovation