Maybe he is right and LLMs are a dead end, maybe even the transformer architecture, but the attention mechanism isn't. Its the crucial genius part of today's AI and certainly can be used to create world models that dont just talk about things but really experience them.
you stole my idea seriously, i think it works so well because typescript is very clear in .. well type definitions. the llm can't get lost so fast between function calls because it understands exactly what data structures goes in and out.
Now is a great time to study AI. LLMs are just big neural networks , understanding how they work is most relevant. Yesterday I trained a small regression model on text embeddings for LLM preprocessing, classic ML is still very much in use.
So it’s not too late at all. The fundamentals matter more than ever if you want to go beyond just calling APIs.