It’s very simple. Apple doesn’t pay as well as other places and they stock price increases and their flashiness are not enough anymore to keep people around. It’s time they realize they are not the darling they used to be
To be clear a cerebras chip is consuming a whole wafer and has only 44 GB of SRAM on it. To fit a 405B model in bf16 precision (excluding kv cache and activation memory usage) you need 19 of these “chips” (and the requirement will grow as the sequence length increases for the kvcache). Looking online it seems on one wafer one can fit between 60 to 80 H100 chips, so it’s equivalent to using >1500 H100 using wafer manufacturing cost as a metric
To be honest restricting funding to the kind of symbolic based AI research that is criticized in this discussion might have helped AI more than it hurt , by eventually pivoting the research toward neural networks and backpropagation. I don’t know how much of a good thing would have been if this kind of research continued to be funded fully.
I mean, he was right … for what we knew at that time. He predicted correctly that the only way to achieve a general intelligence it would require to mimic the extremely complex neural networks in our brain that the hardware of the time was very far away from achieving. He could not predict that things would move so fast on the hardware side (nobody could have)that made this somewhat possible. We are atill I would argue a bit out in having the appropriate computer power to make this a reality still, but it now is much more obvious that it is possible if we continue on this path
Am I the only one not understanding what’s the point of all these efforts to try to run Linux on completely closed with no documentation devices (like iPhones and even mace for that matter). Seems like a lot of effort, for a crappy solution that maybe 0.0001% is going to use before realizing it is crap. Even only effort to keep up with the yearly hw updates that apple does and the complete disregard for backward compatibility and writing hw documentation makes these effort just a technocrat exercise (very cool for sure), but I can’t see anything more than that
This seems specifically designed to make the us look bad. If you try to compare us and Libya it almost seems like it would be so much better to move there which is stupid. Statistics are calculated in such a way that is just unfavorable for the us
But your really can’t. GDP per capita doesn’t capture so many parameters and conditions (like being landlocked surrounded by wealthy countries that use you as a de-facto tax haven)
Whenever I read articles like “Nordic country succeeds doing X” I always wonder if that would work on a country that is not 6 million people with tons of natural resources available per capita (Oil, timber, ore). Sadly I generally think not, but I’d be happy to be proved wrong …
Well that’s not how it works. When a company controls a very important piece of something society starts to rely on (oil, information, communication ... etc), regulation is not just preferable . It is NECESSARY.
What are you talking about. A restaurant doesn’t have the power to steer an economy of billions of dollars worldwide (the phone app market) . Apple and google do. Do you understand the risk for countries to allow one single private company to have complete control over the life/jobs of hundreds of thousands of citizens (app developers) that could be just destroyed by the whim of one of these two companies? It’s the price of creating a multi billion dollar business. You have to take responsibilities that go beyond your own revenue as you have worldwide power.
What about Microsoft and Windows then. People complained to death back in the day for anticompetitive behavior (and were right). The iPhone success is not only Apple’s success. Apple has to thank all the devs that supported its platform with their apps (yeah Facebook and google included) and without which the iPhone would be a gimmick. We can’t just ignore this and tell every developer after they get Sherlock ed to “suck it up and create your own platform you loser”.