You... haven't shown any evidence that we're near collapse. That's what I'm asking you for. Show me some evidence that we are losing capabilities with we have today.
There is undoubtedly a limit somewhere (there is only so much you can pack into a given size) but it's really not particularly clear where that limit is. I don't think it's superintelligence - that much I agree with you - but I think "We already have a 1gb model that is as capable as it will ever be" is strictly false.
> This is science fiction, these models don't have access to their own weights.
The models are being used to train, and improve the infrastructure for training, other models [0][1]. Several RL techniques rely on using the currently-being-trained weights as part of their process. I really would not take "don't have access" as a given, especially during the training phase.
> What would be a lot more scary is a model as capable as sol that's able to run on consumer hardware without taking up several terabytes of storage, but of course that is simply not possible as we need 4t parameters to even begin emulating a small fraction of what a human brain can do.
The Poolside Laguna S 2.1 model [2] purports to compete with models several times its size, and inference compute is becoming increasingly plentiful. Again, would not hold anything here as a given.
I've been rewatching Person of Interest for related reasons, and it hits uncomfortably close to things that are playing out today (e.g. https://youtu.be/zRL2sRkUvYk)
Annoyances around the general workflow (i.e. having to dedicate an entire output to it and/or preventing you from doing anything else with that output), as well as general stability/connectivity issues (i.e. not streaming one of [video|audio|input] on connection). Interacting with its UI also makes me believe that it is in dire need of some TLC.
Comparatively, Moonshine "just worked". Claude set it up, porting across relevant settings from Sunshine, I connected to it, punched the client pairing code into the server, and then I was able to play Clair Obscur on my TV without being logged into my workstation. Pretty cool!
I discovered Moonshine last night [0] as a result of frustration with Sunshine's many flaws on Linux, and I'm loving it so far. Thank you for your work!
Oh, I have no doubt that they could have extracted those gains from Zig! My point is more that, from a relatively naive line-to-line port, they were able to claim these benefits without much effort.
It's not great for Zig if you have to put in more work to end up at the same place efficiency-wise, especially for a language marketed at people who like to get the most out of their metal.
Without commenting on Bun itself as a project, or the nature of the rewrite, it can't be good for Zig that a naive rewrite away from it fixed memory leaks, improved stability, shrunk binary size by 20%, and improved performance by 5%.
The Steam Deck is the closest thing the PC world has to a console (barring the Steam Machine, of course), and features near-console levels of hardware/software integration.
I am _very_ familiar with Claudish, and to some extent, the other AIs' writing styles. This article is human-written and features human writing quirks.
The very first sentence
> Back in 2022 and 2023 there were two big branches of machine learning happening at Meta.
is unmistakably human. That's not how a LLM would phrase this sentence, and if it did, it would have put a comma after 2023.