His program uses quantization, but is very optimised and has builds that can fit into 96GB of memory with great results.
DS4 Flash is usually my go-to for a lot of things these days, and I don't have to worry about a cloud model stopping or telling me it's concerned about my usage.
Modern frontier LLMs know Norwegian. Wouldn't this simply be the job of RAG to do lookups as the user requests for data? Like how Gemini integrates with Google Search.
Seems like they should be building an MCP service rather than training an entirely new LLM...
I’d just plug the ports since things are going wireless and might only need the one usb-c from time to time. Hey StarLabs, perhaps put some nice flush and matching port plugs in the box?
Looks really slick. I'd love to see some more AI oriented mini PCs like the Star Byte but with OSS firmware. Think AMD Ryzen AI Halo form factor with the Gorgon Halo style APU.
Is eBay just a hive of scams now? Try searching for a Mac Studio with 512gb of RAM for example. I know it's a highly sought after item, but there are so many sellers with 0 reviews supposedly selling these at suspiciously low prices. What's going on here?
Many users do like to use scrollback to copy large passages of text, which becomes difficult and cumbersome if they have to use page-up page-down to get at the other parts of it.
I wonder if it's possible for app devs to use Exclaves. The thing that irks me about Apple is that they invent this new amazing internal stuff but then completely wall it off from devs, leaving everyone else (banking apps, wallets, secure messaging, etc.) to continue running in unsecured user space.
Just to clarify. There is an important difference between unified memory, meaning accessible by both CPU and GPU, and regular RAM that is only accessible by CPU.
Western companies operating outside China are often forced to agree with China's censorship requirements too. Look up the "great cannon" on wikipedia. Many such examples.
To show them that their battery life could go from 2.5 hours to 8 or more, perhaps. That was the Mac experience that customers weren't asking for yet "wowed" them when it came.