The RTX/DGX Spark, Mac Ultras with 128GB unified ram are all ~$5k. Its still an expensive toy for rich people, it might as well be an H100 for 99.9% of the population (not devs with high paying jobs, of course).
the value of local models is allowing normal people to access AI without needing to subscribe to cloud services. this is esp imp for the rest of the world where even a 12GB gpu is extremely expensive.
there is no real viable local option that will come even close to Sonnet/Gemini Flash or the cheaper chinese models. Even if your pc costs <$2k you are never going to recoup the hw costs, and the results will be far worse.
qwen IMO is far better for coding, esp agentic coding when combined with something like Pi, it comes probably close enough to Sonnet for a lot of use cases.
Gemma family is better for almost all other tasks you'd use a local llm for.
Meta illegally scraped 80TB of data from Anna's archive, Libgen, Zlib etc. I'm sure other tech giants did too. Without paying them a cent, costing these projects $$$ in bandwidth/hosting etc.
when I hear people complain about these projects it just sounds like hypocrisy.
I've always liked powerlevel10k, or its equivalent tide for fish shell, which I much prefer over bash/zsh. Its fast, async, has everything you need, and is much easier to configure.
I've always wondered why someone doesn't just bundle a nice looking shell prompt with common nerd fonts and make it the default in a single package you can install.
Most websites send massive amounts of telemetry data which is never mentioned but somehow MS doing this for Windows/Edge etc, which they fully disclose, always is.
Vim style keybindings and navigation is massively overhyped as is vim itself.
Cue endless debates about how Vim is the best ever ...... I'm sick and tired of everyone telling me that their neovim setup with a tiling window manager with million customized rc files is somehow better than vscode with a mouse (which mind you still has plenty of keyboard shortcuts) with sane windows. /rant
the only part I question is the 'regardless of family wealth'. This is purely 1st world and even here for the middle class and above only. Sure, poor countries are improving, but there's no guarantee, not with increasing wealth inequality, climate change etc, that this kind of tech will ever reach most people.
If this is public I can only imagine what Google has internally. Does DeepMind compete in this space or is it fundamentally different than a llm like Bard?
With their massive codebase and already deep investment in AI/ML, I'm pretty sure Google and likely MS already have the ability to do massive refactoring, validate it using tests, reiterate, train, rinse and repeat.
Nodejs solved all this years ago, now we have super fast shared package managers like pnpm, yarn etc, not to mention deno etc, why can't other languages adopt the same system?
the final book has the most infuriating, idiotic and worst character I've read in scifi. She repeatedly makes the worst possible choice, literally is responsible first for humanity being enslaved and then being wiped out, before making sure the entire bloody universe is wiped out, and at each stage is not only forgiven, but never questioned, celebrated by everyone else, and given even more power.
There will never be a MacBook of Linux or Windows unless the OS is optimized as much as MacOS is to the underlying hardware. Windows is optimized to a high degree and still cannot match the standby/resume times or battery life of MacOS, and thats without M1.
Linux is not even in the same ballpark. System76 apply some tweaks but its still Ubuntu and as a desktop OS its lacking in many areas.
there is no far left in the US. The 'left' here would be center/right in most other countries. The right/conservatives are the true evil who are responsible for basically every bad thing here and the real problem is that most of this country is conservative, and thinks this country is 'special'.
also at every level, where you are expected to file forms or deal with any officials, you will be asked to pay some bribe, and there will be 'agents' who offer to do it for you using whatever illegal means they can, for a 'fee', and in many cases they are the only feasible way of getting it done. This happens in every corrupt economy/country but in India its an art form and taken to its logical extreme.
Musk/Tesla have been selling alpha quality at best and vaporware in reality FSD for a long time. Its never ever going to work as claimed. Its crap software that endangers other people on the road and routinely kills people and all they needed to do is add a stupid disclaimer and the magic 'beta'. Every few months Musk will lie that its 'done' and out at the end of the year, with outlandish nonsense claims like his robotaxi in 2016/17, his most recent one that you wont need a human driver.
Its a massive scam and fraud thats made them trillions, and its amazing they haven't been sued for it.
the value of local models is allowing normal people to access AI without needing to subscribe to cloud services. this is esp imp for the rest of the world where even a 12GB gpu is extremely expensive.
there is no real viable local option that will come even close to Sonnet/Gemini Flash or the cheaper chinese models. Even if your pc costs <$2k you are never going to recoup the hw costs, and the results will be far worse.