At 1.5 bits per weight it'll still be over 500gb - that's still not running on consumer hardware.
Best case they release smaller models. 120b class of qwen 3.8 would be incredible - it fits on device for those serious about AI, but without millions of dollars in hardware for terabytes of VRAM
Continuing to build my olive oil tracking site (https://www.extravirginvault.com/) and pipeline. Freshness is king in the world of olive oil, and I hope to highlight to people they can find high quality, fresh olive oil produced near them.
It's been received well from producers and olive oil enthusiasts (e.g. looking for specific chemistry, cultivars and similar oils) but I feel like I've been shadow banned from Google - I seem to get more traffic from DuckDuckGo and Bing.
It's sad to see 11ty co-opted like this especially after building a complex project on it with several thousand pages (https://www.extravirginvault.com/). Despite the complexity, I feel like it's only a couple of days work to replatform my site to a more modern SSG like Astro.
Unfortunately I don't think anyone feels strongly enough about 11ty to fight for it when the next SSG is a few Claude Code prompts away.
Funnily enough about 10 years ago, I had noisy neighbours playing music late at night and after some fruitless attempts at politely asking them to turn the sound down, I found their wifi and ran a 'deauth attack'. Effectively flooding their wifi with packets disconnecting devices. Followed by a, "fuck!"
Best case they release smaller models. 120b class of qwen 3.8 would be incredible - it fits on device for those serious about AI, but without millions of dollars in hardware for terabytes of VRAM