Try dropping the power cap on your GPU if it supports it; you can often get much lower energy usage with minimal loss of tok/s (particularly during generation) than whatever the GPU defaults to. There's a sweet spot around 200W on the GPU I'm currently testing that gives me about ~75% of the max pp and 97% of tg while using 100W less than the default/max 300W power cap -- and the card runs much quieter as a result.
> AI for product development and management would be far more impactful than automating rote coding tasks [...]
Yeah, if this stuff actually worked that well already, OpenAI et al. would just run AI CEOs and engineers. Why get some other company to pay you at all when you can automate every other company out of existence and take all the money they make?
The fact of the matter is that while the tech has some uses, it sure as hell isn't a full scale replacement and you almost always actually have to massage the input into LLMs to get anything decent back out in practice. Some CEOs and managers can learn to do this, of course, and some already are... but that quickly turns into a second full time job. A "programmer" is still needed. The job might change from mostly hand-writing C++/JS/Python to prompt engineering + some manual coding to fix all the stupid fuck-ups that the bots can't solve themselves, but you still need someone to actually prompt the bot.
When that changes, it won't just be engineers losing work; there will be no reason to even have a human CEO any more.
27B is the dense one. Try the Qwen3.6-35B-A3B variants for the MoE release. That's what I'm running on a Framework Desktop and I get ~50 tok/s plus or minus a few. The dense one is similarly slow for me -- not sure what to expect on your hardware from the MoE but it should probably be much faster.
I appreciate the sentiment, but this law looks counter-productive if I'm reading it right. This is OBVIOUSLY going to push companies to make games into a subscription service to bypass the law even if they wouldn't have normally:
> (b) This section does not apply to any of the following:
> (1) Any subscription-based service that advertises or offers for sale access to any digital game solely for the duration of the subscription.
This exemption NEEDS to be removed. If a game's official servers are taken down, the community needs to be given the ability to keep running it themselves. Full stop. No exceptions.
I don't think GitHub has made a single UI change since ~2023 (when it went JS heavy) that I've liked. (Admittedly though, I've moved away from it for everything I have a choice about at this point, so it's possible they snuck in some good stuff when I wasn't looking.)
Also: having trouble getting this specific link to load -- just getting the unicorn error over and over.
> it's better anyways and surely close to a decade after coming out, we'd expect devices to support it well enough.
A lot of people, myself included, are still using quite old hardware. The GPU in my daily driver is ~10 years old at this point. Between crypto, COVID, and this AI craze raising GPU costs by insane amounts, it hasn't made sense to replace it with something newer. I know I'm not alone on that...
Iron and platinum have different melting points. If you melt the alloy, then spin it to concentrate the platinum, couldn't you coax the platinum to separate out as solid clumps by adjusting the temperature?
Alternatively, there are differences in magnetic properties that could be exploited...
This isn't my field, so I'm just spitballing. I bet if you can get the cost of launch and interplanetary transit to be low enough for people to really start tinkering with asteroid mining though, someone will crack the metallurgy issues...
Of course they can. They might be too lazy or ignorant to do so, but it's not really any harder to learn to install Linux than it is to learn to make mashed potatoes once you're motivated to bother -- and billions of people have managed to do the latter just fine.
Normal people are absolutely capable of following basic directions like: "download this file", "insert a USB stick", "run this program", "reboot your computer", "double click the install icon", "click the 'Continue' button (or similar) following the on-screen prompts".
> $120K isn't going to cover the fully loaded costs of an SRE who can set up and run that.
> Hiring 1 person to run the infrastructure means that 1 person is on-call 24/7 forever.
> If there's an issue with the server while they're sick or on vacation, you just stop and wait.
Very much depends on what you're doing, of course, but "you just stop and wait" for sickness/vacation sometimes is actually good enough uptime -- especially if it keeps costs down. I've had that role before... That said, it's usually better to have two or three people who know the systems though (even if they're not full time dedicated to them) to reduce the bus factor.
> The one place where OpenAI does have a clear lead today is in the user base: it has 8-900m users.
There is no way that number is an accurate reflection of the number of actual human users of their service. I could believe they have 8-900m bot/fraud accounts in their databases, maybe, but not real users.
The price of electricity where I am in California is pretty cheap for the energy itself -- I pay about $20/mo for generation -- but the cost for electricity delivery is absolutely fucking insane. It costs me $90 for "delivery" of that $20 worth of electricity.
Try dropping the power cap on your GPU if it supports it; you can often get much lower energy usage with minimal loss of tok/s (particularly during generation) than whatever the GPU defaults to. There's a sweet spot around 200W on the GPU I'm currently testing that gives me about ~75% of the max pp and 97% of tg while using 100W less than the default/max 300W power cap -- and the card runs much quieter as a result.