Lwerewolf

4 ngày trướcdiscuss

Might wanna try it now, seems to have been largely fixed. Check huggingface threads and reddit. Works for me, very memory hungry and PP speed drops off a cliff around 200k context (~30tok/s decode and ~40tok/s pp - like... hope it isn't debugging with big logs), but it brings a fresh perspective alongside ds4-flash. The more, the merrier - I prefer keen eyeballs more than speed anyways.

Lwerewolf

6 ngày trướcdiscuss

...they'd messed something up in that quant, apparently fixed promptly. ds4 now supports it as well and it's... well, context-limited (<=250k on a 128gb machine) but it positively flies on an m5 max - the 60tok/s decode / ~500tok/s prefill is real.

Lwerewolf

6 ngày trướcdiscuss

Tool calling in pi completely broke with the updated q4 gguf (spinquant-less). Guessing it'll take some time.

Lwerewolf

7 ngày trướcdiscuss

Right:

https://huggingface.co/poolside/Laguna-S-2.1-FP8/discussions...

Wait time.

Lwerewolf

7 ngày trướcdiscuss

Well, just ran said gguf on the GeneralsX codebase with a pretty open-ended "Explain this codebase to me, and the general game loop." prompt, and...

  Let me also look at the GameLogic::update() to see the rest of the update flow, especially the object update loop.

  Actually, I think I have enough information now. Let me also check the GameLogic::UPDATE to understand the full update flow.

...repeating forever.

Since they mentioned that they're working on new quants, guess I'll wait. From earlier tests on work stuff, it's definitely capable.

Lwerewolf

7 ngày trướcdiscuss

Deleted earlier, didn't see you post, pasting here:

/* Just started testing with the gguf (with gpu offload, m5 max 128gb), q4_k_m, running seemingly well. Speed is initially slightly faster than antirez/ds4 - decode tok/s in the 30s, prefill ~400-ish. Expected, given the slightly smaller size. Looks to be working fine, but too early to tell. Definitely likes to "think". */

Anyways, guessing that discord might be focusing on the nvfp4 stuff. I've noticed spelling mistakes in the thinking traces, tool calls have been fine so far.

Lwerewolf

8 ngày trướcdiscuss

This: https://github.com/Blaizzy/mlx-lm/tree/pc/add-lg ...and this is what I should probably wait for (not sure why it's in vlm): https://github.com/Blaizzy/mlx-vlm/tree/pc/laguna-s-nvfp4 ...or perhaps I should've just used the gguf with the provided llama.cpp instead of trying to run the nvfp4-mlx from the get go, but where's the chaos in that :)

Running deepseek flash on something locally now, this will have to wait a bit. I still stand by my initial quick assessment - looks capable. Some people on r/localllama also reported loops. We'll see in ~10 hours. Hopefully I haven't terribly mislead people.

Lwerewolf

8 ngày trướcdiscuss

nvfp4 mlx, literally barebones pi.

edit: on bigger tests, got it to loop pretty easily unfortunately, probably local settings.

Lwerewolf

8 ngày trướcdiscuss

Almost like a built-in heavyweight harness.

Lwerewolf

8 ngày trướcdiscuss

Testing it now. At the very least, competitive with DS4-Flash indeed. On my small (and per Sol's words, _very_ semantically dense) C test codebase, it found things that only gpt-5.2 managed to find back in the day, but also made a stupidly incorrect initial observation that a memfd_create()/mmap was used for IPC (funnily enough - sol missed that as well in its review, until I pointed it out). Re: the claims vs deepseek v4 - both flash and pro are expected to get a "general availability" release very soon (i.e. well-"post-trained"), so things can change in a... well, flash, as per usual in the current environment.

Anyways, keep 'em coming.

Lwerewolf

9 ngày trướcdiscuss

Pretty sure this might be a duplicate. Regardless, tried the 1bit bonsai 27b gguf three different ways - their llama.cpp fork (prism, was it) on 2 machines (1255u/16g, m5 max/128g) and the web (on the 1255u). With llama.cpp it works. on the web it emits the same thing over and over. Prompt was "do you see anything wrong with this code: <C code, compound literal passed as a pointer to a function in an if statement>", result was literally "Yes, let'ssomestruct_struct_tsomestruct<a bit of similar garbage>structstructstruct<forever>.

Locally, it's definitely not the full 3.6 27b, but for ~6G with the context, it's quite impressive, and I like what this implies for larger models. Speeds on the 1255u are abysmal, though (~1TPS or less) - granted, CPU-only.

Lwerewolf

9 ngày trướcdiscuss

Not too sure about the engines as of late. Bigger and heavier vehicles - yes, but still mostly rural/highway, and at way lower speeds than the EU. Overall, IMO it's just the distances involved.

Lwerewolf

14 ngày trướcdiscuss

All show no go is the trend these days - and not just with cars.

Lwerewolf

16 ngày trướcdiscuss

Only guarantee that you can get is the sandbox in which it operates. The model itself is a slot machine and can result in anything, and if its sandbox is nonexistent... here's one possibility.

Lwerewolf

19 ngày trướcdiscuss

187 N/A BSFC @ 2000rpm and open throttle. Tried emulating a DI 2GR-FXE. Seems a bit optimistic, but still fun to play with.

Lwerewolf

25 ngày trướcdiscuss

The ones in cars need to be heated up quite a bit in order to work, and you still need reference air. Otherwise, I'm pretty sure that CO2 isn't a problem but rather an indication of a lack of oxygen in the first place, so it technically could work... just not if you're measuring the environment itself.

Lwerewolf

28 ngày trướcdiscuss

Same with ds4-flash. Low power is 13t/s vs 26t/s, power usage is ~30w vs ~100-120w. I still use high power because my m5 max is basically a server with built-in UPS and screen (and an off-work media machine, blender cycles toy, etc - growing fond of it, actually), but even 10tok/s is usable with a relatively smart model. Caveat is that the code that I touch barely has any boilerplate and I like keeping it lean.

Lwerewolf

29 ngày trướcdiscuss

Modding communities are still going. Kids, afaik, are still playing around with hosting minecraft servers or whatever is en vogue/cool/meta/etc nowadays. DIY 8-bit computers are gaining popularity.

IMO the fact that something's become very mainstream doesn't necessarily mean it's been watered down for everybody. There will always be people with various levels of curiosity and enthusiasm.

Lwerewolf

30 ngày trướcdiscuss

+ it lowers humidity and moves air.

Lwerewolf

tháng trướcdiscuss

DS4-Flash definitely stands its ground when I'm obviously wrong (i.e. me reading ifneq as ifeq for several minutes straight), and I've seen at least once a "thinking" trace that was almost verbatim "the user has changed this". That's local, so thinking traces are raw. Pretty sure the more powerful models (500+GB weights, closed SOTA, etc) are even better at this - haven't had GPT5.5 with codex sugar coat things for me.

Submissions

Ask HN: Salaries in/around the Netherlands, (Windows) drivers developers?

comments