easygenes · HackerTrans

easygenes

1,392 karmajoined 10 jaar geleden

Submissions

Show HN: Sixteen year trends in AI doom on HN

hn.ai-doom.cc

3 pointsby easygenes4 maanden geleden0 comments

Show HN: HN Remixed to only show AI Doom (or not)

hn.ai-doom.cc

2 pointsby easygenes4 maanden geleden1 comments

GPT from GPT: de novo microgpt

github.com

3 pointsby easygenes4 maanden geleden1 comments

EEmicroGPT: 19,000× faster microgpt training on a laptop CPU (loss vs. time)

entrpi.github.io

11 pointsby easygenes5 maanden geleden2 comments

Training microgpt in milliseconds

github.com

2 pointsby easygenes5 maanden geleden1 comments

Accurate Low-Cost Robot Arm

github.com

14 pointsby easygenes2 jaar geleden2 comments

Show HN: Good, Fast, Cheap – Iron Triangle Like SimAnt Behavior Control

enia.cc

1 pointsby easygenes3 jaar geleden0 comments

Ask HN: What Is Going on with SBCs?

3 pointsby easygenes5 jaar geleden6 comments

GitHub: Stack Graphs for Code Nav (tree-sitter) – StrangeLoop 2021 Talk

youtube.com

2 pointsby easygenes5 jaar geleden0 comments

Lab: Impact of Tamping Pressure on Espresso Extraction

socraticcoffee.com

1 pointsby easygenes6 jaar geleden0 comments

Ask HN: Where's that wiki/notes/knowledge management project?

5 pointsby easygenes6 jaar geleden4 comments

comments

8 dagen geledendiscuss

That’s not what this indicates. This is the biggest and most expensive to serve, and most capable open weights model yet. They’re just pricing it in line with capabilities.

Kimi also offers generous subscriptions. Subs aren’t going anywhere. Think of subs like running an insurance business. There might be some users you lose money on (ones who max out their weekly quota without fail), but they’re managed such that the average subscription turns a healthy profit. There’s never been subsidies in model serving, inference is just cheaper in terms of ops TCO than people assume, and API margins are very high.

21 dagen geledendiscuss

Was fun to see their developers make nods to Le Chaton Fat in the announcements for this on Twitter.

I suspect a true "big new general-purpose" model is around the corner from them, whether or not they were in on Le Chaton Fat for real. They've mentioned it after the media circus. Hopefully more creatively named than just "Large 4".

24 dagen geledendiscuss

I'm a heavy enough user that I have both the OAI and Anth $200 plans. I always use at least 50% of my weekly Opus quota at Extra setting (meaning I use double the limit of the $100 plan, at minimum). Max I rarely touch because it is twice as slow and the incremental capability gain is minimal. Usually if Opus can't sort something well at Extra, the answer isn't to use Max but to hand the issue off to GPT-5.5 at XHigh.

26 dagen geledendiscuss

There are. If the kernels are nondeterministic (e.g. timing issues) there are minor changes between runs, on a single system, even with eager decode enabled (typically what temperature=0 achieves).

28 dagen geledendiscuss

This is a strange one. We know the hardware capabilities of Cerebras force them to do aggressive REAP pruning to serve Kimi K2.6. Meaning that about 750B parameters is the upper limit of what they can serve economically. Not sure if this means Sol is smaller than anyone thinks or that they're just going to charge so much that a very inefficient serving regime is feasible.

vorige maanddiscuss

[dead]

vorige maanddiscuss

M5 Ultra will ship before end of year, likely. Though with current RAM shortage, likely max spec will be 256GB and in short supply.

In late 2027 or early 2028, Nvidia will release Vera Rubin DGX Spark, likely with double or better the performance of current Blackwell, though unclear if memory capacity will go up much from current 128GB. Two to four of those will run models like this decently.

In 2028 we should expect Vera Rubin RTX discrete lineup, including the replacement to the RTX PRO 6000. Likely memory spec will be minimum 128GB. Good chance of up to 200GB. Two to four of those will run NVFP4 models in this class very well.

vorige maanddiscuss

Article reads as though written by someone who doesn't have much experience with deployments like this. Underestimates the memory needed to run with a reasonable amount of context. Misses two other obvious targets:

  1) 4x DGX Spark (or equivalent other GB10 boxes) with a switch (MikroTik CRS504 or CRS804) and TP=4.
  2) 4x RTX PRO 6000 box. Probably the most practical for cost/perf if you want on-prem as an individual.

Both would be best to run a 2-bit quant so everything can stay resident (article claims you could run a 4-bit quant with 4x RTX 6000 Ada, and while technically true it would mean a lot of the weights are streaming from DRAM, so it would be slow and impractical. You would need 8x RTX PRO 6000 to run 4 bit at a good speed).

This model quantizes unusually well: https://unsloth.ai/docs/models/glm-5.2#quantization-analysis

vorige maanddiscuss

The Wired headline reframes the issue in a way that’s misleading. SK Telecom was a previously resolved issue (as in prior to Fable launch).

It may have been a contributing factor, but the crux of the shutdown was the industry reporting of Fable jailbreaks (reportedly spearheaded by Amazon CEO Andy Jassy). The more interesting and honest angle is that the industry which has taken the seriousness of Glasswing at face value felt blindsided by Fable release and totally exposed by the residual risk, when they know they still have a months-long bugfixing backlog exposed by Glasswing and are desperate to buy more time.

This misleading looks deliberate on Wired’s part, to appear as though they’re getting a scoop when they’re really just being dishonest. Shameful.

vorige maanddiscuss

This headline is not what I would read from this. The numbers are more favorable than the general tone of rumors, and point towards the expected shape of a fast-growing R&D heavy business.

vorige maanddiscuss

Announcement from the founder of Z.ai:

“ GLM-5.2 is Fully Open, Frontier Intelligence Belongs to Everyone

Today, the sudden restriction of certain frontier models is deeply regrettable. At a time when access to frontier models is abruptly cut off for non-technical reasons, we are even more convinced of one thing: science should be global.

The path to AGI (Artificial General Intelligence) must never be enclosed by high walls. We have always believed that AGI should be the cornerstone for all of humanity to collaboratively explore the boundaries of intelligence and solve complex challenges, rather than a privilege monopolized by a few rules and subject to revocation at any moment. In the face of external blockades and restrictions, our attitude is one of radical openness. Frontier intelligence must remain open-source, accessible, and buildable, serving every dedicated developer.

GLM-5.2 is Zhipu's most capable open-source model to date. It not only supports a truly usable 1M context window but also maintains a continuous lead in the independent completion of long-horizon tasks, providing solid foundational support for building complex agent applications. It also continues to be our main engine for creating the strongest domestic coding model.

Tonight at 5:21—at this special moment—GLM-5.2 will officially be available to all GLM Coding Plan users (including Lite / Pro / Max). The API will also go live next week.

A step closer to frontier intelligence for everyone. The future of AI is open, and it is for the people. ModelKey: GLM-5.2”

https://x.com/jietang/status/2065784751345287314

vorige maanddiscuss

This release was rushed to hang on the coattails of the Mythos drama (“hey, sorry you can’t use Fable, but try us while you wait this weekend!”) I think they planned to release next week, hence benchmarks not all being ready yet.

2 maanden geledendiscuss

That happened a year ago when these shipped as the DGX Spark with only Linux pre installed.

2 maanden geledendiscuss

Mostly a strategy move to protect the CUDA moat… Apple would take over mobile inference in a clean sweep without competition.

2 maanden geledendiscuss

This is the same chip and same memory. Only difference is it is going in a laptop, so will be more thermally limited.

2 maanden geledendiscuss

If I were paying API rates this year, I would have already burned through $20k in tokens. Looking forward to the costs of this level of capability coming down.

2 maanden geledendiscuss

I have now also tried it on this scatter plot: https://3215535692-files.gitbook.io/~/files/v0/b/gitbook-x-p...

Similarly, the 26B A4B Gemma 4 and the 35B A3B Qwen 3.6 identify it clearly, give me the title and trends analysis fairly accurately. While this 12B spits out gobbledygook about it having something to do with hard-drive capacity. It's like it can barely see, gets the very broad strokes (knows it's looking at some kind of chart), but can't identify any details clearly.

2 maanden geledendiscuss

They haven't made one for this new model, but Unsloth has a comprehensive quant KLD map of Gemma 4 26B A4B here: https://3215535692-files.gitbook.io/~/files/v0/b/gitbook-x-p...

2 maanden geledendiscuss

I want to like the vision capabilities of the model. However, when I gave it an image which Gemma 26B A4B and Qwen 3.6 35B A3B has no problem correctly describing in detail, including identifying the Taj Mahal in the background it utterly failed. Its sense of the image was that it was a "distorted wide panorama" and even when I asked directly if it was the Taj Mahal it said no. The reference models saw it correctly as a normal square image taken from a fairly rectilinear lens (iPhone main camera).

2 maanden geledendiscuss

Have you run it through DeepSWE? I understand that's probably a high ask for this class of model, but would be interesting to see regardless.

Even if it can't fully pass much, there are so many tests against most of the scenarios that you can get a fairly rich report beyond the pass@1 stat. See e.g. this DeepSWE report against the Minimax M3 model: https://entrpi.github.io/misc/deep-swe-minimax-m3/