The correct comparison is not sonnet, but qwen3.5-27b on a cloud. Alibaba's pricing [0] is $0.20/m input $1.56/m output, so $0.72 for the prompt processing or $0.22 for the generation. Yours is still cheaper but the margins are less.
My guess is that this math gets less good with MoE (because you will be limited by VRAM, but clouds won't).
why do you think so? they provide some evidence of this in the article, but there have been several improvements in e.g. nanogpt-speedrun or openai parameter golf made by AIs
Does China subsidize housing construction? Is your claim something like "China encourages/forces consumers to save at high rates which lowers interest rates and makes there be more construction"?
The formal Ottoman name was Kostantiniyye=Constantinople until the empire's fall in 1922. The official shift happened in 1930, with the Turkish Postal Services Law changing the name to Istanbul.
This is a quite old technique. The idea, as I understood it, was that lots of data at Google was stored in triplicate for reliability purposes. Instead of fetching one, you fetched all three and then took the one that arrived first. Then you sent UDP packets cancelling the other two. For something like search where you're issuing hundreds of requests that have to resolve in a few hundred milliseconds, this substantially cut down on tail latency.
I am in this world, but am not familiar with this specifically.
My guess is that they found a bug with their implementation of the model using the weights Google released. These bugs are often difficult to track down because the only indication is that the model is worse with your implementation than with someone else's.
The point is that if DoD's supply chain restriction does what Hegseth seems to want, all contractors involved with Anthropic would have to divest. That includes Amazon and Google, who are both DoD contractors who provide massive quantities of capital and compute to Anthropic. It's irrelevant that Anthropic provides Claude through Palantir.
This is not really possible. My guess is that the government is not willing to spend the necessary quantity of money to get e.g. Amazon or Google to divest of Anthropic and stop providing them computing resources.
The point of the supply chain risk designation was not just to have the DoD stop using Anthropic (they could have done that by just cancelling the contract). Their intended effect was to force every company that sells to the US government, no matter how indirectly, to not use Anthropic in any way, which would effectively destroy them because almost every company is in the supply chain (for example my company is https://calaveras.ai/ because we sell to AI companies who in turn sell to DoD).
This seems like a really poorly thought out article. You should take more care on making sure your understanding is correct before publishing in the future.
Taking the Amazon example in Part 2:
For e-books (simpler), Amazon gets 30% for running the store, doing advertising, etc. and then authors get 70% [1].
For print books, I'm a little less clear but it appears Amazon buys the books for roughly 50% of list[2] which for Hachette in 2025 is $26.50 so Amazon pays $13.25 to the publisher and then Amazon retails the book for $14.84. So for $100 of books sold on Amazon, $89 goes to the publisher and $11 goes to Amazon. It appears that the cost to produce these books is maybe $2/book (though I'm very unsure on this, this is a guesstimate from public data) and then the rest flows back to authors, advances, etc.
Amazon.com (not AWS) has a 7% profit margin in North America (FY25), so of that $11 they get in revenue they get $0.77 in operating profit.
Ok and this also annoyed me: you say $1.7T/y is $10.5k/worker, which is accurate. but then you say for the average household it's $26k/y. This is not true. There are 134m households in the US [3] so it's $12.6k/y for the average household. Maybe you meant something else like the median household but it seems more likely you just said ~2.6 people/household and multiplied the number of people/household by cost/worker. This is obviously wrong and you should have caught errors like that earlier.
I think Cosmo's refutations were mostly not very useful and based on misunderstandings of what I was trying to say. This is fine and we discussed it prior to their article being published.
The point I was trying to make with "RL is only necessary once" is that you can embark on a single self-play loop getting better and better, and this will get you to something close to the frontier. Once you're at the frontier, the frontier doesn't move very much, so you have quite a while (decade?) where it's totally fine to distill from the RL games.
On correction histories -- imo I correctly described what they do. Cosmo was annoyed by the word "adapt" but what I described was the adaptation.
On SPSA -- you don't have a gradient! you don't do backprop! this is what i was trying to get at.
Hawaii did do geothermal, but in fact it's so geothermically active their main geothermal plant went offline for a while because lava got shot up their boreholes https://en.wikipedia.org/wiki/Puna_Geothermal_Venture