you're probably only allowed a subset of the query language to talk to an encrypted table. E.g. only range queries that target a sample size > 5% of rows, etc., with exceptions for searches that hit an exact index such as looking up by id.
What strikes me the most is just how many different tasks are involved in modern model design. It used to be the case that you come up with a new loss function, slight architecture changes, etc., run your train and eval loop, and publish the artifacts.
Now, there’s so much work to do just to keep up. It’s the ultimate red queen race. All of the 500 steps involved, each of which is its own little optimization loop, is sort of awe inspiring.
But obviously this inverts the previous rules that small teams run faster than big teams. AI requires a big team. It’s only once the team pushes past the 1000s that organizational inertia seems to become an issue. Because until then, there’s way too many pieces for even a dozen super stars.
Community generated tags seems like the obvious solution to all of this. You could easily give a setting to turn them off, breaks no existing systems, and allows for a broad emergent taxonomy. Only surface tags above X community upvotes except to superusers who are allowed to propose tags.
> We chose a different consensus algorithm for Meerkat, called QuePaxa, that aims to avoid the “tyranny of timeouts” imposed by protocols like Raft. QuePaxa is a subtle protocol, but here are the highlights. A client can contact any replica, and that replica can drive consensus for the latest slot. There is a leader, but it is not required — its only advantage is that it can drive consensus with fewer round trips (one) than other replicas (3+). Critically, clients are free to contact multiple replicas concurrently for the same proposal, to increase the chance of the proposal being successful. Concurrent proposals do not destructively interfere: replicas work together to decide one of the proposed values.
This product feels bad and sloppy, so I’ll give my hypothesis for why this was built:
At this point, Anthropic is likely having Claude itself propose and build features autonomously based on providing it with raw user feedback. This could be one example. Which is why it has an eerie sense of redundancy and pointlessness (“You mostly used Claude to automate work and home tasks”, etc.).
Exactly. The spec should go in a git comment, NOT vcs. Or, you keep the document in history for the duration of the PR and remove it post review or pre merge
Looking at the implementation sketches, this algorithm looks even trickier to implement than Paxos (already a notoriously tricky algorithm to implement) and on top of that, I think the failure case in this algorithm is subtle and different -- very long tail latencies. In Paxos/Raft the latencies are more likely bounded by the timeouts (not eliminated of course) so you can build other systems to expect certain delays, but in this case, you may write something, wait for an ack, then abandon and retry, then realize the old write succeeded, etc. ad infinitum.
This has very little to do with “AI replacing jobs” and much much more to do with a bad product getting obsoleted by better ones.
Human labeling is a two sided marketplace and so as any marketplace startup knows, both sides need to be constantly nurtured otherwise the system can collapse as worsening quality leads to churn and a vicious cycle that empties out the platform.
In labeling, you need to understand the limitations of individual work and fatigue, keep your pipeline bursting with awesome and consistent work, and improve the platform to make customer experience great.
AMT has been totally languishing in all these respects. Pay is terrible, dishonesty rampant, etc. It was a bad product, no need to pedestalize it or turn it political
In Gemini at least, if you look at how they process PDFs, they do an OCR and then feed the text + image to the model, without charging you for the text tokens (I believe).
So my guess is that Claude’s backend is doing the same — so this hack is probably more of a loophole in token accounting that might get closed if Claude is doing what Gemini does
Can you speak to what makes this different from simply including or configuring various agent skills? Or is it simply the combination of lots of helpful defaults that makes this product useful?
To all of those thinking that GLM/OSS will save you — keep in mind that the model size needed to compete here likely requires an NVL72 or similar — 72GPU dedicated infra to run a hosted model. This will almost certainly get regulated by the gov’t as well, and even if not so there will only be a handful of companies that can afford it.
I simply don’t see the value here. At the cost of these systems its inevitable that you hire at least one person full time to manage your rack infra, and that person would likely prefer the customizability of commodity hardware.
Source: I run a startup that recently did our datacenter buildout. At no point were we at all interested in a single integrated vendor.