Just start pricing in bytes input/output. This whole "token" and "tokenizer" thing is an implementation detail that shouldn't even be leaking out into the API.
Providers change tokenizers all the time with model updates, and it's often not even possible to query/figure out how text is tokenized without actually just sending the LLM a request.
Just switch to charging for bytes of intelligence. Please. Claude Shannon figured this out decades ago.
Yeah, this implementation and their behavior these past few weeks is especially laughable when you consider that they consider themselves “philosopher programmers” or whatever.
You would think they’d be more reflective and introspective about these brash moral decisions. Their product quality is akin to my CS capstone lab group.
I've noticed that all of these music generators suffer from something like "mean" collapse (as opposed to mode, you do get variance, but all results are highly centered around similar sounding songs).
The music is all just very average, it sounds like the most average song with the most average chord progression/drum pattern per genre.
I guess that makes sense if these are most likely next audio token predictors... but it'd be cool if there was a way to inject some type of creativity/novelty into these, or at least tune up the temperature.
Everything so far just sounds like stock library music to me.
> And given that in Austin they just reached parity with Waymo (i.e. completely unsupervised robotaxi service), they are not doing badly.
There is no unsupervised robotaxi service in Austin and there won't be, for years, if ever. Just like the way "FSD" is not fully self driving and likely never will be.
There are 67 million baby boomers in the US. How can you rationally blame them all? Roughly 20% of the population.
Saying the "boomers ruined everything" is not sophisticated, we can't move forward from a blame game, we have to diagnose the actions and actors that implemented them, but of course this is much more challenging.
Ancedotally, I know plenty of poor boomers. Have you seen who works at a Dollar Tree lately?
The popular dialogue that boomer=rich and greedy, millennial=poor and exploited is not productive, it's a fabricated generational war that distracts us from the real issues.
Has any society ever behaved that way? It's already a push to get people to think of the middle/lower classes during the present.
I understand the desire to find an entity or group of people to blame, but they were acting in their own self interest at a peak time, they didn't know the party would be over soon, for many of them, it still isn't.
Can you blame them for existing during early globalization, before over the financialization of everything? It's not like they actively took more than they "should have" from anyone directly, it's a consequence of their local economy and where it was at the time.
It's not that hard to notice this, just google "{university} {degree} syllabus" and you can see all the courses that the student will take.
In my case, I have CS degree and work as SWE but I probably would've been fine with just my Data Structures & Algos course as I already had programming experience.
Are computational theory, circuits 101, discrete math, logic 101, etc necessary for being a good SWE? Probably not, but they do probably expand your mind a bit.
I've tried the latest and greatest agentic CLI and toolings with the public SOTA models.
I think this is a productivity jump equivalent to maybe punch cards -> compiled languages, and that's it. Something like a 40% increase, but nowhere close to exponential.
I used the early web. I miss forums, I miss the small webmaster, I miss making fun, small websites to share with friends.
And while you could make the argument that these forms of media were superior to TikTok, I’d also argue that this is mostly just taste.
While we have closed ecosystems now, they’re much easier to make and share content to than the web of the past. It’s much easier to get distribution and go viral. There’s also a well trodden path to monetization so that if you craft great content people love, you can make a living from it.
Yeah quirky designs, guestbooks, affiliate badges, page counters, all that stuff. I miss it. But only ever a very small fraction of society was going to be able to make and consume that stuff.
This new internet is much more accessible and it occasionally produces diamonds of culture, you just have to know where to look.
So no, I don’t think any amount of decentralized protocols or tooling or any technology really can change this. I think this trend is set and will continue, and I’ve had to learn to be more open minded to how I perceive internet content.
No one is going to make personal websites or change their behavior in a major way.
Look, you can still sign up for free web hosting and make an HTML page and tell your friends. There are still people that do this. But it’s naturally eclipsed by these other methods of much easier content sharing.
The point is the content itself, not the packaging. Just get over the shape of the packaging and enjoy.
You spent 3 months on this hacked together garbage when you probably could’ve just configured a pre-existing solution off the shelf with like 10 minutes of reading and understanding documentation.
This blog post reeks of “you can just do things” type of engineering. This is the quality of engineering I would expect from “TPOT” (that part of Twitter) where people talk about working 12 hour days. It’s cause they’re working 12 hours on bullshit like this.
Building some sweet custom codec or binary transportation algorithm was barely cute in like 1989. It definitely ain’t cute now.
How many of these AI and “agentic” companies are just misled engineers thinking they are cracked and writing needlessly complex solutions to problems that dont even exist?
The year is 2034. Countless attempts at re-producing the sophisticated wetware of the brain have failed. Modeling research has proved unfruitful, with the curse of dimensionality afflicting every attempt at breaking the walls of general intelligence. With only a few million of capital left, and facing bankruptcy, they knew that only one option remained.
It's becoming challenging to really evaluate models.
The amount of intelligence that you can display within a single prompt, the riddles, the puzzles, they've all been solved or are mostly trivial to reasoners.
Now you have to drive a model for a few days to really get a decent understanding of how good it really is. In my experience, while Sonnet/Opus may not have always been leading on benchmarks, they have always *felt* the best to me, but it's hard to put into words why exactly I feel that way, but I can just feel it.
The way you can just feel when someone you're having a conversation with is deeply understanding you, somewhat understanding you, or maybe not understanding at all. But you don't have a quantifiable metric for this.
This is a strange, weird territory, and I don't know the path forward. We know we're definitely not at AGI.
And we know if you use these models for long-horizon tasks they fail at some point and just go off the rails.
I've tried using Codex with max reasoning for doing PRs and gotten laughable results too many times, but Codex with Max reasoning is apparently near-SOTA on code. And to be fair, Claude Code/Opus is also sometimes equally as bad at doing these types of "implement idea in big codebase, make changes too many files, still pass tests" type of tasks.
Is the solution that we start to evaluate LLMs on more long-horizon tasks? I think to some degree this was the spirit of SWE Verified right? But even that is being saturated now.
I stopped listening to Lex Fridman after he tried to arbiter a "peace agreement" between Russia and Ukraine and claimed he just wanted to make the world "love" each other more.
Then I found out he was a fraud that had no academic connection to MIT other than working there as an IC.
Providers change tokenizers all the time with model updates, and it's often not even possible to query/figure out how text is tokenized without actually just sending the LLM a request.
Just switch to charging for bytes of intelligence. Please. Claude Shannon figured this out decades ago.