As someone diagnosed with dysgraphia, clean handwriting like this blows my mind. If i were doing this id need to use rng to pick alternates of the same letter.
If the side by side wasn’t so vertically aligned Im not sure I could tell the difference.
At this context length and temperature I imagine it diverges quickly but still it could be cool to see a giant tree of diverging paths or an ngram similarity
So basically it’s a transcription and then sequential classification problem. Im glad this is working for them. Id rather nurses attend to patients rather than paperwork.
Maybe they’re just using 4o transcribe but I do wonder if they've fine tuned for medical terminology.
> So my dystopian prediction for 2031 is that if that form of AGI has come to pass it will be accompanied by extraordinarily bad economic outcomes and mass civil unrest.
I guess six years is the longest time horizon in the question but that "if" around AGI and its impact does a lot of work. This maybe assumes it'll happen sooner? Or, is it similar to the AI art prediction where the 6 year horizon is just a long enough period of time such that we'll see if we're headed towards AGI?
1. _Actually_, not practicing a talk is insane to me unless people are regular speakers. From a cold start, it takes me 10x the amount of time to prep as it does to actually give a speech.
2. It's a mix of ego and motivation. When the work is going out to the public, for me it's just the fear people will end up viewing my work the same as they'd view a Neil Breen film.
To be fair to word2vec (rather, word embeddings) I think both require a fair amount of sentence context.
On a semi-related note, one of the reasons I avoided tackling smells yet is because so much written about smell is in the form of perfume/cologne marketing speak. Asking gpt-4o for smells lists that "the smell of jasmine and tuberose [...] evokes the mystery and elegance of a moonlit garden". I'd hope modern models would understand that this is nonsense but I can imagine a word2vec model would end up with bizarre associations.
Ah, well good to know. I need to read more. Thanks for taking a look.
When you refer to averaging embeddings together, do you mean averaging a bunch of sentences/words for "male" to get a general concept vector or do you mean averaging two different words, like "royal" and "adult male", to get to the combined concept, say "king"?
On the topic of wrappers, as someone that's forced to use GPT-3.5 (or the like) for cost reasons, anything that starts modifying the prompt without explicitly showing me how is an instant no-go. It makes things really hard to debug.
Maybe I'm the equivalent of that idiot fighting against JS frameworks back when they first came out it but it feels pretty simple to just use individual clients and have pydantic load/validate the output.
For me the biggest benefit is just following the project and seeing what the community is doing with llms (It’s also not bad for quick proofs of concept).
That said especially in python it’s not that hard to reimplement things yourself in a cleaner way. Output parsing for agents was nice but with the function update from OpenAI it’s not really necessary (if you’re just using their API)
* IoT/Smart-Home tech calms down a little and focuses on what it does well instead of trying to be all-encompassing and ending up half-baked. Ends up being fairly normalized.
* Nuclear still goes nowhere, wind and solar continue to rise in use. Maybe some Elon-esque person starts experimenting with gravity batteries.
* Self driving cars still aren't a thing.
* The price war with uber and lyft ends, and both are still around just more pricey. Food delivery for regular restaurants will stop but chains and delivery only places in cities stick around.
* Commercial FM Radio will be close to death and shut down in a lot of areas.
* Silicon Valley continues it's pattern of cycling monopolies, or ya know, just buying the next one.
Cynical Takes:
* The general public in the US becomes increasingly sick/disinterested/numb as social media and blogs become ambiguously trustworthy (bots, propaganda, etc.) and and local media is swallowed/assimilated into large media groups.
* Moderate cuts to US and UK social benefits continue gradually over the decade.
Hot Takes:
* Twitter gets nationalized due to it's frequent use by politicians.
* Small scale functional fusion reactor is built/being built by the end of the decade, presumably in Europe.