I find these style of models are great, but fail hard, and fail randomly. I'd be hesitant to use it for a daily driver, but I'm using dual 3060s, so it's not like I'm quantizing a frontier model here.
How do you find the overall experience? And do you have any special sauce or recommendations for going this route?
In regards to people with reasons to illuminate several sq km at once - I'd bet that major metro areas would see a massive savings in electricity/maintenance if these were deployed over a metro region. Whether that is more than the cost of a satellite? Who knows, it's still fiction until these people try it out. But it's at least an interesting use case.
Super cool! I noticed you had a blurb about it being used for mesh networks? Could you please go into more details/provide links to resources to learn more about that?
Really? It's what he did after he spent nearly a third of a billion dollars to influence an election (which doesn't include the incalculable value of his influence via Twitter!) that makes him a Bond villain.
It's Chesterton's Fence[0] in action - Elon took a self-proclaimed woodchipper to the United States government without understanding what he was destroying and without concern for the repercussions to society. He used that influence to benefit himself and his companies directly. It's not sharks with laser beams, but it's far more impactful and the world will living with it for decades to come.
It's an inherently different thing. Fibre is infrastructure. It'll still function decades later. GPUs at this scale are consumables. I've heard 3-5 years lifespan before they fail out. This might be a low estimate, but even if you double it - they're 50% of the cost of datacenters. We're flushing entire countries worth of economic value down an Nvidia shaped toilet.
I think part of it is the feeling of false understanding that comes from using llms regularly. They let you operate at a higher conceptual level, and they paper over enough of the actual details that your conceptual model might not actually be correct.
I'm a mechanical engineer by training, and have similar vibes with the similarities I see between llm training and metallurgy. I could probably put together a formal concept for these vibes at this point, but is there actually a "there" there? I have no idea. And it would take me years to actually dive in and learn everything to gain the deep understanding that would be required to know if I'm just experiencing my own brand of AI psychosis or not.
It seems that we're exact opposites! But if mathematics is your thing, it might be interesting for you to explore trying to learn things from a lagrangian perspective first?
Not sure if it'll help you with gaining an intuitive understanding, but at least it'll be interesting!
Ding ding ding! This is a huge reason. Being able to bootstrap a domestic weapons manufacturing base is a massive win for any country these days. South Korea is one of the few countries that are both willing and able to do so with high quality modern materiel.
I've always wanted to figure out how to implement a cooperative source license. Something like, you're allowed to do what you want with it, but any derivative work requires the same license, and X% of any income goes to the cooperative?
Not sure how it'd work, but there's absolutely a niche for a privacy focused data cooperative out there.
I do enjoy the immediate out of touch signaling with the "runs on your 16gb vram laptop" line. Because everyone has a laptop with 16gb vram, or can just pop out and buy a new one, right?
Do you have a collection of these benchmark apps saved anywhere? I'd be particularly interested in seeing the relative cost differences between different models in a use case like this.
It's always been this way. America has just been able to coast on being the only remaining major economy after WW2, and exploited the rest of the world instead. That exploitation of the rest of the globe has been mostly optimized now, so those shareholder returns are now coming at the expense of the 90% of Americans who aren't sitting at the table.
Parts of these cities worse off than the third world? Have you been to a third world country? Or Seattle, for that matter?
The commonly scapegoated cities in the United States are not experiencing third world conditions. Appalachia is experiencing third world conditions. Hollowed out rust belt cities in the Midwest are experiencing third world conditions. These areas are not run by lefty politicians. The United States has a systemic problem, not a local one.
And yes, the systemic problem is that there are a tiny number of ultra wealthy people with wildly outsized influence on the government of the United States, doing everything they can to reduce the amount they need to pay in taxes while simultaneously ensuring they extract the maximum amount of profit from the US government's wildly excessive expenditures.
Indeed. Thankfully - as has been proven time and time again in America - if leniency is given to those who abuse their power, they will absolutely never ever decide to abuse their power again.
I find these style of models are great, but fail hard, and fail randomly. I'd be hesitant to use it for a daily driver, but I'm using dual 3060s, so it's not like I'm quantizing a frontier model here.
How do you find the overall experience? And do you have any special sauce or recommendations for going this route?