I tried this on M1 Pro today with 16GB ram and it worked!!!
I was using vscode and it seemed to interperet the system prompt right and then started actually inspecting and doing stuff.
Unfortunately the vscode system prompt is 24000 tokens, and I was getting 100 at beginning, 69 by the end of it, but honestly I'm super impressed. Great work team
1
All right there is so much hate for this rust rewrite, but I'm going to tell everybody that people are way way underestimating how sucky the Zig codebase was.
Basically all the time people were having horrid memory leaks and stuff that they couldn't even figure out.
So yeah, I get it, people are frustrated, but stop pretending Bun was this battle tested mature thing. It was a prototype, and still is.
Switching it to Rust is understandable since they just couldn't fix the memory leaks. It was and still is in beta, because anything with memory leaks is beta.
So yeah, I understand the concern but nobody would ever use it in production anyways for a server now because of the leaks so treat it like what it is - beta software and a cool experiment.
Ok heres the thing you will nevwr be able to truly do this due to logic.
Logically five people pooling their resources beats one guy.
therefore datacenters will always win because they get higher time utilization.
so forget it.
I always wonder the same but i let logic tell me its a fantasy, on average you cant outspend a whole group of people making better use of the hardware.
you will get better hardware though, cutting edge will always be cloud
Yes its a huge deal because these are starting to get bound by memory bandwidth not compute. therefore one bit wirfhts stream way faster leading to substantially better results. At least thats what Id guess!
I for one am glad they did it because I felt like it was a little bit... I just felt the company as big as Google, it felt wrong for them to be piggybacking off VS Code.
I know it was MIT license, but honestly, I feel better knowing that they're making their own product. So, you know, it goes both ways. I think they did the right thing to migrate off Microsoft's code just out of respect.
I would be very pleased if Zuckerberg got away with it. I don't copyright or infringe, but honestly, he was the one guy of the big guys who released everything as open source.
If he did the right thing, then we should all support his choice to use it under fair use.
Freedom means that the state shouldn't punish a public benefactor.
It makes me furious to see programmers fighting against an open source hero.
If it was closed source for Meta profit, I understand.
But they gave it away free, so it infuriates me that people support damages for a public benefactor.
Churches and schools get free money from the government. We need a rule that open AI (not the company, I mean the actuality), can torrent whatever they want because it's for the public good.
Otherwise the rich companies win and can pay their sources and the small guys are screwed.
If Meta has to pay for their training data, they will need to profit from it and won't be able to offer it free.
Nobody in their right mind would ever support the publishers here.
Guys I'm from Texas and I want to share something with you all, my friends I've made here on the internet from my heart.
I think all of us are a bit sad now that AI has essentially removed what it means to be a coder.
There will never again be the time like we had, the golden age of being a nerd. We nerds had it all, and then we destroyed it by making something too smart!
As a Texan, it's kind of like cowboys. Coders were wrangling the computer, but now we have been replaced by industry and mechanics.
Having read the twitter post, it was raw and honest, and I want to share some ideas about life that I feel are relevant.
The first one is that when you work, you should always do something you believe in, because nobody can take that away from you.
If you worked for the money, or because someone told you you could be a part of a cool team, your whole world falls apart when you get let go.
But if you work because you truly believe your work is worthwhile, you will always be glad you did it.
I feel that people on here continually complain about capitalism and how bad corporations are. I challenge all you all to check yourself and ask what are you doing to be a part of the system. If you go accept employment at a 9-5, you are part of the system and making it stronger.
I have always refused to have a job. At age 32, I have only ever worked at one company as an employee, and that only for a short time, and the person was a genuine friend of mine.
I ask each person here to quit working at a company. I think all of us should choose to only ever work at a nonprofit.
Fundamentally Capitalism can't be defeated if we complain and then try to negotiate the biggest salary or benefits.
It's logically stupid for us to be saying they are evil, when we do the exact same thing with a salary.
Instead, each of us should work at a nonprofit, and we should NEVER accept a salary but instead ask them to give to us when they have something left over.
Ultimately, friends, I chose to tell my boss one day (the guy I ended up being an employee at his small company for for a bit), that I didn't want a salary, just donate if you want.
Ever since then, I have been happy.
I hated life when I worked for money. But now, I love it. I have gotten to code on many fun projects, but for the first time I felt alive.
It was terrifying with a wife, a kid and a mortgage to say that. But I am a true believer that the universe, or God has a plan for everyone, and that if you stop worrying and doing what you are told, and just go out and love people, it will all work out.
What I found is that the pay you get working for free is better than the pay you could ever get with money.
You can finally live with yourself when you just love everybody, every day.
If you pay me, and I did great work, you will never know if I love you. But if I did it for free, for all of eternity, you will know that you know that I care about you. And that, to me, is worth more than all the money in the world.
That's why I never accept a salary when I work. I just let people give as they feel fit.
Yes, it is hard, and it doesn't always feel fun. But it is 1000X worth it.
Thank you for reading, God bless you and have a great day!
all right, I am doing a sort of a copy-on-write thing here. So the idea is that I only want to update the pointer if the record it points to is "unlocked"