If she’s rich and married a successful tech founder, I don’t understand why she didn’t get a lawyer to draft these investment papers to keep herself from getting fleeced. Like the amount she was dropping could probably have been recouped from a buyout without much fuss if the contracts were a bit more assertive.
You're correct about the weights: each machine could in fact store all of the weights. However I think you still have to transfer the activations and the KV-Cache while performing inference.
This is silly. If I’m only rebuilding 1 file out of a 200 file source base, I guarantee the non-unity build will be faster. Just the number of characters I have to tokenize in this thought experiment should be enough to convince. If this isn’t the case then you’re doing some sort of n^2 c++ boost every header includes most other headers shenanigans and you need to stop that rather than doing a unity build.
Mobile devices don’t have the memory or the memory bandwidth to run an LLM that’s big enough to be good at much. Plus the fixed battery and thermal constraints.
Length of time doing something doesn't imply mastery. It can contribute to mastery, but only if you're always pushing your skill to the next level I think.
For example: I know people who have been skateboarding for decades and are just barely OK at it. How you practice matters.
Headphones don’t require a treated room to sound excellent. Speakers will engage the natural acoustics of whatever space they live in and comb filtering will result. Almost always a great pair of headphones will beat a great pair of speakers in a listening test.
Then you weren't watching the video. They drew guns after entering the residence. They pointed them up the stairs where she said her husband and two children were. Thus they were pointing guns at her children. Watch the full video on her twitter account, it happens about 10-20 seconds into the video.
50% of your time and energy seems like an impossible bar. At 16 waking hours, we are talking about 8 hours spent entirely on focusing on some task. That’s like the hyper optimistic assumptions of time spent that lead to bad estimates in software. I would say even the 10x engineers I met only focused for 5-6 hours a day max, so 30% focus.
This article was written by a former VP of software at Microsoft. You are simultaneously saying that MS is successful in some way that Apple is not and also saying that one of the folks that helped lead MS to success over the last 20 years isn’t competent enough to comment on just how competent and successful Apple has been for the last 15 years. Just drop the bitterness and read the dude’s writing, he knows what he is talking about.
I really wanted to run FreeBSD in my T470s and the lack of hardware support pushed me over to Ubuntu. I loved setting up FreeBSD and it felt snappy for a lot of stuff but it would be cool if some of the devs who do live on laptops would just release a package they tune for their particular hardware.
In Silicon Valley, the down payment on a house could buy you a mansion pretty much anywhere else in the US. In Florida, you could get a waterfront mansion in many places.
When I was an intern at Apple in 2002, Steve Jobs gave a talk to our cohort. Someone asked if he had any advice and he replied “The things that are important to you now, will not be the things that are important to you later. Sorry, I know that vague but I don’t know how else to say it.” Now that I’m a father (and an actual adult), I think I understand what he means. Don’t feel ashamed because your priorities shift and you lose “ambition”. It could come back or it could be gone forever, whatever the case just try to enjoy what you have at that point.
I’ll go a step farther and point out that it’s troubling that we feel like we need these sorts of tools to survive at home today. It seems to be a symptom of an ever increasing level of complexity in every facet of modern life.