aka Rocky (this is a reference to Project Hail Mary). Great descriptions in the book about how the fictional creature can use the arms together or differently and on multiple tasks at the same time.
I'm optimistic this won't be a problem in 10-20 years (I agree that's a long time). We have the technology in matrix headlights that were banned in the US and basically in Canada up until a few years ago. I expect to see kits on Amazon in a few years for retrofits. Since they need a camera and some brains they will likely start at many hundreds of dollars but that should come down.
throwaway account and "virtue signalling" plus a dig at so called subsidies. Oh and "no value judgement" except for the value judgement. You are not helpful here.
Yes. The memory is just located very close to the cpu with wires "welded" directly to it. This allows the memory to be run as fast as possible but it's still a RAM component.
The cache parts of memory are on the CPU itself but they are on the order of MB not GB.
Another recent project that runs a huge model on a 48gb Mac is https://github.com/danveloper/flash-moe - it gets over 5 tokens/sec on an M3 Max compared to this projects very impressive 1 token/sec on an M5 Max. So for anyone wanting to tackle a Mac only version that targets lower spec machines this looks like a good candidate with plenty of room for speedups [edit: because it doesn't use the gpu].
Not hijacking anything as this project is amazing.
I work with a lot of 3D graphics and geo stuff so I can hit the ceiling with my 48 GB mac. It's not all LLM work. I prioritized more storage than RAM with my budget. Being able to run local llms has greatly helped me understand how they work. For day to day dev I pay for Gemini or Claude.
RAM is a commodity and nvidia will be paying the same prices. The used market will reflect the cost of RAM. nvidia owns the top of the market but many of us don't need that.
I agree. It was very annoying to me to spend the money (and on the nano matte one too) and still have that stupid notch. But it never makes any difference at all which is good news.
How do you know that? What information do you have that would explain your position? We are talking about a specific circumstance and you have brought unsupported generalities to the discussion.
The are guilty of letting these terrible pilots fly humans over oceans. Sometimes the driver is bad and yet we point at the car and say it should have been designed "better". I have read a lot about this flight over the years and I have my obvious opinions.