Most features are already supported on x86 CPUs, you can pip install mlx on Linux , and you can even use it on Windows (no official binary release yet but it is building and tests are passing).
You can use any serialization that supports numbers, in the repo I used BSER (a binary format of JSON), you can even use raw JSON but it would be very inefficient for float numbers though.
Suppose one is writing a desktop app doing searches of embeddings, is there a lightweight vector database that runs on all major desktop platforms? I'm aware of redis and sqlite-vss, but none runs natively on Windows.
Will you provide APIs for this service? I'm writing an extensive desktop app for all ChatGPT alike services, and this service is definitely a thing I want to include.
Since several years ago I was starting to have health issues that if I sat still for too long my eyes/arms/legs/waist would feel pain, sometimes fiercely. So I set a timer to remind me to stop staring at the monitor and stand up to do some light exercise, at first the timer was 40 minutes and in recent years it became 20 minutes as my body wears.
So now my work is interrupted every 20 minutes, at first the timer was annoying but after several months I got used to it completely and I don’t think it affects my productivity. And actually I wish I could do it from the begining so I wouldn’t have the health issues at all.
However my interruption is short and during it I was uaually just thinking about my work while stretching my body, so it is no compare to hard context switches like being dragged to a conversation.
I have no relationship with Apple, but from my experience, the usual way big corp contributes to open source is to have their engineers sending patches, instead of sponsoring money/hardware directly.
From my memory GNOME 3 and Unity were created because there was a trend to make all interfaces both desktop and mobile friendly, Ubuntu tried to ship a phone using Unity, and GNOME 3 was advertised for its tablet friendly interface.
For Windows world there was Metro UI of Windows 8, Apple insisted on using different UIs for desktop and mobile and was laughed at.
In Japan, Powerwall is also significantly cheaper than all Japanese maker batteries, last time I checked Powerwall's per-kWh price is only 1/5 of a Panasonic one. How could this happen?