reerdna

hace 12 díasdiscuss

Cool, but I find rather than just shapes and indexes, tensors with labels are much easier to use and reason about. E.g.:

  {
      {user:bob, movie:"Heat"}:0.1,
      {user:alice, movie:"Frozen"}:0.9,
      {user:carol, movie:"Top Gun"}:0.3,
  }

https://docs.vespa.ai/en/ranking/tensor-user-guide.html

reerdna

hace 3 mesesdiscuss

This brings back good memories from when a friend made C in nynorsk: https://www.pvv.ntnu.no/~andreer/nynorsk/

reerdna

hace 4 mesesdiscuss

I was able to get part way some years ago by demodulating the bitstream with gnuradio and then making small changes (like replacing one note with the next higher one) and noting the differences. So that is one possible, but probably too inefficient way.

I never got close to finishing or publishing anything. Awesome to see this released and I'll have to play with it!

reerdna

hace 5 mesesdiscuss

I couldn't help but laugh out loud at the notion of a "held-out test set" for addition of 10-digit numbers.

reerdna

hace 6 mesesdiscuss

No, not beyond what I already put in the twitter thread. I wanted to wait until I had some cool distributed software running on it too, but then I ran into trouble with the plan 9 wifi drivers for the rpi being unstable and so I'm still working on fixing that. It does serve as a great test bed for that purpose too, as with 8 nodes I can get much more reliable data about how often the driver gets stuck

reerdna

hace 6 mesesdiscuss

Wanted to reply to you directly also to increase the chance you see this because I think I had exactly the same intrusive thought as you, and actually built such a cluster recently. Would love to hear what you think: https://x.com/andreer/status/2007509694374691230/photo/1

reerdna

hace 6 mesesdiscuss

I recently built a Plan 9 cluster of 8 raspberry pi zero (2w). From my supplier (digikey) the 2W was the same price and has 4X the cores!

I think it looks quite cool: https://x.com/andreer/status/2007509694374691230

Instead of having to use lots of dongles and usb ethernet, I just wired them all up using brass rods, a small 5V power supply in the base, and boot them over WiFi (just the kernel and wifi config on the sd card).

Raspberry pi's are cheap, easily available, and there is an absolutely massive trove of information about them on the internet. And the scale means that the linux implementation is very stable and "just works" to a degree that is extremely hard for other SBCs to match.

Sure, VMs are the logical choice, but not everything has to be logical. Real hardware does feel more real :-)

reerdna

hace 11 mesesdiscuss

Yes, but it turns out it doesn't matter much.

What _does_ matter is the huge reduction in the much more dangerous brake dust, as electric vehicles convert the kinetic energy back to the battery charge via generation instead of wasting it via friction: https://news.ycombinator.com/item?id=44666157

reerdna

hace 11 mesesdiscuss

Same experience in Norway. 95%+ of new cars sold are electric.

I've been riding my bike to work along the same road for 15 years. I used to have to hold my breath along some sections of my ride. Now the air in the city is almost as fresh as in the countryside.

reerdna

hace 2 añosdiscuss

For use in retrieval/RAG, an emerging paradigm is to not parse the PDF at all.

By using a multi-modal foundation model, you convert visual representations ("screenshots") of the pdf directly into searchable vector representations.

Paper: Efficient Document Retrieval with Vision Language Models - https://arxiv.org/abs/2407.01449

Vespa.ai blog post https://blog.vespa.ai/retrieval-with-vision-language-models-... (my day job)

reerdna

hace 2 añosdiscuss

Sounds a little like this recent paper;

"RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval"

https://arxiv.org/abs/2401.18059

reerdna

hace 2 añosdiscuss

Analysis by dhruv___anand in https://twitter.com/dhruv___anand/status/1752641057278550199 suggests that there are three different "resolutions" in the embeddings, for the first 512, 1024 and full 1536 dimensions in text-embedding-3-small.

You can put a subset of the dimensions in your vector database, thus saving a lot of cost by reducing memory/compute when retrieving nearest neighbors.

Then you can optionally even re-rank the most promising top-k candidates by the full embeddings. At least one database supports this natively: https://twitter.com/jobergum/status/1750888083900240182

reerdna

hace 3 añosdiscuss

You can turn this into a pocket "lisp machine" by following the instructions on http://www.ulisp.com/show?4JAO - although I don't think this can make use of the LoRa interface (yet).

The hardware is cool, but its just a PCB and the edges of the display are vulnerable. I would recommend 3D printing a case to protect it, especially if you are planning to bring it around with you. There are .stp files for one in the official github repo.

reerdna

hace 3 añosdiscuss

I've been lucky to get to work through a few of these already, they do give a decent introduction in how to use Vespa tensor expressions.

I believe it's one of the most flexible ways in any vector (or other) database to express how to rank your query results, and it's compiled down to fast native code for execution, using openblas etc. where appropriate.

reerdna

hace 3 añosdiscuss

(It later did, in https://news.ycombinator.com/item?id=35074233 )

reerdna

hace 3 añosdiscuss

Sorry to have caused you pain!

I thought this video would get maybe 100 view at most, or I would have put more effort into it (like implemented paren matching in the editor first).

I like lisp (and apparently it's good HN bait). But the language is not really the core of this project.

It is more about making a truly personal computer. One that doesn't require you to think about charging or software updates. That is always fast and responsive and ready to use as it is never doing something strange in the background. Simple enough for me to feel like I understand how everything works.

And writing your own OS for it is easy if you wanted to - you could implement forth, lua, a small C compiler - whatever you wish, and these properties would still be preserved.

Useful? Probably not. Fun? At least for me it is.

reerdna

hace 3 añosdiscuss

Yes, I'd love some help with it, or it would probably take me years. Schematics and stls (made in tinkercad) will be coming once I find the time. For now I'm spending too much time replying to comments but I'm enjoying the dopamine

reerdna

hace 3 añosdiscuss

No, I did spend some time reading eink datasheets but in the end it seemed too hard for me to do on my own. There's the Kindle and Freewrite so it seems possible

reerdna

hace 3 añosdiscuss

Yes, I'm running the display SPI at 2MHz which is ~25 fps. Overclocking it to twice as fast works just fine but uses significantly more power as expected. I did not try to go further.

Approximately 25%-50% of the total power depending on refresh rate. Worst case seems to be alternating black and white pixels, maximizing the number of transitions?

reerdna

hace 3 añosdiscuss

More RAM, a higher resolution display, a proper keyboard, solar power and much easier to program (for me at least). But yes, it is essentially the same sort of thing, and much more poorly made at that. :-)

I loved my TI-83, wrote games and crude 3D graphics on it high school math class.

Submissions

Revolutionizing Semantic Search with Multi-Vector HNSW Indexing in Vespa

comments