A Guide to In-Browser LLMs(intel.com)

11 pointsby ramyaravi19ปีที่แล้ว1 comments

https://www.intel.com/content/www/us/en/developer/articles/technical/web-developers-guide-to-in-browser-llms.html

2 comments

fancyfredbotปีที่แล้ว

No thanks. Even if you are running the LLM locally it's a terrible experience for me since inference will be slow and I'll need a lot of bandwidth to fetch weights. I'll probably not trust that my data remains on my device, and I definitely don't trust anything the LLM does.

It's cool JavaScript can use the NPU though.

[deleted]ปีที่แล้ว