Show HN: Run AI models directly in the browser – no server or internet required(private-ai-chat.vercel.app)
private-ai-chat.vercel.app
Show HN: Run AI models directly in the browser – no server or internet required
https://private-ai-chat.vercel.app/
5 comments
Source code: https://github.com/nadchif/in-browser-llm-inference
What happens after you close the browser? Is the model still stored locally?
The model remains cached in the OPFS.
If you're curious about the caching code, it can be found here: https://github.com/ngxson/wllama/blob/c267097dc79df8d23df8bc...
If you're curious about the caching code, it can be found here: https://github.com/ngxson/wllama/blob/c267097dc79df8d23df8bc...
nice tool, can see this actually being useful especially in those times where sites go down for no reason