Hi again :) I updated the engine and 27B model should work in the demo[1]. We can still consider it as experimental but I am trying to make it better and efficient.
Thank you :) I wanted to create it from zero myself so I can control it better. e.g. I started with ONNX support but now it support gguf models too. It might be a good idea to add some popular connectors in the future. Good luck with your project :)
Hi :) There are some smaller embedding and re-ranking models (I am currently using some of them on my aidekin project) but having it like bonsai models will be great to have.
Thank you for trying it :) I just added the 27B support 1 hour ago. Let me check and try to fix it. All other models should work as expected but if you have issues with them too, I can take a look.
It looks great, thank you! I'll see if I can use it for my in browser AI assistant project's ( https://aidekin.com ) voice part. It's currently using Nemotron-3.5-ASR and supertonic-3 but overall it requires 1.2gb download.
aidekin: an open-source, client-side AI assistant you drop onto any website. Your visitors get a private voice and text assistant that runs entirely on their own device via WebGPU
Thank you :) Currently I am not planning to have hosted fallback Q&A but it's a nice idea. It should only download the ~300mb initially once and then use the cached model.
Thank you for the feedback :) Letting players play before signing up might not be ideal for this case but I probably need to make the landing page better.
You play a duck in a small shared town. You pick a job, pay rent, post on a Twitter-style feed, vote in local elections. The simulation keeps running when you close the tab. No PvP, no loot boxes, no combat. Playtime is a few minutes a day by design.
You play a duck in a small shared town. You pick a job, pay rent, post on a Twitter-style feed, vote in local elections. The simulation keeps running when you close the tab. No PvP, no loot boxes, no combat. Playtime is a few minutes a day by design.
1. https://stfurkan.github.io/bitgpu/examples/chat.html