Ollama.com A website to download LLMs and try AI quick and easy(ollama.com)
ollama.com
Ollama.com A website to download LLMs and try AI quick and easy
https://ollama.com/
1 comments
Really nice. Install it, it runs as service and "ollama run model-name" that you get on the page. It will download, some are really big, but any 32GB ram pc will run any up to 32B parameters.
It helps a lot to have a good graphics card with the most amount of ram you can buy.
If you don't have a good graphics, the CPU will have to do it al and will take a few seconds/minutes to compute the output. So pick a model up to 14B and those are a bit much for only cpu power.
There are also some "studio" interfaces that are nice and work with Ollama. They usually facilate the download and the ouput, I don't use it.
I only use Ollama on the terminal.