Ask HN: Best UNCENSORED language model comparable to ChatGPT?
8 comments
Thank you. As I'm new to this field, I have been grappling with some concepts like GGML vs GPTQ models, etc. It seems the GPTQ models only run on Linux, so your suggestion is right to use llama.cpp as that works with GGML and is compatible with M1 Macs as well.
I had trouble running oobabooga on M1 Mac, something about Python arm64 vs x86_64...
I didn't know about GPT4-x-Vicuna that you mentioned. Interesting to see that it's uncensored. I knew about Wizard-Vicuna-uncensored though. It seems like GPT4-x-Vicuna is similar.
I had trouble running oobabooga on M1 Mac, something about Python arm64 vs x86_64...
I didn't know about GPT4-x-Vicuna that you mentioned. Interesting to see that it's uncensored. I knew about Wizard-Vicuna-uncensored though. It seems like GPT4-x-Vicuna is similar.
You might want to try our ChatDolphin model on NLP Cloud that is very similar to Vicuna and uncensored: https://nlpcloud.com/home/playground/text-generation (select the ChatDolphin model at the top right).
I hope it will be useful.
I hope it will be useful.
I think this is the currently trending
https://huggingface.co/TheBloke/Manticore-13B-GGML
You can download it directly from oobabooga interface
overall i have found gptx-4-alpaca to be pretty good.
None of them are comparable to chatGPT of course because they are smaller, but they are still great
https://huggingface.co/TheBloke/Manticore-13B-GGML
You can download it directly from oobabooga interface
overall i have found gptx-4-alpaca to be pretty good.
None of them are comparable to chatGPT of course because they are smaller, but they are still great
https://www.reddit.com/r/LocalLLaMA/wiki/models/
https://chat.lmsys.org/?arena (Then click Leaderboard)
https://chat.lmsys.org/?arena (Then click Leaderboard)
What sort of censoring are you concerned about? What's excluded from ChatGPT that you want to use?
Not op, but working on network code it suddenly refused asserting it could not help me make 'hacking tools', which was not the case. Furthermore, even if it was, those tools are legal and useful. Unwanted censorship abounds.
Are there even any? I think all the big players censor because they're afraid of the headlines "major AI product used to do <bad thing>".
Perhaps llama considering it can be self hosted?
Perhaps llama considering it can be self hosted?
> "major AI product used to do* <bad thing>"
*say
*say
I was thinking more about it helping people doing something bad, like write malware.
In fact I expect the phishers will have a field day with this. I expect phishing to become a lot more targeted and accurate in the near future. And much harder to detect.
In fact I expect the phishers will have a field day with this. I expect phishing to become a lot more targeted and accurate in the near future. And much harder to detect.
[deleted]
Nothing
I personally had the best experience with GPT4-x-vicuna: https://huggingface.co/NousResearch/gpt4-x-vicuna-13b.
There's more variants, and you can find information on them on https://www.reddit.com/r/LocalLLaMA.
The best way for you to run the model is probably through https://github.com/ggerganov/llama.cpp. This is a plain C/C++ implementation that can run LLMs pretty efficiently. It can run the LLaMA 13B variants at a pretty quick pace (~100 ms/token) on my M1 Pro macbook.
I'd be happy to answer more questions.