On-Device LLM Inference Powered by X-Bit Quantization(github.com)15 points·by dynamix·vor 2 Jahren·0 commentsgithub.comOn-Device LLM Inference Powered by X-Bit Quantizationhttps://github.com/Picovoice/picollm0 commentsPost comment—