Takeoff Inference Server Is Now Open Source(github.com)3 points·by mezark·vor 3 Jahren·1 commentsgithub.comTakeoff Inference Server Is Now Open Sourcehttps://github.com/titanml/takeoff1 commentsPost comment[–]mezark·vor 3 JahrenreplyDrop in replacement for HF's TGI server. The fastest and easiest way to inference LLMs locallyGithub: https://github.com/titanml/takeoff Docs: https://docs.titanml.co/docs/titan-takeoff/getting-started Discord: https://discord.gg/83RmHTjZgf
Github: https://github.com/titanml/takeoff Docs: https://docs.titanml.co/docs/titan-takeoff/getting-started Discord: https://discord.gg/83RmHTjZgf