Solving the inference problem for open source AI projects with GitHub Models(github.blog)

https://github.blog/ai-and-ml/llms/solving-the-inference-problem-for-open-source-ai-projects-with-github-models/