Show HN: AI Infra for non-Nvidia GPUs(github.com)

2 pointsby shadowfax92vor 2 Jahren1 comments

https://github.com/felafax/RoadrunnerX

Hey! We are building open-source AI infra (on top of XLA) to make it easier to run AI workloads on non-NVIDIA GPUs (AMD, Google TPU, AWS Trainium, Intel Gaudi). We believe that with some effort, it is possible to achieve similar or better performance per watt compared to NVIDIA GPUs, while also enabling hardware diversity and reducing costs.

For the first step in this milestone, we released Felafax RoadRunnerX on Github (pun intended ), which includes a set of notebooks and deployment scripts for fine-tuning LlaMa3 on Google TPUs!

What do you all think? Would love to get your feedback!

Felafax RoadRunnerX repo - https://github.com/felafax/RoadrunnerX

1 comments

shadowfax92vor 2 Jahren

We also built a cloud UI to make it easy to spin-up large clusters of TPUs and run multi-GPU fine-tuning on them! Check that out here - https://felafax.ai/