Craylm: Open-source unified LLM training and inference for R1(blog.cray-lm.com)

https://blog.cray-lm.com/2025/01/22/cray-lm.html

2 comments

gdiamosano passado

Some interesting notes about the project if folks want to dig deeper:

There is a dev mode that runs on a laptop:

  - https://docs.cray-lm.com/deployment/laptop

There is a unified dockerfile for building vLLM and the training stacks on four targets [ROCm, CUDA, ARM, x86]

  - https://github.com/cray-lm/cray-lm/blob/main/Dockerfile

gdiamosano passado

Some of the authors are available to discuss the current code or the roadmap.