Fast transformer inference with Metal Performance Shaders(explosion.ai)
explosion.ai
Fast transformer inference with Metal Performance Shaders
https://explosion.ai/blog/metal-performance-shaders/
1 comments
Seems like the Apple M1 Max is almost half as fast as a RTX 3090. Pretty cool!