I Gave Up Trying to Run Gemma 3 27B on AWS P3dn.24xlarge(medium.com)

6 pointsby live_alonevor 12 Monaten1 comments

https://medium.com/@rohitkhatana/why-i-gave-up-trying-to-run-gemma-3-27b-on-aws-p3dn-24xlarge-and-you-should-too-0749fa0408e7

2 comments

[deleted]vor 12 Monaten

kcbvor 12 Monaten

G6e surely would be much faster for inference and cheaper.