I would be interested in running inference on Instinct GPUs(MI250 with 128gb)BUT I can’t find any cloud provider to spin up a machine.
It seems they are not yet available or cloud providers are not interested in supporting AMD hardware..
I would not worry about that too much. There are already models that can predict if its transformer generated or not. At the same time google started penalizing transformer generated text; https://youtu.be/EZWx05O6Hss
→ Scans logs every night → Finds bugs before team wakes up → Reports root cause + evidence on Slack → Even knows who's already working on the fix