rogerdox14·il y a 2 ans·discussOr you could run it quantized on about $6k worth of 192GB Mac Studio — probably not that fast.
rogerdox14·il y a 2 ans·discussVarious Internet sources claim Rashida Jones sounds a lot like Scarlett Johansson: could Rashida Jones have voiced ‘Sky’?
rogerdox14·il y a 3 ans·discuss"recommended max working set size" is a property of the Mac the model is being run on, not the model itself. The model is smaller than that, otherwise it wouldn't be running on GPU.