I agree that buildx is really slow for multiplatform images, the advantage is provides is that if you want don't have a machines for that architecture you cannot build nativly, and with buildx you can build images for multiple platforms on your own self hosted runner.
I agree with the cons and pros you mentioned, but I am hoping that the qemu and buildx will continue to improve.