I don't like the way Google Cast always needs to connect to a service before playing any media. This could be a little bit annoying with audio. Its okay for me to wait a couple seconds to connect for watching a movie.
But let's say you wanna switch from Google Music to Spotify, it's always gonna take some time.