Are you resizing the video at all in the browser? When messing around with it, I found that I could play 720p video with the video tag smoothly without any formatting in Chrome and Firefox, but that setting it's size attributes to something other than the actual file size made it slow to the point of being unwatchable.