I agree with rjett about not having anything to lean on. It really does improve your posture.
I sit on a balance ball at my office, and have consistently for about 10 months.
It's really hard to slouch on a balance ball. It's improved my overall core strength considerably, and I don't think I ever slouch.