I don't think you're committing career suicide. Sticking around indefinitely while you're miserable will not only suck the life out of you, but your drive to do well at work.
Might I recommend a book called Quitter by Jon Acuff? He's done a couple of books about making the leap from the corporate world to a more fulfilling "dream" job. It was a good, quick read.
If you've got the savings and a decent plan, I'd say go for it.