I use the Colemak layout since a couple of weeks back. I'm also using Emacs with Evil mode (i.e. Vim bindings). I have thought about remapping "hjkl" for navigation, but haven't yet done it. Using the Colemak "hjkl" is not completely unnatural, but the habit of the qwerty positions for these characters is pretty deeply rooted.
So no remappings so far.