nexus 5 with 5.0.1 and me and my father definitely have had this problem. I switched to an iPhone because I had an upgrade and genuinely thought the phone wasn't working anymore.
my entire office uses vnc, reason is helpdesk sometimes needs to see what you're doing in order to help you. But you most definitely have to be on the network and we have a password, albeit very weak.