The issue is that self driving cars are naturally _worse_ than human drivers, and the only way to ensure that only the _good_ self driving cars get on the road is regulation.
Like flying, if anyone could build an airplane and fly it, flying would be more dangerous then driving. It's the FAA which keeps these things in check.