The issue is that no form of transport is 100% safe, autonomous cars will never achieve 100% safety in use, Human drivers will never achieve 100% safety.
The tipping point is when autonomous cars can match the or exceed the abilities of the human driver.
At which point we have the dilemma, do we ban the human driver on safety grounds or just accept the accident rates of human drivers