This "frightens" me a lot more than the Google car does. I trust that automated cars will be safe "enough." I don't think I would necessarily trust an automated car that can find itself in a situation in which a driver needs to intervene. I barely trust other drivers on the road (maybe its the NYC driver in me...). Trusting those drivers' reaction times in a situation where the car needs to disable automation would require a lot of built up good will/trust.
That being said, I think this could be a great idea for more closed environments. Honestly, I'm not really sure where they are. Maybe huge airport parking lots (as "drop offs" at specific locations), or in large corporate parks or something of that nature.
It seems like vehicles will have to go through an "unsafe valley"[0] where there's a huge gulf between "does a couple of things really well" and "go to sleep and you'll arrive safely at your destination".
That's probably fair. I, funny enough, used quotes, because I couldn't think of a less serious word than frightens. Concerns is maybe a better word choice.
That being said, I think this could be a great idea for more closed environments. Honestly, I'm not really sure where they are. Maybe huge airport parking lots (as "drop offs" at specific locations), or in large corporate parks or something of that nature.