I agree, but the legal system is designed that we can set up rules for humans, and punish them. It's hard to imagine how to introduce similar rules for AIs.
My prefered route is I can sue the company if their AI misbehaves, but we are already seeing cases of companies saying "Oh yes, the chatbot said X, and the chatbot is the only way to communicate with us, but that's clearly just the AI being wrong so we will ignore it".
Hopefully some cases will go to court, and side with consumers against companies and their black-box AIs, but I'm not hopeful.
My prefered route is I can sue the company if their AI misbehaves, but we are already seeing cases of companies saying "Oh yes, the chatbot said X, and the chatbot is the only way to communicate with us, but that's clearly just the AI being wrong so we will ignore it".
Hopefully some cases will go to court, and side with consumers against companies and their black-box AIs, but I'm not hopeful.