Why does anyone care about anyone else's opinions? I think it's pretty reasonable to take issue with others assuming that you made a particular decision because you hadn't fully thought through the consequences. Do you like having people second-guess your decisions, or does it annoy you?
Why do you care about what other people do? It's not harming you.