> It seems worth commenting that you could make the same argument about not listening to doctors for medical advice. In this context, it just seems like you're making an appeal against authority.

You could, but mainly against things like billing practices and perhaps the necessity of certain procedures where there might be a conflict of interest.