I have seen plenty of "too many tourists" complaints that were blatant xenophobia like complaining about hearing too many foreign languages or "feeling like a foreigner in their own country".
Is that not fair? People don't want tourists in their city, they want other people who are a part of the community.
I guess it depends on how it was said, but this isn't a "white people" issue, mainly because this isn't white-people-specific. I'm sure Nairobi would feel the same way about being overrun by tourists.
I have seen plenty of "too many tourists" complaints that were blatant xenophobia like complaining about hearing too many foreign languages or "feeling like a foreigner in their own country".