The suggestion is that almost everybody is biased in some way, so that while biases may or may not balance each other out, to focus on one side particularly may be a little unfair.