Why is anyone that points out any of Obamas flaws immediately labeled a racist?

Racism is the perfect cover. For instance, I work for the federal reserve, so if anyone accuses us of foul play, we can just accuse them of being anti-Semitic. Works great, no?