Am I The Only One

So I'm reading an article on CNN's site about James von Brunn, the accused shooter in the Holocaust Museum murder and I'm utterly amazed at what some people are willing to say on record. When a gallery owner was questioned about his knowledge of von Brunn's mental condition he had the following to say:

After three days, he said, von Brunn accused him of not doing enough to sell the paintings, telling him he "really needed money." Demolli said he gave the man $20, which he immediately used to buy beer and cigarettes and returned to the gallery, where he quickly began to disparage residents of the surrounding neighborhood, which was largely African-American.
"Then he started talking about the gas chambers, and I said, 'Jim, that's it. That's it. Time out.' I told him to get out of my gallery, and I started taking his paintings down," Demolli said. As he removed the last painting, he said, von Brunn opened his jacket to show him a pistol.

Is it just me or does it appear that the gallery owner was cool with von Brunn making disparaging remarks about African-Americans, but he had crossed the line to talk about Jews? Isn't it all wrong? Shouldn't we have respect for all races? Am I reading too much into the comment?