Humor has historically been tied to the mores of the day. The Yellow Kid was predicated on what people thought was funny about the immigrant Irish. When you're different in a society you're funny.
There is the fear common to all English-only speakers that the chief purpose of foreign languages is to make fun of us. Otherwise you know why not just come out and say it?