I'm not for this overly PC culture at all but there's a huge difference in using slurs to highlight a joke like so many good comedians do (Chappelle, Louis, etc..), and using them in what looks like a normal conversation like this guy did here. If you don't use it to make people laugh you just sound plain racist, altough I'm sure he probably meant it as an edgy type of "joke".
Some comedians need to stop saying controversial shit just for the heck of it and focus on the art of comedy again. Coincidentally, this guy is often a guest on Legion of Skanks, which is a great podcast but they often take things too far just to go against the PC culture. Especially when they had that cnut Milo on there.