It's always a very specific type of person or group of people that accuse others of having privilege. Those who fall somewhere between the haves and have nots.
They get very angry about it when people correct them as well. As if it's an afront for someone who has experienced true hardships...