You need to go back and watch that hatchet job he's done again and take note of what he's saying. That Spurs have no aspirations, no culpability, no fight or fire to become anything other than what they are. They are essentially inert, and have accepted that as a club, which is unacceptable. The rot comes from Levy and has permeated every other element of the club. The fight the fans should have in them has eroded and turned into a perpetuity of acceptance, an acceptance that contradicts the standing they believe they should have. There's a cognitive dissonance that has loomed over them like a fog - the players have no heart, no fire and no belief they can be anything more; the higher ups have made it so and a single manager cannot come in and change what is bedrock, or he certainly can't do it without a chairman as equally hungry and hellbent on change as he is.
Spurs are seen as the biggest laughing stock in the PL with Chiellini's comment basically become legion across the continent, and generally accepted as what Spurs are. They've done nothing to dispel the notion and everyone expects what we see from them. They've coasted for years - for every season other clubs have that is below par, they are slaughtered for it, internally and externally. Not so at Spurs.
Like I said before, his reasons for saying what he said were not altruistic, but they were absolutely bang on the money to the point it compounds the humiliation if Spurs don't look to do anything to fix it, with or without him there.
How well did they do before Levy? Maybe it's not his fault.