At one point you simply run out of good options. That is the downside of not giving managers time. In terms of picking a manager, there are very few safe bets in the PL. In fact, you could argue that Pep is the only safe bet these days. But he also requires a feckton of money being spent on the team so...
Once the 2-3 "hipster choices" have been hired elsewhere, you are left with two choices: a gamble(Lampard/Arteta) or an old fart who's probably past it(Mourinho/Van Gaal). I guess Potter is one of the few options that belong to neither category, so Spurs might go with him.