He will be fine in the sense that he is financially set for life, and he will find a new managerial position in due time.
What I am refering to is his career trajectory that will go the route of "what if", unless he has a near miraculus redemption story in his next job in the Premier League at a new low/mid-table club. You simply wont get hired in a big-six club as a manager without a big pedigree, or results to back you up. Potter took a gamble with Chelsea and he failed to deliver, no other CL club is going to take a chance on him as their next manager, so he has to start from scratch and rebuild his reputation.