Well... I'm not a brit.
So here's my 2c.
Nobody cares about England, although many asians seems to support them, but on the grand scheme of things I don't care if you hosted them or not, nor if you win them or not. Infact lately I'd started to bet against England because they have good odds, and ussually make money.
You have no likeable stars after Beckham and co. You have shit atmosphere compared to the SouthKorea/Japan host where we can see variety from things we see on EPL on weekly basis, even Brazil is a bit of a welcome breeze for me rather than seeing the same ol stadium and the same ol sets of fans. And to top it off your press is annoying, even for non brits. I still remember the Euro 1996 how your media made funs of ze german only to get booted out by them. You lot aren't a very likeable chaps for neutrals.
EDIT: and as a caftards, seeing them fail and revel in their misery is akin to seeing RAWK after a lost, it's an entertainment for me, how the press bigging them up and failed on the very small resistance (cough.. iceland) they met and come crashing out.