xG And Analytics Under Amorim

Agree with all of that.

Sometimes I see people saying "winning th xG", not that I'd like to couch it in those terms, is completely irrelevant - it's not. Definitely requires scpeticsm though.

I mean obviously teams who do that nearly every week are also nearly always the top of the league table and winning actual games of football too. You'd also be able to guess the winner of matches much better than random chance if all you had to look at was xG and knew absolutely nothing else.

Just a quick look at that - teams who "won the xG" by 1 or more this season:

Won 23
Drawn 4
Lost 4

Spurs v Burnley (won)
Wolves v City (won)
Leeds v Everton (won)
West Ham v Chelsea (won)
Bournemouth v Wolves (won)
Arsenal v Leeds (won)
Newcastle v Liverpool (lost)
Chelsea v Fulham (won)
Spurs v Bournemouth (won)
Wolves v Everton (won)
United v Burnley (won)
Forest v West Ham (won)
Villa v Palace (won)
Arsenal v Forest (won)
Palace v Sunderland (drew)
Everton v Villa (drew)
Burnley v Liverpool (won)
West Ham v Palace (won)
Wolves v Leeds (lost)
City v Burnley (won)
Newcastle v Arsenal (won)
Arsenal v West Ham (won)
United v Sunderland (won)
Villa v Burnley (won)
Newcastle v Forest (won)
Wolves v Brighton (drew)
Burnley v Leeds (lost)
Palace v Bournemouth (drew)
City v Everton (won)
Fulham v Arsenal (won)
Spurs v Villa (lost)

That's quite a big margin, doesn't happen every week, most matches are closer than that on xG. Once things get closer in the xG being able to guess the winner like that is going to become less and less reliable.

Still, you can make those guesses at point with some reliability.

It's not that I think single-game xG is useless statistically, because if it was it wouldn't magically become useful over a bigger sample size. It's telling you something.

But I do find it quite useless when it comes to actually discussing an individual game, as it immediately becomes so heavily qualified with opinions on game state & variance that it doesn't really add much to any argument you're making.
 
It's not that I think single-game xG is useless statistically, because if it was it wouldn't magically become useful over a bigger sample size. It's telling you something.

But I do find it quite useless when it comes to actually discussing an individual game, as it immediately becomes so heavily qualified with opinions on game state & variance that it doesn't really add much to any argument you're making.
I think, you have to really get it, then you can use it to gain some information about a single match as well. For example - if your xG is below 0.5 then either the other team had an absolute field day in terms of defending or you struggled with creating useful chances. If your xG is over 2.0 then it means that you created a fair bit of chances (maybe check for amount of penalties first) which usually should be enough to score at least once.

If we look at the xG result of our last match - 2.6 v 1.3 "for" Liverpool. It shows that Liverpool had multiple very good chances to score but didn't. So while we did defend well, we didn't manage to contain them very effectively. Our own attacking was useful as well though, so they weren't able to contain us as well.

So it can tell you something, but probably not the specific numbers and the relation of the two numbers.

It is interesting to see that 2.6 v 1.3 is from fbref - while understat has it as 2.61 v 2.53. Only shows that xG isn't just one "normed" thing - it can be multiple things.
 
It's not that I think single-game xG is useless statistically, because if it was it wouldn't magically become useful over a bigger sample size. It's telling you something.

But I do find it quite useless when it comes to actually discussing individual games, as it immediately becomes so heavily qualified with opinions on game state & variance that it doesn't really add much to any argument you're making.

There's certainly enough exceptions out there to not be able to say that a team "deserved" to win purely based from it or were unlucky to lose.

There'll be examples in there where a team takes a 1 or 2 goal lead, perhaps early on in a game and then restricts their opponents to long-range efforts, and while still accumulating xG for them there was a sense that they were never in that much real danger. That can be some of the matches where the team "loses the xG" but wins the match, and if you watched it would think they deserved the victory anyway.

The game state stuff certainly matters.

Still, suppose that when you can't watch every game it can still give you an idea of how things went at least some of the time. There will be those matches where a false impression is created by that though, and the problem is that you don't know which matches those were until you watch them.

Think specific game-state stats can help with that at least some of the time for example the timing-chart on Understat, and even things like pens and red cards without needing to watch but it's never going to be flawless. There will certainly be games that can give you wrong idea even then.

Just for fun, I think I have a twisted idea of fun, a quick breakdown of other margins:

Teams with an xG advantage of 0.5-0.99 in single-games:
W 9
D 3
L 2

Teams with an xG advantage of 0.00-0.49:
W 15
D 11
L 7

I must have missed 1 off somewhere as that's 47 matches to add to the 31 I looked at with the wider xG margins earlier for a total of 78. We've got 1 match currently being played that would only mean 79 when it should be 80. Not doing it all again. :lol:
 
Because counter attacking has a lower ceiling, it's just limited.

Also you can't always play counter attacking football, for example when we lost the Europa League final.
There's nothing wrong with being a counter based team and growing to get better to control games when you have the players that can control though. Also it doesn't really have a lower ceiling. The best teams just are able to do everything to a high level. You're very much capable of winning everything by focusing on being a direct transition team in the bigger games but who dominates games against the smaller teams.

Just a nonsense obsession that's held us back for years to be honest. Should worry about the dominating games part when we are consistently a top 3 side and if we plateau, not thinking about it when we're mid table.
 
There's nothing wrong with being a counter based team and growing to get better to control games when you have the players that can control though. Also it doesn't really have a lower ceiling. The best teams just are able to do everything to a high level. You're very much capable of winning everything by focusing on being a direct transition team in the bigger games but who dominates games against the smaller teams.

Just a nonsense obsession that's held us back for years to be honest. Should worry about the dominating games part when we are consistently a top 3 side and if we plateau, not thinking about it when we're mid table.
We have literally been direct constantly since SAF aside from when we had LvG.

We have hit so many problems and limits with it.
 
We have literally been direct constantly since SAF aside from when we had LvG.

We have hit so many problems and limits with it.
Nah, we've generally been a solid top 4 side when we have focused on the counter and when we didn't think about trying to be more than we are.
 
There's nothing wrong with being a counter based team and growing to get better to control games when you have the players that can control though. Also it doesn't really have a lower ceiling. The best teams just are able to do everything to a high level. You're very much capable of winning everything by focusing on being a direct transition team in the bigger games but who dominates games against the smaller teams.

Just a nonsense obsession that's held us back for years to be honest. Should worry about the dominating games part when we are consistently a top 3 side and if we plateau, not thinking about it when we're mid table.
It really does and we felt that. That style of play was never going to be the way we were going to get back challenging for the league.

The issues we had when setup for counter-attacking is that against weaker teams who ceded possession to us, we struggled to break them down because in the absence of being able to counter at pace, all we had left was a slow build up of passing the ball from side to side without actually threatening. And this was also some of the dullest football I have ever seen.

And then against the better teams, we gave them so much possession that they were always likely to create chances and score.

It was not sustainable and we have been devoid of an identity for far too long. Something that they are looking to change with Amorim and I feel we are on the right path.
 
It really does and we felt that. That style of play was never going to be the way we were going to get back challenging for the league.

The issues we had when setup for counter-attacking is that against weaker teams who ceded possession to us, we struggled to break them down because in the absence of being able to counter at pace, all we had left was a slow build up of passing the ball from side to side without actually threatening. And this was also some of the dullest football I have ever seen.

And then against the better teams, we gave them so much possession that they were always likely to create chances and score.

It was not sustainable and we have been devoid of an identity for far too long. Something that they are looking to change with Amorim and I feel we are on the right path.
Eh I guess it depends. It does have a lower ceiling if you are competing with Pep's peak teams. But we shouldn't base our plan on how to beat Pep Guardiola. City isn't what they used to be, and nobody controls games like they used to.

We also didn't "max out" being a counter attacking team by any means, there were loads of signings we could've made to improve us and of course the coaching/implementation of it can always be improved too the same as trying to be a possession team. And like sir Alex used to do, you can grow to control games naturally through better players while still being built to counter in bigger games. There is nothing wrong with that, and it provides a much safer and steadier growth while really being closer to our roots. It's closer to what Ancelotti did with Madrid. There was a world where we sign Haaland, Bellingham and Rice for example under Ole, and naturally having players like that pushes teams back while still being built to counter (assuming the manager doesn't try to play in a style not suited to what he can also provide).

I really think chasing that obsession to try and be like Barcelona/Pep is a big reason we keep failing. You're never going to dictate games in the prem successfully without having truly top players and certain types of players. The others are too good and they'll take advantage of your weaknesses which are very easy to do in those systems if you aren't elite at it. It's not just a coaching thing, it's a player ability thing. But also obviously a coaching thing, very few can actually implement that well.

Basically - Stop trying to go for the lottery every time. Play a system that suits who you have, coach in a way to get the best results you can with who you have, and if you somehow hit the jackpot like Liverpool did with Klopp where you get both all of a sudden, then great. Otherwise... It's a bad idea and it'll keep crashing. That's how I see it anyway. Just a bad way to manage a football Club.
 
It really does and we felt that. That style of play was never going to be the way we were going to get back challenging for the league.

The issues we had when setup for counter-attacking is that against weaker teams who ceded possession to us, we struggled to break them down because in the absence of being able to counter at pace, all we had left was a slow build up of passing the ball from side to side without actually threatening. And this was also some of the dullest football I have ever seen.

And then against the better teams, we gave them so much possession that they were always likely to create chances and score.

It was not sustainable and we have been devoid of an identity for far too long. Something that they are looking to change with Amorim and I feel we are on the right path.
PSG literally set up to smash the ball long and win second balls from throw ins given to the oppo, and absolutely annihilated Liverpool and City both. There's room for nuance in how we play.
 
PSG literally set up to smash the ball long and win second balls from throw ins given to the oppo, and absolutely annihilated Liverpool and City both. There's room for nuance in how we play.

They also dominated possession vs both teams.

There's room for nuance but almost all of the CL winners the past decade were very good sides in possession.

Being a side that can only play/thrive in transition and have an inability to control games vs the best sides limits your ceiling. I do think we've improved this season in terms of control vs the best sides(and even lesser sides).
 
Utd are now pretty much on the points xPts suggests they should be on 16 v 15.x but still underperforming goals scored should have 18.x but only got 15. Still performances been better than results suggested earlier in the season and now it's evening out.
 
Utd are now pretty much on the points xPts suggests they should be on 16 v 15.x but still underperforming goals scored should have 18.x but only got 15. Still performances been better than results suggested earlier in the season and now it's evening out.
So I guess the question is are we getting better, or is that mainly regression to the mean.
 
Utd are now pretty much on the points xPts suggests they should be on 16 v 15.x but still underperforming goals scored should have 18.x but only got 15. Still performances been better than results suggested earlier in the season and now it's evening out.
Makes sense, earlier this season we were wasting a lot of good chances. Do the penalty misses factor in that too?
 
Our xG was low yesterday. Just over 1 for both teams.

I definitely think that understates our threat but we were unusually clinical too (and lucky with the deflection).
 
So I guess the question is are we getting better, or is that mainly regression to the mean.
I think the regression is luck factors while performances are getting better.

So we've played a lot better the last 2 games. But have also had some luck go our way in our finishing/moments we've scored goals and with opposition missing a few chances. Compare City away and Liverpool away.

45% - 55%
2.63 from 13 shots - 1.52 xG from 12 shots

64% - 36%
2.75 from 19 shots - 1.34 from 12 shots

The city one we did feck all til we were 3 down, and city has no problem letting us have the ball and then just didn't bother to keep pushing, so the majority of our xG came at the end.

The Liverpool one, we had the lead, and the majority of Liverpool's xG came in the final 15 minutes or so.

Numbers will just say they are similar, or worse even for the Liverpool game yet when you watch it, extremely different games.

Also as a side note, been noticing recently... So many xG numbers on random chances are just complete nonsense. I love the idea of xG, and it's useful for the most part, but I've definitely stopped paying attention to it like I used to because of this. Just straight up massively disagree with the xG assessment of so many chances that it's not worth the discussion it brings. We had a random de ligt header from a corner vs Liverpool that was 0.43 xG but Maguire's wide open winner was 0.09? Yesterday you're telling me we only accumulated 1.29xG? feck that.

I think they consistently get the difficulty of headed chances wildly wrong, and that represents a huge chunk. They can't properly asses if a player is cover or not, if the header is contested or not, if the player is stretching to get a touch or if he has proper contact or not... All of that impacts the quality of a chance and xG is just garbage for it.
 
Surprised to see our XG was so low vs Brighton - the Mbeumo miss and the Sesko miss in particular struck me as good chances. I would have guessed easier than two or three of the goals we did score.

I then had a click around on UnderStat etc...seems the Sesko chance (Bruno turn, into Mbuemo, Mbuemo into Sesko, left-footed shot wide at the near post) wasn't counted for some reason?
 
Just straight up massively disagree with the xG assessment of so many chances that it's not worth the discussion it brings. We had a random de ligt header from a corner vs Liverpool that was 0.43 xG but Maguire's wide open winner was 0.09? Yesterday you're telling me we only accumulated 1.29xG? feck that.

I think they consistently get the difficulty of headed chances wildly wrong, and that represents a huge chunk. They can't properly asses if a player is cover or not, if the header is contested or not, if the player is stretching to get a touch or if he has proper contact or not... All of that impacts the quality of a chance and xG is just garbage for it.
Must be very, very difficult with headers because so much of it depends on how the ball arrives on the head of the attacking player and also the positioning of the goalkeeper as a result.

The Maguire header, for example, was a sitter. You would expect to score that 50% of the time. Pace was on the cross, keeper was stranded and having to move left, all it needed was directing back across goal, which Maguire duly did.

Had the ball come in from the other flank, so it was a near-post header from the same spot, it would have been a much more difficult chance. Goalkeeper would have been positioned differently for a near-post cross and the attacker would have had to either find a deft header into the far corner or a very powerful top corner header at the near-post.

Until xG can account for pace on the ball, trajectory of the ball and intangibles like which foot the GKs weight is on due to original crossing position, imagine headers will basically be almost random.
 
Also as a side note, been noticing recently... So many xG numbers on random chances are just complete nonsense. I love the idea of xG, and it's useful for the most part, but I've definitely stopped paying attention to it like I used to because of this. Just straight up massively disagree with the xG assessment of so many chances that it's not worth the discussion it brings. We had a random de ligt header from a corner vs Liverpool that was 0.43 xG but Maguire's wide open winner was 0.09? Yesterday you're telling me we only accumulated 1.29xG? feck that.

I think they consistently get the difficulty of headed chances wildly wrong, and that represents a huge chunk. They can't properly asses if a player is cover or not, if the header is contested or not, if the player is stretching to get a touch or if he has proper contact or not... All of that impacts the quality of a chance and xG is just garbage for it.
I think this isn't something that should be labeled an "xG Problem" since from my understanding, different sources use different models to get to their numbers. The simpler models just look for position of the shot and the more advanced ones take more factors into account. That'll never be perfect but it still remains the most unbiased way of looking at it. Since even when there are some odd things in the model, they are applied to all games the same way.

Out of interest - the only place I found for xG values for shots within a game is understat (that seems to be rather "generous", the Maguire chance had 0.24 there fyi) - what is your source?
 
I think this isn't something that should be labeled an "xG Problem" since from my understanding, different sources use different models to get to their numbers. The simpler models just look for position of the shot and the more advanced ones take more factors into account. That'll never be perfect but it still remains the most unbiased way of looking at it. Since even when there are some odd things in the model, they are applied to all games the same way.

Out of interest - the only place I found for xG values for shots within a game is understat (that seems to be rather "generous", the Maguire chance had 0.24 there fyi) - what is your source?
Fotmob is what I typically use, and I think they use Opta data (and it tends to match up perfectly with the data they show on tv when I'm watching the games vs checking out the scores/data on fotmob. Fbref as well - they have per match data and have Maguire with 0.1xG vs Liverpool while de ligt is at 0.4 for that match.

I like understat, but from what I've heard they've always used a very simplistic xG model but definitely seems better there for Maguire's header at least. They gave de ligt 0.54 xG.. so again just wildly off what was just somebody stretching to get a touch from a set piece while contested.

I'm sure some of them are better. I would hope so especially as football clubs use it. But these numbers are similar to what is shown live during matches/after matches so it is the data that is viewed by most in the public. When this data is so off, it's just not worth looking at in the slightest IMO and I'm surprised there isn't more quality control to just quickly see it's wrong and manually override moments that happen quite frequently. It's not like headed chances are some small minority, hard to say total shots but headed goals alone account for usually about 25% of total goals. That's massively impacting the data every game, and it's easy to just look at the numbers and know it is just off.
 
Fotmob is what I typically use, and I think they use Opta data (and it tends to match up perfectly with the data they show on tv when I'm watching the games vs checking out the scores/data on fotmob. Fbref as well - they have per match data and have Maguire with 0.1xG vs Liverpool while de ligt is at 0.4 for that match.
Thanks, the data on fbref match report is per player though, right? Not per shot as with understat?
I like understat, but from what I've heard they've always used a very simplistic xG model but definitely seems better there for Maguire's header at least. They gave de ligt 0.54 xG.. so again just wildly off what was just somebody stretching to get a touch from a set piece while contested.
I agree
I'm sure some of them are better. I would hope so especially as football clubs use it. But these numbers are similar to what is shown live during matches/after matches so it is the data that is viewed by most in the public. When this data is so off, it's just not worth looking at in the slightest IMO and I'm surprised there isn't more quality control to just quickly see it's wrong and manually override moments that happen quite frequently. It's not like headed chances are some small minority, hard to say total shots but headed goals alone account for usually about 25% of total goals. That's massively impacting the data every game, and it's easy to just look at the numbers and know it is just off.
I see your point. I just think that this is just statistical "stuff" in a sense that there isn't somebody sitting thinking "this chance should have an xG of 0.23" or something so there are no "mistakes" at least, thats my take on it. They just take the parameters of a shot, transfer the ones relevant for their model and check their database for shots with similar parameters and then establish how many ended up a goal and thats then the xG for that particular shot.
 
Thanks, the data on fbref match report is per player though, right? Not per shot as with understat?

I agree

I see your point. I just think that this is just statistical "stuff" in a sense that there isn't somebody sitting thinking "this chance should have an xG of 0.23" or something so there are no "mistakes" at least, thats my take on it. They just take the parameters of a shot, transfer the ones relevant for their model and check their database for shots with similar parameters and then establish how many ended up a goal and thats then the xG for that particular shot.
Yeah its per player, but they had 1 shot each so it's easy to check for that one.

I agree that's what happens, and generally I think it's pretty good with the ball at feet. But headed chances I've been looking at lately and they all just seem way off what they should be and it's tough to ignore the impact (and makes me pay less attention to xG than before)
 
Yeah its per player, but they had 1 shot each so it's easy to check for that one.
Ah, thats actually smart, didn't think of that. But "only" works for players who won't shoot on goal more than once. Just found the individual shot stats on Futmob, thanks for the info
I agree that's what happens, and generally I think it's pretty good with the ball at feet. But headed chances I've been looking at lately and they all just seem way off what they should be and it's tough to ignore the impact (and makes me pay less attention to xG than before)
Fair enough
 
There's not much wrong with how the models measured Maguire's header. If you believe that trying to direct a header from the height of one post diagonally to the other and find the side of the net is the easiest thing next to scoring a penalty, the problem lies with you and not with the statistics. If the player does hit the target, though, it's a great chance because, where the ball ends up, it's very difficult to defend. Hence, Opta's xGOT 0.48.
 
There's not much wrong with how the models measured Maguire's header. If you believe that trying to direct a header from the height of one post diagonally to the other and find the side of the net is the easiest thing next to scoring a penalty, the problem lies with you and not with the statistics. If the player does hit the target, though, it's a great chance because, where the ball ends up, it's very difficult to defend. Hence, Opta's xGOT 0.48.
The problem is headed chances in general. Maguire's header for example should be much higher than 0.09, but fair enough if you think that's accurate. Compare it to Gakpo's just a bit later, at 0.30, or de ligts after that where he was stretching to get a head on at from a set piece, at 0.43. or a Van Dijk one in the first half at 0.21.

That's 4 headed "chances" all from the same game where Maguire's allegedly is the "hardest" chance, when in reality it was the easiest header to score. Lofted ball, plenty of time to adjust himself, he's unmarked, and there's no chance for the goalkeeper when he puts it back across goal. Those 4 chances account for a quarter of the total xG in the match, yet it's just wildly inaccurate on each occasion.

That's not a "me" problem, that's a problem in the way that headed chances are calculated in the models. They can't properly assess what is a free header vs an open header. They can't assess when a player is stretching to get a touch on the ball (so it counts as a shot even if they barely got a nick on it and was never an actual chance), or when a player has the time to plant, set themselves and comfortably place the ball. They can't assess if the ball is behind the player or ahead of them so they're running on to it with a header. It's not an exception either, start paying attention to the values assigned to headers in other matches. It's complete nonsense in the majority of occasions.

Another point that I've been noticing. Free kicks. You would think that is extremely easy to model consistently. The wall is the same distance away, and you don't take into account the quality of the player or the goalkeeper taking it. Goalkeepers will be effectively in the same position. Why then does Welbecks free kick, which went in, have an xG of 0.13 but similar free kicks that I found from other matches are often at like 0.02 or 0.03? There's variance, it's never going to be perfect, but that is a huge difference.

I like the idea of xG but really, there are so many flaws with the data of each individual shot and how it's compiled that it's not worth the discussion it actually brings.
 
Last edited:
I get the impression our high xG is greatly informed by how many times we hit the woodwork. We lead the league in that category (7) followed closely by Palace. Not coincidentally, we're also the same two clubs with the highest xG.
 
The problem is headed chances in general. Maguire's header for example should be much higher than 0.09, but fair enough if you think that's accurate. Compare it to Gakpo's just a bit later, at 0.30, or de ligts after that where he was stretching to get a head on at from a set piece, at 0.43. or a Van Dijk one in the first half at 0.21.

That's 4 headed "chances" all from the same game where Maguire's allegedly is the "hardest" chance, when in reality it was the easiest header to score. Lofted ball, plenty of time to adjust himself, he's unmarked, and there's no chance for the goalkeeper when he puts it back across goal. Those 4 chances account for a quarter of the total xG in the match, yet it's just wildly inaccurate on each occasion.

That's not a "me" problem, that's a problem in the way that headed chances are calculated in the models. They can't properly assess what is a free header vs an open header. They can't assess when a player is stretching to get a touch on the ball (so it counts as a shot even if they barely got a nick on it and was never an actual chance), or when a player has the time to plant, set themselves and comfortably place the ball. They can't assess if the ball is behind the player or ahead of them so they're running on to it with a header. It's not an exception either, start paying attention to the values assigned to headers in other matches. It's complete nonsense in the majority of occasions.

Yes, Gakpo's header is an "easier" header to target toward goal. De Ligt could have done better under different circumstances, therefore his zero (0) xGOT. The same applies to Van Dijk's header, which also valued at zero xGOT. But these chances from these positions are scored more frequently than Maguire's. This is a scientific fact, not an opinion. The xGOT provides the further analysis.
 


Thought this was interesting, when I saw the stats after the game.

When you add up our chances, you would only expect a bit more than one goal for this game? Seems wildly off to me. Of the relatively big chances we scored or missed I can remember: Mbeumo's second goal (huge chance), Sesko's big chance on his left, Mbeumo low shot hitting the post, Bruno point blank after Cunha back-heel. And then a bunch of half-chances and efforts from range.

I guess it's accurate by the methodology, but then it just shows the severe limitations of xG.
 
Yes, Gakpo's header is an "easier" header to target toward goal. De Ligt could have done better under different circumstances, therefore his zero (0) xGOT. The same applies to Van Dijk's header, which also valued at zero xGOT. But these chances from these positions are scored more frequently than Maguire's. This is a scientific fact, not an opinion. The xGOT provides the further analysis.
It's not a scientific fact at all. You are looking at the value of the xG as if it is because a model compares it based off similar data, when it is clearly failing to accurately read the situation and chance. The model is trying to fit all in as the same but the numbers very clearly look extremely wrong for headed chances, and that is a common theme whenever you just look into it.

A chance where a player is stretching to get on the end of a chance, with the ball fired at them in a way they can't even set themselves, where they are covered by defenders and it is a contested header, simply is never going to be an easier chance than Maguire's chance for example. That's just an example though. Anyone with an understanding of the factors that go into xG should be able to look at chances and see if the rough numbers "look" right or wrong. I listed out a few of them there that are very clearly the model just representing it properly. You can't just say "model says so, so it is". The model is not scientifically proven beyond doubt in all instances, it is not precise, there are tons of models that have wildly different numbers (even understat vs Opta vs statsbomb, all very different).

Like I said, xG is generally decent, but it is horrible at assessing headed chances, and that is probably 25% of all chances if it follows the same percentage as goals. That is a very large issue in looking at xG data.

XGoT, nah that's even further away from being accurate. Again, you can choose to ignore the individual data points and just take it as face value, or you can actually look at them, compare them, and make your own assessment into how accurate it actually is. It's all over the place when you look at it on an individual shot basis.
 


Thought this was interesting, when I saw the stats after the game.

When you add up our chances, you would only expect a bit more than one goal for this game? Seems wildly off to me. Of the relatively big chances we scored or missed I can remember: Mbeumo's second goal (huge chance), Sesko's big chance on his left, Mbeumo low shot hitting the post, Bruno point blank after Cunha back-heel. And then a bunch of half-chances and efforts from range.

I guess it's accurate by the methodology, but then it just shows the severe limitations of xG.

An example - Bruno's point blank shot has an xG of 0.18. Welbecks free kick has an xG of 0.13. That very obviously just doesn't look right. A Lewis Dunk contested header from a corner where he was stretching for it is 0.21. Obviously bollocks.

Now generally the xG in that game for us, I get why it's not that high. I'd argue it should be a bit higher, but it's not too far off. But when every game there are a lot of problematic data points... I dunno. Just needs a lot more work. The models that we have access to or even see on TV after matches clearly just have a tough time at assessing impact of defenders, and first time shots, especially headers. The pace of the cross, if a player is stretching for it or properly set, of they're free or actually under pressure... It's clearly not assessing those details properly and that's why the data is all over the place.
 
An example - Bruno's point blank shot has an xG of 0.18. Welbecks free kick has an xG of 0.13. That very obviously just doesn't look right. A Lewis Dunk contested header from a corner where he was stretching for it is 0.21. Obviously bollocks.

Now generally the xG in that game for us, I get why it's not that high. I'd argue it should be a bit higher, but it's not too far off. But when every game there are a lot of problematic data points... I dunno. Just needs a lot more work.
That's very strange. The Bruno chance, for instance, was a very good save. I'd expect that to be a goal at least every third time. Welbeck's freekick probably goes in 1:15 or so. Do you have a source for the individual xG of these chances?

Anyway, it just proves these analyses should always be taken with a grain of salt.
 
That's very strange. The Bruno chance, for instance, was a very good save. I'd expect that to be a goal at least every third time. Welbeck's freekick probably goes in 1:15 or so. Do you have a source for the individual xG of these chances?

Anyway, it just proves these analyses should always be taken with a grain of salt.
Was just looking at fotmob data for individual shots. Understat also does it. But yeah the Bruno one is definitely low, while Welbecks is way too high given it's a free kick and most free kicks from similar positions tend to be far lower (talking like <0.05).
 
Stats are based on facts, and facts don't care about how things "look" to the average viewer. To me, it seems like a case of people getting excited about the recent good results only to have a look at the underlying stats and find out the numbers don't "big up" the performances as much as they would have liked. It's the same stats, though, that were suggesting at the start of the season that United aren't as bad as most people believe. On both occasions, it's more about people reacting emotionally. It's like the stats are out to play down United's performances.
 
xG works over large datasets but has far too much variability over a single game to be really meaningful. I would wager that using the xG model coupled with someone who understood it and adjusted it for the actual events and you would have a far more accurate number.

Does xG account for the position of defenders? Over enough data points, yes. In isolation? No. A shot from the edge of the box might have an xG of 0.15 on average but with the correct positioning of 2-3 defenders I reckon you could knock that down to 0.01.

A header from the edge of the 6 yard box could be a great chance that a good striker finishes 30% of the time or he might have been in the wrong position for it and barely gets his head to it and it flies miles over the bar. Perhaps instead, it was a cross and he meets it perfectly and the only player to beat is the keeper and it should really be scored 75% of the time. Again, context is vital to individual instances. Over the season the data will obviously take all these into account and come up with an average but in isolation its probably more accurate to watch the game and judge it on its merit.
 
xG works over large datasets but has far too much variability over a single game to be really meaningful. I would wager that using the xG model coupled with someone who understood it and adjusted it for the actual events and you would have a far more accurate number.

Does xG account for the position of defenders? Over enough data points, yes. In isolation? No. A shot from the edge of the box might have an xG of 0.15 on average but with the correct positioning of 2-3 defenders I reckon you could knock that down to 0.01.

A header from the edge of the 6 yard box could be a great chance that a good striker finishes 30% of the time or he might have been in the wrong position for it and barely gets his head to it and it flies miles over the bar. Perhaps instead, it was a cross and he meets it perfectly and the only player to beat is the keeper and it should really be scored 75% of the time. Again, context is vital to individual instances. Over the season the data will obviously take all these into account and come up with an average but in isolation its probably more accurate to watch the game and judge it on its merit.
Yep definitely this.

Stats are based on facts, and facts don't care about how things "look" to the average viewer. To me, it seems like a case of people getting excited about the recent good results only to have a look at the underlying stats and find out the numbers don't "big up" the performances as much as they would have liked. It's the same stats, though, that were suggesting at the start of the season that United aren't as bad as most people believe. On both occasions, it's more about people reacting emotionally. It's like the stats are out to play down United's performances.
It's not a stat based on fact. It's an analytical model that is trying to quantify a unique situation. How that model collects information is open to interpretation and criticism. A shot is a shot. That is a fact. One model saying Maguire's xG on his chance was 0.25 and another saying 0.09 is not factual. That is 2 different models reading the chance a very different way. Understat has the xG vs Liverpool at 2.61 for Liverpool and 2.53 for United. Fotmob has it completely differently.

You can't just say it's based on emotion - it isn't. It's understanding how xG is supposed to work, looking at the chance and looking at the number, and saying "that's not right". And then noticing a pattern of "that isn't right" when it comes to headed chances. The xG is all over the place on them, both high and low. It rarely lines up with what is actually a good chance or bad chance, what is a free header vs contested, what is a player barely getting a touch on the ball vs what is a calm and measured header. It's a weakness in the models that can't be ignored.
 
Understat is a free model which comes with a lot of limitations. Opta, mainly, and others have integrated much more data into it. The clubs themselves use the stats to draw conclusions and analyse their performances. The differences come down to how much data has been used and how many times it gets updated throughout the season. And it is factual, as they take a huge amount of attempts from the same position to come up with their numbers. If you want to believe, out of thin air, that Maguire's header goes in half the times, it's your prerogative.
 


I guess it's accurate by the methodology, but then it just shows the severe limitations of xG.

Think you are misunderstanding xG to a degree. When we amass an xG of 1.11 in a game that doesn't mean it should have ended with us scoring once. It shows that we created chances with certain probabilities to go in that add up to 1.11 in one particular game. There is nothing about limitations out there at all - it is just looking at how often similar shots do go in. It can't predict stuff like the 2:0 - Casemiro makes a 0.02 xG shot but gets deflected into goal. Thats 0.02 added to the xG tally...

Stats are based on facts, and facts don't care about how things "look" to the average viewer. To me, it seems like a case of people getting excited about the recent good results only to have a look at the underlying stats and find out the numbers don't "big up" the performances as much as they would have liked. It's the same stats, though, that were suggesting at the start of the season that United aren't as bad as most people believe. On both occasions, it's more about people reacting emotionally. It's like the stats are out to play down United's performances.
Get the same feeling

It's not a stat based on fact. It's an analytical model that is trying to quantify a unique situation. How that model collects information is open to interpretation and criticism. A shot is a shot. That is a fact. One model saying Maguire's xG on his chance was 0.25 and another saying 0.09 is not factual. That is 2 different models reading the chance a very different way. Understat has the xG vs Liverpool at 2.61 for Liverpool and 2.53 for United. Fotmob has it completely differently.
Those models differ in the number of context parameters they add up. The easiest model might just look only for the position a shot is taken from. Over thousands of matches you'll maybe find a few hundred similar shots and take the average from there. A more sophisticated model will integrate the foot the shooter takes the shot with, the position of the goal keeper and whether the shooter is under pressure or not. The more parameters the lower the number of comparable shots. It isn't different models using wildly different formulas to create a somewhat quasi-subjective set of numbers. It is "just" different parameters from model to model. If you have ideas to improve the current models, I am sure people are up for it. If you find a way to incorporate stretch, player height and level of contestion thats great - the trouble won't be to generate other averages - the trouble will be how to annotate games detailed enough to have that level of data available.

Understats model seems to be fairly simple, thats maybe a factor why it is out there not too long after a match. Thats maybe a model that just takes into account the position and the style of shot and ends up with 0.25. Another model takes into account where the keeper is positioned and how close defenders where positioned. That model will then end up with 0.09. Because it not only incorporates headers from Maguire but also from players who aren't as notable with their heading than he is.
 
Think you are misunderstanding xG to a degree. When we amass an xG of 1.11 in a game that doesn't mean it should have ended with us scoring once. It shows that we created chances with certain probabilities to go in that add up to 1.11 in one particular game. There is nothing about limitations out there at all - it is just looking at how often similar shots do go in. It can't predict stuff like the 2:0 - Casemiro makes a 0.02 xG shot but gets deflected into goal. Thats 0.02 added to the xG tally...


Get the same feeling


Those models differ in the number of context parameters they add up. The easiest model might just look only for the position a shot is taken from. Over thousands of matches you'll maybe find a few hundred similar shots and take the average from there. A more sophisticated model will integrate the foot the shooter takes the shot with, the position of the goal keeper and whether the shooter is under pressure or not. The more parameters the lower the number of comparable shots. It isn't different models using wildly different formulas to create a somewhat quasi-subjective set of numbers. It is "just" different parameters from model to model. If you have ideas to improve the current models, I am sure people are up for it. If you find a way to incorporate stretch, player height and level of contestion thats great - the trouble won't be to generate other averages - the trouble will be how to annotate games detailed enough to have that level of data available.

Understats model seems to be fairly simple, thats maybe a factor why it is out there not too long after a match. Thats maybe a model that just takes into account the position and the style of shot and ends up with 0.25. Another model takes into account where the keeper is positioned and how close defenders where positioned. That model will then end up with 0.09. Because it not only incorporates headers from Maguire but also from players who aren't as notable with their heading than he is.
My point on the Maguire one (and headers in general) is that 0.09 is obviously too low, especially as a comparison to other headers within the same model. If your model takes into account keeper position, defender position, the cross details etc - then Maguire's chance should go up from the basic one. He was wide open on the back post and had a relatively simple header to place it on target. I'm using Maguire's header, de ligts header, and multiple other headed chances as pretty jarring examples that xG just has a really hard time quantifying headers. Of course there are reasons for it. But when 20-30% of your set of data is pretty much nonsense numbers, it's kind of hard to take it seriously.

I very much understand how xG is collected - I argued for it for years on here. It's definitely swung too far though in terms of people treating it as gospel, using it incorrectly, reading too much into it, going down the line of "team A deserves xyz because they had an xG of whatever".

There are aspects of xG analytics that are definitely useful to look at. 10 game rolling average charts are great for example. Looking at single match xG, or xG tables after a few games, or saying a team deserved to win or lose on the back of it, is all incorrect ways to use the data. You have to take it all with a pinch of salt, understand that the data is not the be all and end all, understand that there are very clear flaws to how it's collected, and that it just doesn't do a fair representation of every type of shot, for a variety of reasons.
 
Think you are misunderstanding xG to a degree. When we amass an xG of 1.11 in a game that doesn't mean it should have ended with us scoring once. It shows that we created chances with certain probabilities to go in that add up to 1.11 in one particular game. There is nothing about limitations out there at all - it is just looking at how often similar shots do go in. It can't predict stuff like the 2:0 - Casemiro makes a 0.02 xG shot but gets deflected into goal. Thats 0.02 added to the xG tally...
Yeah, no. It's not hard to understand at all. My point is that for our game against Brighton it seems, for whatever reason, that the xG doesn't really accurately reflect quantity and quality of chances in the aggregate. I can't say I came away from that game and thought that us and Brighton had accumulated roughly the same opportunities, but that's what the xG shows. Perhaps it has something to do with quirks related to how each chance is evaluated, like @bosnian_red pointed out.

It also doesn't really matter. We got the result and fully deserved it, in my opinion. For me it just shows that taking xG with a grain of salt is probably a good idea, especially because there is now a lot of discourse around teams underperforming or overperforming their xG.
 


Thought this was interesting, when I saw the stats after the game.

When you add up our chances, you would only expect a bit more than one goal for this game? Seems wildly off to me. Of the relatively big chances we scored or missed I can remember: Mbeumo's second goal (huge chance), Sesko's big chance on his left, Mbeumo low shot hitting the post, Bruno point blank after Cunha back-heel. And then a bunch of half-chances and efforts from range.

I guess it's accurate by the methodology, but then it just shows the severe limitations of xG.


Yep. If you base a game of xG stats you're wildy missleading. That system is far from truthful