My issue with this issue, is that legitimate concerns over worker welfare in the Middle East, has been mixed with concerns over the host award process, "football culture in Qatar", disruptions to the European club calendar... And for the latter, they've either not been concerns in previous WCs, or it sounds a bit frivolous to me.
I find the Kafala system disgusting from top to bottom and that's even without the deaths. It's hard for me to suppress my cynicism given how intertwined the Western world is with Qatar. Their money is in your real estate, defense contractors, shopping malls, investment funds, football clubs... this is the time that ire is raised?
Call it the impact of propaganda or uncertainty over the topic or numbers being fudged by nonprofits... Is there a verified number on the number of deaths that occurred during the stadiums being built? If the number is in fact in the thousands, then personally I'd feel a bit queasy watching the tournament.
In conclusion I can't begrudge anyone who genuinely feels their conscience prompts them to boycott. You'd have a hard time making an objective argument on this issue though if this boycott doesn't extend to other areas of life, and that's avoiding any whataboutism argument on the subject.