...and we're back

Discussion in 'Admin/Mod Help Forum' started by Niall, Jul 26, 2011.

  1. Jul 26, 2011
    #1

    Niall All Powerful Super Being

    Joined:
    Jun 13, 1999
    Messages:
    10,688
    After a ridiculously long stretch of downtime, we have successfully resolved a hardware fault with the database server and rolled back the database to a backup from approx midnight on Saturday. Obviously this means everything posted since then has been lost, but given the amount of data corruption in the database, it was the safest option.

    I can't apologise enough for this downtime. It has been a hugely frustrating couple of days. What should have been a relatively straight forward move of server hardware from one data centre to another turned into a bit of a nightmare.

    Hopefully now everything is back to normal and we can forget this ever happened ;) As ever, you guys are my best eyes and ears so if you come across any odd behaviour - error pages, double posts etc - please post here and I'll investigate. The more detail you can provide about the problem the better.

    Thanks again for your patience. Hopefully this is the last time we have such a lengthy outage.

    Update:
    So I spoke to soon. Obviously we're still having a lot of problems, error pages, double posts. We're actively looking into it and hopefully a solution is not far away.

    Update 2:
    I think we've tracked down the problem, a rogue database query that was using the wrong index which lead to long running queries that would eventually block all the database threads. As ever, can people please let me know if things are working better now - specifically when it comes to posting and editing posts. Thanks.
  2. Jul 26, 2011
    #2

    SharkyMcShark Horrified

    Joined:
    May 17, 2007
    Messages:
    20,812
    Location:
    Using location as a tagline: because I'm just not
    First post back!
  3. Jul 26, 2011
    #3

    Shimo Full Member

    Joined:
    Nov 11, 2009
    Messages:
    6,229
    Thanks for the work / effort in getting my addiction back up.
  4. Jul 26, 2011
    #4

    SATA Full Member

    Joined:
    Nov 8, 2005
    Messages:
    6,931
    Location:
    We all love United
    Get in!
  5. Jul 26, 2011
    #5

    MikeUpNorth Wobbles like a massive pair of tits

    Joined:
    Apr 26, 2007
    Messages:
    15,630
    ...aaaaanndddd breaaatthhhheeee.
  6. Jul 26, 2011
    #6

    Billy Blaggs Billy no mates and im shit at Halo

    Joined:
    Nov 6, 2000
    Messages:
    5,262
    Location:
    Billy fuckin no mate, thats me!!!
    I have come to realize I have a serious problem with my addiction to this site.
  7. Jul 26, 2011
    #7

    Brophs The one and only

    Joined:
    Nov 28, 2006
    Messages:
    38,093
    Location:
    Charlie Adam: A Pivot
    I'm getting the 'Canae take the strain' message when I try to quick reply.
  8. Jul 26, 2011
    #8

    WR RedCafe FIFA League Season 1 Winner

    Joined:
    Sep 20, 2009
    Messages:
    13,297
    Location:
    Manchester
    Testing
  9. Jul 26, 2011
    #9

    WeasteDevil Banned

    Joined:
    Jun 21, 2001
    Messages:
    108,931
    Location:
    Salford in Castellón de la Plana
    Well, that went as well as could be expected!
  10. Jul 26, 2011
    #10

    OneToAnother Full Member

    Joined:
    Jun 9, 2010
    Messages:
    2,093
    I'm getting the canae.... whenever I try to get on anything but this thread.
  11. Jul 26, 2011
    #11

    humdinger Full Member

    Joined:
    Mar 10, 2011
    Messages:
    1,273
    Location:
    Scotland
    still lots of 'canae take the strain' messages and has been very difficult to post any replies, but thanks for bringing the caf back to us! I was going through withdrawal!
  12. Jul 26, 2011
    #12

    Brophs The one and only

    Joined:
    Nov 28, 2006
    Messages:
    38,093
    Location:
    Charlie Adam: A Pivot
    Yeah, almost nothing's working for me without having to try about twenty times.
  13. Jul 26, 2011
    #13

    Solius Has a massive ginger bush

    Joined:
    Dec 31, 2007
    Messages:
    54,628
    Location:
    PAUL SCHOLES AVATAR RIP: 2010 - 2013
    I'm scared.
  14. Jul 26, 2011
    #14

    032Devil Full Member

    Joined:
    Oct 26, 2004
    Messages:
    20,714
    Sadly, still not operating properly though. Not on AppleMac laptop.
  15. Jul 26, 2011
    #15

    SteveJ all-round nice guy

    Joined:
    Oct 22, 2010
    Messages:
    33,616
    Location:
    Exactly where Nazi Germany started
    It's too late - I've decided to support Athletico Fray Bentos instead.
  16. Jul 26, 2011
    #16

    brad-dyrak Full Member

    Joined:
    Feb 28, 2007
    Messages:
    2,322
    I just got 2 really productive full days of work done. It was horrible.
  17. Jul 26, 2011
    #17

    alastair ignorant

    Joined:
    Aug 6, 2010
    Messages:
    16,313
    Location:
    The Champions League
    Working now???
  18. Jul 26, 2011
    #18

    Maciek Arrogant prick who is best ignored

    Joined:
    Feb 21, 2006
    Messages:
    11,062
    Finally, I'm tired of wanking...
  19. Jul 26, 2011
    #19

    WR RedCafe FIFA League Season 1 Winner

    Joined:
    Sep 20, 2009
    Messages:
    13,297
    Location:
    Manchester
    I just got a message telling me to wait 30 seconds between posts, even though it was 30 odd minutes since my last
  20. Jul 26, 2011
    #20

    mustaine Full Member

    Joined:
    Oct 5, 2007
    Messages:
    833
    Location:
    Reykjavik, Iceland
    [​IMG]
  21. Jul 26, 2011
    #21

    crappycraperson "Resident cricket authority"

    Joined:
    Dec 26, 2003
    Messages:
    28,968
    Location:
    <Insert something funny here>
    sadfdffd
  22. Jul 26, 2011
    #22

    SteveJ all-round nice guy

    Joined:
    Oct 22, 2010
    Messages:
    33,616
    Location:
    Exactly where Nazi Germany started
    A poster named Mr Anderson requested that I post his PM to me in this thread:

  23. Jul 26, 2011
    #23

    Classy Cannon Left Back <font face="Arial"color="White"> in the

    Joined:
    Jun 2, 2006
    Messages:
    2,761
    Location:
    On the Edge
    You don't know what you got till it's gone
  24. Jul 26, 2011
    #24

    phelans shorts Full Member

    Joined:
    Jan 4, 2009
    Messages:
    20,566
    Location:
    Gaz. Is a Mewling Quim.
    She Canae take the strain lots.
  25. Jul 26, 2011
    #25

    Stookie Full Member

    Joined:
    Jun 5, 2008
    Messages:
    4,423
    Location:
    Quit yo jibba jabba... you aint hurt!
    Its still fecked though
  26. Jul 26, 2011
    #26

    phelans shorts Full Member

    Joined:
    Jan 4, 2009
    Messages:
    20,566
    Location:
    Gaz. Is a Mewling Quim.
    She Canae take the strain lots.
  27. Jul 26, 2011
    #27

    Classy Cannon Left Back <font face="Arial"color="White"> in the

    Joined:
    Jun 2, 2006
    Messages:
    2,761
    Location:
    On the Edge
    You don't know what you got till it's gone...got Scotty though
  28. Jul 26, 2011
    #28

    Stookie Full Member

    Joined:
    Jun 5, 2008
    Messages:
    4,423
    Location:
    Quit yo jibba jabba... you aint hurt!
    Its still fecked though
  29. Jul 26, 2011
    #29

    phelans shorts Full Member

    Joined:
    Jan 4, 2009
    Messages:
    20,566
    Location:
    Gaz. Is a Mewling Quim.
    She Canae take the strain lots.
  30. Jul 26, 2011
    #30

    Danny1982 Full Member

    Joined:
    Aug 18, 2009
    Messages:
    13,088
    Location:
    Old Trafford
    Our forum is still sick. He doesn't seem to like the new hardware.. :(

    But at least it's better than yesterday.. :nervous:

    Why was this change necessary??
  31. Jul 26, 2011
    #31

    Niall All Powerful Super Being

    Joined:
    Jun 13, 1999
    Messages:
    10,688
    Out of necessity the server hardware had to be moved to a new data centre. We also added a new database server at the same time and it's having a few, shall we say, teething problems :(
  32. Jul 26, 2011
    #32

    Lynk Obsessed with discrediting Danny Welbeck

    Joined:
    Aug 28, 2009
    Messages:
    13,905
    I've missed the caf, I automatically open it along with Facebook and I was getting transfer news withdrawls :(
  33. Jul 26, 2011
    #33

    KM I’m afraid I just blue myself

    Joined:
    Sep 18, 2008
    Messages:
    33,309
    The loading times are much better now.
  34. Jul 26, 2011
    #34

    Burndogg Magic Meat

    Joined:
    Mar 14, 2006
    Messages:
    17,122
    Location:
    Viva La Soviet Union
    Translates as:


    Niall spilt a pot noodle on the server
  35. Jul 26, 2011
    #35

    Top killjoy

    Joined:
    Oct 16, 2005
    Messages:
    9,302
    Location:
    Denmark
    It works very well now.

    Jinx.
  36. Jul 26, 2011
    #36

    Raven Blade Dull

    Joined:
    Jun 24, 2004
    Messages:
    33,306
    Location:
    Red man down in London town
    I was suffering withdrawal symptoms like everyone else. Hope the Caf is back for real now.

    Edit: It's working stupendously well again!
  37. Jul 26, 2011
    #37

    KM I’m afraid I just blue myself

    Joined:
    Sep 18, 2008
    Messages:
    33,309
    It's back to the best!
  38. Jul 26, 2011
    #38

    Spoony The People's President

    Joined:
    Oct 27, 2001
    Messages:
    48,140
    Location:
    Vote RNilsson for best poster!
    I've started a new forum, if anyone's interested PM Top.
  39. Jul 26, 2011
    #39

    Niall All Powerful Super Being

    Joined:
    Jun 13, 1999
    Messages:
    10,688
    traitor!!!!

    ;)
  40. Jul 26, 2011
    #40

    WR RedCafe FIFA League Season 1 Winner

    Joined:
    Sep 20, 2009
    Messages:
    13,297
    Location:
    Manchester
    Everything works good now.

Share This Page