Viewing 6 reply threads
  • Author
    Posts
    • #1559528
      Michael Pietroforte
      Keymaster
      Member Points: 32,173
      Author of the year 2018
      Rank: 4

      It seems Gmail is completely down. Is anyone able to login?

    • #1559531
      Michael Pietroforte
      Keymaster
      Member Points: 32,173
      Author of the year 2018
      Rank: 4

      Gmail just came back. Scary. All services were red (see attached below) for 10 minutes or so.

      Attachments:
      You must be logged in to view attached files.
    • #1559533
      Paolo Maffezzoli
      Participant
      Member Points: 63,231
      4sysops member of the year 2018Member of the Year 2019Member of the Year 2020Member of the Year 2021
      Rank: 4

      I have an account down, another one is still running. But there is a global problem random about Google services down.

    • #1559534
      Paolo Maffezzoli
      Participant
      Member Points: 63,231
      4sysops member of the year 2018Member of the Year 2019Member of the Year 2020Member of the Year 2021
      Rank: 4

      More info available on Google Dashboard: https://www.google.com/appsstatus

      • #1559535
        Michael Pietroforte
        Keymaster
        Member Points: 32,173
        Author of the year 2018
        Rank: 4

        My accounts all came back now. But the dashboard is still red. Amazing that this happens to Google.

        Scary when you try to login and Google claims your account does not exist.

    • #1559537
      Steven
      Participant
      Member Points: 1,114
      Rank: 3

      It happened to Microsoft and ISP worldwide not long ago as well.

      I believe the expectation are unrealistic regarding availability.

      • #1559538
        Michael Pietroforte
        Keymaster
        Member Points: 32,173
        Author of the year 2018
        Rank: 4

        Yeah, you never get 100% availability. However, there are big differences. Microsoft is not really known for providing reliable software and services. Google is a bit better, I’d say. And in the 10 years 4sysops is running on AWS, I experienced 0 downtime.

        avatar
    • #1559578
      Paolo Maffezzoli
      Participant
      Member Points: 63,231
      4sysops member of the year 2018Member of the Year 2019Member of the Year 2020Member of the Year 2021
      Rank: 4

      Someone in Google has changed something in the quota management…

      Outage caused by a bug in storage quota system
      According to a tweet and a Google status report, the outage was caused by the company’s automated quota management system reducing the amount of storage available to Google’s authentication system.

      “Today, at 3.47AM PT Google experienced an authentication system outage for approximately 45 minutes due to an internal storage quota issue. This was resolved at 4:32AM PT, and all services are now restored,” Google stated in a tweet from their Google Cloud account.

      Link : Google outage caused by critical system running out of storage

      avatar
      • #1559579
        Michael Pietroforte
        Keymaster
        Member Points: 32,173
        Author of the year 2018
        Rank: 4

        That explains why Google claimed that my account does not exist. A large company like Google should have a monitoring system that notices when a storage system runs low on space.

        • #1559606
          Steven
          Participant
          Member Points: 1,114
          Rank: 3

          I believe Google has such a set up for their own system.

    • #1559608
      Michael Pietroforte
      Keymaster
      Member Points: 32,173
      Author of the year 2018
      Rank: 4

      Google worships automation. My guess is that the Google engineers were so convinced of their automated quota management system that they neglected monitoring. I mean it is easy to confuse quota automation with storage space monitoring. In the latter case you need humans who receive alerts when unusual storage consumptions occur. Google tries to get rid of human workers as much as possible. It is hard to explain how an human admin could have missed that such an important system will run out of storage.

Viewing 6 reply threads
  • You must be logged in to reply to this topic.
© 4sysops 2006 - 2022

CONTACT US

Please ask IT administration questions in the forums. Any other messages are welcome.

Sending

Log in with your credentials

or    

Forgot your details?

Create Account