GitHub Incident with Webhooks, Actions, etc.

(githubstatus.com)

57 points | by jbredeche an hour ago ago

29 comments

  • dgritsko an hour ago ago

    So frustrating. You can only experience so many of these outages before you seriously have to start questioning whether it makes sense to continue to use GitHub (and many have already long since reached this point)

    • herpdyderp a minute ago ago

      Still mid switch to self hosted Gitea here!

    • adamddev1 7 minutes ago ago

      Isn't this an example of how everyone wants to believe that vibe-coding software is enough, but no one actually wants to depend on vibe-coded software (like GitHub)?

      I switched to Forgejo and it's such a breath of fresh air. You can feel the solidity, snappiness and dependability of a good old carefully coded app.

    • kilroy123 28 minutes ago ago

      I'm now running the actions elsewhere, but yeah, I'm almost ready to self-host a full alternative.

      • adamddev1 7 minutes ago ago

        Forgejo with a self-hosted runner is amazing.

    • colechristensen an hour ago ago

      I implemented my own, it was time well spent.

      The features I care about work as I want them to, the features I don't care about are kinda janky.

    • x86a an hour ago ago

      We switched to self-hosted GitLab several outages ago

      • Aaronstotle an hour ago ago

        Yeah, switched over to self-hosted Gitlab back in mid-June and feels like the right choice

        • trevinhofmann 9 minutes ago ago

          Same here. Gitea has been pleasant to use for my business, and I've had 0 downtime issues compared to near-daily problems with GitHub during the first half of the year.

          Edit: Sorry, thought you wrote Gitea rather than GitLab. I've also had a nice experience with self-hosted GitLab years ago, and I'd wager that pretty much any self-hosted option would be better than GitHub at this point.

      • Riemer an hour ago ago

        Just don't expose them to the internet. They have a lot of CVEs latey, some even allowing full control

        • sandeepkd 41 minutes ago ago

          How would that work out for remote workers and agents?

          • betaby 16 minutes ago ago

            VPN or tailscale or client certificates on https endpoint.

    • xyst an hour ago ago

      self hosted forgejo and forgejo action runners for my homelab

      • huijzer 40 minutes ago ago

        Yup am running too for 2 years now and love it. It’s my favorite service. Uptime is basically 100% since it’s only down when I’m doing server maintenance (apt get update and reboot) and then I’m not pushing anyway.

  • OptionOfT an hour ago ago

    I visit https://status.github.com it is the second suggestion, after https://github.com/ itself.

  • godzillafarts 28 minutes ago ago

    We self-host actions and this still impacted us. Incident resolved 30 minutes ago, but all our builds are still queued/pending. Maybe GitHub needs to replay some webhooks?

  • plasma 33 minutes ago ago

    There has been degradation in their copilot cloud agent in the last few weeks (sessions erroring/disappearing, connections not working, etc) that is not on a status dashboard.

  • Riemer an hour ago ago

    Codeberg has been pretty stable for me

  • tosser811 an hour ago ago

    Dead in the water for actions that are merge requirements here.

  • fishgoesblub 10 minutes ago ago

    The more these incidents happen, the more I think about I talking to investors about investing in my GitHub alternative; an old computer in the corner running Gitea.

  • mtremsal an hour ago ago

    I don't know them, and am not an investor, but I'm trying Blacksmith as a GHA alternative because I'm losing my mind over the regular downtime. Apparently all the cool kids already use it, so... Obviously this doesn't help at all with Webhooks.

    update: first jobs are green already. migration took 5 minutes. so far so good.

  • hrpnk an hour ago ago

    Wonder how soon GitHub will tighten rate limits on OSS GitHub further and start charging per API call like x.com did to weed out bots...

    Not being able to isolate OSS and Enterprise workloads properly is also quite the downer.

    • colechristensen an hour ago ago

      I'm not saying bots/LLMs aren't making GitHub's job harder but I saw an uptime graphic with a pretty stark and obvious change pre/post acquisition by Microsoft.

    • deadbunny an hour ago ago

      If you believe Twitter "weed[ed] out the bots" I have a bridge to sell you.

  • adamddev1 10 minutes ago ago

    I have been moving everything away to a self hosted Forgejo, and I am so happy.

    But now I wonder about Netlify. Their dashboard is jammed full of prompt boxes for agents. Could more AI psychosis there turn that into a house of cards as well?

  • Vosporos 30 minutes ago ago

    Great day to be on Codeberg

  • saejox an hour ago ago

    i have githubstatus.com on my bookmarks. Maybe i should make it my homepage?

  • mococa an hour ago ago

    Another, another incident

  • bpiroman 39 minutes ago ago

    Yet everyone still uses GitHub lolz