Reminds me of the Crowdstrike incident last year.

    • Björn@swg-empire.de
      link
      fedilink
      arrow-up
      5
      ·
      edit-2
      6 hours ago

      Most Lemmy images stopped working. And maybe what my server is showing me in terms of posts is just what it still has stored.

      Edit: My server is actually much more responsive with most of the big Lemmy instances being down. I really hope 1.0 brings great improvements.

  • Ephera@lemmy.ml
    link
    fedilink
    English
    arrow-up
    14
    ·
    3 hours ago

    Oh man, these global outages are really getting out of hand. A few days after the recent AWS and Azure outages, I suddenly noticed that I couldn’t reach certain webpages anymore. And I genuinely didn’t even bother trying to debug, because I just assumed that it’s another global outage.

    In the evening, I did look into it and noticed that my router was at fault (presumably DNS got bugged by a recent update). That was just wild to me, that I genuinely deemed it more likely that several major webpages went offline together than that my home setup is fucky.

    • ramble81@lemmy.zip
      link
      fedilink
      arrow-up
      12
      ·
      5 hours ago

      There are a lot of IT departments though that get to throw up their hands and say “can’t fix it, it’s a cloud issue!” and watch as management, who pushed for cloud in the first place, sucks it up because they don’t want to lose face for their decision.

      (Yes I know some still get yelled at regardless and told to fix a 3rd party service)

      • 7U5K3N@lemmy.dbzer0.com
        link
        fedilink
        arrow-up
        2
        ·
        5 hours ago

        (Yes I know some still get yelled at regardless and told to fix a 3rd party service)

        Man I feel this. Once some drunk asshat hit a telephone pole and it killed the fiber line to a call center for the company I worked for. Hilariously the backup Internet was on the same pole… Additionally… It was a hemispherical call center meaning it served everyone in the western hemisphere.

        Anyway… All internet was down for the call center for like 8 hours. So no calls were being answered. No orders being placed etc.

        Being on the Helpdesk at the time…I took so many “our Internet is down” calls. Which after a couple hours it turned into “fix the internet or I’m calling your boss” lol

        Which then turned into “fix the internet or I’m calling their boss”

        From my pov it was hilarious.

        Someone in upper management got fired for consolidating all the call centers. Then they moved to wireless Internet via cell towers as a backup.

        But as we all know. That’s just fiber based at the tower. Lol

        So yeah fun times of “go do someone else’s job”

        Still to this day idk why it took so long… you’d think an sla would be in place. ¯⁠\⁠_⁠(⁠ツ⁠)⁠_⁠/⁠¯

      • utopiah@lemmy.ml
        link
        fedilink
        arrow-up
        1
        ·
        4 hours ago

        I don’t know how many 9s I do … but I don’t care. We should not think of metrics of uptime or scalability like BigTech, we’re not them. We’re not “selling” the same “product”. To me it’s about agency, empowerment, creativity, privacy, not uptime.

  • VoxAliorum@lemmy.ml
    link
    fedilink
    arrow-up
    5
    ·
    6 hours ago

    It’s so funny :P just months ago one of my most used forums adopted cloudflare and many asked “Are you sure?”. Well…

  • ☂️-@lemmy.ml
    link
    fedilink
    arrow-up
    3
    ·
    edit-2
    2 hours ago

    i’m usually on frontends, alternatives and self-hosted services. i’m barely seeing any of those outages.

    feeling cool rn ngl 😎

  • yxp@lemmy.radio
    link
    fedilink
    English
    arrow-up
    6
    ·
    7 hours ago

    Damn, I really shouldn’t have trusted cloudflare tunnel. All my selfhosted servers are inaccessible… It’s running behind traefik so no ports are open.

    • qjkxbmwvz@startrek.website
      link
      fedilink
      arrow-up
      8
      ·
      6 hours ago

      VPS+VPN (WireGuard for me), with Tailscale as an emergency alternative, has worked very well for me. Knock on wood the only outages have been my own fault.

      • yxp@lemmy.radio
        link
        fedilink
        English
        arrow-up
        3
        ·
        6 hours ago

        Do you have VPS recommendations? I searched for a bit on Lemmy and found out Vultr might not be a good option (they sell your data).

        • qjkxbmwvz@startrek.website
          link
          fedilink
          arrow-up
          2
          ·
          5 hours ago

          Sadly not really. I use the free tier Oracle, which honestly has worked very well, but I’m not going to recommend using Oracle aside to say that it functionally works for me.

          If I were to switch I would probably go to racknerd.

  • antrosapien@lemmy.ml
    link
    fedilink
    arrow-up
    17
    ·
    5 hours ago

    There’s some malicious satisfaction watching centralized internet burning in dumpster fire while your self hosted stuff is still up

    • krashmo@lemmy.world
      link
      fedilink
      arrow-up
      2
      ·
      5 hours ago

      Isn’t cloudflare a pretty common part of remotely accessing your server? I don’t use it but I’ve seen lots of people talk about it and recommend using them.

      • 4grams@awful.systems
        link
        fedilink
        English
        arrow-up
        3
        ·
        4 hours ago

        I do use it myself (free tier only) but it’s out of ease and convenience. I’m ready to abandon it but I like the security it brings. My stuff is just personal garbage with no strict uptime requirement - if I lose public access I still have Tailscale and a VPN to my router as backup.

        So, it’s a deal with the devil for sure, but it’s one I wore protection for when signing.

      • TubularTittyFrog@lemmy.world
        link
        fedilink
        arrow-up
        10
        ·
        edit-2
        5 hours ago

        yes. it also prevents attacks. it’s basically a necessity these days.

        if you host your own stuff and get any traffic you’ll get DDoSed by bots. cloudflare prevents this by detaching your DNS from your IP and distributing requests.

        just port forwarding on your home network these days… and you’ll get dozens of attacks per hour.

        the internet is not ‘nice’ anymore. services like cloudflare are a necessity for any active services beyond personal use. long gone are the days you could host a web server from your bedroom.

        • krashmo@lemmy.world
          link
          fedilink
          arrow-up
          1
          ·
          3 hours ago

          Maybe you guys are hosting more than me but I’ve got a few ports forwarded and don’t see any unusual activity. I guess I’m just lucky.

    • DigitalDilemma@lemmy.ml
      link
      fedilink
      English
      arrow-up
      3
      ·
      1 hour ago

      Except many of us use cloudflare tunnels to reach our selfhosted kit from the internet because we’re behind CGNATs…