• Mwa@thelemmy.club
    link
    fedilink
    English
    arrow-up
    7
    ·
    1 day ago

    The problem is Ai doesn’t follow robots.txt,so Cloudflare are Anubis developed a solution.