Botnet Part 2: The Web is Broken
jan.wildeboer.net
I guess you have all heard about the growing problem of AI companies trying to aggressively collect whatever data they can get their hands on to train their models. This has caused an explosive surge in web crawlers relentlessly hitting servers big and small. But who runs these crawlers? Turns out — it could be you!
  • Viri4thus@feddit.orgEnglish
    8·
    5 days ago

    I couldn’t read past the bio, gave me Linkedin PTSD and my confidence levels cratered. That’s the IT equivalent of fake quotes with abstract art backgrounds on facebook, it immediately disqualifies the author.

  • obbeel@lemmy.eco.brEnglish
    3·
    5 days ago

    Crawling the web is an important right for access of information. I think big crawlers shouldn’t dominate the market. Especially since Google isn’t up to par to find anything that is wanted anymore.

    • pHr34kY@lemmy.worldEnglish
      3·
      5 days ago

      Google has found exactly what you’re searching for. It’s just they can make more money by suggesting something else.

      • obbeel@lemmy.eco.brEnglish
        1·
        4 days ago

        I think that if the algorithm is so broken to the point of only listing things that are interesting to Google, the search is beyond redemption.