I’m a systems librarian in an academic library. I moved over the Lemmy after Rexxit 2023. I’ve had an account on sdf.org since 2009 (under a different username), and so I chose this instance out of a sense of nostalgia. I do all sorts of fiber arts (knitting, cross stitch, sewing) and love dogs.
It’s also a huge problem for library/archive/museum websites. We try so hard to make data available to everyone, then some rude bots come along and bring the site down. Adding more resources just uses more resources–the bots expand to fill the container.
Bots lie about who they are, ignore robots.txt, and come from a gazillion different IPs.