61·
18 hours agoLast I checked, cloudflare requires the user to have JavaScript and cookies enabled. My institution doesn’t want to require those because it would likely impact legitimate users as well as bots.
I’m a systems librarian in an academic library. I moved over the Lemmy after Rexxit 2023. I’ve had an account on sdf.org since 2009 (under a different username), and so I chose this instance out of a sense of nostalgia. I do all sorts of fiber arts (knitting, cross stitch, sewing) and love dogs.
- 0 Posts
- 3 Comments
Joined 2 years ago
Cake day: July 3rd, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
It’s also a huge problem for library/archive/museum websites. We try so hard to make data available to everyone, then some rude bots come along and bring the site down. Adding more resources just uses more resources–the bots expand to fill the container.
Odd. I just tried
and got
I’m clearly not on the same setup as you are, but my off-the-cuff guess is that your curl command was issued from a system that cloudflare already recognized (IP whitelist, cookies, I dunno).
Anyways, I’m reading through this blog post on using cURL with cloudflare-protected sites and I’m finding it interesting.