(no subject)

[brin_bellway]

Got IP-banned from Tumblr for participating in the ArchiveTeam scrape. I can still view posts through the dashboard, but not the webpage view.

Guess how I'm getting around this?

If you guessed "by submitting the pages to the Internet Archive and then viewing the archived version", you're absolutely fucking right.

(I mean, I suppose I could probably use a proxy or something, but this does have the advantage of being extremely meta.)

Comments

[ilzolende]

I tried to back up a page with the Internet Archive on Tumblr today, and it looked like Tumblr was rate-limiting the Internet Archive, which is certainly ... a thing to do. Possibly it was some other sort of issue, though?

[brin_bellway]

That is very possibly what they were doing. It looks like (for now) I am no longer banned outright from using the webpage view, but I *am* rate-limited. My ArchiveTeam client has automatically switched back to the Tumblr project and is currently very slowly scraping some diaper-fetishist blog, with several instances of "Server returned 429 (RETRFINISHED). Sleeping." in-between each successful page.

I suspect that either the blog will be purged or I will be banned again or both before the scrape is completed, but I will leave it running overnight just in case it accomplishes something.