brin_bellway: forget-me-not flowers (Default)
Brin ([personal profile] brin_bellway) wrote 2020-04-21 11:08 pm (UTC)

Good point: I used the long-form flags for better readability, but I hadn't accounted for the possibility of copy-paste issues (mine is fine with it, at least if you use the right-click menu rather than keyboard shortcuts).

I think I told *you* this part already, but in general: for more on wget, see this manual.

I learned recently about Wpull, a wget-inspired scraper written by people tired of wget's inadequacies (notably, Wpull has much better rejection behaviour and does not keep its to-do list (which can get quite large) in RAM), and about an archiving-focused Wpull wrapper called grab-site. Still getting the hang of them myself, though.

Post a comment in response:

If you don't have an account you can create one now.
HTML doesn't work in the subject.
More info about formatting

If you are unable to use this captcha for any reason, please contact us by email at support@dreamwidth.org