(no subject)
Oct. 19th, 2021 12:21 pm![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png){kind=small}
brin_bellwayAnyone have access to a computer with 24+ GB of RAM and willing to try running a WARC-to-WACZ conversion for me?
22.1 GB of glowfic is far too much for ReplayWeb to handle in WARC form. (Even if I had thought to exclude individual files above 50 MB on the grounds that something like that wasn't going to be worth its space, it would still be around mid to high teens.) The WACZ conversion ran for a while, consuming more and more RAM, then crashed: I suspect it was attempting to hold the entire file in RAM, and failed because I only have 16 GB.
I can get you the file in either original or 7-zipped form, depending on how much you value [reducing the amount of data you have to download] vs [not having to unzip it in order to work with it]. (The 7-zipped version is 17.8 GB.)
22.1 GB of glowfic is far too much for ReplayWeb to handle in WARC form. (Even if I had thought to exclude individual files above 50 MB on the grounds that something like that wasn't going to be worth its space, it would still be around mid to high teens.) The WACZ conversion ran for a while, consuming more and more RAM, then crashed: I suspect it was attempting to hold the entire file in RAM, and failed because I only have 16 GB.
I can get you the file in either original or 7-zipped form, depending on how much you value [reducing the amount of data you have to download] vs [not having to unzip it in order to work with it]. (The 7-zipped version is 17.8 GB.)
