Get ready to Donate to their legal defense fund
It it long past overdue for the Internet Archive to move to the EU or Switzerland or something.
Would be best if there were several mirrors in several countries. It's unfortunately too large to realistically host via crowd sourcing. The best you could do is something ala Storj where fragments are redundantly distributed across various hosts.
you’re right and you should say it but it makes me sad
As long as money still means something after Elon is through with the Treasury...
We are screwed if the Internet Archive goes down, right?
Seems like a huge point of failure for one entity.
Agreed, I think the biggest issue though is just scale. It’s over 100 petabytes of data. Not outside the realm of big cloud providers to mirror, but they don’t really give a shit. It would require some sort of significant distributed software solution for the community to work with. Not impossible, but as far as I know, nobody’s taken up the mantle yet as I think it would need custom software just to begin the solution of how to distribute it as a sharded set of community mirrors, different people just mirroring individual pieces.
So about 104,857,600 GB? You'd need 105,000 people with 1 TB each to save that. Or...
Assuming you bought 30 TB SSDs, you'd need about 3,500 of those, costing €80 each.
That'd be €280k, but let's round it to €300k.
If every person spent €960 (or €80 per month), then each person could get 12 of those SSDs. You'd need 8,750 people to do that.
Should be doable if crowdfunded by a community, or if you had some big donor. Then you'd need to connect it.
I will grab this torrent when I get home and make it a permanent seed, alongside the one outing nazis in Patriot Front.
Shit good idea, didn't even know you could do this.
What else should we seed? I've got a homelab and am eager to put some storage to use for something like this.
Was there a mailing list or other identifying docs in that pf leak or was it just chats and stuff?
Not sure if it's the same leak, but if it's PatriotFail, it's even got videos.
Watch the marching drill one for a good laugh. https://xcancel.com/alt_uscis/status/1549969687999553539
I appreciate you doing this!
Glad you said so. I completely forgot that I needed to grab this once home. It is now active. Once it's done downloading, I'll keep it seeding forever, since I have no bandwidth cap. Cheers.
hi spujb. Only 98gb? I can mirror that 🤷♀️
e: https://kate.fail/cdc_2025_01_28/archive.org/download/20250128-cdc-datasets/
I suggest also mirroring on https://academictorrents.com/
I'm gonna download it when I get home and put on a few USBs. They won't be connected to any device and will be stored in safes.
Can't remote wipe data that's not connected.
The more backups of important information we have the better.
Based kate
The best Kate
🚨 BIG NEWS Y'ALL! 🚨
Someone just saved ALL the CDC's public data before it could disappear! 🦅
What's the Deal?
Some mystery hero downloaded everything from the CDC's website (that's 98 GIGABYTES of health info!) and uploaded it to the Internet Archive on Jan 28th. Think of it like making a backup copy of your phone before it breaks!
Why Should You Care?
- This is YOUR health data - stuff about vaccines, diseases, and public health that your tax dollars paid for! 🏥
- Once this info is gone from CDC's website, it could be really hard for your doctor to get important updates
- Researchers need this to keep studying ways to keep Americans healthy 💪
What's Next?
Smart folks at places like Harvard are making sure this data stays safe by keeping copies. It's like having multiple backups of your family photos - can't be too careful!
Remember folks: Knowledge is power, and someone just made sure we didn't lose a whole bunch of it! 🎯
#SaveTheData #PublicHealth #AmericanRight2Know
Source: Internet Archive upload by anonymous user on Jan 28, 2025 Post by Ed Summers (@[email protected]) - Feb 3, 2025
As a reminder, AI generated content is against the rules in this community—see the sidebar. I appreciate your instinct to bring some quality content to this space, but let’s please keep in mind that genuine interaction with diverse voices is what makes this community beautiful. :)
My reasoning:
- You have personally admitted to writing AI comments in the past: https://sh.itjust.works/comment/16482371
- Heavy use of markdown headings, bullets, and section dividers is a common pattern in LLM output
- Use of “it’s like” or “it’s about” phrases as the conclusion to a paragraph are very common in LLM models like ChatGPT
- Verbatim replication of content from my original post that is common in LLM output and highly indicates an LLM was instructed to create something based on the text of the original post
- Use of 🎯 emoji does not match context
- “100% AI generated” response on multiple AI detection websites (GPTZero, Quillbot)
Any single one of these facts would not lead me to comment, but with all of it combined it makes a pretty strong case. Thank you for your contribution to this community but please let’s keep it genuine in the future! We love and appreciate the real you :)
it's weird that I learned of this through this community and not a security or health community. something to look into tomorrow
well and truly based
Good thing they’re based far from the US in… oh.
Because the feds didn't already have it out for IA.
How would you recommend someone go about archiving important parts of the IA? Just external drives?
The Internet Archive is, and I really want to emphasize this, Fucking Huge. If you want to help archive it, every upload has an associated torrent you can download and help seed. Torrenting itself isn't illegal, only torrenting illegal stuff like copyrighted movies. You can buy a relatively cheap refurbished HDD of whatever size you want, set up qBittorrent, and torrent the uploads that you want to make sure are available even if the Internet Archive has to take them down or has a critical data loss failure.
Thank you so much for the advice! I want to preserve important documents like the bill of rights and the constitution, as well as sexual education material, especially stuff pertaining to women and reproductive health. Also banned books. Things the facists are trying to purge and things that are important to me.
i’m not smart enough for this but maybe look to communities like r/DataHoarder to get started
Was this previously public data? Not illegal to download an torrent, right?
from the linked page
Excludes corrupt datasets and data not publicly accessible.
it sounds like it's only stuff that was already publicly available tho
Some of the publicly available data is disappearing under the new administration. Most notably information about COVID, long COVID, vaccines, and bird flu is disappearing. Presumably, this data dump contains the missing data.
key word was
Time to download all of it!
Same, especially before the inevitable attacks on the Internet Archive to come. Who knows what nonsense will be in the works to try and get this removed, or the whole project shut down in the coming years.
Inb4 it gets DDoS'd again
