I want to create torrents of my entire NASA/Astronomy/Spaceflight Mission data/image/video collection consisting of over 57.12 terabytes. Would you be interested if i did?

[Astra Infinitum]

I have over 57 Terabytes of data (and constantly growing) I've hoarded over the years from NASA and other Astronomy, Astrophysics, Spaceflight, etc. resources. I've acquired most of it from thousands and thousands.... and thousands of places across the internet over the last 15-20 years. I've ben asked countless times to compile it and put it online somehow for people to acces and download it. I have thousands and thousands of PDF documents, images, notes, test results, and more starting from the Mercury program all the way through Artemis I and present day 2023. I have Documents and Manuals on nearly every Rocket, capsule, module, flight test, mission, mission briefing, science data from missions from Mercury to Gemini to Apollo To Shuttle to ISS, until present day 2023. I have engineering drawings of rockets, spacecrafts,  capsules, satellites, and more from Redstone to SLS. I have the entire Apollo image collection in high resolution .tif images from every roll of hasselblad film on every Apollo mission. Shoot I literally have over 400gb of just Apollo Lunar Sample collection images, reports, research, and data alone. Almost everything from everywhere is in extreme high resolution. I have extreme high resolution images of every photo taken by Hubble, Cassini, Juno, and more in .tif  and other formats as well. I have every single thing from Apollo- every document ever made nearly, i kid you not like everything from the first project to do with the Apollo missions down the the last document from Apollo missions to the audio files and  typed transcripts of everything from astronauts to mission control from every mission, digitized film camera images, and just everything you can think of including all the Rockets, capsules, LM, Lunar rover, manuals, drawings, Flight plans, guidance system manuals, I can literally go on and on and on and on and on and on and on and on. I have bits and pieces of astronaut photos and videos from dozens and dozens of space shuttle missions.

I have scanned PDFs of hand written notes from Mercury, Gemini, and Apollo astronauts as well as NASA engineers

I have hoards of raw data and high res images (from spacecraft that had imaging cameras/instrumentation) from 50+ space craft and missions/surveys/ect like Hubble, Kepler, TESS, K2, WASP,   Cassini (also every Cassini image), Juno, New Horizons, Gaia, Digitized Sky Survey, and more.

A large amount of all the data from MAST which has all the image and data from Hubble, Webb, TESS, Nancy Grace Roman, the ones i also had just named above and more. I also a trove of the special apps and software, code, scripts, special file viewers , and more that you need to work with or view alot of the data from alot of these missions.

A large amount of the data and images and catalogs from Simbad and VizieR and anything you can view in/through Aladin sky atlas.

Every image and video file from NASA SDO - Solar Dynamics Observatory for about 2-3 years, currently.

I have endless high res images, planetary maps, surface maps, and data from every planet from USGS and other sources

All data from NASA exoplanet archive up to 12-2022

I also a trove of the special apps and software, code, scripts, special file viewers , and more that you need to work with or view alot of the data from alot of these missions.
 

I leave it at that bc i could never stop explaining everything ive compiled. 

 

But i've said all that to say this: I've been asked by many people over the years to put it online somehow so people can access and download all of it. I've recently been trying to first organize everything a little better because its so all over the place. But what i think i will do is once everything is very neatly organized i would like to split into many different categories and in groups/files that i will make into torrents. I would like for no torrent file to include more than 50gb, that way people can choose what they want to download and not be forced to have to download 100s of gb or TBs of data only to get a few things in there that turns out to be a fraction of the entire torrent. Ive never actually created a torrent so I gotta go learn how to do that first but that should be quite easy.

 

Anyone else have any ideas on ways to compile everything to put online for people to download safely? Any ideas besides breaking it all down into torrents? I own a handful of domains and have access to storage servers

 

And last question: is all this something that would greatly interest any/all/some users on this forum? My guess would be yes but i wanted to ask anyway. 

 

Also feel free to offer to help. Idk how we can go about it yet but il figure something out bc its gonna take awhile to do all this.

[Shpaget]

Wow.

Do you have it indexed? Such a huge amount of data is of little use if it's impossible to navigate.

[Nuke]

torrents really only work if you can find regular seeders with big storage. id be hard pressed to find 10tb of storage in my entire house. i got 8tb on my main rig and nas alone and a lot of 512 gig drives in all my other machines. and most of that space is allocated to operating systems, software, and data not to mention a good half is backup. you might find some data hoarders with more storage. 

you might be better off uploading the video to youtube, monetize it (at least ask for donations) and use the proceeds to fund cloud storage for the non-video data. science has always had this problem of finding long term archival storage for their data. we really need a new rom standard that has some serious density behind it. there was that 5d holographic storage thing in the news around back, but i doubt that's something you can just buy a drive for.  tape works but you have to periodically check for degradation. 

Edited January 31, 2023 by Nuke

[Gargamel]

There’s a few places that can easily handle that much data.    NSA, Google, Amazon, NASA…. One of them might have an interest in archiving research data.     Try reaching out to their publications relations people and see if they could put you in contact with somebody inside the agency who might be interested in helping out.  

[AckSed]

Wow. That's a small-scale data centre's worth.

Ask the Internet Archive?

https://archive.org/about/contact.php

For example, they helped with (partial) digitisation of the Prelinger Archives, a 60,000-strong collection of film ephemera.

And of course I'm interested. I just don't have the storage space!