Tumblr CrossPost:17decemberarchive: This is how the Archive Team is going to...
Posted in full at: https://ift.tt/2RFPuxp at December 06, 2018 at 09:16AM
17decemberarchive:
This is how the Archive Team is going to save Tumblr (and you can help us)
There is a website in trouble like Tumblr
We have hundreds of warriors machines, which run a special operating system made for archiving the web.
There is a tracker which is a central ToDo list worked on by each warrior. The warriors keep the files for archiving only for a moment before they hand them to the staging servers.
The staging server collect and process the data into huge .warc files which are accepted by archive.org
archive.org process and indexed our .warc files and makes them available in the wayback machine. It takes care of the long term hosting. Each TB stored costs somewhere between 1500$ and 2000$ in the long run.
Our minimum how much we will save is above 60 TBs. An estimate of the total size of the NSFW part of tumblr alone is 10-20 times that. Even when we will archive only a fraction it is going to be expensive. When you donate to archive.org today. Your donation will be matched.
You can help the Archive Team (which is not related to the nice guys at archive.org) by filling out this https://docs.google.com/forms/d/e/1FAIpQLSdoYnlweKF-5iQ2G0FB9s7pDV_Le61dDU-gMMDsc8CQ50YBjQ/viewform?hl=en form which is used to built the ToDo list stored by the tracker. We are looking for endangered blogs like NSFW blogs for example. If you know any that you would be sad be to loose please add them to the list. That way they will be saved.
Please share.
Tags:pdwcrosspost
Tumblr post (this is likely a reblog, and may have more pictures over there)
December 06, 2018 at 09:16AM
[A Dreamwidth post with
comments | Post or read on Dreamwidth| How to use OpenID]
17decemberarchive:
This is how the Archive Team is going to save Tumblr (and you can help us)
There is a website in trouble like Tumblr
We have hundreds of warriors machines, which run a special operating system made for archiving the web.
There is a tracker which is a central ToDo list worked on by each warrior. The warriors keep the files for archiving only for a moment before they hand them to the staging servers.
The staging server collect and process the data into huge .warc files which are accepted by archive.org
archive.org process and indexed our .warc files and makes them available in the wayback machine. It takes care of the long term hosting. Each TB stored costs somewhere between 1500$ and 2000$ in the long run.
Our minimum how much we will save is above 60 TBs. An estimate of the total size of the NSFW part of tumblr alone is 10-20 times that. Even when we will archive only a fraction it is going to be expensive. When you donate to archive.org today. Your donation will be matched.
You can help the Archive Team (which is not related to the nice guys at archive.org) by filling out this https://docs.google.com/forms/d/e/1FAIpQLSdoYnlweKF-5iQ2G0FB9s7pDV_Le61dDU-gMMDsc8CQ50YBjQ/viewform?hl=en form which is used to built the ToDo list stored by the tracker. We are looking for endangered blogs like NSFW blogs for example. If you know any that you would be sad be to loose please add them to the list. That way they will be saved.
Please share.
Tags:pdwcrosspost
Tumblr post (this is likely a reblog, and may have more pictures over there)
December 06, 2018 at 09:16AM
[A Dreamwidth post with
comments | Post or read on Dreamwidth| How to use OpenID]