Is anybody working on archiving large parts of the internet…
Is anybody working on archiving large parts of the internet to the metanet?
e.g. https://bitcointalk.org
Let's chat.
Replies
BitcoinTalk is 28GB+ (uncompressed text and without pictures).
Good luck!
this can only be done in combination with other features.
comment on a specific post from an old platform and store it in a way that other people who do the same per website or platform can see it.
combine it in a unifying way that can be also viewed in combination across uploader.
. it's a tremendous amount of work and you will never have the complete set but only what people wanted to upload for whatever reason.
I agree. There is a challenging opportunity here to DRY data and its representation more intelligently as well. For example, de-composing data into objects: templates, posts, users. Not simply storing, but restructuring for efficiency and future re-use.