this post was submitted on 18 Jun 2024
1466 points (98.3% liked)
Technology
60033 readers
2871 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Hey guys not to be a downer but like…what DO we do when a federated instance goes down and takes all its content with it?
If you search back far enough on some lemmy instances that have defederated others, you'll find ghosts of old content from those defederated servers, but it's all local to whatever instance you're viewing it on. A large amount of the content from the server that went down should also exist on the servers that server was federated with.
These lemmy instances have got to start running out of storage though, I haven't heard of any kind of automated purging. I'd bet someone somewhere is already working on an archive lemmy.
Speaking explicitly of text, they can likely be compressed to an insane degree instead of purged, if someone wanted to. For comparison, the entirety of Wikipedia (text only) is ~22GB.
Just for context, the full database of feddit.uk compresses down to about 4GB. I am not sure what's going to happen to the ghosts long term, but I don't think storage will be a huge issue.
Use S3 and pay up, don't worry you're almost never running out of storage
Same as when one of the big name hosting companies takes a site down. You hope it's archived, and if it was important enough to you, hopefully you saved it to your personal server.
What you're describing is a major benefit of federation. Any site can be taken down. But when a federated server goes down it's because the site owner exercised their control over their own data. If Google or Amazon takes a site down, you lose your data, but they keep copies to use however they want.
So this pretty much happened with feddit.de
The admin took off for a business trip and his backup forgot the password and locked himself out. Now the admin seems to have vanished and the server shit itself, making all previously posted pictures unavailable.
The solution is that a bunch of lemmings are forming a "Verein" (Kind of Like a club I suppose?) and will build an entirely new German instance.
So, it's not pretty.
If someone hasn't written a software package to do so already, it's probably possible to write one to dump and clone all the comments and posts on a server.
The comments fortunately are still there, but the images are all gone. They had some trouble that was image-related which led to the server collapsing at some stage. I can't recall the specifics unfortunately.
Are those posts/comments/images available on other instances?
If an instance just shuts down, we just lose all that content? Sounds like a pretty fatal flaw.