this post was submitted on 12 Sep 2024
470 points (97.6% liked)

Technology

60016 readers
2757 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS
 

My father told me he wanted to make USB flash drives of all the scanned and digitized family photos and other assorted letters and mementos. He planned to distribute them to all family members hoping that at least one set would survive. When I explained that they ought to be recipes to new media every N number of years or risk deteriorating or becoming unreadable (like a floppy disk when you have no floppy drive), he was genuinely shocked. He lost interest in the project that he’d thought was so bullet proof.

top 50 comments
sorted by: hot top controversial new old
[–] [email protected] 88 points 3 months ago* (last edited 3 months ago) (6 children)

I explained that they ought to be recipes to new media every N number of years or risk deteriorating or becoming unreadable

This is important, and for some media, it should be more often than that.

People forget that flash memory uses electrical charge to store data. It's not durable. If left unpowered for too long, that data will get corrupted. A failure might not even be visible without examining every bit of every file.

Keep backups. Include recovery data (e.g. PAR2). Store them on multiple media. Keep them well-maintained (e.g. give flash drives power). Mind their environment. Copy them to new storage devices before the old ones become obsolete.

It's funny that with all our technology, paper is still the most durable storage medium (under normal conditions) that doesn't cost an arm and a leg.

[–] [email protected] 24 points 3 months ago

It's funny that with all our technology, paper is still the most durable storage medium (under normal conditions) that doesn't cost an arm and a leg.

Sophistication often creates fragility. The human mind marvels at sophistication naturally; appreciation for resilience usually only comes after that fragile thing has broken. Of course it's too late by then.

All them young whipper snappers will continue to learn these life lessons the hard way, it seems.

[–] [email protected] 16 points 3 months ago (1 children)

If I had a cent every time an artist on patron had their computer die on them and lost works in progress or all their old stuff... I'd afford a few coffees.

load more comments (1 replies)
[–] [email protected] 12 points 3 months ago (1 children)

Tape backups, baby.

No, I don't have a library of those. I don't even have a tape drive.

load more comments (1 replies)
[–] [email protected] 11 points 3 months ago

Anything important, I write on clay tablets.

load more comments (2 replies)
[–] [email protected] 76 points 3 months ago (2 children)

This is where "piracy" is actually the industry's saving grace. Decades or centuries later, will record labels exist and be well-managed (and flush with cash) enough to preserve archival copies of their artists catalogs? Probably not.

Will obscure weirdos exist all around the world on Usenet, IRC, or seeding torrents? Possibly.

[–] [email protected] 27 points 3 months ago (2 children)

What is really being discussed here is archiving of master recordings and session files. The publically avaliable releases themselves aren't really in jeopardy. Orthough piracy probably does provide an extra layer of security to more obscure releases.

[–] [email protected] 16 points 3 months ago (2 children)

I thought I read somewhere that when they were making one of the Toy Story movies, there was some catastrophic data loss that nearly tanked the whole production. But then one of the animators came back from maternity and said wait, I think I have most of it synced to my home server? And the next thing you know, John Lasseter himself is barrelling down the highway to her place and it turned out yeah, she did have it.

load more comments (2 replies)
load more comments (1 replies)
[–] [email protected] 24 points 3 months ago

Many films and tv programs survive only thanks to a total stranger keeping their own copy. For a long term survival of any media it has to be copied and distributed far and wide.

[–] [email protected] 71 points 3 months ago* (last edited 3 months ago) (11 children)

There is no "write and forget" solution. There never has been.

Do you think we have ORIGINALS or Greek or roman written texts? No, we have only those that have been copied over and over in the course of the centuries. Historians knows too well. And 90% of anything ever written by humans in all history has been lost, all that was written on more durable media than ours.

The future will hold only those memories of us that our descendants will take the time to copy over and over. Nothing that we will do today to preserve our media will last 1000 years in any case.

(Will we as a specie survive 1000 more years?)

Still, it our duty to preserve for the future as much as we can. If today's historians are any guide, the most important bits will be those less valuable today: the ones nobody will care to actually preserve.

Citing Alessandro Barbero, a top notch Italian current historian, he would kill no know what a common passant had for breakfast in the tenth century. We know nothing about that, while we know a tiny little more about kings.

[–] [email protected] 15 points 3 months ago

Do you think we have ORIGINALS or Greek or roman written texts?

In some cases we do. For example, the documents at Pompeii, those at Qumran, and other rare instances where documents have been preserved from the time they're written. It's also true that we have far more copies than originals, and that we've lost most of the works of many ancient authors.

[–] [email protected] 7 points 3 months ago (7 children)

There is: mdiscs. Allegedly 1000 years durability even in Blu-ray format. Should be good enough for most important things. The best tapes AFAIK 30- 100 years

load more comments (7 replies)
load more comments (9 replies)
[–] [email protected] 54 points 3 months ago (10 children)

Yeah if you're looking for long term it needs to be archival media. Many people think the flash drive will hold it forever but they are potentially the most fickle.

[–] [email protected] 20 points 3 months ago (12 children)

But what actually is "archival"?

Like, what technology normal person has access to counts at least as enthusiast level archival?

Magnetic tape, optical media, flash, HDD all rot away, potentially within frighteningly short timeframes and often with subtle bitrot.

[–] [email protected] 23 points 3 months ago (2 children)

1960s style punch cards. Made of concrete.

[–] [email protected] 22 points 3 months ago (3 children)

I write these words in steel, for anything not set in metal cannot be trusted.

[–] [email protected] 14 points 3 months ago (1 children)
[–] [email protected] 7 points 3 months ago (1 children)

Can't spell trust without rust

load more comments (1 replies)
load more comments (2 replies)
load more comments (1 replies)
[–] [email protected] 16 points 3 months ago (1 children)

M-DISC, at a guess. The media would last long enough at least for grandkids, who will have bigger things to worry about.

[–] [email protected] 10 points 3 months ago (5 children)

Don’t forget, you also need drives that work that long and connect to computers or some other device to utilize the bits, and the bus they use must be available and working, and the disk format they’re written in must be readable, and the images themselves encoded with an algorithm that we still have access to, etc. it’s not just the media.

I think it’s possible, thanks to the retro enthusiasts, we still have access to some things from the 70s and 80s, but they’re getting fewer and fewer, especially in a working state. That’s only 50yrs ago. What happens when you want to go 100? Or 500? A few thousand? We are familiar with journals from the Civil War, and have found items and notes from Egypt, Roman, and Ancient Greek civilizations, how can we preserve what happened in the currently information rich time we live in, for future generations? Especially as much of it migrates online to blog posts and social networks and news sites that eventually shut down due to corporate issues or shifting internet traffic?

load more comments (5 replies)
[–] [email protected] 9 points 3 months ago (3 children)

Probably M Disk as others have said for consumer use, but Microsoft is working on storing data in glass that could last for potentially 100,000 years +. Not that you’d ever likely have that in your home. Although, maybe by 2100 we will, who knows. https://www.microsoft.com/en-us/research/project/project-silica/

[–] [email protected] 6 points 3 months ago

This is really the only way. Ironically not far off clay tabs just much much smaller.

load more comments (2 replies)
load more comments (9 replies)
load more comments (9 replies)
[–] [email protected] 31 points 3 months ago (23 children)

Im really hoping, waiting, for a good dense long-term storage medium. It doesn't have to be fast, but large, cheap, and durable. I want a way to backup my plex library, or even, daily backups of documents and project files, and I don't want to think about them ever again.

[–] [email protected] 19 points 3 months ago

It does has to be fast enough that you can transfer the files to a different disk within your lifetime.

[–] [email protected] 15 points 3 months ago (2 children)

Tape is cheap and durable if you store it properly. Except the tape drive is expensive af.

Microsoft is working on glass storage. A glass plate can last 10,000 years according to Microsoft. Hopefully that tech will get miniaturized and available to consumers within our lifetimes.

[–] [email protected] 8 points 3 months ago (2 children)

As a former audio engineer in the days where we still used it- tape can rot.

load more comments (2 replies)
load more comments (1 replies)
load more comments (21 replies)
[–] [email protected] 30 points 3 months ago (3 children)

To me, this is just another story of the music industry's technical incompetence.

Even in the 1990s, everyone would have known that hard drives were not a long-term archival storage solution. This is like crumpling up a piece of paper, tossing it in the corner, then being upset decades later when your "archival solution" had issues.

[–] [email protected] 14 points 3 months ago (2 children)

The piece of paper is basically much more likely to survive in a corner barring a fire. I have crumpled pieces of paper from 20 years ago. My PATA hard drive... I don't even have a computer with that connector

[–] [email protected] 7 points 3 months ago

A bunch of paper tossed into a corner could get wet, mouldy, get munched on by rats, etc. But, I know what you mean. Spinning plates full of magnetized bits with a connector technology that only lasts a decade at most is hardly going to be reliable, even if stored under ideal conditions.

load more comments (1 replies)
[–] [email protected] 8 points 3 months ago

I'm sure they considered anyone telling them they needed to spend money to be a pain in the ass the same way companies don't follow the recommendations of their IT departments.

load more comments (1 replies)
[–] [email protected] 25 points 3 months ago (1 children)

It's not a bad start though, and how hard would it be for the people who have surviving copies to copy it to "the next best new thing" in 10 years? The problem is of course that sequence would need to be continued on, like a tradition, which is doable as well.

load more comments (1 replies)
[–] [email protected] 22 points 3 months ago

how music is so complicated to archive now

??

[–] [email protected] 19 points 3 months ago (7 children)

That's why I back up my data on stone tablets in Cunieform.

Seriously though, if you wanted data to last for centuries, what would be your best bet? Would it be some sort of 3D-printed mechanical storage? At least plastics are generally not biodegradable, though they are photodegradable, so I guess you'd want to stick your archive in a dry cave somewhere?

Or what about this idea of encoding the data in the DNA of some microbe and cutting it loose? What could possibly go wrong?

[–] [email protected] 12 points 3 months ago (2 children)

Please stop that, DNA is good for mutations, not for long-term consistency.

load more comments (2 replies)
load more comments (5 replies)
[–] [email protected] 17 points 3 months ago

Well, nothing lasts forever. I'd say distributing them on something that lasts 10+ years is better than doing noting. Otherwise they just get lost, buried in the attic or the next harddrive crash takes them.

[–] [email protected] 15 points 3 months ago (5 children)

I got four HDDs, some are almost 10 years old. They work great but I know that won't be for forever.

load more comments (5 replies)
[–] [email protected] 11 points 3 months ago* (last edited 3 months ago) (1 children)

In my life I've had several HDD's and SSD's fail on me. None of that shit lasts forever and you would honestly be surprised how often they fail. For huge servers like data centers the average failure rate is between 1% and 2% per year, and sometimes even higher. They literally have to replace hard drives on a daily basis because of failure.

Disk failure is one of the reasons I have copies of all of my important stuff saved to every hard drive on my computer, along with an external just in case. One time my system drive failed and I couldn't save anything because my operating system stopped working. Had to reinstall the OS and do a data recovery. Ended up with a bunch of photos that were corrupted, distorted, or missing half the photo.

load more comments (1 replies)
[–] [email protected] 9 points 3 months ago (6 children)

Buy Spinrite. It's not perfect but it's the best thing available for drive maintenance and recovery. I have used it for over 10 years. If the drive is dying it'll take forever, but I've recovered data that was nearly gone due to sector loss. It goes down to the bit level BTW. Someday Steve will release v7 .. someday.

[–] [email protected] 7 points 3 months ago

This is the first time I've seen anyone else talk about SpinRite, known about it a long time too

load more comments (5 replies)
[–] [email protected] 8 points 3 months ago (1 children)

These people haven't heard of zfs then?

load more comments (1 replies)
[–] [email protected] 7 points 3 months ago (3 children)

My system is to duplicate to fresh media once in a while. It's more hands on, but it's the only option I have. My NAS will be cloned to new drives in the next few years.

load more comments (3 replies)
load more comments
view more: next ›