this post was submitted on 22 Aug 2024
263 points (97.1% liked)

Ask Lemmy

26628 readers
2656 users here now

A Fediverse community for open-ended, thought provoking questions


Rules: (interactive)


1) Be nice and; have funDoxxing, trolling, sealioning, racism, and toxicity are not welcomed in AskLemmy. Remember what your mother said: if you can't say something nice, don't say anything at all. In addition, the site-wide Lemmy.world terms of service also apply here. Please familiarize yourself with them


2) All posts must end with a '?'This is sort of like Jeopardy. Please phrase all post titles in the form of a proper question ending with ?


3) No spamPlease do not flood the community with nonsense. Actual suspected spammers will be banned on site. No astroturfing.


4) NSFW is okay, within reasonJust remember to tag posts with either a content warning or a [NSFW] tag. Overtly sexual posts are not allowed, please direct them to either [email protected] or [email protected]. NSFW comments should be restricted to posts tagged [NSFW].


5) This is not a support community.
It is not a place for 'how do I?', type questions. If you have any questions regarding the site itself or would like to report a community, please direct them to Lemmy.world Support or email [email protected]. For other questions check our partnered communities list, or use the search function.


Reminder: The terms of service apply here too.

Partnered Communities:

Tech Support

No Stupid Questions

You Should Know

Reddit

Jokes

Ask Ouija


Logo design credit goes to: tubbadu


founded 1 year ago
MODERATORS
 

Inspired by the very similar thread about school incidents.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 55 points 2 months ago (4 children)

Years ago I worked for a large-ish post production company. They had recently moved into a swanky new location and everything there was tailored to spec, including the server room. In norwegian we sometimes call a server room a ‘machine room’, this is relevant.

As a part of the server room spec, a dry fire suppression system was among the requirements.

The summer of the incident was particularly hot, and we experienced some trouble with our cooling, so a cooling technician was called to have a look. While he was working on the unit inside the server room, he made a mistake that caused all the cooling gas to dump into the room, triggering the fire extinguishers.

A dry fire system works by releasing an inert gas into a space to displace any oxygen, effectively choking any fire. I imagine this is usually done by some solenoids opening some canisters of gas and the room quickly, but gradually becomes oxygen free. Luckily, my boss at the time was present and he quickly got both himself and the tech to safety.

All good right? No. The contractor who constructed the new location had ordered and installed a system meant for maritime machine rooms, not the computer ‘machine room’ we had. In an environment filled with fuel and grease, you optimize towards filling the room with an inert gas as quickly as possible, and it turns out they use explosives to complete the task. In this room there were three canisters in the ceiling with fire shooting out of them, burning pellets to generate the inert gas. The gas and smoke from the canisters combined with the leaked cooling gas, and started condensing.

Into hydrochloric acid.

While all this was going on, all of the servers and workstations were happily humming along, sucking the now extremely corrosive atmosphere into themselves, making sure that every nook and cranny inside and outside got covered in a thin greasy film of acid.

The aftermath: Mine and two colleagues’s summer break was cut short, as we were called in to do damage control. Ripping out and wiping hard drives clean was what we did all summer. With external help we managed to recover all of the data. One feature film was delayed a few weeks. The insurance payout actually made the company a bit ahead financially. As far as I know there’s still burn marks in the floor of the server room, from when flames shot out of the fire extinguishers. Everyone involved now knows what a proper dry fire suppression system for a server room looks like.

The kicker is, the cooling was messed up because a fabric awning on the building had fallen down and was covering the air intake. If anyone had thought to check the roof this whole thing would have been avoided, and that server room would probably still have bombs attached to its ceiling.

[–] [email protected] 7 points 2 months ago (1 children)

Great story! Very well told. I can tell you must enjoy retelling it to newbies when they join the company :)

But wow, other than 2 summer breaks being cut short, it sounds like a good outcome. Especially considering no one was seriously hurt

[–] [email protected] 7 points 2 months ago

I’m not with that company anymore, but given the right audience, ‘that time the server room blew up’ is a big hit.

It could have gone way worse. A stressful lesson and a good story is best case scenario outcome when stuff hits the fan.

load more comments (2 replies)