You are viewing a single comment's thread.

view the rest of the comments →


[–] pewpewpewmoon 0 points 90 points (+90|-0) ago  (edited ago)


1) Don't run untested scripts on production servers

2) Don't run code you don't understand

3) Airgap your fucking backups

I hope this guy does go out of business. No one should trust someone this reckless and lackadaisical.


[–] ForgotMyName 0 points 41 points (+41|-0) ago 

I have never seen something this gloriously stupid... and I've seen people delete entire databases by accident. But at least we had on-site backups that required different permissions that we were able to restore. Worst case scenario, we had tape backups hidden away in a vault off site.

I won't even begin enumerating how many errors are simultaneously required in order to be able to completely erase all your servers and all your backups in a single strike.

Pure gold from the article. Just amazing. You have to work to do something that stupid.


[–] BentAxel 0 points 19 points (+19|-0) ago 

I am a simple person that used work in tech for many years. I am no way to the level of many of you. On my best day, with planning and assistance, I am not sure I could pull this off as glorious as this person has.


[–] roznak 0 points 3 points (+3|-0) ago 

Not really, inexperience.

As I experienced last year a new drive failed, then it turned out that my all my backups were corrupted. I ended up buying a NAS, only to discover that Windows 10 was snooping on it and did something wrong that basically crashed the complete NAS. By sheer luck I did have an off-line backup.

People do learn by mistake, this is such a mistake.


[–] multidan 0 points 16 points (+16|-0) ago 

If you are wondering if your backups are not secure enough, they need to be airgapped more. Stick them in a vault in the Vatican's archives, on a RAID, with multiple copies, some in archives with recovery records.

I feel bad for his customers, they had no idea he was acting this stupidly until it's all gone.


[–] Donbuster 0 points 7 points (+7|-0) ago 

Yup, I get anal about airgapping my backups. For the business I work for, I have a couple systems.

Live NAS for all our storage needs, holds tax data, customer info, and other records.

Nas that automatically creates incremental backup every 10 minutes of the customer order data, and incremental of everything else every 48 hours. Backups last 3 days.

System that has an independent copy of mission critical financial data. This one is updated weekly, and its drives are in a fireproof bombproof .etc safe, with a hole drilled out and caulked shut for sata and power cables.

A pair of drives in a different safe, one has a longterm backup and the other a short term backup of the data above. These drives are not connected to any system. They are never to leave the safe at the same time. I manually clone them from of the disks from the aforementioned safe system.

And if all that fails, an encrypted version of the data in a safe deposit box.

All this might be overkill for a small business that doesn't work in the tech sector. But it sure as hell should be the minimum for a web host. If all copies of your data are on powered up drives at the same time, at ANY time, you are doing something very, very wrong.


[–] fluffernuttins 0 points 1 points (+1|-0) ago 

And not just that. People forget that backups are worthless unless they actually exist. At least once a month you need to pull something out and try to restore it. You can do all the backups you want but if you're writing out garbage, you might as well not bother.


[–] TremorAcePV 0 points 6 points (+6|-0) ago  (edited ago)

Having not read the article, I am hoping it somehow came to DROP TABLES; or "sudo rm -rf /"



[–] ForgotMyName 0 points 9 points (+9|-0) ago 

Oh of course it was rm -rf /.

Guy wrote a script, didn't test it, threw it out in production on a system he uses to distribute them across all of his boxes, and it just dutifully burned through and deleted everything on every box. Computers are great like that, they generally do exactly what you tell them to do.


[–] thunder_fuck 0 points 2 points (+2|-0) ago 

We call him little Bobby Tables.


[–] Gargilius 0 points 2 points (+2|-0) ago 


TIL a new word. Thanks.