hey4

A social media website that allows you to create, view and share high-quality user generated content.

Welcome guest


Join today, it's fun!
Create account or Log in

I Screwed Up at work and took down 2 states!


Views: 126
toby
57 days ago+1
Ok, Slight Exageration, but it did involve me screwing over 10 business spread over 2 states (3 Including SA)

Because my work hosts other peoples servers *Total of 10*, from LemSec to KiroKids in Ballarat and WISA, when our work goes down, they go down.
Anyways, I was asked to test a router on my computer to check if it works or not, so I did...Only, I accidently forgot to disable my second and third LAN connection, so the Router issued DHCP, along with our server.
As anyone with a half brain knows, 2 DHCP servers on a network is a bad idea as they conflict with each other.

So the router on my system issued DHCP with the Server, which caused the Server's DHCP Server service to hang, which hung the entire network, then the server hardlocked as it can't cope with 10 VM wares and a hang, as it is the VM's use all CPU and Ram.
So our only hope was to reboot the server, which takes 30 minutes as the DHCP Server service is on a delayed start for after the VM machines have loaded, which with 10 to load, power on and initialize, takes massive amount of time.

In the end, I caused 10 business, 13 include the ones located in our building *Geek, First Choice Accounting, OneEarth* to go down for 30 minutes, which means no Exchange Server for those 13, no remote clients, nothing.
Can't even do work which relates to the server.

As you can imagine, phone calls were flooding in after 10 minutes of being down, most of which I attended to and appoligised greatly...
Ohwells, it was a funny day, everyone at work was pissing them selves laughing *Of course I blammed Adam, who wasn't even there XD*
 
weesals
57 days ago+1
I once walked into a hosting companies HQ, took of my bag, and with a loud thud, blew up the entire building

However, i only took out 5 companies servers
 
toby
57 days ago-1
lol, I bet you

 
franko
57 days ago0

my day of work was pretty cool too.

i went to work - swept a building for a while went for a while. took a drive to the other side of town. sat on a lawn for an hour. loaded a safforld onto the back of a truck (was light as). was driven to the bosses house to unload the scaffold. didnt bother unloading the scaffold. was driven back to work swept for half an hour more. went home. end



EDIT: GOD DAMN IT! THIS IS TASMAN - I KEEP FORGETTING I'M IN FRANK'S LOGIN!

 
fezel
56 days ago+1
its because your post was crap, and made you look like a 5yr old.

but i wasnt the one that voted them down, i might tho

you are trying to make it sound like your in an elitist computer society, which you are not

 
weesals
56 days ago+1
quote: fezel
you are trying to make it sound like your in an elitist computer society, which you are not
i kinda agree when you say things like
quote: toby
As anyone with a half brain knows, 2 DHCP servers on a network is a bad idea
are you trying to say anyone who doesnt use a computer, is missing more than half a brain?

And not everyone knows that, most dont care how any of that works, they just plug in and it works, so they leave it alone.. Googling something/cisco/tafe/getting told it at work doesnt make you any smarter than the next person, it means you happen to be in the right place at the right time to learn this bit of information
*end rant*
 
jtmiller
56 days ago+1
quote: toby
Ohwells, it was a funny day, everyone at work was pissing them selves laughing *Of course I blammed Adam, who wasn't even there XD*

So you pass the blame on to someone for something fairly major you fucked up in, +(-1)
 
toby
55 days ago0
lol yup, it doesn't matter that they went down since it was only 30 minutes, and they didn't even care, its not like they couldn't type or the whole business ended
quote: weesals
Googling something/cisco/tafe/getting told it at work doesnt make you any smarter than the next person, it means you happen to be in the right place at the right time to learn this bit of information
*end rant*
Yes it does, cause If i google something you don't know about, then im smarter then you are at it, since iknow about it and you dont *Example*

But i never implied im an 'elitest' you guys just like to assume it, im sooory if i have a job that i enjoy and where i actualy learn stuff, rather then just raking up
quote: fezel
its because your post was crap, and made you look like a 5yr old.

but i wasnt the one that voted them down, i might tho

you are trying to make it sound like your in an elitist computer society, which you are not

Eh, your not one to talk, you think your all god aswell
 
fezel
55 days ago0
damn straight

and i think its good that your doing a job you enjoy. better than doing a shit job that your gunna come home every day depressed about


 
lambda
55 days ago+1
So, let me get this straight, you connected a dhcp server to a network, which was already possesed one that also ran
10 VMs, that caused the machine's dhcpd to crash/hang (I don't know the difference), which in turn slowed the system to a grinding halt
and you rebooted it without killing the process ('killall dhcpd') and restarting ('/etc/init.d/dhcpd start' or something similar)

Yep, sounds like vista, an utter lack of unix, skill and ergo, an utter n00b at the wheel.
Those companies have every reason to be Irate
 
toby
55 days ago0
lol few things there...
I connected a Router that issued DHCP, just didn't think at the time that they did that haha,
Second the entire Machine Hardlocked, not just the dhcp server process, and restarting the process would have meant all the dhcp clients attached would have needed to be reissued dhcp so the same IP was reissued to another device that may get connected *Restarting dhcp server process clears the dhcp table thingo as to what address have been issued.
And we use SBS 03 so 'killall dhcpd' wouldn't work
 

To create a reply you need a hey4 account.

Create account or Log in

Related topics

An open letter to whoever keeps "downing" my posts. newley build computer turns off after verfing dmi pool data appears on screen. Social Networking in Plain English The sunscreen song! Social networking website naming issue

  Home - Stats - Terms of Service