FM down... - Page 2

COUME · 7 Sep 2011, 05:34 AM

Problem is that this time some emails bounced and did not get queued

hmh · 12 Sep 2011, 01:59 AM

Quote:

Originally Posted by brong

We have redundant everything, but it's not redundant against one piece of networking hardware doing something really awful at the low level.

Brong, can you disclose the hardware that is having issues, and the final solution that was offered to you by the vendors involved at a later date? This kind of report is useful to those of us who also have to deal with the class of hardware used at FM. Your report about those WD disks with crap firmware years ago is still being extremely useful to many

brong · 12 Sep 2011, 03:31 AM

hmh - absolutely. As soon as we can tell, we will. I can tell you that the symptom is a vast flood of packets, and the solution is to kill the blade that's causing the problems by logging directly into the management console and powering it down.

Opera sysadmin have dealt with the same issue on other machines by disabling the ports on the switches instead of actually switching them off - we might try that next time too, so we have another "captive" host.

7 Sep 2011, 05:34 AM	#16
COUME Master of the @ Join Date: Apr 2002 Location: Twickenham, UK Posts: 1,306	Problem is that this time some emails bounced and did not get queued

12 Sep 2011, 03:31 AM	#18
brong The "e" in e-mail Join Date: Jul 2004 Location: Melbourne, Australia Posts: 2,696 Representative of: Fastmail.fm	hmh - absolutely. As soon as we can tell, we will. I can tell you that the symptom is a vast flood of packets, and the solution is to kill the blade that's causing the problems by logging directly into the management console and powering it down. Opera sysadmin have dealt with the same issue on other machines by disabling the ports on the switches instead of actually switching them off - we might try that next time too, so we have another "captive" host.