|
Title: Hard drive failure - resolved Post by: kris on May 06, 2008, 06:49:42 am The Virtualmeet.net server crashed the night between Saturday and Sunday my local time. The problem turned out to be corrupted sectors on one of the two hard drives that caused an essential system directory to be corrupted. The server has been up and running 24/7 since 2005, so frankly it is not very surprising that one drive had enough. Unfortunately, the data was also corrupted on the healthy fallback drive.
I had both drives replaced and restored all system services from the latest backup. Unfortunately, the downloading speed from the backup server was very slow causing the 15GB backup to take 12 hours to transfer. To top that off, I accidentally deleted the backup file and had to download it again (luckily at somewhat better speeds). The system went down as the nightly backup was being transferred to the backup server, so the latest available backup was some 20 hours old. It is possible that a few posts were lost, apologies if so. In any case, we are now back on fresh drives and ready to kick off the May bench meets. I will update all lifters today. Thanks for your patience! :) EDIT: This announcement was reposted after an additional database restore and will appear as a new topic to those who already read it earlier. |