topics that matter; ideas worth sharing

share a tip, submit a link, add something new

San Francisco Web host explains cause of power failure

August 1, 2007, 05:03 PM —  IDG News Service — 

A Web hosting company Wednesday cited a faulty controller as the reason its backup electrical system failed during a San Francisco power outage last week, dousing the Web sites of several customers.

Service was interrupted to 40 percent of 365 Main Inc.'s customers on July 24 when an electrical surge caused Pacific Gas & Electric Co., the local utility, to shut off power. Three of 10 backup generators failed to start at 365 Main as expected and the Web sites Craigslist.com, Red Envelope.com, Yelp.com, Technorati.com and others went down for about 45 minutes.

365 Main traced the generator failures to a weakness in a controller in back-up diesel generators. An incorrect setting on the device -- called a DDEC, for Detroit Diesel Electronic Controller -- was not allowing it to correctly reset its memory. Erroneous data left in the DDEC's memory subsequently caused the diesel generators to misfire or fail to start, the company said.

365 Main corrected the settings on all the generators at its San Francisco data center and at another center it operates in El Segundo, California, because both use the same model of generators from Hitec Power Protection Ltd. Three other 365 Main data centers use other Hitec models.

The power outage resulted in 365 Main breaking service level agreements it has with its client Web sites and 365 Main says, as a result, it will refund a portion of the monthly Web hosting fee the clients pay. Miles Kelly, vice president of marketing and strategy at 365 Main, declined to specify the amounts being refunded.

Even with last week's outage, the San Francisco data center has delivered 99.9942 percent uptime, but that's no consolation to clients whose Web sites were out of service, said Kelly.

"What we learned from this is that there remains a delta between any number of nines and perfection," he said.

» posted by abennett

IDG News Service

I like it!
Post a comment
The content of this field is kept private and will not be shown publicly.
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd>
  • Lines and paragraphs break automatically.
Resources
White Paper

Symantec Backup Exec 12 and Backup Exec System Recovery 8 deliver industry leading Windows data protection and system recovery. Download this whitepaper to find out the top reasons to upgrade and how to get continuous data protection and complete system recovery.

Webcast

Data and system loss — from a hard drive failure, malicious attack, natural disaster, or simple human error — can happen anytime. Don’t leave your business vulnerable. Make sure you have a secure recovery strategy in place. Symantec's latest backup and system recovery technology can efficiently restore critical applications, individual emails and documents and even restore your entire system in minutes in the event of a loss.

White Paper

Businesses face a growing challenge to ensure that the IT environment is properly protected. Backup Exec 12 integrates with other applications in the Symantec family of products, to complement your current data protection strategy, keep your data securely backed up and make it recoverable when you need it most.

Free stuff
Featured Sponsor

AISO founders envisioned a Web hosting company that was environmentally friendly. While the company employed energy-efficient innovations like solar panels, its infrastructure produced unacceptable power and cooling requirements. Find out how AISO leveraged AMD technology to overcome their challenge in this case study white paper.

In this whitepaper, Scalar explores the opportunity to change the landscape with respect to mission critical databases built around Oracle. Leveraging technologies such as Linux, high-end commodity processing power and Oracle RAC technology to architect, design, build and maintain database infrastructure that delivers maximum availability, reliability and performance at a fraction of traditional cost.

On a typical day, weather.com, the Web site for The Weather Channel in Atlanta, serves up between 15 million and 20 million page views. But in September 2004, when back-to-back hurricanes ransacked Florida, the peak traffic on one day more than tripled: over 70 million page views by more than 7 million unique visitors. Read the full success story now.

More Resources