• About Us
  • Partnership Opportunities
  • Privacy Policy

Data Center Frontier

Charting the future of data centers and cloud computing.

  • Cloud
    • Hyperscale
  • Colo
    • Site Selection
    • Interconnection
  • Energy
    • Sustainability
  • Cooling
  • Technology
    • Internet of Things
    • AI & Machine Learning
    • Edge Computing
    • Virtual Reality
    • Autonomous Cars
    • 5G Wireless
    • Satellites
  • Design
    • Servers
    • Storage
    • Network
  • Voices
  • Podcast
  • White Papers
  • Resources
    • COVID-19
    • Events
    • Newsletter
    • Companies
    • Data Center 101
  • Jobs
You are here: Home / Colo / Generator Catches Fire, Causes Lengthy Data Center Outage at WebNX

Generator Catches Fire, Causes Lengthy Data Center Outage at WebNX

By Rich Miller - April 7, 2021

Generator Catches Fire, Causes Lengthy Data Center Outage at WebNX

The exterior of ther WebNX data center in Ogden, Utah. (Image: Google Maps)

LinkedinTwitterFacebookSubscribe
Mail

An emergency generator caught fire at a data center in Ogden, Utah over the Easter weekend, causing the full shutdown of the data center and lengthy outages for customers. The incident at a WebNX facility comes a month after a more serious fire that destroyed an entire OVH data center in Strasbourg, France.

Dedicated server hosting firm WebNX says a backup generator experienced a “catastrophic failure” Sunday afternoon, and fire officials opted to cut power to the entire building. The company says a small number of servers may have suffered water damage as emergency crews battled the generator fire.

“Sunday afternoon the city power was disrupted and, as designed, our backup generators automatically switched on,” the company said. “However, during that transition, one of our backup generators that had been recently tested and benchmarked specifically for this situation experienced a catastrophic failure, caught fire, and as a result initiated the fire suppression protocol.

“Customers servers in one of our main bays were exposed to water and possible damage may have occurred,” WebNX added. “No fire damage was inflicted on customer servers. The majority of hardware in the entirety of our data center was spared, but there are machines that need to be inspected for water damage, and possibly rebuilt.”

WebNX has been providing regular customer updates through its Facebook page and web site and said it is still working on restoring full power and restarting customer servers. As of Wednesday afternoon, the company said many servers were back online, and that they were working through issues on remaining servers that were damaged in the incident.

“The majority of hardware in the entirety of our data center was spared, but there are machines that need to be inspected for water damage, and possibly rebuilt,” WebNX said in an update Wednesday. “Timelines are difficult to predict at any stage and many clients’ servers won’t be back online for several weeks.”

“If you are unable to access your server, it can be assumed it is currently down and will remain so until it can be inspected for any damage in the coming weeks. We are optimistic that the vast majority of data stored on these servers is recoverable. Several servers racked in the vicinity of the incident have resumed operation without trouble.”

The company’s roots date to the early Internet BBS days, and it launched its web hosting operation in 1999. The company operates data centers in Downtown Los Angeles and in Ogden, where it has a 100,000 square foot data center.

Fire Risk and Lessons for the Data Center Industry

The incident, which was first reported by The Register, comes a month after an OVH data center was destroyed by fire, with a second data center on the campus ultimately being shuttered due to damage from the fire.

The March 9 event in France also has caused extended downtime for customers, as fire officials turned off for the entire four-building campus. Once the site was secured, OVH began a cleanup effort with plans to restore service at the remaining three data centers.

Free Resource from Data Center Frontier White Paper Library

colocation
Innovation in Colocation
Data centers are constantly being asked to improve their agility, accommodate higher densities, and meet or exceed the sustainability and environmental goals of their customers. Future Facilities presents a case study of how Thésée DataCenter used a digital twin to drive innovation at their colocation data center.
We always respect your privacy and we never sell or rent our list to third parties. By downloading this White Paper you are agreeing to our terms of service. You can opt out at any time.

Get this PDF emailed to you.

Fires that consume an entire data center building are rare due to the industry’s standard use of data center fire suppression technology, which is designed to detect smoke and then deploy suppressants (either water or chemical agents) to extinguish the fire and contain the damage to a small area.

But the WebNX event will likely intensify the data center industry’s efforts to re-evaluate assumptions about fire protection in the wake of the fire at OVH. On this front, two recent columns are worth noting:

  • In Learning From the OVHcloud Data Center Fire, Andy Lawrence of The Uptime Institute says there have been 25 data center fires in recent industry history, including 11 which have not been publicly reported.  Lawrence reviews the known details from the OVH event and highlights some design and operational issues for other data center providers to consider.
  • In Give OVH a Break and Use the Data Center Fire as A Teachable Moment,  Dennis Cronin of DCIN (the Data Center Incident Reporting Network) writes that the OVH incident “should not be assumed unique to OVH. Everyone in the global data center industry has something to learn from this disaster and probably many things to learn. This includes clients, support vendors, designers, contractors, and staff. It will be a tragedy if the facts and the lessons learned are restricted to a small exclusive group and not shared with the data center industry.”

 

LinkedinTwitterFacebookSubscribe
Mail

Tagged With: Generators, WebNX

Newsletters

Stay informed: Get our weekly updates!

Are you a new reader? Follow Data Center Frontier on Twitter or Facebook.

About Rich Miller

I write about the places where the Internet lives, telling the story of data centers and the people who build them. I founded Data Center Knowledge, the data center industry's leading news site. Now I'm exploring the future of cloud computing at Data Center Frontier.

Comments

  1. david.patrick.reid@jci.com'David says

    April 7, 2021 at 5:59 pm

    Great read Rich thank you

  2. dowenp@aol.com'Don Owen says

    April 8, 2021 at 11:54 am

    There’s really no excuse to have any type of catastrophic incident lead to customers having to deal with DAYS of lost service. It’s totally unacceptable for any provider. What blows my mind is that in this day and age the center had to deal with WATER damage… really… WATER DAMAGE… why is water ever used in an electrical fire incident in the first place? Just ridiculous.

    • tof.sto@free.fr'stooo says

      April 8, 2021 at 3:27 pm

      Stops combustion pretty fast.

      • dowenp@aol.com'Don Owen says

        April 8, 2021 at 4:21 pm

        Don’t be a dope. Why would a data center responsible for millions of dollars of equipment be housed in a combustible space? If you’re going to be a player in this space, my view is that you house the equipment in a non-combusitble building where you can tackle an electrical fire WITHOUT WATER, period. It is the 21st century, figure it out.

  3. kimble77@gmail.com'mopbucket says

    April 8, 2021 at 5:31 pm

    Plenty of excuses I can think of. generators fail often. Patience Don. No need to say dope. Happy days.

    • dowenp@aol.com'Don Owen says

      April 8, 2021 at 10:53 pm

      Apologies. Hopefully hard lessons will be learned and actions taken to circumvent future events causing catastrophic consequences.

  4. info@firepass.com'Gary Kotliar says

    April 17, 2021 at 10:41 am

    It’s simply amazing that some data center owners save money on a real, 100% guaranteed, fire protection that can be provided by the Oxygen Reduction System based on the unique FirePASS technology. Especially that the cost of the system is much less than they loose just in one day being down. This is the future: https://firepass.com/

  • Facebook
  • Instagram
  • LinkedIn
  • Pinterest
  • Twitter

Voices of the Industry

Mitigate Risk, Improve Performance and Decrease Operating Expenses through Data Center Self-Performance

Mitigate Risk, Improve Performance and Decrease Operating Expenses through Data Center Self-Performance If a vendor conducts the actual work in your data center, then you or your operator aren’t maximizing your current operating resources and are experiencing incremental cost and risk. Chad Giddings of BCS Data Center Operations, explains the importance of your data center provider having a high-degree of self-performance.

White Papers

sustainable

Getting to Green – Paving a Sensible Path To Sustainable Data Centers

This special report, courtesy of Kohler, explores the current state of the five sustainable energy sources recognized by the U.S. Energy Information Administration – solar, wind, geothermal, biomass, hydropower, and batteries. It outlines how viable a solution each might be for data center operators.

Get this PDF emailed to you.

We always respect your privacy and we never sell or rent our list to third parties. By downloading this White Paper you are agreeing to our terms of service. You can opt out at any time.

DCF Spotlight

Data center modules on display at the recent Edge Congress conference in Austin, Texas. (Photo: Rich Miller)

Edge Computing is Poised to Remake the Data Center Landscape

Data center leaders are investing in edge computing and edge solutions and actively looking at new ways to deploy edge capacity to support evolving business and user requirements.

An aerial view of major facilities in Data Center Alley in Ashburn, Virginia. (Image: Loudoun County)

Northern Virginia Data Center Market: The Focal Point for Cloud Growth

The Northern Virginia data center market is seeing a surge in supply and an even bigger surge in demand. Data Center Frontier explores trends, stats and future expectations for the No. 1 data center market in the country.

See More Spotlight Features

Newsletters

Get the Latest News from Data Center Frontier

Job Listings

RSS Job Openings | Pkaza Critical Facilities Recruiting

  • Electrical Commissioning Engineer - Los Angeles, CA
  • Data Center Construction Project Manager - Ashburn, VA
  • Critical Power Energy Manager - Data Center Development - Dallas, TX
  • Data Center Facilities Operations VP - Seattle, WA
  • Senior Electrical Engineer - Data Center - Dallas, TX

See More Jobs

Data Center 101

Data Center 101: Mastering the Basics of the Data Center Industry

Data Center 101: Mastering the Basics of the Data Center Industry

Data Center Frontier, in partnership with Open Spectrum, brings our readers a series that provides an introductory guidebook to the ins and outs of the data center and colocation industry. Think power systems, cooling, solutions, data center contracts and more. The Data Center 101 Special Report series is directed to those new to the industry, or those of our readers who need to brush up on the basics.

  • Data Center Power
  • Data Center Cooling
  • Strategies for Data Center Location
  • Data Center Pricing Negotiating
  • Cloud Computing

See More Data center 101 Topics

About Us

Charting the future of data centers and cloud computing. We write about what’s next for the Internet, and the innovations that will take us there. We tell the story of the digital economy through the data center facilities that power cloud computing and the people who build them. Read more ...
  • Facebook
  • LinkedIn
  • Pinterest
  • Twitter

About Our Founder

Data Center Frontier is edited by Rich Miller, the data center industry’s most experienced journalist. For more than 20 years, Rich has profiled the key role played by data centers in the Internet revolution. Meet the DCF team.

TOPICS

  • 5G Wireless
  • Cloud
  • Colo
  • Connected Cars
  • Cooling
  • Cornerstone
  • Coronavirus
  • Design
  • Edge Computing
  • Energy
  • Executive Roundtable
  • Featured
  • Finance
  • Hyperscale
  • Interconnection
  • Internet of Things
  • Machine Learning
  • Network
  • Podcast
  • Servers
  • Site Selection
  • Social Business
  • Special Reports
  • Storage
  • Sustainability
  • Videos
  • Virtual Reality
  • Voices of the Industry
  • Webinar
  • White Paper

Copyright Endeavor Business Media© 2022