• About Us
  • Partnership Opportunities
  • Privacy Policy

Data Center Frontier

Charting the future of data centers and cloud computing.

  • Cloud
    • Hyperscale
  • Colo
    • Site Selection
    • Interconnection
  • Energy
    • Sustainability
  • Cooling
  • Technology
    • Internet of Things
    • AI & Machine Learning
    • Edge Computing
    • Virtual Reality
    • Autonomous Cars
    • 5G Wireless
    • Satellites
  • Design
    • Servers
    • Storage
    • Network
  • Voices
  • Podcast
  • White Papers
  • Resources
    • COVID-19
    • Events
    • Newsletter
    • Companies
    • Data Center 101
  • Jobs
You are here: Home / Cooling / Pockets of Density Will Be More Common in Future Data Centers

Pockets of Density Will Be More Common in Future Data Centers

By Rich Miller - March 18, 2020

Pockets of Density Will Be More Common in Future Data Centers

High-density racks will become more common as AI gains traction. (Photo: Rich Miller)

LinkedinTwitterFacebookSubscribe
Mail

Will high-density, liquid-cooled racks become more common in data centers? That’s today’s topic as we continue our Data Center Executive Roundtable, a quarterly feature showcasing the insights of thought leaders on the state of the data center industry, and where it is headed. In today’s discussion, our panel of experienced data center executives – Iron Mountain’s Michael DeVito, Chris Sharp of Digital Realty, Kristen Kroll-Moen from Chatsworth Products, Intel’s Jeff Klaus, Gary Niederpruem of Vertiv, and Amber Caramella of Netrality and Infrastructure Masons – discuss trends in rack power density and their implications for design and operations.

The conversation is moderated by Rich Miller, the founder and editor of Data Center Frontier.

Data Center Frontier: Last year several studies indicated that rack density level is increasing. How might the growing use of artificial intelligence and edge computing impact rack density and the world of data center cooling?

GARY NIEDERPRUEM, Vertiv

Gary Niederpruem: What we are seeing from our customers is that average rack densities aren’t rising dramatically for many operators. But in select applications, such as AI, extremely high densities are becoming more common. That’s created an interesting environment where you have some users with relatively stable densities and some with densities that weren’t even practical 10  years ago. This is occurring both within the core data center and on the edge.

From a cooling perspective, operators need the ability to efficiently cool facilities that support standard density racks (5 kW to 8 kW), high density racks (30 kW and higher), and have some mix of both. Key to accomplishing that is being able to adapt the right cooling technology to the application.

Vertiv is enabling this by offering a range of different technologies that include air-based, compressor-based and liquid-based cooling. That has given high-performance computing facilities, for example, the flexibility to design racks around their specific requirements and then adapt the appropriate cooling technology rather than designing racks based on the capacity of their cooling system.

KRISTEN KROLL-MOEN, Chatsworth Products

Kristen Kroll-Moen:  As rack density increases, airflow management becomes critical in traditional air-cooled facilities. In the late 2000s, the industry was projecting significant rack density increases. CPI conducted lab tests to observe and verify performance of airflow management technology and we discovered that air cools very dense racks, up to 30 kW, with disciplined airflow management. Since then, there have been more hardware improvements: hard drives have transitioned to solid state, power supplies have increased in efficiency, and equipment operating ranges have widened.

These improvements provide even more opportunity to accommodate new computing with traditional airflow cooling models. Where space is limited, perhaps in edge sites or where there is a high-density compute node, an alternative is to shift to liquid cooling, either supplemental indirect cooling, or direct liquid cooling. The challenge for enterprise operators is the availability of off-shelf direct liquid cooled solutions.

AMBER CARAMELLA, Netrality Data Centers and Infrastructure Masons.

Amber Caramella: As artificial intelligence (AI) and edge computing proliferate, rack density will continue to increase. More data-intensive workloads naturally require more compute power, which increases the amount of electricity used by servers and the amount of heat the servers produce. This makes powering and cooling data centers more expensive and increases their carbon footprint.

Conventional data center cooling methods will not scale under the processing demands of AI, 5G wireless, Internet of Things (IoT), and the rise of Smart Cities. Luckily, there are a growing number of new approaches to cooling that actually reduce energy consumption and costs. As data center needs transform, dynamic infrastructure is needed to respond to high, mixed and variable power densities, enabling environments to evolve without stranding capacities. Newer cooling systems are being developed that are purpose-built for data centers.

These and other promising new cooling methods will be needed to ensure that data centers can keep up with data processing demands and become more green and sustainable.

CHRIS SHARP, CTO, Digital Realty

Chris Sharp: With the explosion of AI and IoT in the enterprise, data gravity has become one of the biggest challenges to successful digital transformations. The explosive growth of data means it is now heavier, denser, and more expensive to move. At the same time, these new technologies require data centers to support a higher level of computational power, electricity usage, and heat generation, requiring specialized power and cooling techniques that aren’t available in the enterprise basement.

Organizations across all industries are using AI to meet business challenges and increase efficiency. It’s also important to note that not every colocation facility is prepared to support these compute-intensive technologies in a multi-tenant environment. Per-rack power demands for AI can easily and regularly do exceed what standard data centers can deliver. To put into context, the average kilowatt per rack is around 7kW, but with AI, applications can pull more than 30 kW per rack. As per-rack power demands rise, so does the need for highly efficient cooling.

One of the ways data center operators are addressing these data-intensive technologies is through various next-generation cooling technologies, including liquid cooling and direct air cooling. While it isn’t the right fit for all workloads, liquid cooling enables ultra-high-density equipment be deployed in otherwise low- or medium-density facilities, essentially retrofitting a data center for future applications.

As part of our commitment to lead the data center into the future, we’re partnering with companies like Submer Technologies to help customers evaluate the potential applications of new cooling technologies and support their future data center infrastructure needs.

MICHAEL DeVITO, Iron Mountain

Michael DeVito: At the high level, AI requires a lot of processing. It must go through many different data sets quickly and requires algorithms capable of processing that data.

Along with the demand for low latency and high processing comes greater compute capability. This will increase the power required at the rack level. Once you increase power at the rack level, you must be able to cool it.

As the need for greater cooling grows, data centers must ensure we are doing this efficiently. As we consume more and more cooling, we need to be cognizant of any waste and operate in the most sustainable manner possible. Finding sustainable sources of power are key.

DMaaS

JEFF KLAUS, Intel

Jeff Klaus: AI and edge are driving a lot of growth, although I see the density increase is more a function in the advancement in cooling and materials allowing for robust deployments. AI and Edge do benefit from better density, because it reduces the overhead from sprawl.

NEXT: Our panel discusses the data center industry’s progress on diversity.

Keep pace with the fact-moving world of data centers and cloud computing by following us on Twitter and Facebook, connecting with me on LinkedIn, and signing up for our weekly newspaper using the form below:

LinkedinTwitterFacebookSubscribe
Mail

Tagged With: Chatsworth Products, Digital Realty, Infrastructure Masons, Intel, Iron Mountain, Vertiv

Newsletters

Stay informed: Get our weekly updates!

Are you a new reader? Follow Data Center Frontier on Twitter or Facebook.

About Rich Miller

I write about the places where the Internet lives, telling the story of data centers and the people who build them. I founded Data Center Knowledge, the data center industry's leading news site. Now I'm exploring the future of cloud computing at Data Center Frontier.

  • Facebook
  • Instagram
  • LinkedIn
  • Pinterest
  • Twitter

Voices of the Industry

Overcoming Supply Chain Roadblocks: How to Avoid Disruptions in Your Data Center

Overcoming Supply Chain Roadblocks: How to Avoid Disruptions in Your Data Center The data center industry continues to experience significant global supply chain problems. Brett Williams of Service Express, explores the importance of leveraging the secondary hardware market to overcome supply chain roadblocks.

White Papers

sustainability metrics

Guide to Environmental Sustainability Metrics for Data Centers

As more and more companies are reporting on their Environmental, Social, and Governance (ESG) programs, there’s a need for standardized sustainability metrics, especially in the data center industry. A new white paper from Schneider Electric proposes five categories of metrics for data centers to use when reporting on environmental sustainability.

Get this PDF emailed to you.

We always respect your privacy and we never sell or rent our list to third parties. By downloading this White Paper you are agreeing to our terms of service. You can opt out at any time.

DCF Spotlight

Data center modules on display at the recent Edge Congress conference in Austin, Texas. (Photo: Rich Miller)

Edge Computing is Poised to Remake the Data Center Landscape

Data center leaders are investing in edge computing and edge solutions and actively looking at new ways to deploy edge capacity to support evolving business and user requirements.

An aerial view of major facilities in Data Center Alley in Ashburn, Virginia. (Image: Loudoun County)

Northern Virginia Data Center Market: The Focal Point for Cloud Growth

The Northern Virginia data center market is seeing a surge in supply and an even bigger surge in demand. Data Center Frontier explores trends, stats and future expectations for the No. 1 data center market in the country.

See More Spotlight Features

Newsletters

Get the Latest News from Data Center Frontier

Job Listings

RSS Job Openings | Pkaza Critical Facilities Recruiting

  • Critical Power Energy Manager - Data Center Development - Ashburn, VA
  • Site Development Manager - Data Center - Ashburn, VA
  • Data Center Facility Operations Director - Chicago, IL
  • Electrical Engineer - Senior - Dallas, TX
  • Mechanical Commissioning Engineer - Calgary, Alberta

See More Jobs

Data Center 101

Data Center 101: Mastering the Basics of the Data Center Industry

Data Center 101: Mastering the Basics of the Data Center Industry

Data Center Frontier, in partnership with Open Spectrum, brings our readers a series that provides an introductory guidebook to the ins and outs of the data center and colocation industry. Think power systems, cooling, solutions, data center contracts and more. The Data Center 101 Special Report series is directed to those new to the industry, or those of our readers who need to brush up on the basics.

  • Data Center Power
  • Data Center Cooling
  • Strategies for Data Center Location
  • Data Center Pricing Negotiating
  • Cloud Computing

See More Data center 101 Topics

About Us

Charting the future of data centers and cloud computing. We write about what’s next for the Internet, and the innovations that will take us there. We tell the story of the digital economy through the data center facilities that power cloud computing and the people who build them. Read more ...
  • Facebook
  • LinkedIn
  • Pinterest
  • Twitter

About Our Founder

Data Center Frontier is edited by Rich Miller, the data center industry’s most experienced journalist. For more than 20 years, Rich has profiled the key role played by data centers in the Internet revolution. Meet the DCF team.

TOPICS

  • 5G Wireless
  • Cloud
  • Colo
  • Connected Cars
  • Cooling
  • Cornerstone
  • Coronavirus
  • Design
  • Edge Computing
  • Energy
  • Executive Roundtable
  • Featured
  • Finance
  • Hyperscale
  • Interconnection
  • Internet of Things
  • Machine Learning
  • Network
  • Podcast
  • Servers
  • Site Selection
  • Social Business
  • Special Reports
  • Storage
  • Sustainability
  • Videos
  • Virtual Reality
  • Voices of the Industry
  • Webinar
  • White Paper

Copyright Data Center Frontier LLC © 2022