• About Us
  • Partnership Opportunities
  • Privacy Policy

Data Center Frontier

Charting the future of data centers and cloud computing.

  • Cloud
    • Hyperscale
  • Colo
    • Site Selection
    • Interconnection
  • Energy
    • Sustainability
  • Cooling
  • Technology
    • Internet of Things
    • AI & Machine Learning
    • Edge Computing
    • Virtual Reality
    • Autonomous Cars
    • 5G Wireless
    • Satellites
  • Design
    • Servers
    • Storage
    • Network
  • Voices
  • Podcast
  • White Papers
  • Resources
    • COVID-19
    • Events
    • Newsletter
    • Companies
    • Data Center 101
  • Jobs
You are here: Home / Machine Learning / NVIDIA Moves to Accelerate Growth of GPU-Powered AI Clouds

NVIDIA Moves to Accelerate Growth of GPU-Powered AI Clouds

By Rich Miller - May 30, 2017

NVIDIA Moves to Accelerate Growth of GPU-Powered AI Clouds

A prototype of the HGX-1 machine learning system on display at the Microsoft booth at the Open Compute Summit. The HGX-1 is a collaboration between Microsoft, NVIDIA and Ingrasys/Foxconn and optimized for cloud AI services. This version uses eight Tesla P100 for PCIe GPUs. (Photo: Rich Miller)

LinkedinTwitterFacebookSubscribe
Mail

NVIDIA is looking to accelerate sales of its artificial intelligence (AI) hardware to hyperscale computing providers through tighter partnerships with original design manufacturers (ODMs), who have become key players in the cloud technology ecosystem. The company said it will work more closely with partners like Foxconn, Quanta/QCT, Inventec, and Wistron in building custom machine learning hardware using NVIDIA’s GPU (graphics processing unit) technology.

ODMs create new products and specifications based on the product designs provided by the client. NVIDIA engineers will now work closely with ODMs to help minimize the amount of time from design win to production deployments.

The NVIDIA HGX Partner Program will provide each ODM with early access to NVIDIA’s HGX reference architecture, GPU computing technologies and design guidelines. HGX is the data center design used to power the Microsoft Project Olympus initiative, Facebook’s Big Basin server and NVIDIA DGX-1 AI supercomputers.

Surging Demand for AI Hardware

“Accelerated computing is evolving rapidly — in just one year we tripled the deep learning performance in our Tesla GPUs — and this is having a significant impact on the way systems are designed,” said Ian Buck, general manager of Accelerated Computing at NVIDIA. “Through our HGX partner program, device makers can ensure they’re offering the latest AI technologies to the growing community of cloud computing providers.”

The race to leverage AI is led by the industry’s marquee names – including Google, Facebook, Amazon and Microsoft – who are seeking to add intelligence to a wide range of services and applications. These companies have developed in-house designs for many elements of their infrastructure, turning to ODMs like Quanta/QCT and Wistron to turn their design ideas into hardware for their data centers.

The HGX design is configurable, with the ability to combine GPUs and CPUs in a number of ways to customize hardware for high performance computing (HPC), deep learning training or deep learning inferencing. Using HGX as a starter recipe, ODM partners can work with NVIDIA to more quickly design and bring to market a wide range of qualified systems for hyperscale data centers.

NVIDIA is already working with some of major ODMs. It partnered with Foxconn’s Ingrasys Technology unit in working with Microsoft to develop the HGX-1 AI accelerator for GPU-powered deep learning in the cloud. But ODMs said the new partnership structure will enable them to be more agile in creating new GPU products.

“Through this new partner program with NVIDIA, we will be able to more quickly serve the growing demands of our customers, many of whom manage some of the largest data centers in the world,” said Taiyu Chou, general manager of Foxconn/Hon Hai Precision Ind Co., Ltd., and president of Ingrasys Technology. “Early access to NVIDIA GPU technologies and design guidelines will help us more rapidly introduce innovative products for our customers’ growing AI computing needs.”

“As a long-time collaborator with NVIDIA, we look forward to deepening our relationship so that we can meet the increasing computing needs of our hyperscale data center customers,” said Donald Hwang, chief technology officer and president of the Enterprise Business Group at Wistron. “Our customers are hungry for more GPU computing power to handle a variety of AI workloads, and through this new partnership we will be able to deliver new solutions faster.”

“Tapping into NVIDIA’s AI computing expertise will allow us to immediately bring to market game-changing solutions to meet the ever-growing demands in the AI era.” said Mike Yang, SVP of Quanta Computer Inc. and President of QCT.

Free Resource from Data Center Frontier White Paper Library

Cloud computing
Intel MCA+MFP Helps JD Stable and Efficient Cloud Services
A new white paper from Intel explores how Intel MCA Recovery  + MFP has helped JD Cloud provide efficient and stable services to their more than 2,500 partners.
We always respect your privacy and we never sell or rent our list to third parties. By downloading this White Paper you are agreeing to our terms of service. You can opt out at any time.

Get this PDF emailed to you.

Arms Race in Hyperscale AI Hardware

NVIDIA’s graphics processing technology has been one of the biggest beneficiaries of the rise of specialized computing, gaining traction with workloads in supercomputing, AI and connected cars. NVIDIA has been investing heavily in innovation in AI, which it sees as a pervasive technology trend that will bring its GPU technology into every area of the economy and society.

In artificial intelligence (AI), computers are assembled into neural networks that emulate the learning process of the human brain to solve new challenges. It’s a process that requires lots of computing horsepower, which is why the leading players in the field have moved beyond traditional CPU-driven servers.[clickToTweet tweet=”Cloud builders work with ODMs like Quanta and Foxconn to turn design ideas into hardware for their data centers.” quote=”Cloud builders work with ODMs like Quanta and Foxconn to turn design ideas into hardware for their data centers.”]

The NVIDIA DGX-1 is packed with 8 Tesla P100 GPUs, providing 170 teraflops of computing power in a 3U form factor. (Photo: Rich Miller)

The NVIDIA DGX-1 is packed with 8 Tesla P100 GPUs, providing 170 teraflops of computing power in a 3U form factor. (Photo: Rich Miller)

NVIDIA says the world’s 10 largest hyperscale businesses are all using its GPU accelerators in their data centers. It is introducing the partnership program at a key moment in the AI hardware arms race, as these huge customers survey an evolving landscape of new hardware. NVIDIA has just introduced new Volta-based GPUs offering three times the performance of its prior architecture, and is hoping ODMs can feed the market demand with new products based on the latest NVIDIA technology available.

The standard HGX design architecture includes eight NVIDIA Tesla GPUs in the SXM2 form factor and connected in a cube mesh using NVIDIA NVLink high-speed interconnects and optimized PCIe topologies. With a modular design, HGX enclosures are suited for deployment in existing data center racks across the globe, using hyperscale CPU nodes as needed. Both NVIDIA Tesla P100 and V100 GPU accelerators are compatible with HGX. This allows for immediate upgrades of all HGX-based products once V100 GPUs become available later this year.

LinkedinTwitterFacebookSubscribe
Mail

Tagged With: Artificial Intelligence, NVIDIA, ODM, Quanta

Newsletters

Stay informed: Get our weekly updates!

Are you a new reader? Follow Data Center Frontier on Twitter or Facebook.

About Rich Miller

I write about the places where the Internet lives, telling the story of data centers and the people who build them. I founded Data Center Knowledge, the data center industry's leading news site. Now I'm exploring the future of cloud computing at Data Center Frontier.

  • Facebook
  • Instagram
  • LinkedIn
  • Pinterest
  • Twitter

Voices of the Industry

Mitigate Risk, Improve Performance and Decrease Operating Expenses through Data Center Self-Performance

Mitigate Risk, Improve Performance and Decrease Operating Expenses through Data Center Self-Performance If a vendor conducts the actual work in your data center, then you or your operator aren’t maximizing your current operating resources and are experiencing incremental cost and risk. Chad Giddings of BCS Data Center Operations, explains the importance of your data center provider having a high-degree of self-performance.

White Papers

colocation services

Integrating Colocation Services with Business Operations

A&M helps companies around the world address complex business issues to boost their productivity and performance. Get the new white paper from QTS that explores how Alvarez & Marsal (A&M) has benefited from integrating colocation services with business operations.   

Get this PDF emailed to you.

We always respect your privacy and we never sell or rent our list to third parties. By downloading this White Paper you are agreeing to our terms of service. You can opt out at any time.

DCF Spotlight

Data center modules on display at the recent Edge Congress conference in Austin, Texas. (Photo: Rich Miller)

Edge Computing is Poised to Remake the Data Center Landscape

Data center leaders are investing in edge computing and edge solutions and actively looking at new ways to deploy edge capacity to support evolving business and user requirements.

An aerial view of major facilities in Data Center Alley in Ashburn, Virginia. (Image: Loudoun County)

Northern Virginia Data Center Market: The Focal Point for Cloud Growth

The Northern Virginia data center market is seeing a surge in supply and an even bigger surge in demand. Data Center Frontier explores trends, stats and future expectations for the No. 1 data center market in the country.

See More Spotlight Features

Newsletters

Get the Latest News from Data Center Frontier

Job Listings

RSS Job Openings | Pkaza Critical Facilities Recruiting

  • Electrical Commissioning Engineer - Los Angeles, CA
  • Data Center Construction Project Manager - Ashburn, VA
  • Critical Power Energy Manager - Data Center Development - Dallas, TX
  • Data Center Facilities Operations VP - Seattle, WA
  • Senior Electrical Engineer - Data Center - Dallas, TX

See More Jobs

Data Center 101

Data Center 101: Mastering the Basics of the Data Center Industry

Data Center 101: Mastering the Basics of the Data Center Industry

Data Center Frontier, in partnership with Open Spectrum, brings our readers a series that provides an introductory guidebook to the ins and outs of the data center and colocation industry. Think power systems, cooling, solutions, data center contracts and more. The Data Center 101 Special Report series is directed to those new to the industry, or those of our readers who need to brush up on the basics.

  • Data Center Power
  • Data Center Cooling
  • Strategies for Data Center Location
  • Data Center Pricing Negotiating
  • Cloud Computing

See More Data center 101 Topics

About Us

Charting the future of data centers and cloud computing. We write about what’s next for the Internet, and the innovations that will take us there. We tell the story of the digital economy through the data center facilities that power cloud computing and the people who build them. Read more ...
  • Facebook
  • LinkedIn
  • Pinterest
  • Twitter

About Our Founder

Data Center Frontier is edited by Rich Miller, the data center industry’s most experienced journalist. For more than 20 years, Rich has profiled the key role played by data centers in the Internet revolution. Meet the DCF team.

TOPICS

  • 5G Wireless
  • Cloud
  • Colo
  • Connected Cars
  • Cooling
  • Cornerstone
  • Coronavirus
  • Design
  • Edge Computing
  • Energy
  • Executive Roundtable
  • Featured
  • Finance
  • Hyperscale
  • Interconnection
  • Internet of Things
  • Machine Learning
  • Network
  • Podcast
  • Servers
  • Site Selection
  • Social Business
  • Special Reports
  • Storage
  • Sustainability
  • Videos
  • Virtual Reality
  • Voices of the Industry
  • Webinar
  • White Paper

Copyright Endeavor Business Media© 2022