LinkedIn Plans for Huge Growth for the EdgeCloud

May 22, 2018
LinkedIn sees edge computing as a huge driver of infrastructure growth. The company has begun deploying edge data centers, and using the Open19 project as a platform for future design innovations to power smaller facilities.

NEW YORK – Edge computing isn’t just a hot trend, says Yuval Bachar. It’s the future of IT infrastructure.

“We need to have a new Internet,” said Bachar, the Principal Engineer for Data Center Architecture at LinkedIn. “The current Internet doesn’t give us what we need. It’s not regional anymore. We have to rebuild it on localization.”

Bachar shared his views on edge computing, and what LinkedIn is doing to prepare for it, in a recent presentation at the DCD Edge conference in New York. His convictions about the future were clear in the title of his presentation: “EdgeCloud, The Next Mega Data Center.”

LinkedIn sees the edge as a “once in a generation innovation cycle,” said Bachar, and has spent several years developing infrastructure to support this new architecture. This began with a small network of micro data centers that LinkedIn deployed as a proof of concept in several markets. It continues with its work with the Open19 initiative, an open hardware initiative co-founded by LinkedIn to develop standardized solutions for smaller data centers, including designs optimized for edge computing.

One Company’s Approach to Edge Demand

The rise of edge computing is driven by the increased use of consumer mobile devices, especially consumption of video and virtual reality content and the growth of sensors as part of the Internet of Things. Artificial intelligence emerged as a major edge use case in 2017, while the 800-pound-gorilla of edge traffic – the autonomous car – looms on the horizon.

Companies across the technology sector are preparing for edge computing. LinkedIn’s EdgeCloud thesis provides an example of how one large social platform is thinking about the future infrastructure, and adapting its data center and network infrastructure for the road ahead. It’s not a small job.

“EdgeCloud will be the future of the data center,” said Bachar. “It’s a very different architecture.”

Bachar sees the need for many small data centers at telecom towers, the edgiest of several scenarios for the evolution of edge computing. The key challenge, he says, is managing machine-to-machine (M2M) interactions, which will generate large amounts of data that must be processed and analyzed. Bachar believes that only about 5 percent of that data will move across the network to core data centers, and that will require analytics at the edge to identify a smaller dataset that has business value. This requires compute power and data storage in new places, where there is currently no data center capacity.

A slide from Yuval Bachar’s presentation providing an overview of LinkedIn’s Edge Connect edge data center prototypes. (Image: LinkedIn)

LinkedIn began experimenting with edge infrastructure several years ago with deployments of LinkedIn Edge Connect, a micro-modular data center. LinkedIn deployed five facilites – two in the U.S., two in India and one in China. Each Edge Connect facility housed 8 to 16 servers and one switch, and supported 50 GBps peering and transit.

The areas where LinkedIn deployed Edge Connect units saw a 15 to 50 percent improvement in the user experience, Bachar said, confirming the benefits of  edge infrastructure.

Open19 as Plaform for the Edge at Scale

Those results prompted LinkedIn to go back to the lab and think more deeply about its hardware and data center designs. In 2016, the company had just come through an 18-month journey in which it doubled its infrastructure and overhauled its design. The result was a cutting-edge data center in Portland, Oregon that featured one of the largest deployments yet of rear-door chilling units that support extreme power density.

The Portland data center was highly optimized around LinkedIn’s requirements. With edge deployments on the horizon, a more flexible design solution was required. Part of the answer is Open19, which the LinkedIn team created to offer options beyond the Open Compute Project, particularly for smaller data centers. Both projects emphasize rack-level design, disaggregated systems and modular integration of components. Bachar says Open19 is differentiated by its focus on a 19-inch rack and licensing terms that allow participants better control over their intellectual property.

Open19 seeks to use “building block” elements to create repeatable infrastructure designs that hat can be used in everything from hyperscale facilities to edge micro-modules. Several of the early participants in Open19 are focused on edge computing, including Vapor IO, Flex, Crown Castle and GE Digital, which is developing the Predix platform for industrial Internet of Things applications.

Bachar said the growing Open19 ecosystem provides options for LinkedIn as it adds edge capacity. Future edge facilities will support between 50 kW and 175 kW of IT capacity per location, and 50 to 100 servers.

“We plan to deploy this in many locations,” said Bachar. “The EdgeCloud is here and now. It’s happening.”

Explore the evolving world of edge computing further through Data Center Frontier’s special report series and ongoing coverage.

About the Author

Rich Miller

I write about the places where the Internet lives, telling the story of data centers and the people who build them. I founded Data Center Knowledge, the data center industry's leading news site. Now I'm exploring the future of cloud computing at Data Center Frontier.

Sponsored Recommendations

Guide to Environmental Sustainability Metrics for Data Centers

Unlock the power of Environmental, Social, and Governance (ESG) reporting in the data center industry with our comprehensive guide, proposing 28 key metrics across five categories...

The AI Disruption: Challenges and Guidance for Data Center Design

From large training clusters to small edge inference servers, AI is becoming a larger percentage of data center workloads. Learn more.

A better approach to boost data center capacity – Supply capacity agreements

Explore a transformative approach to data center capacity planning with insights on supply capacity agreements, addressing the impact of COVID-19, the AI race, and the evolving...

How Modernizing Aging Data Center Infrastructure Improves Sustainability

Explore the path to improved sustainability in data centers by modernizing aging infrastructure, uncovering challenges, three effective approaches, and specific examples outlined...

Cadence Design Systems

Are You Ready for the Storm About to Hit the Data Center Industry?

Mark Fenton, Senior Product Engineering Manager at Cadence Design Systems, explains how a campus-wide digital twin for data centers is one way to revolutionize performance and...

White Papers

N Vent Thumbnail

Liquid cooling is in your future

June 26, 2023
The data center environment is changing as densities increase and operating temperature rise. These fundamental shifts in the way data centers operate is driving the need for ...