• About Us
  • Partnership Opportunities
  • Privacy Policy

Data Center Frontier

Charting the future of data centers and cloud computing.

  • Cloud
    • Hyperscale
  • Colo
    • Site Selection
    • Interconnection
  • Energy
    • Sustainability
  • Cooling
  • Technology
    • Internet of Things
    • AI & Machine Learning
    • Edge Computing
    • Virtual Reality
    • Autonomous Cars
    • 5G Wireless
    • Satellites
  • Design
    • Servers
    • Storage
    • Network
  • Voices
  • Podcast
  • White Papers
  • Resources
    • COVID-19
    • Events
    • Newsletter
    • Companies
    • Data Center 101
  • Jobs
You are here: Home / Storage / Microsoft: Your Cloud Data May Soon Be Stored in DNA and Holograms

Microsoft: Your Cloud Data May Soon Be Stored in DNA and Holograms

By Rich Miller - October 19, 2020 1 Comment

Microsoft: Your Cloud Data May Soon Be Stored in DNA and Holograms

With Project HSD, Microsoft is working on using holograpms in crystals to store data at unprecedented scale. (Photo: Microsoft)

LinkedinTwitterFacebookSubscribe
Mail

Data is growing so fast that current technologies may not be able to keep up. That’s why Microsoft is working on new storage technologies to house massive amounts of data in DNA and holograms. These storage technologies could disrupt the world of data centers, and Microsoft says they are closer than we think.

At the recent Ignite conference, Microsoft Azure Chief Technical Officer Mark Russinovich showed off working prototypes for data storage systems based on DNA and holography. These approaches need extensive engineering work to commercialize at scale, but Russinovich said real-world data growth makes a compelling case for these new technologies.

“The amount of data being generated is really escaping our grasp,” said Russinovich. “There are some types of data that we simply won’t be able to efficiently store with today’s technologies. This is where we’re exploring novel ways to store data very efficiently and at very high scale to close this gap.”

The implications for digital infrastructure are profound. Storing an exabyte of data currently requires two Azure data centers, each about the size of a Walmart, Russinovich said. DNA storage could house that exabyte in just one cubic centimeter of space.

“It’s sustainable it’s organic, and it’s durable,” said Russinovich. “It lasts hundreds of thousands to millions of years. On Earth we’ve found 700,000-year-old biologic DNA. Stored under the right conditions, it can survive virtually forever.”

Holographic storage concepts are not new, but has been difficult to execute in a practical way.

“It was invented in 1960s, but it’s never been successfully commercialized,” said Russinovich. “We actually believe that now is the right time to leverage this cool storage technology. We also believe Microsoft is in the best position to do so because we’ve been working on optical technologies in this area for many years on HoloLens, and the optical technologies inside of it are something that we can leverage for holographic storage.”

These new approaches to storage seem like science fiction. What’s clear is that Microsoft is willing to invest considerable resources in “moonshot” research that brings dramatic change to infrastructure – as has clearly been seen in Project Natick, its initiative to operate edge data centers beneath the sea.

Exploring DNA Storage

In traditional data storage systems, information is stored in a binary series of ones and zeroes that are written onto spinning disks or tape using magnetics, or to DVDs or Blu-Ray media using lasers. In a DNA system, data is stored in a liquid solution containing DNA, and “read” using systems that combine electronic and molecular components.

Microsoft’s DNA storage initiative uses synthetic DNA created by companies like Twist Bioscience, rather than repurposing DNA from humans or animals.

Free Resource from Data Center Frontier White Paper Library

cloud service providers
Pro Tips and Best Practices: Physical Layer Strategies for Cloud/Managed Service Providers
Successful Cloud Service Providers and Managed Service Providers need to be out in front of everything in their managed data center spaces – ensuring uptime, bandwidth, and operational/cost efficiency today, with the flexibility and scalability to adapt and expand on the fly. Physical layer and  infrastructure is the foundation on which those services are built. Get the new data center ebook from Siemon that explores pro tips and best practices for physical layer strategies for cloud and managed service providers, from zone cabling in the colocation data center to high speed interconnects in the data center.
We always respect your privacy and we never sell or rent our list to third parties. By downloading this White Paper you are agreeing to our terms of service. You can opt out at any time.

Get this PDF emailed to you.

“You might be saying ‘so when I archive through DNA my family photos or my photos from my last vacation, what kind of creatures that can create?'” Russinovich said. “Fortunately, these things are going to be inert and not actually grow, so not to worry about weird creatures based off of your holiday photos walking around and attacking people.”

Microsoft has worked with researchers from the University of Washington to create a system that encodes data in synthetic DNA that is stored in a liquid solution and can then be read and used in data processing.

The automated DNA data storage system uses software that converts the ones and zeros of digital data into the building blocks of DNA, expressed as a string of As, Ts, Cs and Gs. Then it uses lab equipment to flow the necessary liquids and chemicals into a synthesizer that builds manufactured snippets of DNA and pushes them into a storage vessel.

When the system needs to retrieve the information, it adds other chemicals to prepare the DNA and uses microfluidic pumps to push the liquids into a system that “reads” the DNA sequences and converts it back to information that a computer can understand.

Here’s a video that explains the process in more detail.

It’s cool science. But in practice, working with DNA and solutions is ideal for laboratories, not data storage facilities.

“The process thus far has been incredibly manual,” said Luiz Ceze, a professor at the University of Washington’s Molecular Information Systems Lab. “It’s literally people moving around with pipettes in their hands. The only way we’re going to make DNA storage scale up to be useable and go mainstream is by automating it. What we’ve done is show that it’s possible to automate the entire process – from bits to molecules and back to bits.”

“We’ve actually gotten to the point where we’ve got a first fully automated DNA storage system,” Russinovich said in his presentation at Insight. “It’s not just a proof of concept. We’ll take the binary data and synthesize the DNA molecule. We’ve got the storage and prep part inside that vial of DNA, and then we can sequence it out and get the resulting data all in one testbed.”

Here’s what it looks like:

This is the first prototype of an automated system to store data within DNA, developed by researchers from Microsoft and the University of Washington. (Photo: Microsoft Research)

Those beakers and flasks wouldn’t be at home in most data center environments. Microsoft is working on that.

“Our ultimate goal is to put a system into production that, to the end user, looks very much like any other cloud storage service — bits are sent to a data center and stored there and then they just appear when the customer wants them,” said Microsoft principal researcher Karin Strauss. “To do that, we needed to prove that this is practical from an automation perspective.”

“It might be pointing to a new kind of system that has an electronic component and a molecular component, and allow us to build a system that integrates wet molecules and dry electronics and together they do something amazing,” said Ceze.

“There’s incredibly hard engineering problems to solve to make this scale, and really be cost efficient. But we’re well on our way down this path.”
Mark Russinovich, CTO of Microsoft Azure

Russinovich believes the massive data storage potential of DNA makes a compelling case for the research.

“This is kind of the next step in showing that this technology really is viable, and there’s incredibly hard engineering problems to solve to make this scale, and really be cost efficient. But we’re well on our way down this path.”

Holographic Data Storage

For the current generation of data center professionals, holographic storage might seem an easier leap than DNA. In a holographic system, data within optical light beams is stored as an image inside a crystal of lithium niobate.

Holographic storage is capable of recording and reading millions of bits in parallel, enabling data transfer rates greater than those attained by traditional optical storage.

Project HSD is a collaboration between Microsoft Research Cambridge and Microsoft Azure to create a holographic storage system as a cloud-first design, building on recent advances in optical technologies such as smartphone cameras.

“To implement holographic storage, we need very high-resolution cameras,” said Russinovich. “If you take a look at the cameras coming out of commodity smartphones today, they’re up at the resolutions that we need – in the 10s of megapixels range – to commercialize a technology like this. We’ve actually made some really great progress.

“We’ve been able to read and write to unlock access rates that are comparable to hard disks,” he said. “We’ve also been able to leverage software compensation via deep learning to be able to read out with high degrees of accuracy, the data that’s been stored in the holographic storage. We’ve got proof of concepts now.”

Here’s a video that explains the details:

From a data center design perspective, holographic storage would be an easier adaptation that DNA, as it simply substitutes a different storage media and perhaps new form factors.

These technologies are making rapid progress, but are still likely years away from implementation at scale. Even after new technologies are viable, they are adopted gradually over time, providing data center operators time to adapt designs and best practices.

As an example, cloud computing is among the most disruptive IT trends. Amazon Web Services launched its cloud platform in 2006, and 14 years on Gartner estimates that about 30 percent of enterprise IT shops use some form of cloud storage. Effective liquid cooling solutions have been available for years, and remain lightly adopted. Change comes most slowly to the most mission-critical areas of the data center, which certainly includes storage.

But Microsoft’s interest in these technologies underscores the innovation premium of working with hyperscale data center customers, who drive a large and growing chunk of the data center business. Service providers targeting this market must reckon with the technologies these companies are embracing, and the specifications required to support them.

Here’s a look at the portion of Russinovich’s Ignite presentation where he discusses Microsoft’s approach to the future of storage.

/p>

LinkedinTwitterFacebookSubscribe
Mail

Tagged With: DNA Storage, Holographic Storage, Microsoft

Newsletters

Stay informed: Get our weekly updates!

Are you a new reader? Follow Data Center Frontier on Twitter or Facebook.

About Rich Miller

I write about the places where the Internet lives, telling the story of data centers and the people who build them. I founded Data Center Knowledge, the data center industry's leading news site. Now I'm exploring the future of cloud computing at Data Center Frontier.

Comments

  1. robbiems89@gmail.com'Rob S. says

    November 6, 2020 at 10:57 am

    It sounds a little too futuristic for me, but I can definitely see it becoming more of a practice in the years to come. Technology has already evolved so much in the past few years and it’s fair that these sorts of challenges will be tackled as well.

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

  • Facebook
  • Instagram
  • LinkedIn
  • Pinterest
  • Twitter

Voices of the Industry

5 Ways to Mitigate Supply Chain Unpredictability and Labor Shortages in Data Center Construction

5 Ways to Mitigate Supply Chain Unpredictability and Labor Shortages in Data Center Construction Blake Weaver, Data Center Specialist at ProLift Rigging offers a list of ways to overcome supply chain challenges and labor shortages in data center construction. 

DCF Spotlight

The COVID-19 Crisis and the Data Center Industry

The COVID-19 pandemic presents strategic challenges for the data center and cloud computing sectors. Data Center Frontier provides a one-stop resource for the latest news and analysis for decision-makers navigating this complex new landscape.

An aerial view of major facilities in Data Center Alley in Ashburn, Virginia. (Image: Loudoun County)

Northern Virginia Data Center Market: The Focal Point for Cloud Growth

The Northern Virginia data center market is seeing a surge in supply and an even bigger surge in demand. Data Center Frontier explores trends, stats and future expectations for the No. 1 data center market in the country.

See More Spotlight Features

White Papers

colocation services

Integrating Colocation Services with Business Operations

A&M helps companies around the world address complex business issues to boost their productivity and performance. Get the new white paper from QTS that explores how Alvarez & Marsal (A&M) has benefited from integrating colocation services with business operations.   

Get this PDF emailed to you.

We always respect your privacy and we never sell or rent our list to third parties. By downloading this White Paper you are agreeing to our terms of service. You can opt out at any time.

Newsletters

Get the Latest News from Data Center Frontier

Job Listings

RSS Job Openings | Peter Kazella and Associates, Inc

  • Navy Electrician / Navy Mechanic - Redmond, WA
  • Electrical Commissioning Engineer - Ashburn, VA
  • MEP Superintendent - Data Center - Dallas, TX
  • Construction Project Manager - Data Center - Dallas, TX
  • Data Center QA / QC Manager - Huntsville, AL

See More Jobs

Data Center 101

Data Center 101: Mastering the Basics of the Data Center Industry

Data Center 101: Mastering the Basics of the Data Center Industry

Data Center Frontier, in partnership with Open Spectrum, brings our readers a series that provides an introductory guidebook to the ins and outs of the data center and colocation industry. Think power systems, cooling, solutions, data center contracts and more. The Data Center 101 Special Report series is directed to those new to the industry, or those of our readers who need to brush up on the basics.

  • Data Center Power
  • Data Center Cooling
  • Strategies for Data Center Location
  • Data Center Pricing Negotiating
  • Cloud Computing

See More Data center 101 Topics

About Us

Charting the future of data centers and cloud computing. We write about what’s next for the Internet, and the innovations that will take us there. We tell the story of the digital economy through the data center facilities that power cloud computing and the people who build them. Read more ...
  • Facebook
  • LinkedIn
  • Pinterest
  • Twitter

About Our Founder

Data Center Frontier is edited by Rich Miller, the data center industry’s most experienced journalist. For more than 20 years, Rich has profiled the key role played by data centers in the Internet revolution. Meet the DCF team.

TOPICS

  • 5G Wireless
  • Cloud
  • Colo
  • Connected Cars
  • Cooling
  • Cornerstone
  • Coronavirus
  • Design
  • Edge Computing
  • Energy
  • Executive Roundtable
  • Featured
  • Finance
  • Hyperscale
  • Interconnection
  • Internet of Things
  • Machine Learning
  • Network
  • Podcast
  • Servers
  • Site Selection
  • Social Business
  • Special Reports
  • Storage
  • Sustainability
  • Videos
  • Virtual Reality
  • Voices of the Industry
  • White Paper

Copyright Data Center Frontier LLC © 2021