OCP 2024 Spotlight: Meta Debuts 140 kW Liquid-Cooled AI Rack; Google Eyes Robotics to Muscle Hyperscaler GPUs

Oct. 24, 2024
This month's OCP Global Summit (Oct. 15-17) saw heavy interest in AI data center rack capacity and cooling advancements, and hyperscaler robotics for servicing that infrastructure.

The Open Compute Project's blockbuster 2024 OCP Global Summit (Oct. 15-17) swarmed with over 7000 attendees thirsty to learn about the latest liquid cooling developments in wake of roughly the past 2 years' data center AI tsunami. 

Fittingly enough, as one of the event's central highlights, Meta Engineering shared its soon-to-be-released Catalina rack design for high-density AI computing. 

Catalina is built to support the latest NVIDIA GB200 Grace Blackwell Superchip to ensure capacity for the growing demands of modern AI infrastructure. 

Meta notes that growing power demands from GPUs mean that open rack solutions need to support higher power capability. The Catalina platform's Orv3, a high-power rack (HPR) capable of supporting up to 140 kW, embodies this support.

As unveiled to the OCP technical community, Meta billed Catalina as the company's newest high-powered rack designed for AI workloads, based on the NVIDIA Blackwell platform full rack-scale solution, and with a design focused on modularity and flexibility. 

The full platform is liquid-cooled and consists of a power shelf that supports a compute tray, switch tray, the Orv3 HPR, the associated Wedge 400 fabric switch, a management switch, battery backup unit, and a rack management controller.

Meta said it aims for Catalina’s modular, open design to empower others to customize the rack to meet their specific AI workloads, while leveraging both existing and emerging industry standards.

"Scaling AI at this speed requires open hardware solutions," the Meta Engineering team wrote on its blog. "Developing new architectures, network fabrics, and system designs is the most efficient and impactful when we can build it on principles of openness. By investing in open hardware, we unlock AI’s full potential and propel ongoing innovation in the field."

Hyperscaler Robots to Muscle Heavier GPU Racks

This year's OCP spotlight announcements also indicated a growing focus on robotics by the hyperscalers as their networks grow.

Google revealed a specific interest in using robotics to manage GPU racks, which are much heavier than many traditional cloud racks, creating new safety concerns for data center staff.

During his keynote at the 2024 OCP Global Summit, Google VP/Engineering Fellow Partha Ranganathan shared video footage of large robotic units moving through a Google data center, managing hard drives and equipment. 

The video is emblematic of the broader OCP data center robotics and automation initiatives, whereby Google is working with Microsoft and Meta to "explore common operational pain points among hyperscalers and highlight specific use-cases for physical automation solutions in the near, mid, and long-term," Ranganathan said. 

"Robotics can be very profoundly transformative in how you think about data center operations scaling much, much more, while also having safety and reliability," said Ranganathan, who cited opportunities for robots in moving data center racks and material, as well as monitoring, repair and servicing, and media management. 

Here's the video of the OCP 2024 keynote by Google's Ranganathan that talks about the company's data center robotics efforts:

 

Keep pace with the fast-moving world of data centers and cloud computing by connecting with Data Center Frontier on LinkedIn, following us on X/Twitter and Facebook, and signing up for our weekly newsletters using the form below.

About the Author

Matt Vincent

A B2B technology journalist and editor with more than two decades of experience, Matt Vincent is Editor in Chief of Data Center Frontier.

Sponsored Recommendations

How Deep Does Electrical Conduit Need to Be Buried?

In industrial and commercial settings conduit burial depth can impact system performance, maintenance requirements, and overall project costs.

Understanding Fiberglass Conduit: A Comprehensive Guide

RTRC (Reinforced Thermosetting Resin Conduit) is an electrical conduit material commonly used by industrial engineers and contractors.

NECA Manual of Labor Rates Chart

See how Champion Fiberglass compares to PVC, GRC and PVC-coated steel in installation.

Electrical Conduit Cost Savings: A Must-Have Guide for Engineers & Contractors

To help identify cost savings that don’t cut corners on quality, Champion Fiberglass developed a free resource for engineers and contractors.

Shutterstock, courtesy of Blueprint Supply Chain
Source: Shutterstock, courtesy of Blueprint Supply Chain

Preventing Loss and Damage to Mission-Critical Gear Within Your Construction Supply Chain

Joey Wagner of BluePrint Supply Chain explains why it's critical to have a reliable quality assurance program and consistent reporting across the entire construction supply chain...

White Papers

Get the full report.

2022 Report: How People, Process and Technology are Redefining Mission Critical Infrastructure Operations

June 16, 2022
A new white paper from BCS Data Center Operations explores how people, processes, and technology are redefining mission critical infrastructure operations.