Executive Roundtable: Achieving Balance in AI Data Center Designs

Sept. 23, 2024
How can data center operators and developers balance a need for great versatility with a mutual need for great specificity in data center designs for the AI era?

The third installment of our Executive Roundtable for the Third Quarter of 2024 asked our four seasoned data center industry leaders about project management strategies for facility and infrastructure developers seeking to balance a mutual need for versatility and specificity in AI data center designs.

Because as noted by ABB Electrification Products' Solutions Director Yasir Shinaishin in a recent DCF 'Voices of the Industry' guest editorial:

"AI data centers present unique challenges in terms of rack densities and in terms of scale. It is not now uncommon to see data centers of 1 GW with liquid-cooled racks with densities over 100 kW. In the future, we will see even larger data centers with higher rack densities."

 

 

Our panel of data center industry leaders for DCF's Executive Roundtable for the Third Quarter of 2024 includes:

Danielle Rossi, Global Director – Mission Critical Cooling, Trane
Sean Farney, VP of Data Center Strategy for the Americas, JLL
Harry Handlin, U.S. Data Center Segment Leader, ABB 
Josh Claman, CEO, Accelsius

Now onto the third question of the series for our Executive Roundtable for the Third Quarter of 2024.

Data Center Frontier:  What are some key project management tips and strategies for facility operators and developers seeking to balance a need for great versatility with a mutual need for great specificity in data center designs for the AI era? 

 

Danielle Rossi, Trane:  Future-proof, or near future-proof, planning is key to decreasing the future cost and downtime of day two changes to a site. 

Ensuring site design can accommodate future liquid cooling upgrades, higher electrical inputs, and possible load density expansion is the best way to guarantee future versatility. 

Additionally, it is important to adapt to changing requirements over time. 

If a site is pre-planned properly to support future changes and growth, the site operator will be able to pivot designs as needed for an application close to real-time. 

We will see more hybrid cooling designs, particularly in future retrofits, and site operators should be able to adjust to those needs without any substantial site redesign or construction. 

 

Sean Farney, JLL:  Take the time and energy to learn the technology, because the IT equipment for running AI applications is different than legacy IT assets. 

Then, talk with business leaders to understand the current and future needs. 

As you move into design, plan for optimal scalability and flexibility, knowing that requirements may change as the project progresses. 

Our project management team has seen requests to scale in both directions. 

Also, be sure to consider how the facility design can support optimal operational efficiency. 

If you engage your facility management team early in the design phase, they can provide valuable tips that lead to more efficient and resilient operations down the line.

 

Harry Handlin, ABB:  With exponential growth of data generation and storage, data centers are scaling up rapidly and construction trends are emerging. 

Higher power densities are required to support AI data centers.

Being able to adapt is key.  

We expect both electrical and HVAC designs to change. 

It's all due to the expanded scale of the data center and the significant increases in rack densities.

 

Josh Claman, Accelsius:  First, when planning a project, you need to look ahead and guarantee you’ve got investment protection. 

From a cooling perspective, one way to achieve this is by putting in facility infrastructure that can support multiple types of cooling technology, such as a facility water loop that can support single-phase direct-to-chip, two-phase direct-to-chip, and immersion. 

Then, when choosing your cooling technologies, it’s smart to choose solutions that run at the highest possible FW temperature to drive sustainability and efficiency–that way, you won’t have to keep your chillers ramped up around the clock.

Overall, flexibility is key. 

Of course, while we’re convinced that two-phase direct-to-chip cooling is the future of liquid cooling, it’s imperative to keep your options open to whatever the future may bring.

 

Next:  Innovation Paths for Energy-Efficient Data Centers 

 

Keep pace with the fast-moving world of data centers and cloud computing by connecting with Data Center Frontier on LinkedIn, following us on X/Twitter and Facebook, and signing up for our weekly newsletters using the form below.

About the Author

Matt Vincent

A B2B technology journalist and editor with more than two decades of experience, Matt Vincent is Editor in Chief of Data Center Frontier.

Sponsored Recommendations

NECA Manual of Labor Rates Chart

See how Champion Fiberglass compares to PVC, GRC and PVC-coated steel in installation.

Electrical Conduit Cost Savings: A Must-Have Guide for Engineers & Contractors

To help identify cost savings that don’t cut corners on quality, Champion Fiberglass developed a free resource for engineers and contractors.

Conduit Sweeps and Elbows for Data Centers and Utilities

Data Centers and Utilities projects require a large number of electrical conduit sweeps and elbows. Learn why Champion Fiberglass is the best supplier for these projects.

Prefabricated Conduit Duct Banks Enable Smooth and Safe Electrical Installation for a Data Center

Prefabricated conduit duct banks encourage a smooth, safe electrical conduit installation for a data center.

Image courtesy of Submer
Image courtesy of Submer

The Future of Data Center Cooling: Addressing Jitter and Thermal Inconsistencies

Ryan Howard, Solution Engineer at Submer, explores the impact of jitter and thermal inconsistencies on various sectors and how innovative cooling solutions can improve efficiency...

White Papers

Get the full report

Getting to Green – Paving a Sensible Path To Sustainable Data Centers

April 19, 2022
This special report, courtesy of Kohler, explores the current state of the five sustainable energy sources recognized by the U.S. Energy Information Administration – solar, wind...