The AI Revolution: Reshaping Data Centers for the Future

July 23, 2024
In this episode of the Data Center Frontier Show podcast, DCF Editor in Chief Matt Vincent speaks with Manja Thessin, RCDD, RTPM, AFL's Market Manager – Market, Strategy & Innovation.

Welcome to the forefront of data center innovation! In this podcast, we'll explore how Artificial Intelligence (AI) is driving a revolution in data center design. We'll delve into three key areas: high-performance networking, cutting-edge cooling solutions and advancements in fiber optic technology. These advancements are all essential for supporting the ever-growing demands of powerful AI systems.

Building the Superhighways of Data

The lifeblood of AI is data, and moving it efficiently is paramount. We'll explore two key networking advancements:


•    RDMA/ROCE and Ultra Ethernet: These technologies are designed to optimize data transfer within AI clusters. RDMA provides a direct, high-speed lane for data movement, while Ultra Ethernet offers a future-proof architecture for even more demanding applications.
•    SERDES and the Rise of 800G: We'll unpack Serialization and Deserialization (SERDES), a fundamental technology for converting data into a transmittable format. Higher SERDES rates and modulation techniques like PAM are enabling the jump to 800G networking speeds, providing the bandwidth needed for complex AI workloads.

Keeping Cool Under Pressure

As AI chips become more powerful, they generate more heat. Traditional air cooling methods struggle to keep pace. We'll discuss advanced cooling techniques that will be essential for managing the thermal load of future data centers:
•    On-Board Optics (OBO): This technology integrates data transmission components directly onto equipment, reducing latency and increasing efficiency. OBO is poised to become a mainstream solution for future data centers.
•    Water and Immersion Cooling: These advanced techniques offer superior heat dissipation compared to air cooling. They will be crucial for managing the thermal demands of high-density AI clusters.

Packing More Data, Less Space: Fiber Innovation

The ever-increasing number of connections within AI clusters demands advancements in fiber technology. We'll explore two key areas:
•    Multicore Fiber (MCF): This innovation transmits multiple data streams through a single fiber, significantly increasing bandwidth capacity.
•    Reduced Fiber Diameter: By making fiber strands thinner, data centers can pack more cables into the same space, accommodating the ever-growing connection density of AI clusters.
•    High-Density Connectors: With more fibers comes the need for innovative connector designs. We'll discuss Multi-Fiber Very Small Form Factor (MF VSFF) connectors, which offer a high-density, low-loss solution critical for future AI deployments.

The growth of AI is pushing the boundaries of data center technology. From high-speed networking to innovative cooling solutions and ever-denser fiber optic solutions, the future of data centers is being shaped by the demands of artificial intelligence. As the demand on exascale computing intensifies, we can expect even more groundbreaking advancements in the years to come. Thanks for joining us on this exploration of the exciting future of data centers!

Sponsored by:

Sponsored Recommendations

How Deep Does Electrical Conduit Need to Be Buried?

In industrial and commercial settings conduit burial depth can impact system performance, maintenance requirements, and overall project costs.

Understanding Fiberglass Conduit: A Comprehensive Guide

RTRC (Reinforced Thermosetting Resin Conduit) is an electrical conduit material commonly used by industrial engineers and contractors.

NECA Manual of Labor Rates Chart

See how Champion Fiberglass compares to PVC, GRC and PVC-coated steel in installation.

Electrical Conduit Cost Savings: A Must-Have Guide for Engineers & Contractors

To help identify cost savings that don’t cut corners on quality, Champion Fiberglass developed a free resource for engineers and contractors.

CoolIT Systems
Source: CoolIT Systems

Selecting the Right Coolant Distribution Unit for Your AI Data Center

Ian Reynolds, Senior Project Engineer with CoolIT Systems, outlines considerations for selecting the best CDU for your needs.

White Papers

Download the full report.

PCIe® 6.0: Testing for a New Generation

Aug. 1, 2021
This white paper from Anritsu outlines the enhanced PCIe 6.0 technologies, such as PAM4, Forward Error Correction (FEC) and link equalization. It also provides guidelines on selecting...