Flexential CIO Jason Carolan Unpacks the Data Center Industry's NVIDIA Moment
For this episode of the DCF Show podcast, we interview Jason Carolan, Chief Innovation Officer at data center operator Flexential. He’s a 25-year expert in the enterprise IT industry, with experience leading companies through technological evolutions like the one we’re experiencing right now.
Carolan believes there is a bigger story to uncover from the sheer dollar amount of Nvidia’s recent blockbuster valuation. In response to Nvidia’s market dominance in AI and data centers, Carolan wanted to discuss larger trends that may follow from this specific news moment.
According to Carolan:
“Nvidia's earnings results and forecasts for a continued AI boom doesn't come as too much of a surprise with the volume of businesses that are increasingly testing and utilizing the technology.
Nvidia's data center business is a combination of GPU and their network technologies, which further showcases the importance of high performance architectures that can support next generation AI demands. The company is currently forecasted to ship 4-5 times more GPUs this coming year – indicating another trend line with little competition in sight.
As inference matures, we will see more diversity in chip suppliers but that is a ways off. The bottom line is that, now with accelerating AI rollouts, companies will need more compute capacity, ultra-high bandwidth and very low latency in order to succeed.”
Here's a timeline of the podcast's highlights:
1:30 - Carolan explains that Flexential is a US-focused data center and interconnect operator with 41 data centers across 19 markets, and increasingly those workloads are becoming AI workloads
3:37 - Carolan discusses the diversification in the stack of CPUs and GPUs and the thermal demand for both doubling or tripling in the next five years, and how data center operators are trying to support that cooling load. Carolan says operators need to explore and develop a diversified portfolio of cooling solutions that can cater to different types of data center environments, considering the need for SKUs and staged cooling upgrades based on hall-specific requirements.
5:07 - The conversation turns to the recent Cisco announcement with Nvidia and the trend of "incorporating more ASIC level or FPGA level services, which goes back to Tensor," as explained by Carolan. There is also a discussion on the diversification between training and inference and the industry's focus on training.
10:45 - Data Center Frontier asks about competition for Nvidia in supplying GPUs, and wonders about their competitive advantage through their highly integrated platform and vertical integration.
16:02 - The discussion lights on speculation that the next generation of AI innovation will be around and through IoT and dealing with unstructured data growth, and as such, resources need to be moved closer to manufacturing and logistics.
20:57 - Carolan opines on how the data center industry can address PR problems by having an ESG strategy, reducing local impact through design elements and clean energy, engaging with the community and partners early on, and creating a flywheel effect of bringing jobs to the region.
24:43 - Carolan says enterprise deployment will involve either investing in highly dense rack-level architecture with liquid cooling or sliding HGXs into existing environments. Large language models require more data access than inference, which needs a local data repository.
See Also:
As told by our tour guide, Flexential Regional Vice President Tom Myers, the Dallas-Plano data center's customer base is highly diversified across the industrial, retail, manufacturing, technology, financial services, and healthcare sectors.
The announcement of new data center builds in key markets was counterpoint to a recent enhancement of the company's national interconnection capabilities, and the release of its inaugural ESG report.
"Now more than ever, data centers are mission-critical for healthcare and education," says Flexential CEO Chris Downie in the DCF Data Center Roundtable. "Enterprises are hyper-reliant on connectivity."
Flexential CEO Chris Downie is a member of the Editorial Advisory Board for the inaugural Data Center Frontier Trends Summit, to be held Sept. 4-6, 2024 in Reston, Virginia.
Recent DCF Show Podcast Episodes:
- DCF Show: Data Center PR Practice Fosters Coalitions, Community Outreach to Reduce Development Backlash
- DCF Show: Data Center Construction and Dallas Market Talk with Burns & McDonnell
- DCF Show: The Top 5 Data Center Industry Stories of Q4
- DCF Show: Steve Madden, Equinix VP of Digital Transformation and Segmentation Marketing
- DCF Show: 8 Key Data Center Industry Themes for 2024, Part 3
Did you like this episode? Be sure to subscribe to the Data Center Frontier show at Podbean to receive future episodes on your app.
Keep pace with the fast-moving world of data centers and cloud computing by connecting with Data Center Frontier on LinkedIn, following us on X/Twitter and Facebook, and signing up for our weekly newsletters using the form below.
About the Author
Matt Vincent
Matt Vincent is Editor in Chief of Data Center Frontier, where he leads editorial strategy and coverage focused on the infrastructure powering cloud computing, artificial intelligence, and the digital economy. A veteran B2B technology journalist with more than two decades of experience, Vincent specializes in the intersection of data centers, power, cooling, and emerging AI-era infrastructure. Since assuming the EIC role in 2023, he has helped guide Data Center Frontier’s coverage of the industry’s transition into the gigawatt-scale AI era, with a focus on hyperscale development, behind-the-meter power strategies, liquid cooling architectures, and the evolving energy demands of high-density compute, while working closely with the Digital Infrastructure Group at Endeavor Business Media to expand the brand’s analytical and multimedia footprint. Vincent also hosts The Data Center Frontier Show podcast, where he interviews industry leaders across hyperscale, colocation, utilities, and the data center supply chain to examine the technologies and business models reshaping digital infrastructure. Since its inception he serves as Head of Content for the Data Center Frontier Trends Summit. Before becoming Editor in Chief, he served in multiple senior editorial roles across Endeavor Business Media’s digital infrastructure portfolio, with coverage spanning data centers and hyperscale infrastructure, structured cabling and networking, telecom and datacom, IP physical security, and wireless and Pro AV markets. He began his career in 2005 within PennWell’s Advanced Technology Division and later held senior editorial positions supporting brands such as Cabling Installation & Maintenance, Lightwave Online, Broadband Technology Report, and Smart Buildings Technology. Vincent is a frequent moderator, interviewer, and keynote speaker at industry events including the HPC Forum, where he delivers forward-looking analysis on how AI and high-performance computing are reshaping digital infrastructure. He graduated with honors from Indiana University Bloomington with a B.A. in English Literature and Creative Writing and lives in southern New Hampshire with his family, remaining an active musician in his spare time.
Voices of the Industry
