Meta Rolls Out New Network Tech for Building its Facebook Metaverse

Nov. 9, 2021
As Meta begins building a digital metaverse to house a future version of the Facebook social network, it is rolling out new networking hardware and software to power its effort. Here’s a closer look at today’s announcements from the OCP Summit.

As Meta begins building a digital metaverse to house a future social network, it is rolling out new networking hardware and software to power its effort. Meta – the newly renamed hyperscale data operator that operates Facebook – unveiled new networking technologies today at the Open Compute Project Summit, including a next-generation top-of-rack switch, a key component of data center networks.

The announcements at the OCP Summit are the first signs of how Meta will build upon its existing infrastructure to create a metaverse – a virtual world populated by 3D avatars

The company has invested more than $16 billion in building and operating 18 Facebook cloud campuses in the United States, which upon completion will span 40 million square feet of data center space.

That spending will clearly ramp up as Meta retools its data centers and networks for the demands of a globally-distributed virtual world that can serve a billion users or more. Meta says it expects to invest between $29 billion and $34 in capital expenditures, up from $19 billion last year.

“The metaverse will rely on many technologies, including advanced AI at scale,” the Meta team said in a blog post. “We’re only about one percent along on the journey, but the road to the metaverse will be paved with open advanced networking hardware.”

New Wedge Top-of-Rack Switches

Network hardware is front and center in Meta’s announcements at today’s kickoff of the annual OCP Summit.

Meta has worked with Broadcom and Cisco to develop next-generation versions of its Wedge top-of-rack (TOR) switches, which use custom ASICs (application specific integrated circuits) to optimize its network. The Wedge 400 will use Broadcom’s Tomahawk 3 ASIC, while the 400C uses Cisco’s Silicon One chip. Both versions offer higher front panel port density and greater performance for AI and machine learning applications.

The new switches are already deployed in Facebook data centers, and are providing four times the switching capacity over the predecessor Wedge 100S. Both Wedge 400 switches are manufactured by Celestica and are open platforms that developers can use in their own projects.

Meta says its data center network fabrics have fabrics have evolved from 100 Gbps to the next-generation 200 Gbps/400 Gbps. The company has developed two next-generation 200G fabric switches, including an update of Meta’s own Minipack2 modular network switch, as well as working with Arista Networks on the Arista 7388X5. Both are backward compatible with previous 100G switches and will support upgrades to 400G.

Migrating to OCP Switch Interface

Emphasizing its focus on open networking, Meta also said that it has migrated its data center network hardware to a standard and open API — the Open Compute Project (OCP) Switch Abstraction Interface (SAI).

“In the past, FBOSS, Meta’s own network operating system for controlling network switches, has utilized the specific API provided by the ASIC vendor,” the Meta team said. “Now, with FBOSS being adapted to OCP SAI and deployed at scale in the Meta network, we can work with more silicon vendors.

“Adapting and migrating FBOSS to SAI means we can onboard multiple ASICS from multiple vendors more quickly and easily onboard new ones in the future,” the company added. “SAI’s API lets engineers configure new networking hardware without needing to delve into the specifics of the underlying chipset’s SDK (software development kit).”

10 Years of Open Compute

The Meta team observes the 10-year-anniversary of the Open Compute Project with reflections on the success of Facebook’s open hardware initiative, as well as its ambitions for the next 10 years.

“As we look at the next decade, we want to build an open and standardized approach to solving even more of the big problems that our industry is facing collectively,” said a blog post from Meta’s Mark Roenigk, Omar Baldonado and Dharmesh Jani.

A key priority is the work of the OCP Domain Specific Architecture workgroup to develop custom chip hardware for demanding new workloads.

“Moore’s era of transistor doubling has tapered, and the industry is looking at chiplets to continue achieving the performance gains of past.,” the Meta team wrote. “We are focused on building an open and standard die-to-die interface that can be used by all in the industry to develop innovative solutions that large data center operators, including Meta, can easily integrate within our data centers.”

The hardware innovation ecosystem of the Open Compute Project will be key to building infrastructure that can handle the computing challenges of the metaverse.

“To deliver a diversity of new workloads that will be created as a result, we continue down the path of disaggregated global networks and data centers that will underpin all of this,” Meta writes. “Open hardware drives the innovation necessary to reach these goals. And our collaborations with both long-standing and new vendors to create open designs for racks, servers, storage boxes, motherboards, and more will help push Meta and the wider industry onto the next major computing platform.”

About the Author

Rich Miller

I write about the places where the Internet lives, telling the story of data centers and the people who build them. I founded Data Center Knowledge, the data center industry's leading news site. Now I'm exploring the future of cloud computing at Data Center Frontier.

Sponsored Recommendations

NECA Manual of Labor Rates Chart

See how Champion Fiberglass compares to PVC, GRC and PVC-coated steel in installation.

Electrical Conduit Cost Savings: A Must-Have Guide for Engineers & Contractors

To help identify cost savings that don’t cut corners on quality, Champion Fiberglass developed a free resource for engineers and contractors.

Conduit Sweeps and Elbows for Data Centers and Utilities

Data Centers and Utilities projects require a large number of electrical conduit sweeps and elbows. Learn why Champion Fiberglass is the best supplier for these projects.

Prefabricated Conduit Duct Banks Enable Smooth and Safe Electrical Installation for a Data Center

Prefabricated conduit duct banks encourage a smooth, safe electrical conduit installation for a data center.

Image courtesy of Submer
Image courtesy of Submer

The Future of Data Center Cooling: Addressing Jitter and Thermal Inconsistencies

Ryan Howard, Solution Engineer at Submer, explores the impact of jitter and thermal inconsistencies on various sectors and how innovative cooling solutions can improve efficiency...

White Papers

Get the full report.

Reimagine Enterprise Data Center Design and Operations

April 27, 2022
Future Facilities explores how digital twin technology can be used to virtualize and fine tune data center design.