Amazon Bets on Hollow Core Fiber to Keep a Million Chips in Sync

Seoul Economic Daily Visits AWS Networking Lab, a First for Korean Media Hollow Core Fiber Carries Light at Near-Vacuum Speed, 50% Faster Inside Widening Distances Between Data Centers Create Latency Problems Hyperscalers Race to Build Out HCF Networks Nvidia, the Largest AI Chip Maker, Joins the Scramble for Optical Fiber Complex Manufacturing and High Cost Remain Hurdles

International|
|
By Kim Chang-youngkcy@sedaily.com
||
An AWS employee inspects networking equipment. AWS - Seoul Economic Daily International News from South Korea
An AWS employee inspects networking equipment. AWS

SILICON VALLEY — Inside the Amazon Web Services networking lab in Mountain View, California, on the 9th, rows of server racks draped in yellow optical cable stretched across the research floor. The cables ran through transceivers, which convert signals between electrical and optical form, linking trays about 50 centimeters wide within each rack and connecting racks standing side by side. On a table next to the servers, equipment measured how much transmission loss the cable prevented over distances of more than a kilometer. It was the first time AWS, the world's largest hyperscaler, or operator of large-scale computing infrastructure, had opened the lab to Korean media.

Optical fiber sits at the center of that network. AWS researchers showed reporters hollow core fiber, or HCF, billed as the next generation of the technology. It is an opaque strand as thick as a human hair, measured in micrometers, or millionths of a meter, that runs inside the optical cables carrying data between servers in a data center. From the outside it looks no different from conventional fiber. Inside it is another thing entirely. Where standard fiber is filled with glass or another solid, the center of an HCF strand is empty. Light travels quickly through that core, confined by a cladding of high-purity silica. The fiber measures 125 micrometers across, with a core diameter of just 8 to 9 micrometers.

AWS employees explain how hollow-core optical fiber reduces transmission loss at the Amazon Web Services networking lab in Mountain View, California, on Sept. 9 local time. Correspondent Kim Chang-young - Seoul Economic Daily International News from South Korea
AWS employees explain how hollow-core optical fiber reduces transmission loss at the Amazon Web Services networking lab in Mountain View, California, on Sept. 9 local time. Correspondent Kim Chang-young

Filled with air, HCF is the key technology for tying together distant data centers while cutting network latency. The idea rests on the lower refractive index of air compared with a solid such as glass, which lets light pass through faster. Switching the transmission medium from glass to air lifts speeds from about 200,000 kilometers per second to roughly 300,000, and sharply increases bandwidth, or the volume of data carried per second. That 300,000 figure is the speed at which light travels in a vacuum. Conventional fiber carries a transmission latency of 5 microseconds, or millionths of a second, per kilometer; HCF runs at 3.3 to 3.5. In practical terms, HCF extends reach by 50% over standard fiber and improves latency by 30%. Given that the continental United States spans 1,700 to 1,800 kilometers from east to west, shaving 1 to 2 microseconds per kilometer counts as a substantial gain.

An AWS employee explains the thickness of a hollow-core optical fiber, thinner than the lines on a palm, at the Amazon Web Services networking lab in Mountain View, California, on Sept. 9 local time. Correspondent Kim Chang-young - Seoul Economic Daily International News from South Korea
An AWS employee explains the thickness of a hollow-core optical fiber, thinner than the lines on a palm, at the Amazon Web Services networking lab in Mountain View, California, on Sept. 9 local time. Correspondent Kim Chang-young

The AI industry tends to name graphics processing units and high-bandwidth memory as its bottlenecks, but AWS argues the network matters as much as the silicon. "Take Project Rainier," said Stephen Callaghan, principal network development engineer at AWS, referring to the company's massive AI infrastructure effort. "There are places handling more than a million chips. A problem in any single part of the network stops every GPU." Callaghan added: "The GPUs have to move through every task in sequence, like an army marching in lockstep. Our principle has been to keep the network running at its best so customers can think about nothing but the GPUs."

HCF is drawing attention as a way past the physical distance limits of data centers. Constraints on the sheer volume of AI chips, on the electricity needed to run and cool the facilities and on industrial water supply are pushing individual sites to grow larger and to sit farther apart. AWS has broken ground on a new subsea cable linking the western United States and Japan, targeted for service in 2029 — a measure of how much securing low-latency, high-bandwidth networks across physical constraints has become the central challenge.

A hollow-core optical fiber as thick as a strand of hair, alongside a model built to illustrate its structure. AWS - Seoul Economic Daily International News from South Korea
A hollow-core optical fiber as thick as a strand of hair, alongside a model built to illustrate its structure. AWS

AWS operates 123 data center clusters across 39 regions worldwide. The optical fiber cable it has laid undersea, underground and overland to connect those sites, and to wire each of them internally, runs to 20 million kilometers. That is enough to circle the Earth, at 40,000 kilometers around, 500 times, or to make 25 round trips to the moon. Working with several manufacturers, AWS built its own HCF procurement system and began deploying the fiber in its data centers in 2024. It now links more than 10 of them. "The scale of AI is becoming enormous, and everything runs through the data center," said Matt Rehder, vice president of network engineering at AWS. "Our goal is to use HCF to extend reach without adding latency."

Copper, which carries electrical signals, was once the main material in the network cables connecting data centers. As the race to develop AI has intensified, optical fiber, which moves data as light, has taken its place in the spotlight. AI chips that handle training, such as GPUs, and the memory that speeds up their calculations have long been cast as the bottleneck; more recently, network speed and reliability have emerged as another one. The realization, in short, is that however many AI chips and memory modules a data center packs in, none of it matters if the network linking the servers breaks down. Data Bridge Market Research, a global market research firm, projects the worldwide optical fiber market will surge from $7.36 billion in 2024 to $15.45 billion in 2032.

An AWS employee presents network servers connected by optical fiber at the Amazon Web Services networking lab in Mountain View, California, on Sept. 9 local time. Correspondent Kim Chang-young - Seoul Economic Daily International News from South Korea
An AWS employee presents network servers connected by optical fiber at the Amazon Web Services networking lab in Mountain View, California, on Sept. 9 local time. Correspondent Kim Chang-young

AWS rivals have entered the same race. Microsoft began deploying HCF in Azure, its data center cloud, in 2023, and last September said it would work with Corning, the U.S. fiber manufacturer, and Heraeus Covantics, a silica materials company, to expand HCF production. Microsoft acquired Lumenisity, a spinout from the Optoelectronics Research Centre at the University of Southampton in Britain, in 2022, then built what it called the world's first advanced HCF manufacturing plant in the U.K. In response, AWS said on the 8th that it would partner with Qualcomm, the mobile chip company, on 1.6-terabit-per-second optical communications technology to raise data transfer speeds inside data centers.

Nvidia, the world's largest AI chip company, has concluded that securing enough optical fiber is essential to running its GPUs reliably, and signed an advanced fiber supply agreement with Corning in May. Corning agreed to increase its U.S. optical connector production capacity tenfold and expand fiber output by 50%. Nvidia secured the right to invest as much as $3.2 billion in the company. In March, Nvidia had invested $2 billion each in Lumentum Holdings, the U.S. optics and laser component maker, and Coherent, an optical transceiver manufacturer, signing multiyear non-exclusive purchase agreements with both.

Nvidia CEO Jensen Huang. Reuters-Yonhap - Seoul Economic Daily International News from South Korea
Nvidia CEO Jensen Huang. Reuters-Yonhap

Nvidia Chief Executive Jensen Huang has taken a personal hand in locking down optical equipment, attending the groundbreaking in June for an expansion of Coherent's plant in Sherman, Texas. Optical transceivers convert electrical signals into light and back. Having concluded that AI chips and memory alone — GPUs and high-bandwidth memory — can carry performance only so far, Nvidia is cutting copper wiring and adding optical transceivers in next-generation accelerators such as Vera Rubin.

For all its gains in reducing signal loss and raising speed, HCF has limits to overcome: complicated manufacturing and cost. Conventional fiber optic cable runs a few dollars per meter, while HCF costs about $600. Because the strand is hollow, performance degrades when it is bent or struck. Some also argue the bandwidth gains will not justify the expense.

※Subscribe to Silicon Valley Look for news on Silicon Valley technology, investment and startups, as well as engaging features. https://media.naver.com/hotissue/main?sid1=163&cid=1088902 - Seoul Economic Daily International News from South Korea
※Subscribe to Silicon Valley Look for news on Silicon Valley technology, investment and startups, as well as engaging features. https://media.naver.com/hotissue/main?sid1=163&cid=1088902

Original reporting by Kim Chang-young for Seoul Economic Daily.

AI-translated from Korean. Quotes from foreign sources are based on Korean-language reports and may not reflect exact original wording.

Watch · Seoul Economic Daily

More →
2:28

AI KEY

Preview
Korean Corporate Intelligence HubKOSPI · KOSDAQ · 12 sectors

A live, cap-weighted view of every KOSPI and KOSDAQ sector, with same-day Korean reporting distilled by company — built for foreign investors, correspondents and analysts who need to scan Korea before the next session.

Korea Company Atlas

Preview
Market Ontology · The Feedback LoopKFTC 2025 · 92 groups · 121,954 articles

An English ontology of the Korean market — how companies, the media, the government and the National Assembly move each other in a loop. Korea's named controlling persons and designated business groups are a mechanism, not a risk to be priced blind.

SIGNAL

Now live
English Edition · Capital MarketsM&A · IPO · PE · Fund Flows

SIGNAL English Edition is live — Korea's deal desk reporting in English. M&A, IPOs, private equity and fund flows, covered daily for global institutional investors. Browse free; subscriber-only scoops at the 50% intro rate.