Advertisements
On March 29, reports surfaced from SiliconANGLE, a technology news outlet, revealing that Celestial AI, a developer of optical interconnect technology based in the United States, has successfully secured $175 million in a Series C funding roundThe funding was led by the U.SInnovation and Technology Fund (USIT), with notable participation from major global semiconductor suppliers Samsung and AMD.
Established in 2020, Celestial AI focuses on developing optical technologies designed to connect processors with memory modules
The company has engineered a platform called Photonic Fabric, which aims to enhance performance acceleration for optical scalability, thereby enabling more efficient data center computing and memory solutions.
In an era defined by smart technology, the volume of data generated online is staggering, and the demands on data centers for higher network speeds and interface performance continue to growTraditionally, data processors transfer information between Random Access Memory (RAM) modules via electronic signalsCelestial AI's innovative Photonic Fabric technology utilizes light to transmit this information rather than relying solely on electricity.
Optical interconnects offer a significant advantage over their copper and electrical counterparts, boasting faster data transmission speeds, higher bandwidth, and lower latency and power consumption
According to company claims, their technology could potentially increase memory bandwidth and capacity by a factor of 25, while also substantially reducing power usage.
Celestial AI's CEO and co-founder, Dave Lazovsky, asserts that the Photonic Fabric presents a novel and efficient approach for designing infrastructure tailored for artificial intelligence (AI).
Many AI chips integrate a memory module specifically designed to store data for neural networksThis memory often hinges on a RAM architecture known as HBM3 (high-bandwidth memory). In comparison to standard RAM, HBM3-based memory can transfer data to connected processors at much greater speeds, enhancing overall processing efficiency.
However, this comes at a cost; individual AI chips can only be equipped with a limited amount of HBM3 memory
If companies require larger capacities, acquiring additional chips becomes necessaryRecent reports from The Next Platform reveal that Celestial AI’s technologies can boost HBM3 memory in AI server clusters to accelerate processing speeds without the overhead of additional processor purchases.
Currently, the most advanced graphics cards featuring HBM3 memory store less than 1TBCelestial AI claims that their Photonic Fabric could enable AI chips to connect with memory capacities reaching up to several tens of terabytesLazovsky remarked, "Today’s advanced AI models demand exponentially increasing I/O bandwidth and memory capacity, yet are hindered by low bandwidth and high latency."
Given the spatial constraints of modern AI processors, the available memory capacity is quite limited
From a technological perspective, chip manufacturers have no choice but to place HBM3 modules in close proximity to the processor, often within a few millimetersThis necessitates a relatively small available space for RAM, thereby restricting the potential memory capacity offered by the chips.
Celestial AI’s Photonic Fabric allows HBM3 modules to be positioned further away from the processor, facilitating the transmission of data via light into and out of these modules, which effectively addresses this limitationFurthermore, the technology supports compatibility with not just HBM3 but also HBM4 memory standards.
Shortly after announcing the Series C funding, Celestial AI also revealed it is currently collaborating with multiple large-scale clients within the semiconductor industry.
The company plans to utilize the funds from this financing round to support its public listing ambitions
According to SiliconANGLE, Celestial AI is actively partnering with clients, including large data center operators and chip manufacturers, to commercialize the Photonic Fabric technologyThese collaborations aim to integrate this innovative chip module into processors, such as graphics cards.
Celestial AI's Series C funding signals a significant endorsement from major players in the tech industry regarding the potential of optical interconnect technologyWith the advancements provided by the Photonic Fabric platform, Celestial AI is poised to break through existing barriers in data transmission and storage, thereby offering processors enhanced memory capacities while propelling the development of optical interconnect solutions.
The company’s plans for commercialization, along with collaborations with industry giants, imply a promising future for optical interconnect technology to achieve widespread application.