D-Matrix Samples AI Chiplet

Silicon Valley startup D-Matrix is trying to accelerate LLMs with its digital in-memory compute (DIMC) chip. The company’s Corsair card provides up to 9,600 TOPS at 600 W.

Anand Joshi

D-Matrix, a Silicon Valley startup, is sampling its Jayhawk II chiplet. The company plans to release its first product, the Corsair PCIe accelerator card based on eight Jayhawk II chiplets, by the end of 2024. The Corsair card provides 9,600 TOPS using a 12-bit block floating-point format (BFP12) and has a 600 W TDP.

The company raised its Series B funding round in early 2023 when many chip companies were struggling to raise cash. The 100-person company aims to accelerate transformer models, which form the basis of large language models (LLMs). The company, founded in 2019, has raised a total of $154 million in funding from investors including Microsoft, Singapore-based Temasek, and Playground Global.

The company is using a digital in-memory compute (DIMC) architecture that lowers power by reducing data movement from memory. The card supports 16-lane PCIe Gen5 and has 256 GB of onboard RAM. The company has not released any industry benchmarks such as MLPerf.

D-Matrix projects it will generate close to $10 million in revenue this year and reach more than $70 million in annual revenue in two years. The company says Microsoft plans to evaluate the product when it launches next year.