Purpose-built AI inference for modern data centers. Powering heterogeneous AI infrastructure with digital in-memory compute.
Santa Clara, CA
Joined February 2022
- Tweets328
- Following181
- Followers1.5K
- Likes345
AI inference is driving a new era of specialized hardware. Exciting to see this shift accelerating, and proud to be collaborating with the Gimlet Labs team!
@PitchBook is bullish on d-Matrix.
Its latest report ranks us the most probable to have a successful IPO and lists us among the most operationally efficient.
Explore the findings and insights from CEO @sidsheth.
Download: pitchbook.com/news/reports/q…
#AIInference #dMatrix #InfiniteInference
Tomorrow at #PyTorchCon, join d-Matrix Principal Engineer Tristan Webb for a Demo Theater session on how PyTorch can help accelerate kernel development for custom AI hardware.
dmx-compressor: Accelerating the Development of Kernels for Custom ASIC Hardware
🕧 Wednesday, October 21 | 12:35 PM
📍 Community Expo, Concourse Level
#PyTorchCon #AIInfrastructure #AIInference #dMatrix
Breaking through the memory wall. Rethinking AI inference.
d-Matrix CEO @sidsheth joins Tae Kim (@firstadopter) to discuss memory-centric compute, 3D-stacked DRAM, and the future of low-latency AI inference.
Read the interview: taekim.substack.com/p/an-int…
#AIInference #AIInfrastructure
Next week, d-Matrix is heading to #PyTorchCon in San Jose.
Stop by the d-Matrix booth to meet the team and join d-Matrix Principal Engineer Tristan Webb for his session.
“Accelerating the Development of Kernels for Custom ASIC Hardware”
🕧 Wednesday, October 21 | 12:35 PM
📍 Community Expo, San Jose Convention Center
#AIInference #AIInfrastructure #PyTorch #dMatrix
800+ tokens/sec per user. Heterogeneous inference in action.
At #OCP2026, d-Matrix demonstrated live attention/FFN disaggregation across NVIDIA H100 GPUs and memory-centric Corsair™ nodes.
Watch the demo:
nextgeninfra.io/2026-ocp-glo…
Join d-Matrix's Senior Principal AI Systems Architect Sai Rahul Chalamalasetti at #OCPSummit26 today for a session on scaling communication across increasingly complex AI systems.
One Abstraction, Many Transports: Push-Mode Communication from Chiplet to Rack
🕐 1:15pm
📍 SJCC — Concourse Level, Expo Hall Theater
#AIInfrastructure #OCP2026 #dMatrix
845 tokens/sec per user. ~50% lower latency.
d-Matrix Corsair + NVIDIA H100 are redefining AI inference with attention-FFN disaggregation.
Faster inference. Smarter compute.
Read more: d-matrix.ai/accelerating-ai-…
Meet d-Matrix Squadron. AI inference at data center scale.
Up to 1,024 Corsair XPUs. Ultra-low latency. Air-cooled, megawatt-scale compute.
Built for the next era of AI inference.
Explore Squadron: d-matrix.ai/announcements/sq…
#OCP2026 #AIInference
Big ideas. Bold conversations. NYC energy. ⚡
We're teaming up with @parasail_io and @youdotcom for the AI Engineer New York Speaker VIP Happy Hour!
AI innovators, great connections, and conversations shaping what's next.
See you in NYC! 🚀 luma.com/6dobkzfh
#AIEngineer #AIInference #dMatrix
Next week, we’re heading to #OCPSummit26!
Don’t miss d-Matrix:
Oct 12, 12 PM — Sid Sheth
Oct 14, 1:15 PM — Sai Chalamalasetti
📍 Visit us at Booth C82!
Two sessions. One mission: Infinite Inference.
opencompute.org/events/ocp-s…
AI infrastructure is evolving — and it takes an ecosystem to move it forward.
Great to see @AristaNetworks’ latest announcement on open Ethernet rack-scale infrastructure for AI.
As CEO Sid Sheth said: “Delivering interactive AI at scale is a complex tech challenge requiring collaboration across the ecosystem.”
Open standards. More choice. Built for what’s next.
arista.com/en/company/news/p…
#AIInference #dMatrix #AIInfrastructure
We’ve been named one of @FastCompany’s 2026 Next Big Things in Tech in the Foundational AI category.
Our Corsair™ AI inference platform and memory-centric architecture are redefining AI inference — delivering up to 10x faster interactive inference and up to 3x better energy efficiency for LLM workloads, without relying on scarce HBM.
Proud of the d-Matrix team.
Read more: fastcompany.com/next-big-thi…
#FCTechAwards #AIInference #dMatrix
Tonight in SF: d-Matrix’s Nithesh Kurella and Prashant Nair join the 90/30 Club to discuss Raptor—the first 3D-DRAM accelerator for generative inference and what we’re learning from early silicon.
Up to 100 TB/s memory bandwidth per card.
Join us: luma.com/kyovs0is
#AI #AIInference #dMatrix
Inference is changing, and so are the metrics we use to measure it.
In a new interview with @letsdatascience, d-Matrix CTO Sudeep Bhoja shares how to evaluate next-gen inference platforms through real-world performance, efficiency, and the metrics that matter most.
The conversation also explores Raptor and the role of heterogeneous infrastructure.
Read more: letsdatascience.com/news/d-m…
#AIInference #InfiniteInference
AI inference is entering a new phase.
On this episode of Eye on A.I., d-Matrix CEO @sidsheth joins @craigss to unpack the “premium token economy,” why purpose-built infrastructure matters, and how organizational AI could change the way companies operate.
Listen here: youtube.com/watch?v=JYeXwCFv…
d-Matrix Founder & CEO @sidsheth joined industry leaders at the @GlobalSemi (GSA) US Executive Forum for “The $700 Billion Bet — What Hyperscalers Want from the Semiconductor Industry.”
A timely discussion on what the next phase of AI infrastructure will demand from the semiconductor industry as AI scales.
AI Infra Summit went beyond the show floor.
We welcomed a group of reporters and industry analysts to the d-Matrix office and lab for a closer look at what we’re building, from our silicon to our server racks.
Thank you to everyone who joined us for the lab tour.
#InfiniteInference #AIInfraSummit
The path to infinite inference.
d-Matrix CEO @sidsheth took the Main Stage at #AIInfraSummit2026, while Satyam Srivastava and Chris Nicol joined discussions on low-latency inference and distributed AI infrastructure.
Thanks to everyone who joined us at Booth 722.
#AIInference #dMatrix
