inference @nvidia | eng @westernu @schulichleaders | building and learning for fun
sf/to
Joined February 2015
- Tweets638
- Following619
- Followers3.6K
- Likes3.4K
a few thoughts on this:
- it is now easier to create more than to create less
- create less, but with great intention/meaning
- think about what you are putting out there and why
i think we've glorified productivity so much to where we've lost the joy of creating. i miss the old state of twitter (x) because it felt raw, and nobody really gave a second thought to how well their thoughts would perform online, (speaking purely in terms of engagement). though hacker news and hackaday etc... still preserve remnants of this vanishing culture
Xander Chin retweeted
A year ago, I entered the world of robotics through a hackathon that me and @librendaa072 did.
despite knowing nothing, i enjoyed the experience of building a hardware project immensely more than any of my software ones (immediately regretted picking CS instead of Tron)
after one hardware hack came another, and then another. All while me and Brenda hosted events across Canada and the US.
our revelation? we can’t wait for humanoids, but we also couldn’t imagine them—in their current state, smoothly integrating into society.
perhaps this can be solved in the way we know best: events... but this time, to *also* capture social data.
want a spot at our next event? leave a comment or DM us :)
What used to be sci-fi a year ago is swiftly becoming a reality. Robotics companies around us are racing to create the first, deployable robot into human society. Training is continuously evolving in the age of physical AI, and it won’t be long before clanker friends join us in our homes, in our hospitals, and everyday life.
In 2035, 13M of walking robots in society are expected to be humanoids.
It’s time to teach these robots how to play, and interact in our society.
Introducing: Interplay
For years we’ve hosted events for the people. Somewhere along the way, startups and companies picked up on going IRL as the new method for building trust, creating community, recruiting, and advertising products.
Interplay is creating an entirely new category of events: those curated to bring out the best in humanity… carefully designed to train the best social robots.
Want to teach them? Leave a comment or DM us to grab a spot at our next event :)
Xander Chin retweeted
we made a @bracketbot play cup pong! (or at least, we tried)
first time pulling an all-nighter and learning about how these cuties worked!
check it out
we didn't know how to design a chip a couple months ago
so we reinvented Groq's LPU to run inference on @karpathy 's MicroGPT!
here's a breakdown of what we learned:
if you are ever looking for some guidance hit up @aatikchopra. he’s one of the best coaches out there. Aatik has helped me understand myself and guided me to solve my problems rather than just giving me the answers.
you won't meet another coach who has the same level of curiosity, compassion and investment that Aatik has for you
Xander Chin retweeted
hey @FIFAWorldCup is this valid?
we just ran inference on our reinvented Groq LPU using our custom 2.5k param model!!
Xander Chin retweeted
Reinventing Groq's LPU with @sakshambatraa and @michael_trbo . Recently we transitioned from INT precision to floating points.
Here's a breakdown of how we did it:
Xander Chin retweeted
The LPU team at @nvidia is building the future of low latency inference.
We're going all in on Rust. If you're a cracked Rust engineer and love making hardware do things, we want you.
nvidia.wd5.myworkdayjobs.com…
Xander Chin retweeted
I dropped out of high school at 17 to build my first startup.
Now, at 20, I'm thrilled to share that @TryOmenAI has raised $41.5M in total funding to build intelligence protecting the world's most critical AI compute infrastructure.
Xander Chin retweeted
This sentence from Carl Jung hits hard.
“No matter how isolated you are and how lonely you feel, if you do your work truly and conscientiously, unknown friends will come and seek you.”
Xander Chin retweeted
Want to see distributed computing explained via Pong?
Inspired by TinyTPU and TinyTapeout workshop at FOSSi, I wrote a paper under a week pairs this demo with a proposed next-gen optical I/O chip architecture & a roadmap to prototype it.
Read it on GitHub: github.com/llhtimlam/tt_um_l…
Xander Chin retweeted
A few months ago, I saw Karpathy build NanoChat in PyTorch, and it made me want to understand how these models work underneath the abstractions.
So I decided to try building one myself, but in a different framework: JAX.
Here’s how I did it: 🧵
Xander Chin retweeted
reinventing Groq's LPU with @michael_trbo
we got instruction driven data movement working between SRAM memory blocks and MXM compute!!
Xander Chin retweeted
We implemented @karpathy 's MicroGPT fully on FPGA fabric.
No GPU.
No PyTorch.
No CPU inference loop.
Just a transformer burned into hardware, generating 50,000+ tokens/sec.
The model is small, but the idea is not: inference does not have to live only in software 👇
Xander Chin retweeted
@satvikgari and I have been building our own version of Nvidia’s Blackwell GPU.
We just designed a 4x4 systolic array in Verilog!
Here’s a breakdown of how it works and what we learned building it.
Xander Chin retweeted
blog blog blog blah blah evanlin.ca/writing/exploring…
