Less Wright (@lessw2020) profile picture

Less Wright

@lessw2020

@PyTorch, Large Scale Distributed AI Training, Object Detection, Optimizers, Stock Indexes

linkedin.com/in/less-wright-22b59017/
Joined November 2016
  • Tweets11
  • Following19
  • Followers206
Blog post showcasing some of my kernel work at Cursor: cursor.com/en-US/blog/warp-d…
Better MoE model inference with warp decode · Cursor

Better MoE model inference with warp decode · Cursor

By flipping the parallelism axis we achieve 1.8x faster and more accurate MoE model inference.

cursor.com
1
9
310
Our TorchTitan Paper has been Accepted to ICLR 2025! (lnkd.in/gw5gfVVA) From the paper chair: " I recommend Accept ...: (a) This is a production-grade framework that covers a wide range of parallelism method and .... is likely to have significant impact "

LinkedIn

This link will take you to a page that’s not on LinkedIn

lnkd.in
2
7
834
We've just released the first version of our Deep Learning Tuning Playbook! This is our attempt to distill our process for actually getting good results with deep learning. We emphasize hyperparameter tuning since it has been a large pain point. github.com/google-research/t…
GitHub - google-research/tuning_playbook: A playbook for systematically maximizing the performance...

GitHub - google-research/tuning_playbook: A playbook for systematically maximizing the performance...

A playbook for systematically maximizing the performance of deep learning models. - google-research/tuning_playbook

github.com
44
785
45
3,590
672,771
testing my new handle
1
Excellent article on vector processing on CPU and GPU. If you want to dive deeper into what's happening internally and the tradeoffs involved, this covers SIMD, SIMT, blocks, warps, and more: erik-engheim.medium.com/vect…
1
Trying out @zksync 2.0 zkEVM! uni.zksync.io Send some test tokens for 0x9495f4d2477511a8cf4e.
My trading strategy Software Stars is up +53% for the year so far! collective2.com/details/1217…
Verifying myself: I am silicontitan on Keybase.io. K_jka6m-OwMKZJX11cnIEsiEZzQb_OMyUTrZ / keybase.io/silicontitan/sigs…
#KarenTheSuperTrader = lost $50M in SPX Options, over-leveraged, and then used fraud? Over-leverage strikes again...bit.ly/2fOaiTL
1
Load more