Husband. Father. Engineering Director. Science & book nerd. Lifelong hockey player. Grew up in small town USA. Adult life lived in Madison,SF Bay Area, Boulder.
in a van down by the river
Joined January 2021
- Tweets12
- Following55
- Followers139
- Likes6
Exciting work to be presented at #NeurIPS2022 by my colleague @zhouyanqi30 showing nice efficiency and performance improvements for MoE through a better routing algorithm.
Introducing a novel mixture-of-experts routing algorithm, called Expert Choice, that can achieve optimal load balancing between experts while allowing heterogeneous token-to-expert mapping. Learn how it’s done at goo.gle/3OdpO9t
ALT With Expert Choice routing, experts with predetermined buffer capacity are assigned top-k tokens, thus guaranteeing even load balancing. Each token can be received by a variable number of experts.
Honored to be an advisor to this amazing work led by @Azaliamirh and @annadgoldie
Excited to share that our work has been published in Nature! Our RL agent generates chip layouts in just a few hours, whereas human experts can take months. These superhuman AI-generated layouts were used in Google's latest AI accelerator (TPU-v5)! nature.com/articles/s41586-0…
Honored to be an advisor to this amazing work led by @Azaliamirh and @annadgoldie
Thrilled to announce that our work on RL for chip floorplanning was published in Nature & used in production to design next generation Google TPUs, with potential to save thousands of hours of engineering effort for each next generation ASIC:
nature.com/articles/s41586-0… (1/7)
ALT Image by Google internal agency Hook.
JamesLaudon retweeted
Leveraging #MachineLearning for accelerator design enables faster exploration of the architecture search space leading to more efficient hardware across a range of applications.
Collaboration w/: @cangermueller, Berkin Akin, Yanqi Zhou, @miladhash, @kswersk.
Check out new work on ML-driven design and exploration of custom accelerators, showing how #MachineLearning facilitates architecture exploration by rapidly identifying high-performing configurations across a range of applications. Learn more ↓ goo.gle/3rngiEh
Amazing work by my amazing Google Research colleagues!
On behalf of the entire Google Research & @GoogleAI communities, I'm excited to share an overview of some of our research in 2020.
Thanks to everyone who helped make this work possible!
ai.googleblog.com/2021/01/go…
Yesterday’s rioting, violence, vandalism, and looting by an unruly mob of #Seditious criminals is #AntiAmerican. They and their ringleader need to be arrested, tried by a jury of their peers, and sent to prison if found guilty. #NoOneIsAboveTheLaw
The USA is a nation with a long history of respecting #RuleOfLaw and the right of voters in each state to determine their federal senators, congressmen and women, and to guide the votes of their electoral college representatives.
Logged into Facebook after a long hiatus to post Happy New Year. Scrolled down my feed, where what to my wondering eyes did appear but a post by Trumpers quoting Malcolm X to argue their case. Yikes Alice, does this rabbit hole even have a bottom?