
Hopper Postdoctoral Fellow @BerkeleyLab. Prev: #MachineLearning & #CompBio PhD @Mizzou; Research Intern @ Profluent & Absci. #DeepLearning & #GenerativeModels.
Berkeley, California, USA
Joined December 2012
- Tweets559
- Following1.3K
- Followers907
- Likes2.5K
Alex Morehead (何聪) retweeted
📢 Only two days left to submit to LoG 2026!
We welcome submissions on all areas broadly related to learning on graphs and geometry.
🔗 logconference.org/cfp/
📅 Key dates (AoE):
• July 29 – Abstract deadline
• August 1 – Full paper deadline
Alex Morehead (何聪) retweeted
🧬 MegaFold: Efficient AlphaFold-3 Training Across NVIDIA and AMD GPUs
MegaFold will be presented at ISC High Performance 2026!
🗺️Research Paper Session: ML Systems and Frameworks
🗓️ Wednesday, June 24 · 1:00–2:00 PM (CEST)
📍Hall E, 2nd Floor, Hamburg, Germany
Come find out how we train AlphaFold-3 on 3.36× longer sequences, up to 1.73× faster, on both NVIDIA and AMD GPUs. Using MegaFold, we can successfully train on H200s, MI250 and MI325X. 🚀
Think training AlphaFold-3 (AF3) is just like training an LLM? Think again. Despite having only ~500M parameters, AF3 is up to two orders of magnitude slower to train than a size-equivalent LLM and OOMs on sequences as short as 590 residues.
Why? One operator: 3D attention over 2D pairwise representations. It makes compute and memory scale cubically with sequence length, blowing up activation memory, fragmenting execution into tens of thousans of tiny kernels per iteration, and starving the GPU while the CPU grinds through evolutionary-context preprocessing.
In our latest work, MegaFold, we diagnose exactly why AF3 training is slow and build an end-to-end system that fixes it across the entire stack. The results:
✅ 3.36× longer trainable sequences on 32 GPUs
✅ Up to 1.73× faster per-iteration training (1.62× on AMD)
✅ 23% lower peak memory
✅ Runs on both NVIDIA H200, AMD MI250 & AMD MI325x, fully cross-platform
🔧 Four key innovations:
- EvoFlash-3D: a cross-platform Triton kernel that computes 3D attention without ever materializing the cubic attention map (cutting EvoAttention memory by 4.24×).
- EvoSP-3D: a communication-efficient sharding strategy built for alternating-axis 2D pairwise representations
- EvoFusion: a fused operator stack that tames AF3's kernel fragmentation
- EvoPipe: a determinism-aware host-device pipeline that eliminates preprocessing stalls
And it's verified: MegaFold matches baseline training loss step-for-step, so you get all the speed and memory savings with zero impact on convergence.
Huge thanks to our students Hoa La and Ahan Gupta for working hard on this project, and to our collaborators Jianlin Cheng and Alex Morehead for their valuable contributions, feedback, and support throughout the work!
MegaFold is fully open source. 🎉
💻 Code: github.com/Supercomputing-Sy…
🔗 Project page: supercomputing-system-ai-lab…
📄 Paper: arxiv.org/pdf/2506.20686
📝 Blog: supercomputing-system-ai-lab…
See you at ISC, Hall E! 👋
Alex Morehead (何聪) retweeted
🔬Interested in training AlphaFold3 faster, at scale, and beyond NVIDIA GPU? Now you can.
AlphaFold3 is a major leap in biomolecular modeling, but behind the scenes, it introduces severe system bottlenecks:
🧠 2D EvoAttention spikes memory usage
📉 Retrieval-augmented training pipeline causes long GPU idle time
⛔ Frequent but memory-intensive ops slow everything down
Today, I'm excited to announce MegaFold, a fully open-source system to make AlphaFold3 training fast, scalable, and cross-platform on both NVIDIA and AMD GPUs.
MegaFold delivers:
⚡ Up to 1.73x / 1.62x faster training on NVIDIA H100 / AMD MI250
🧬 Up to 1.35× longer sequences compared to PyTorch baseline
Key features:
🚀 Memory-Efficient EvoAttention via portable Triton kernels
💡 Ahead-of-Time Caching to eliminate GPU idle time in retrieval pipelines
🔗 DeepFusion for reducing overhead of small but frequent memory-intensive AF3 ops
📘 Project page: supercomputing-system-ai-lab…
📄 Paper: arxiv.org/pdf/2506.20686
💻 Code: github.com/Supercomputing-Sy…
🤝 MegaFold is developed in collaboration between UIUC SSAIL Lab and researchers from University of Missouri and Lawrence Berkeley National Laboratory.
Kudos to the brilliant team: Hoa La, Ahan Gupta, Alex Morehead, Jianlin Cheng
#AlphaFold3 #AI #ProteinFolding #Bioinformatics #AMD #Triton #CrossPlatform #OpenSource
Alex Morehead (何聪) retweeted
Unfortunately can't join in-person @icmlconf 🇦🇹 but our awesome co-author @MoreheadAlex will be there!!!
Check out our Oral presentation @ SPIGM Workshop on 26 July and Spotlight poster @AI_for_Science Workshop on 27 July ✨🥳
See our poster + schedule below 👀👇🏻
🧬🤖 Introducing RNA-FrameFlow –– an unconditional generative model for 3D RNA backbone design!
📑: arxiv.org/abs/2406.13839
🧰: github.com/rish-16/rna-backb…
Our method generates ≥ 40% self-consistent *all-atom* RNA backbones that are globally and locally realistic 💪🏻
1/9
Alex Morehead (何聪) retweeted
LoG Conference 2024 is back !!!👉 We are looking for more reviewers! We have a special emphasis on review quality via monetary rewards, a more focused conference topic, and low reviewer load (max 3 papers). But for this we need your help! Sign up here: forms.gle/Nuff4ndVZDFTisb38!
Alex Morehead (何聪) retweeted
🚀 Great news! The @LogConference 2023 proceedings are now available on PMLR: proceedings.mlr.press/v231/ — thanks to the entire community!
We also have some exciting updates about the next edition of LoG, coming soon... ⌛️
Alex Morehead (何聪) retweeted
Published in @NatureBiotech today: @jeffruffolo and I demystify how to design proteins with LMs. Reach out if you have any Qs on how to apply the power of LMs for your protein design goals-- which we do routinely at @ProfluentBio
nature.com/articles/s41587-0…
Alex Morehead (何聪) retweeted
What seemed like an intractable problem is now possible: To design proteins with a specified nonlinear mechanical response, capturing complex folding and unfolding mechanisms in singe and few-shot computations.
We present ForceGen, an end-to-end algorithm for de novo protein generation based on nonlinear mechanical unfolding responses. Rooted in the physics of protein mechanics, this generative strategy provides a powerful way to design new proteins rapidly, including exquisite and rapid predictions about their dynamical behavior.
Proteins, like any other mechanical object, respond to forces in peculiar ways. Think of the different response you'd get from pulling on a steel cable versus pulling on a rubber band, or the difference between honey and glass. Now, we can design proteins with a set of desirable mechanical characteristics, with applications from health to sustainable plastics.
The key to solving this problem was to integrate a protein language model with denoising diffusion methods, and using accurate atomistic-level physical simulation data to endow the model a first-principles understanding. ForceGen can solve both forward and inverse tasks: In the forward task, we can predict how stable a protein is, how it will unfold and what the forces involved are, all given just the sequence of amino acids. In the inverse task, we can design new proteins that meet complex nonlinear mechanical signature targets.
Read the paper, led by @LAMM_MIT postdoc Bo Ni, published in Science Advances: science.org/doi/10.1126/scia…
Why do we care about the mechanics of proteins?
The mechanics of proteins are critical elements of many living systems - as evidenced in many studies of mechanobiology. Through evolution, nature has presented a set of remarkable protein materials with unique mechanical functions like elastins, silks, keratins or collagens that play crucial roles in biology. However, going beyond natural designs to discover proteins that meet specified mechanical properties remains challenging. So far, the only way to do this was to use existing evolutionary concepts or to manually alter proteins.
With our new generative model we can directly design proteins to meet complex nonlinear mechanical property-design objectives. ForceGen leverages deep knowledge on protein sequences from a pretrained protein language model and maps mechanical unfolding responses to create proteins.
Via full-atom molecular simulations for direct validation from physical and chemical principles, we demonstrate that the designed proteins are de novo, and fulfill the targeted mechanical properties, including unfolding energy and mechanical strength, and a detailed unfolding force-separation curves. ForceGen offers rapid pathways to explore the enormous mechanobiological protein sequence space unconstrained by biological synthesis, to enable the discovery of new protein materials with superior mechanical properties.
B. Ni, D.L. Kaplan, M.J. Buehler, ForceGen: End-to-end de novo protein generation based on nonlinear mechanical unfolding responses using a language diffusion model. Sci. Adv. 10, eadl4000 (2024). DOI: 10.1126/sciadv.adl4000
Codes and model weights available @huggingface: huggingface.co/lamm-mit/Prot…
@KaplanLab_Tufts
Alex Morehead (何聪) retweeted
✴️ An LLM for RNA? ✴️
ATOM-1 is a first-of-its-kind #AI foundation model to enable the design of therapies across the #RNA landscape.
Learn more: businesswire.com/news/home/2…
Alex Morehead (何聪) retweeted
Very cool to see a theoretical explanation about why UNets are particularly good for diffusion models.
Tldr: forward diffusion process destroys high frequency information exponentially faster than low.
UNet arch enforce spatial compression (killing high frequencies in the encoder), but adds them back in via skip connections to the decoder.
@NeurIPSConf #NeurIPS2023
Alex Morehead (何聪) retweeted
As many conf. submission/rebuttal deadlines are close, we just decided to extend our ddl for extra 7 days. Take this opportunity to prepare your submission to the best conf. in graph machine learning/geometric deep learning with high-quality reviews and engaged discussions!
The abstract submission deadline of the #LoG conference is extended to August 18th AoE!
Known for high-quality reviews :)
logconference.org/cfp/
There is a nonarchival 5-page track as well.
Thanks for the feedback about the gap between abstract and paper submission deadlines!
Alex Morehead (何聪) retweeted
The deadline for submitting to the best venue for graph machine learning is fast approaching -- with one day left to register your abstract! 🚀
There are 12 days left if you want to submit your paper to the @LogConference!
August 11th is the deadline.
If you have exciting work related to learning on Geometries, Graphs, 3D objects ... submit it here: logconference.org/cfp/
Please share with friends and family :)
Alex Morehead (何聪) retweeted
Sad news as meta lays off their protein machine learning team. For a while, it was a valuable combination of scientific curiosity, openness, and industrial-scale engineering.
ft.com/content/919c05d2-b894…
Alex Morehead (何聪) retweeted
I'll be presenting about incorporating compact structural features (Foldseek!) into PPI prediction with Topsy-Turvy 3D at #ISMBECCB2023 #3DSIG, today at 2pm. Fun as always to work with Kapil Devkota, @rohitsingh8080, Lenore Cowen and @lab_berger!
Alex Morehead (何聪) retweeted
We received around 200 submissions last year, responding to the high demand, we are openly recruiting new reviewers (forms.gle/RxW11dvsf3PbLEfK6) and (new this year!) area chairs (forms.gle/CThEbac9kidHg9EL7)! Please sign up the form if you are interested!
Alex Morehead (何聪) retweeted
New blog post! 🔬 An introduction to generative modelling for small molecule drug design with diffusion models 🧬
Generative modelling for molecular design of all kinds has been gaining significant attention recently (1/7)
medium.com/@cch57/exploring-…
Alex Morehead (何聪) retweeted
Virtually every ML paper is a method comparison, where the authors almost always have a "horse in the race". This is bad for science. We need to diversify and embrace empirical studies that are not incentivized to push a particular narrative or make a specific method look good.
Alex Morehead (何聪) retweeted
Finally, after reviewing process of #ICML2023, we can now officially introduce ProteinDT.
(1) A new multi-modal 𝗳𝗼𝘂𝗻𝗱𝗮𝘁𝗶𝗼𝗻 𝗺𝗼𝗱𝗲𝗹 on the text and #protein.
(2) Rich downstream tasks: representation, text-to-protein generation and editing.
arxiv.org/abs/2302.04611
Alex Morehead (何聪) retweeted
🚀Meet Chameleon! An innovative plug-and-play framework enhancing #GPT4 and #ChatGPT like #AutoGPT for compositional reasoning, blending off-the-shelf tools with tailored LLM models 🔧✨🧠. New SOTA on #ScienceQA and TabMWP! 📈
🔗chameleon-llm.github.io
📜arxiv.org/abs/2304.09842




























