Pinned Tweet
My slides deck for a 3 hrs lecture "generative AI for science"
drive.google.com/file/d/1D1b…
1/3
Lei Wang retweeted
Ten years ago we posted the first preprint on neural quantum states. Today we're launching Ketworks, a community site on NQS. Two parts: Ketbook, a reference written by the community, and Ketboard, variational energies from the literature on exactly defined benchmarks. Link below
Lei Wang retweeted
(1/9) Our book is out this month. Generative AI and Stochastic Thermodynamics: A Tale of Free Energies, with @wellingmax (@cusp_ai + UvA) and @HoldijkLars (@UniofOxford), from Cambridge University Press (@CambridgeUP).
Lei Wang retweeted
tenferro-rs is a Rust-native dense tensor stack: linear algebra, PyTorch-style eager autodiff, JAX-style traced transforms, NumPy-style einsum, FFT, extensible operation crates, and explicit CPU/CUDA backends.
tensor4all.org/blog/introduc…
#rustlang
Lei Wang retweeted
Exciting, scary, and thoughtful session on the future of AI at #apsmarch and possible breakdown of peer review. Matthew D. Schwartz: "AI will keep getting better and better at physics. We will not."
Lei Wang retweeted
Skill is like an operating system that supports ex-scale "abstract instruction set", so much fun to use it to automate my workflows: jinguo-group.science/sustain…
Lei Wang retweeted
Deep generative models solve the hydrogen Hugoniot puzzle in warm dense matter
Predicting how hydrogen behaves under extreme compression—conditions inside giant planets or during fusion implosions—remains one of the hardest problems in condensed matter physics. The key benchmark is the Hugoniot curve: the thermodynamic states reached when a shock wave compresses deuterium to megabar pressures.
Experiments using lasers, gas guns, and pulsed power facilities have mapped parts of this curve, but results don't always agree, and there's a stubborn theoretical gap. Path-integral Monte Carlo works at high temperatures but hits the fermion sign problem as temperature drops. Ground-state methods break down when thermal electron excitations matter. In between—roughly 10,000–60,000 K—no method has provided reliable predictions.
Zihang Li and coauthors tackle this with a deep variational free energy framework using three jointly trained generative neural networks. A normalizing flow captures the Boltzmann distribution of classical nuclei. An autoregressive transformer learns electron occupation across excited Hartree-Fock orbitals, respecting Pauli exclusion and encoding the Fermi-Dirac distribution as a learned prior. A permutation-equivariant flow applies a unitary backflow transformation to electron coordinates, producing orthonormal many-body wave functions for ground and excited states. All three networks have tractable normalization constants—critical because the free energy includes entropy terms requiring exact probability densities.
By jointly minimizing the variational free energy, the authors compute deuterium's equation of state across the problematic intermediate regime. Their Hugoniot curve agrees with Z-machine and laser experiments, connects smoothly with PIMC at high temperatures, and extends into low-temperature territory where PIMC fails—achieving the "handshake" between ground-state and finite-temperature calculations.
From the ML perspective, the architecture is remarkable: three different generative models—a continuous flow, a discrete autoregressive sampler, and an equivariant coordinate transformation—each targeting a distinct physical degree of freedom, trained end-to-end against a single variational objective. The method avoids the fermion sign problem entirely and computes entropy and free energy directly.
Deep generative models are enabling first-principles calculations where traditional quantum many-body methods hit fundamental walls—delivering more reliable inputs for planetary modeling and fusion design.
Paper: journals.aps.org/prl/abstrac…
I found OpenAI Prism useless without git support. Jinguo's post explains why, latex source code is no different from program source code. (The other thing I learned from him: latex will soon gives its way to typst github.com/GiggleLiu/ptable-…)
Lei Wang retweeted
Use git, this is the reason: jinguo-group.science/git-wor…
Lei Wang retweeted
Some thoughts on vibe coding - AI coding is a powerful, but needs to be done right.
jinguo-group.science/vibe-co…
Lei Wang retweeted
Next AP-CMP seminar!
December 23, 2025 (Tuesday) 11:00 JST-12:00 JST
Gil Young Cho (Korean Advanced Institute of Science and Technology)
Most Two-Dimensional Bosonic Topological Orders Forbid Sign-Problem-Free Quantum Monte Carlo Simulation: Nonpositive Gauss Sum as an Indicator
Lei Wang retweeted
来週のセミナーは、新しい量子埋め込み理論のお話 (DMETの一般化に対応)
Date: September 2, 2025 (Tuesday) 11:00 JST-12:00 JST
Speaker: Tsung-Han Lee
Title: Ghost Rotationally-Invariant Slave-Boson Approach to Strongly Correlated Materials
asian-pacific-cmp-seminars.g…
Lei Wang retweeted
Next talk in one week!
asian-pacific-cmp-seminars.g…
Date: August 12, 2025 (Tuesday), 11:00–12:00 JST
Speaker: Po-Yao Chang (National Tsing Hua University)
Title: Diagnosing Many-Body Systems with Entanglement: Insights from Non-Unitary CFTs and TQFTs
Lei Wang retweeted
We are launching a new online seminar series: the Asian-Pacific Condensed Matter Physics (AP-CMP) Seminars.
asian-pacific-cmp-seminars.g…
The goal is to connect researchers in condensed matter physics across the Asia-Pacific region and beyond.
Talks will be in English and open to all.
Lei Wang retweeted
🚨 Special Issue Alert!
Thrilled to co-edit, together with @wangleiphy & @AninditaMaiti7, a new issue on Deep Generative Models for Simulating Physical Systems 🎯
If you’re working at the intersection of generative models & physics, this could be for you!
🔗 Link in thread 👇🏻
Lei Wang retweeted
We've released the code for LegoGPT. This autoregressive model generates physically stable and buildable designs from text prompts, by integrating physics laws and assembly constraints into LLM training and inference.
This work is led by PhD students @AvaLovelace0, @kangle_deng, @RuixuanLiu_, and in collaboration with CMU faculty Changliu Liu and Deva Ramanan.
LegoGPT is a small first step towards the ultimate goal of generative manufacturing of physical objects. Our implementation is limited to 20x20x20 dimensions, 21 object categories, and simple brick types, but we are working on scaling it up!
Code: github.com/AvaLovelace1/Lego…
Website: avalovelace1.github.io/LegoG…
Demo: huggingface.co/spaces/cmu-gi…
Autoregressive model: alphabets, actions, and atoms wangleiphy.github.io/lecture… This lecture tried to offer a unified perspective to LLM, RL, and atomistic modeling!


















