
Research Potato in CS @NUSingapore
Ho Chi Minh, Vietnam
Joined March 2019
- Tweets307
- Following2.7K
- Followers230
- Likes1.5K
Pinned Tweet
I’m happy and grateful to share that I’ve started my PhD @NUSingapore under the @AISingapore PhD Fellowship!
Tuan-Duy Hien Nguyen retweeted
First up a hackathon: 20+ researchers · two weeks · @OxfordStats × @NUSComputing × @NTUsg and tokens on tap by @AnthropicAI .
Outcome: Five open‑source AI agents solving common workflow frustrations across the whole research lifecycle. 🧵
Tuan-Duy Hien Nguyen retweeted
🎉Excited to share our new work: "StochasTok: Improving Fine-Grained Subword Understanding in LLMs"!🎉
We rethink tokenization and allow LLMs to ‘see inside’ individual tokens by stochastically splitting them into equivalent pairs. See👇!
Thanks to my incredible co-authors!🥰
🚀Introducing “StochasTok: Improving Fine-Grained Subword Understanding in LLMs”!🚀
LLMs are incredible but still struggle disproportionately with subword tasks, e.g., for character counts, wordplay, multi-digit numbers, fixing typos… Enter StochasTok, led by @anyaasims!
[1/]
Tuan-Duy Hien Nguyen retweeted
🚨My awesome labmate Yiran
@yiran_zhao924
is presenting our #ACL2024NLP poster: “Prompt Optimization via Adversarial In-context Learning”.
🚀 Want to chat about optimising LLM hard prompts by Adv. Learning?
🌟Please check out his presentation on Tue. 5-6pm, Poster Sec. 5!
Tuan-Duy Hien Nguyen retweeted
NUS CS Research Week researchweek.comp.nus.edu.sg… is in full swing with Hamed Hassani @HamedSHassani now giving a talk on robust machine learning.
Tuan-Duy Hien Nguyen retweeted
Very excited about hosting many distinguished researchers for our upcoming @NUSComputing CS Research Week, Jan 10-12, 2024.
researchweek.comp.nus.edu.sg…
The event is public and needs no formal registration.
Tuan-Duy Hien Nguyen retweeted
My DGX Station is the most gorgeous piece of technology that I’ve ever had.
This quoted post is unavailable.
Tuan-Duy Hien Nguyen retweeted
The rise of LLMs has been the main push for the adoption of vector databases. Turning text (or even multimodal) data into an embedding vector can significantly improve performance of any AI application. However, it is quite possible that we can get even better performance if we first build that basis workhorse of the Internet era - a search engine.
Read more in the following blog post:
“Build a search engine, not a vector DB”
blog.elicit.com/search-vs-ve…
Tuan-Duy Hien Nguyen retweeted
📢 My book on Fairness and ML with @s010n and Moritz Hardt has been published by @mitpress! mitpress.mit.edu/97802620486…
The draft (fairmlbook.org) has already been used in many courses. We've also released a set of exercises and discussion prompts: docs.google.com/document/d/1…
Tuan-Duy Hien Nguyen retweeted
We have been working on fairness problems in federated learning. We showed that FL may propagate bias from the most biased parties to the less biased parties. Check our paper here arxiv.org/abs/2309.02160 and a blog post here montrealethics.ai/bias-propa….
Tuan-Duy Hien Nguyen retweeted
bridgit mendler is THE ONLY person who can rival that korean american Navy Seal Doctor Astronaut guy, and it's not close
she's only 30 so she has time...
Harvard JD
MIT PhD and Masters
USC BA
Space Tech Startup
Disney Channel Lead Star
@bridgitmendler
Tuan-Duy Hien Nguyen retweeted
I'm happy to announce the start of a new free and open online course on neuroscience for people with a machine learning or similar background, co-developed by @MarcusGhosh. YouTube Videos and Jupyter-based exercises will be released weekly. There is a Discord for discussions.
Tuan-Duy Hien Nguyen retweeted
Replying to @brickroad7
Hey! I'm so glad you found this exciting -- I've been really excited about how it might help and delighted to be able to share it.
With that said, I do want to caution that a lot of work remains to be done.
xitter.cf/ch402/status/171046145…
Replying to @ch402
Just to be clear:
- I'm very optimistic, but I don't think superposition is "fully solved".
- Superposition was the biggest bottleneck on mech interp in my view, but not the only one.
- Mech interp may help us tell if models are safe, but it doesn't solve alignment in itself.
Why does this read to me as "Just grab VC money without building usable and scalable products"? Maybe I am missing something.
Replying to @thedanigrant
It's a myth that VCs need you to have a technical co-founder
You just need an answer to "How are you going to build your product?"
“We'll prototype with no-code tools then hire an engineer” is 100% OK.
VCs want to see you can build a team, not write code
Tuan-Duy Hien Nguyen retweeted
New paper! We ask: How important is VQ for neural discrete representation learning? 🤔
I always felt it should be possible to “absorb” the VQ on top of a deep net into the net and use a simple grid-based quantization instead, without sacrificing much expressivity.
Summary 🧵👇
Tuan-Duy Hien Nguyen retweeted
I ask DALLE-3 to generate a Pepe but each time I tell it to make it "more rare."
Tuan-Duy Hien Nguyen retweeted
Here's a tutorial that I wrote about training and fine-tuning LLMs. I try to make the motivation and details of RLHF clearer and discuss a new method called direct preference optimization.
borealisai.com/research-blog…
Hope this is helpful. Feedback welcome.



































