Justin Ji (@jujipotle) profile picture

CS @ Harvard

Joined May 2020
Introducing Altara: the scientific intelligence platform for the physical world. Today @evatuecke and I are excited to announce our $7M seed led by @GreylockVC, joined by @Neo, @BoxGroup, @Liquid2V, and angel investors including @JeffDean and leadership from OpenAI & AMD. We’re already working with early customers in semiconductors, batteries, and advanced materials. More below.
136
133
34
862
191,880
Charts and graphs help people analyze data, but can they also help AI? In a new paper, we provide initial evidence that it does! GPT 4.1 and Claude 3.5 describe three synthetic datasets more precisely and accurately when raw data is accompanied by a scatter plot. Read more in🧵!
1
3
20
1,821
I'm visiting exceptional startups in New York this week on the Harvard Startup Trek organized by my brilliant friends @kelschen99, @jonathanlei0, and @evatuecke. Today, we... – Visited Embedded Intelligence (ei.inc) and @Medal_TV, thank you @PimDeWitte and team for an exciting demo. – Visited @bubble, thanks @joshhaas and @emmanuel_s for insights into your founding journey, 7 years of bootstrapping, and challenges of company building (over great chocolate chip coconut cookies too 🍪)! – Visited Moment (withmoment.com) for a deep dive on fixed income trading. Fixed income is the world's most traded asset class, more than 3x size of global equities market, yet surprisingly illiquid. That may soon change, thanks to Moment (who recently partnered with @apexfintech). – Brief pit stop at the @haizelabs office and reunion with @leonardtang_ and @steveshenli. – Visited @withgraphite, thank you to @gregmfoster and @TomasReimers for sharing your origin story building a company amidst a global pandemic, pivoting based on customer feedback, and finding PMF. – Ending the day with a @generalcatalyst x @SunoMusic AI social. Thank you @jonnyjzhang, @Nim_Ravid1, @apjacob03, @KonstDaskalakis, @max_rimpel and team for hosting us at the GC NYC office and for throwing an awesome party. All this and we've only been in NYC for < 24 hours. If you're around, please reach out – would love to meet up while we're here. Everyone else on the Harvard Startup Trek: @calebcapoccia, @evatuecke, @grx_xce, @InakiArango, @jonathanlei0, @jujipotle, @kelschen99, @Nim_Ravid1, @kineticyang, Peggy Yin, Prin Pulkes
1
5
22
2,927
Speed up your DPO training with zero compromises using ✨prefix sharing✨! Prefix sharing speeds up training by 1.2-1.6x 🚀across the datasets we tested and is numerically identical to standard DPO training. Paper: arxiv.org/abs/2410.20305 Code: github.com/frankxwang/dpo-pr…
3
28
2
125
17,908
So excited to have my first #NeurIPS paper!! And so very lucky to have the best collaborators and mentors for this project.
Congrats to our own Harvard College undergrad @aneeshers getting a first-author paper accepted to NeurIPS!!! Great job mentoring this project @imZhiyuZ !!! Check out FastTRAC: computationalrobotics.seas.h…
3
1
22
3,836
What's missing from #LLM #chatbots? Read thoughts from #KempnerInstitute's graduate fellow @ke_li_2021 in this @gradientpub blog:
LLM chatbots are moving fast, but how do we make them better? In my new blog at The Gradient, I argue that an important next step is giving them a sense of "purpose."
1
1
4
741
DPO is extremely effective when scaled with on-policy data scored by synthetic judges. In this blog post, we conduct a case study on summarization, directly optimizing for objective metrics like Q&A accuracy + compression instead of typical subjective ones.
1/11 🥁Anyscale now offers DPO as part of its LLM training suite! This enables refinement of LLMs for domain-specific preferences, which can outperform frontier closed-models & SFT baselines. We demo the capability through a case study on summarization 🧵
3
6
1
21
4,170
⭐New Paper Alert ⭐ How can your #RL agent quickly adapt to new distribution shifts ? And without ANY tuning?🤔 We suggest you get on the Fast TRAC🏎️💨, our new Parameter-free Optimizer that surprisingly works. Why? Website:computationalrobotics.seas.h… 1/🧵
8
22
4
128
41,742
Our first cohort of KRANIUM @Harvard undergrads is here! Learn more about this intensive summer research program, the students, their mentors, and their projects: bit.ly/3VPXzDd #AI #NeuroAI #ML
6
1
30
6,508