Joined October 2023
Ji Soo Lee retweeted
💡 Millions of shared skills. Why should agents keep starting from scratch? Excited to share RASO! 🚀 Retrieve shared skill knowledge, adapt it to the target harness, and use it for rollout-free initialization and feedback-driven updates. #AgenticAI #Skill #Harness
6
2
9
300
Meta researchers have created a novel and very useful health benchmark: WearableQA As LLMs are starting to be used to analyze longituditinal wearable data for personalized medicine applications, it is important to systematically benchmark this capability on real-world data. Here, the authors introduce WearableQA, a benchmark for data and health reasoning on real-user longitudinal wearable records. WearableQA contains 4,084 multiple-choice questions constructed from 200 real users’ wearable measurements (16 daily metrics) collected over hundreds of days per individual, with complementary blood biomarkers (17 biomarker blood panel) and demographic information. The benchmark has two axes of questions: * reasoning type: some questions require data reasoning (computing trends, anomalies, and relationships from the raw wearable measurements) while others require health reasoning (clinical and physiological interpretation) * signal complexity: there are single-signal questions vs. cross-signal questions The authors evaluated a total of XXX models, both proprietary and open-source. A few conclusions: * performance ranges widely, from 72.9% accuracy to 19.6% against a 10% chance baseline. * Data reasoning remains more challenging than health reasoning for most models. * Cross-signal reasoning remains challenging across model scales. Note that the benchmark hasn't been released yet, though the paper has links for HuggingFace and GitHub, so the release is likely soon. Paper link: arxiv.org/abs/2609.05405
4
12
1
70
5,572
can the web help AI make better predictions from wearable data? rabbitholed this week after reading @Meta’s WearableQA paper. tested an LLM with and without @p0 search + extract and saw a meaningful lift in questions re: heart/metabolic health and inflammatory response with web data included!
8
7
23
1,804
Ji Soo Lee retweeted
😆 We are presenting our work, “Captioning for Text-Video Retrieval via Dual-Group Direct Preference Optimization” in Suzhou, EMNLP’25! @so0zip Paper: arxiv.org/pdf/2509.16560 Homepage: hyunwoojkim.com/publications See you soon!! #EMNLP2025 #Retrieval #VideoLLM #DPO
1
2
171
Ji Soo Lee retweeted
😆 We are presenting our work, “Bidirectional Likelihood Estimation with Multi-Modal Large Language Models for Text-Video Retrieval” in Hawaii, ICCV’25! Time:10/23(Thu), 10:45 Location: Exhibit Hall I PosterID: 232 Paper: arxiv.org/pdf/2507.23284 #ICCV2025 #Retrieval #MLLM
1
2
135
Ji Soo Lee retweeted
Congrats again! 🎉 One of our ICCV 2025 papers was selected as a Highlight! Big shoutout to the team “Bidirectional Likelihood Estimation with Multi-Modal LLMs for Text-Video Retrieval” @godohwan @so0zip @metaai #ICCV2025 #HighlightPaper #MLV #Multimodal #TextVideoRetrieval
1
5
208
Ji Soo Lee retweeted
We are presenting our work, “VidChain: Chain-of-Tasks with Metric-based Direct Preference Optimization for Dense Video Captioning” in Philadelphia, AAAI’24! Time:2/27 (Thu.) 12:30 - 14:30 Location: Hall E, West Building PosterID: 8542 Paper: arxiv.org/pdf/2501.06761 #AAAI2025
1
4
129