💡 Millions of shared skills. Why should agents keep starting from scratch?
Excited to share RASO! 🚀
Retrieve shared skill knowledge, adapt it to the target harness, and use it for rollout-free initialization and feedback-driven updates.
#AgenticAI #Skill #Harness
Ji Soo Lee retweeted
Meta researchers have created a novel and very useful health benchmark: WearableQA
As LLMs are starting to be used to analyze longituditinal wearable data for personalized medicine applications, it is important to systematically benchmark this capability on real-world data.
Here, the authors introduce WearableQA, a benchmark for data and health reasoning on real-user longitudinal wearable records.
WearableQA contains 4,084 multiple-choice questions constructed from 200 real users’ wearable measurements (16 daily metrics) collected over hundreds of days per individual, with complementary blood biomarkers (17 biomarker blood panel) and demographic information.
The benchmark has two axes of questions:
* reasoning type: some questions require data reasoning (computing trends, anomalies, and relationships from the raw wearable measurements) while others require health reasoning (clinical and physiological interpretation)
* signal complexity: there are single-signal questions vs. cross-signal questions
The authors evaluated a total of XXX models, both proprietary and open-source. A few conclusions:
* performance ranges widely, from 72.9% accuracy to 19.6% against a 10% chance baseline.
* Data reasoning remains more challenging than health reasoning for most models.
* Cross-signal reasoning remains challenging across model scales.
Note that the benchmark hasn't been released yet, though the paper has links for HuggingFace and GitHub, so the release is likely soon.
Paper link: arxiv.org/abs/2609.05405
Ji Soo Lee retweeted
can the web help AI make better predictions from wearable data?
rabbitholed this week after reading @Meta’s WearableQA paper.
tested an LLM with and without @p0 search + extract and saw a meaningful lift in questions re: heart/metabolic health and inflammatory response with web data included!
Ji Soo Lee retweeted
😆 We are presenting our work,
“Captioning for Text-Video Retrieval via Dual-Group Direct Preference Optimization” in Suzhou, EMNLP’25!
@so0zip
Paper: arxiv.org/pdf/2509.16560
Homepage: hyunwoojkim.com/publications
See you soon!!
#EMNLP2025 #Retrieval #VideoLLM #DPO
Ji Soo Lee retweeted
😆 We are presenting our work,
“Bidirectional Likelihood Estimation with Multi-Modal Large Language Models for Text-Video Retrieval” in Hawaii, ICCV’25!
Time:10/23(Thu), 10:45
Location: Exhibit Hall I
PosterID: 232
Paper: arxiv.org/pdf/2507.23284
#ICCV2025 #Retrieval #MLLM
Ji Soo Lee retweeted
Congrats again! 🎉
One of our ICCV 2025 papers was selected as a Highlight!
Big shoutout to the team
“Bidirectional Likelihood Estimation with Multi-Modal LLMs for Text-Video Retrieval”
@godohwan
@so0zip
@metaai
#ICCV2025 #HighlightPaper #MLV #Multimodal #TextVideoRetrieval
Ji Soo Lee retweeted
We are presenting our work, “VidChain: Chain-of-Tasks with Metric-based Direct Preference Optimization for Dense Video Captioning” in Philadelphia, AAAI’24!
Time:2/27 (Thu.) 12:30 - 14:30
Location: Hall E, West Building
PosterID: 8542
Paper: arxiv.org/pdf/2501.06761
#AAAI2025









