PhD at @KAUST_News; Ex @Meta

Joined October 2018
๐Ÿšจ VideoAuto-R1 from Meta!๐Ÿšจ ๐Ÿš€Excited to share our VideoAuto-R1: the first video understanding framework that only reasons when necessary. Our VideoAuto-R1 produces dramatically better results than video reasoning models such as Video-R1 by +10% on both video perception and reasoning benchmarks with significantly improved efficiency, reducing the average response length byโˆผ3x. Our VideoAuto-R1 also outperforms Qwen3-VL-8B by >2.5% on video reasoning benchmarks. For those of you who want to know how we did it, I have 4 words for you: Thinking Once, Answering Twice. Check out the following for more details! Paper: arxiv.org/abs/2601.05175 Project details and demo: ivul-kaust.github.io/projectโ€ฆ with: @MingchenZhuge @zechunliu @garvinchen2 @liuzhuang1234 @Hu_Hsu @klightlm @ChongZhou7 @erniecyc @_sakshams_ @balakrishnan_vr @raghuraman @BernardSGhanem @vikasc @YoungXiong1 etc
3
15
1,754
๐Ÿซฑ Introducing ๐๐ž๐ฎ๐ซ๐š๐ฅ ๐‚๐จ๐ฆ๐ฉ๐ฎ๐ญ๐ž๐ซs: ๐ฐ๐ก๐š๐ญ ๐ข๐Ÿ ๐€๐ˆ ๐๐จ๐ž๐ฌ ๐ง๐จ๐ญ ๐ฃ๐ฎ๐ฌ๐ญ ๐ฎ๐ฌ๐ž ๐œ๐จ๐ฆ๐ฉ๐ฎ๐ญ๐ž๐ซ๐ฌ ๐›๐ž๐ญ๐ญ๐ž๐ซ, ๐›๐ฎ๐ญ ๐›๐ž๐ ๐ข๐ง๐ฌ ๐ญ๐จ ๐›๐ž๐œ๐จ๐ฆ๐ž ๐ญ๐ก๐ž ๐ซ๐ฎ๐ง๐ง๐ข๐ง๐  ๐œ๐จ๐ฆ๐ฉ๐ฎ๐ญ๐ž๐ซ ๐ข๐ญ๐ฌ๐ž๐ฅ๐Ÿ? Beyond today's conventional computers, agents, and world models, Neural Computers (NCs) are new frontiers where computation, memory, and I/O move into a learned runtime state. We ask: whether parts of runtime can move inward into the learning system itself. This is our first step toward the Completely Neural Computer (CNC): a general-purpose neural computer with stable execution, explicit reprogramming, and durable capability reuse. Work done with Mingchen Zhuge (@MingchenZhuge), Changsheng Zhao, Haozhe Liu (@HaoZhe65347 ), Zijian Zhou (@ZijianZhou524 ), Shuming Liu (@shuming96 ), Wenyi Wang (@Wenyi_AI_Wang ), Ernie Chang (@erniecyc ), Gael Le Lan, Junjie Fei, Wenxuan Zhang, Zhipeng Cai (@cai_zhipeng ), Zechun Liu (@zechunliu ), Yunyang Xiong (@YoungXiong1 ), Yining Yang, Yuandong Tian (@tydsh ), Yangyang Shi, Vikas Chandra (@vikasc), Juergen Schmidhuber (@SchmidhuberAI)
30
130
28
560
225,321
Shuming Liu retweeted
just spent time to read this paper. I think the design of output format {a1}{think}{a2} is smart. so that RL can use dual-answer reward to surprise the prediction before and after thinking. videoauto-r1: arxiv.org/pdf/2601.05175
๐Ÿšจ VideoAuto-R1 from Meta!๐Ÿšจ ๐Ÿš€Excited to share our VideoAuto-R1: the first video understanding framework that only reasons when necessary. Our VideoAuto-R1 produces dramatically better results than video reasoning models such as Video-R1 by +10% on both video perception and reasoning benchmarks with significantly improved efficiency, reducing the average response length byโˆผ3x. Our VideoAuto-R1 also outperforms Qwen3-VL-8B by >2.5% on video reasoning benchmarks. For those of you who want to know how we did it, I have 4 words for you: Thinking Once, Answering Twice. Check out the following for more details! Paper: arxiv.org/abs/2601.05175 Project details and demo:: ivul-kaust.github.io/projectโ€ฆ with: @shumin96 @MingchenZhuge @zechunliu @garvinchen2 @liuzhuang1234 @Hu_Hsu @klightlm @chongzhou7 @erniecyc @_sakshams_ @balakrishnan_vr @raghuraman @BernardSGhanem @vikasc etc
3
20
156
13,663
๐Ÿ“ขExcited to share our new paper "Motion-Aware Concept Alignment for Consistent Video Editing". A training-free framework for video semantic mixing: ๐Ÿ”Blend new concepts into specific objects ๐ŸŽฏMaintain spatial stability & temporal coherence ๐Ÿ“ŠOutperform basselines A thread๐Ÿงต
4
4
18
974
Shuming Liu retweeted
Excited to share our new paper "Beyond the Last Answer: Your Reasoning Trace Uncovers More than You Think"! We show that digging into an LLMโ€™s intermediate โ€œsubthoughtsโ€ and aggregating their answers can significantly boost math reasoning performance. A thread ๐Ÿงต
4
9
4
22
4,804
Ever noticed how one scene seamlessly transitions into another in films? Thatโ€™s a match-cutโ€”a subtle yet powerful cinematic trick. Our MatchDiffusion, generates two videos from text prompts, designed to form a seamless match-cutโ€”effortlessly and training-free. ๐ŸŽฅโœจ 1/n
1
33
3
91
9,208
๐Ÿ”” new ๐—”๐—ด๐—ฒ๐—ป๐˜-๐—ฎ๐˜€-๐—ฎ-๐—๐˜‚๐—ฑ๐—ด๐—ฒ paper: ๐—–๐—ฎ๐—ป ๐—”๐—œ ๐—ฎ๐—ด๐—ฒ๐—ป๐˜๐˜€ ๐—ฒ๐˜ƒ๐—ฎ๐—น๐˜‚๐—ฎ๐˜๐—ฒ ๐—”๐—œ ๐—ฎ๐—ด๐—ฒ๐—ป๐˜๐˜€ ๐—ฎ๐˜€ ๐—ฒ๐—ณ๐—ณ๐—ฒ๐—ฐ๐˜๐—ถ๐˜ƒ๐—ฒ๐—น๐˜† ๐—ฎ๐˜€ ๐—ต๐˜‚๐—บ๐—ฎ๐—ป๐˜€? ๐—ฌ๐—ฒ๐˜€, ๐˜๐—ต๐—ฒ๐˜† ๐—ฐ๐—ฎ๐—ป! ๐Ÿ“„ arxiv.org/abs/2410.10934v1 ๐Ÿ‘จโ€๐Ÿ’ป github.com/metauto-ai/agent-โ€ฆ Introducing ๐—”๐—ด๐—ฒ๐—ป๐˜-๐—ฎ๐˜€-๐—ฎ-๐—๐˜‚๐—ฑ๐—ด๐—ฒ, a groundbreaking proof-of-concept that reduces costs and time by 97%, while providing rich, intermediate feedback. It precisely captures the natural step-by-step processes of agentic systems. We also developed ๐——๐—ฒ๐˜ƒ๐—”๐—œ, a new benchmark featuring 55 automated AI development tasks and 365 requirements. Agent-as-a-Judge not only outperforms LLM-as-a-Judge but also closely mirrors human evaluations with greater efficiency and precision. The real game-changer? It provides reliable reward signals, paving the way for scalable, self-improving agentic systems. Thanks my Meta/KAUST mentors/peers/collaborators @SchmidhuberAI @tydsh @zechunliu @vikasc @YoungXiong1 @vikasc @Obs01ete @erniecyc @oneDylanAshley ... โ€“ at Menlo Park, CA
31
209
27
1,027
198,858
๐Ÿ“ข Open Call: Fully funded #PhD student positions starting in 2025 at IVUL @KAUSTVision Lab with Prof. @BernardSGhanem If you are passionate about computer vision and machine learning, contact us now and apply to #JoinOurTeam. ๐Ÿ”— Our lab: cemse.kaust.edu.sa/ivul โ€“ at Kingdom of Saudi Arabia
21
2
46
7,518
ColorMAE: Exploring data-independent masking strategies in Masked AutoEncoders @CarlosH_93 @shuming96 @BernardSGhanem tl;dr: color masked pixels in green, it helps. Jokes aside, mid-size continuous regions appear to be better for MAE pretraining. arxiv.org/pdf/2407.13036
7
23
1,942
๐Ÿ†๐Ÿฅ‡We are proud to announce that we won 1st Place in five challenges this year at the Epic-Kitchens and Ego4D Challenges at #CVPR Let's celebrate this achievement and hope their work inspires further research on egocentric video understanding. #EGOVIS ๐Ÿงต(1/3)
2
6
1
29
5,577
Announcing the creation of *KAUST Center of Excellence in Generative AI*; official launch on July 1, 2024. Joint with @BernardSGhanem @SchmidhuberAI @bremen79 @TheSandyCoder and a few more KAUST colleagues. KAUST funding ($11m over 5 years) + industrial funding. We are looking for further industry partners! @KaustResearch @cemseKAUST @KAUST_News @AI_KAUST @kaustMLhub
2
16
1
114
10,535
Thrilled to share that our research group at KAUST is making waves at #CVPR2024! We've had EIGHT papers accepted this year. Huge congrats to all the authors and our incredible collaborators! ๐Ÿฆพ๐Ÿ“š #AI #ML #ComputerVision @CVPR Letโ€™s connect in Seattle next week! ๐Ÿ‡บ๐Ÿ‡ธ @KaustResearch
12
1
27
4,343
Can a language model understand JPEGs ๐Ÿ’พ? We trained ours ๐Ÿฆ™ on raw byte streams, and it learned to speak JPEG-ese! We find the model's can understand file properties, fix anomalies, and generate new JPEGs ๐Ÿ–ผ๏ธ, all while bypassing the decompression step ๐Ÿš€. A thread ๐Ÿงต
4
43
3
234
41,158
We are excited to release OpenTAD: an open-source toolbox for temporal action detection (TAD). OpenTAD unifies the implementation of 14 (more are coming) TAD methods with 8 datasets. Star us and stay tuned for further updates. @KaustVision Link: github.com/sming256/OpenTAD
9
7
31
3,000
Shuming Liu retweeted
๐Ÿš€โœจ SynthCLIP is out! ๐ŸŽ‰ In the past few months, I've been working on an end-to-end synthetic pipeline for CLIP training. Today, the paper is out on Arxiv, and our 30M samples synthetic-image pairs dataset is available on @huggingface ! Thread. ๐Ÿงต Paper: arxiv.org/abs/2402.01832
7
37
4
188
27,765