
Pinned Tweet
๐จ VideoAuto-R1 from Meta!๐จ
๐Excited to share our VideoAuto-R1: the first video understanding framework that only reasons when necessary. Our VideoAuto-R1 produces dramatically better results than video reasoning models such as Video-R1 by +10% on both video perception and reasoning benchmarks with significantly improved efficiency, reducing the average response length byโผ3x. Our VideoAuto-R1 also outperforms Qwen3-VL-8B by >2.5% on video reasoning benchmarks. For those of you who want to know how we did it, I have 4 words for you: Thinking Once, Answering Twice. Check out the following for more details!
Paper: arxiv.org/abs/2601.05175
Project details and demo: ivul-kaust.github.io/projectโฆ
with: @MingchenZhuge @zechunliu @garvinchen2 @liuzhuang1234 @Hu_Hsu @klightlm @ChongZhou7 @erniecyc @_sakshams_ @balakrishnan_vr @raghuraman @BernardSGhanem @vikasc @YoungXiong1 etc
Shuming Liu retweeted
๐ซฑ Introducing ๐๐๐ฎ๐ซ๐๐ฅ ๐๐จ๐ฆ๐ฉ๐ฎ๐ญ๐๐ซs:
๐ฐ๐ก๐๐ญ ๐ข๐ ๐๐ ๐๐จ๐๐ฌ ๐ง๐จ๐ญ ๐ฃ๐ฎ๐ฌ๐ญ ๐ฎ๐ฌ๐ ๐๐จ๐ฆ๐ฉ๐ฎ๐ญ๐๐ซ๐ฌ ๐๐๐ญ๐ญ๐๐ซ, ๐๐ฎ๐ญ ๐๐๐ ๐ข๐ง๐ฌ ๐ญ๐จ ๐๐๐๐จ๐ฆ๐ ๐ญ๐ก๐ ๐ซ๐ฎ๐ง๐ง๐ข๐ง๐ ๐๐จ๐ฆ๐ฉ๐ฎ๐ญ๐๐ซ ๐ข๐ญ๐ฌ๐๐ฅ๐?
Beyond today's conventional computers, agents, and world models, Neural Computers (NCs) are new frontiers where computation, memory, and I/O move into a learned runtime state.
We ask: whether parts of runtime can move inward into the learning system itself. This is our first step toward the Completely Neural Computer (CNC): a general-purpose neural computer with stable execution, explicit reprogramming, and durable capability reuse.
Work done with Mingchen Zhuge (@MingchenZhuge), Changsheng Zhao, Haozhe Liu (@HaoZhe65347 ), Zijian Zhou (@ZijianZhou524 ), Shuming Liu (@shuming96 ), Wenyi Wang (@Wenyi_AI_Wang ), Ernie Chang (@erniecyc ), Gael Le Lan, Junjie Fei, Wenxuan Zhang, Zhipeng Cai (@cai_zhipeng ), Zechun Liu (@zechunliu ), Yunyang Xiong (@YoungXiong1 ), Yining Yang, Yuandong Tian (@tydsh ), Yangyang Shi, Vikas Chandra (@vikasc), Juergen Schmidhuber (@SchmidhuberAI)
VideoAuto-R1
Video Auto Reasoning via Thinking Once, Answering Twice
huggingface.co/papers/2601.0โฆ
Shuming Liu retweeted
just spent time to read this paper.
I think the design of output format {a1}{think}{a2} is smart. so that RL can use dual-answer reward to surprise the prediction before and after thinking.
videoauto-r1: arxiv.org/pdf/2601.05175
๐จ VideoAuto-R1 from Meta!๐จ
๐Excited to share our VideoAuto-R1: the first video understanding framework that only reasons when necessary. Our VideoAuto-R1 produces dramatically better results than video reasoning models such as Video-R1 by +10% on both video perception and reasoning benchmarks with significantly improved efficiency, reducing the average response length byโผ3x. Our VideoAuto-R1 also outperforms Qwen3-VL-8B by >2.5% on video reasoning benchmarks. For those of you who want to know how we did it, I have 4 words for you: Thinking Once, Answering Twice. Check out the following for more details!
Paper: arxiv.org/abs/2601.05175
Project details and demo:: ivul-kaust.github.io/projectโฆ
with: @shumin96 @MingchenZhuge @zechunliu @garvinchen2 @liuzhuang1234 @Hu_Hsu @klightlm @chongzhou7 @erniecyc @_sakshams_ @balakrishnan_vr @raghuraman @BernardSGhanem @vikasc etc
Shuming Liu retweeted
๐ขExcited to share our new paper "Motion-Aware Concept Alignment for Consistent Video Editing". A training-free framework for video semantic mixing:
๐Blend new concepts into specific objects
๐ฏMaintain spatial stability & temporal coherence
๐Outperform basselines
A thread๐งต
Shuming Liu retweeted
Excited to share our new paper "Beyond the Last Answer: Your Reasoning Trace Uncovers More than You Think"!
We show that digging into an LLMโs intermediate โsubthoughtsโ and aggregating their answers can significantly boost math reasoning performance.
A thread ๐งต
Shuming Liu retweeted
Ever noticed how one scene seamlessly transitions into another in films? Thatโs a match-cutโa subtle yet powerful cinematic trick.
Our MatchDiffusion, generates two videos from text prompts, designed to form a seamless match-cutโeffortlessly and training-free. ๐ฅโจ 1/n
Shuming Liu retweeted
๐ new ๐๐ด๐ฒ๐ป๐-๐ฎ๐-๐ฎ-๐๐๐ฑ๐ด๐ฒ paper:
๐๐ฎ๐ป ๐๐ ๐ฎ๐ด๐ฒ๐ป๐๐ ๐ฒ๐๐ฎ๐น๐๐ฎ๐๐ฒ ๐๐ ๐ฎ๐ด๐ฒ๐ป๐๐ ๐ฎ๐ ๐ฒ๐ณ๐ณ๐ฒ๐ฐ๐๐ถ๐๐ฒ๐น๐ ๐ฎ๐ ๐ต๐๐บ๐ฎ๐ป๐? ๐ฌ๐ฒ๐, ๐๐ต๐ฒ๐ ๐ฐ๐ฎ๐ป!
๐ arxiv.org/abs/2410.10934v1
๐จโ๐ป github.com/metauto-ai/agent-โฆ
Introducing ๐๐ด๐ฒ๐ป๐-๐ฎ๐-๐ฎ-๐๐๐ฑ๐ด๐ฒ, a groundbreaking proof-of-concept that reduces costs and time by 97%, while providing rich, intermediate feedback. It precisely captures the natural step-by-step processes of agentic systems. We also developed ๐๐ฒ๐๐๐, a new benchmark featuring 55 automated AI development tasks and 365 requirements. Agent-as-a-Judge not only outperforms LLM-as-a-Judge but also closely mirrors human evaluations with greater efficiency and precision.
The real game-changer? It provides reliable reward signals, paving the way for scalable, self-improving agentic systems.
Thanks my Meta/KAUST mentors/peers/collaborators @SchmidhuberAI @tydsh @zechunliu @vikasc @YoungXiong1 @vikasc @Obs01ete @erniecyc @oneDylanAshley ... โ at Menlo Park, CA
Shuming Liu retweeted
๐ข Open Call: Fully funded #PhD student positions starting in 2025 at IVUL @KAUSTVision Lab with Prof. @BernardSGhanem
If you are passionate about computer vision and machine learning, contact us now and apply to #JoinOurTeam.
๐ Our lab: cemse.kaust.edu.sa/ivul โ at Kingdom of Saudi Arabia
Shuming Liu retweeted
ColorMAE: Exploring data-independent masking strategies in Masked AutoEncoders
@CarlosH_93 @shuming96 @BernardSGhanem
tl;dr: color masked pixels in green, it helps.
Jokes aside, mid-size continuous regions appear to be better for MAE pretraining.
arxiv.org/pdf/2407.13036
Shuming Liu retweeted
Announcing the creation of *KAUST Center of Excellence in Generative AI*; official launch on July 1, 2024. Joint with @BernardSGhanem @SchmidhuberAI @bremen79 @TheSandyCoder and a few more KAUST colleagues. KAUST funding ($11m over 5 years) + industrial funding. We are looking for further industry partners!
@KaustResearch @cemseKAUST @KAUST_News @AI_KAUST @kaustMLhub
Shuming Liu retweeted
Thrilled to share that our research group at KAUST is making waves at #CVPR2024! We've had EIGHT papers accepted this year. Huge congrats to all the authors and our incredible collaborators! ๐ฆพ๐ #AI #ML #ComputerVision @CVPR
Letโs connect in Seattle next week! ๐บ๐ธ @KaustResearch
Shuming Liu retweeted
Can a language model understand JPEGs ๐พ? We trained ours ๐ฆ on raw byte streams, and it learned to speak JPEG-ese! We find the model's can understand file properties, fix anomalies, and generate new JPEGs ๐ผ๏ธ, all while bypassing the decompression step ๐.
A thread ๐งต
Shuming Liu retweeted
We are excited to release OpenTAD: an open-source toolbox for temporal action detection (TAD). OpenTAD unifies the implementation of 14 (more are coming) TAD methods with 8 datasets. Star us and stay tuned for further updates. @KaustVision
Link: github.com/sming256/OpenTAD
Shuming Liu retweeted
๐โจ SynthCLIP is out! ๐ In the past few months, I've been working on an end-to-end synthetic pipeline for CLIP training. Today, the paper is out on Arxiv, and our 30M samples synthetic-image pairs dataset is available on @huggingface ! Thread. ๐งต
Paper: arxiv.org/abs/2402.01832
































