Lei Yang retweeted
1/3 The physical world does not pause while a robot thinks.
In our new technical report, โHas GPT-6-Astra Achieved Embodied Intelligence?โ, we study its capabilities across 12 benchmarks and 8 real-world robot configurations.
With access to training demonstrations through in-context learning and up to 10ร the execution budget, GPT-6-Astra brings several benchmarks close to saturation, without updating its weights. Its ability to recognise failed actions and recover through further interaction is a meaningful advance.
But this also raises a question: what does success measure when an agent is given more time to correct itself?
๐งต
Lei Yang retweeted
12 Simulation benchmarks, 8 real robots, 1 question:
Has GPT-6-Astra achieved Embodied Intelligence?
Our answer:
- Embodied competence? Yes.
- Practical embodied inteligence? Not yet.
Hereโs what we found: sensenova.ai/has-gpt-6-astraโฆ
HF daily paper: huggingface.co/papers/2610.2โฆ
Lei Yang retweeted
We release the most comprehensive ๐ฒ๐บ๐ฝ๐ถ๐ฟ๐ถ๐ฐ๐ฎ๐น ๐๐๐๐ฑ๐ ๐ผ๐ณ ๐๐ฃ๐ง-๐ฒ-๐๐๐๐ฟ๐ฎโ๐ ๐ฒ๐บ๐ฏ๐ผ๐ฑ๐ถ๐ฒ๐ฑ ๐ถ๐ป๐๐ฒ๐น๐น๐ถ๐ด๐ฒ๐ป๐ฐ๐ฒ across 12 simulation benchmarks and 8 real-robot platforms, together with ๐ฆ๐ฒ๐ป๐๐ฒ๐ก๐ผ๐๐ฎ-๐ฅ๐ผ๐ฏ๐ผ๐ฅ๐ฆ๐: an open-source harness framework and a 27B model that runs at ~1/50 the cost of GPT-6-Astra.
Here's what we found:
๐น ๐ง๐ต๐ฒ ๐ฐ๐ฎ๐ฝ๐ฎ๐ฏ๐ถ๐น๐ถ๐๐ ๐ฐ๐ฒ๐ถ๐น๐ถ๐ป๐ด ๐ถ๐ ๐ฎ๐ฐ๐๐๐ฎ๐น๐น๐ ๐บ๐๐ฐ๐ต ๐ต๐ถ๐ด๐ต๐ฒ๐ฟ. Under a unified protocol (ICL + up to 10ร the interaction budget), GPT-6-Astra achieves clear SOTA across all 12 benchmarks: RoboDojo: 27.6% at 1ร โ 81.9% at 10ร, DexJoCo: 87.3% vs. 40.3% prior SOTA, while the LIBERO benchmarks are pushed to saturation.
๐น ๐ง๐ผ๐ผ ๐บ๐๐ฐ๐ต ๐ฏ๐๐ฐ๐ธ ๐ณ๐ผ๐ฟ ๐๐ต๐ฒ ๐ฏ๐ฎ๐ป๐ด. Even a simple task like placing pens in a holder costs ~$55 in inference.
๐น ๐ง๐ต๐ฒ ๐๐ผ๐ฟ๐น๐ฑ ๐ฑ๐ผ๐ฒ๐๐ปโ๐ ๐๐ฎ๐ถ๐. Time matters as real robots overheat, and an egg burned while the model was still thinking.
Our takeaway: GPT-6-Astra has largely crossed the threshold of ๐ฒ๐บ๐ฏ๐ผ๐ฑ๐ถ๐ฒ๐ฑ ๐ฐ๐ผ๐บ๐ฝ๐ฒ๐๐ฒ๐ป๐ฐ๐ฒ, but ๐ฝ๐ฟ๐ฎ๐ฐ๐๐ถ๐ฐ๐ฎ๐น ๐ฒ๐บ๐ฏ๐ผ๐ฑ๐ถ๐ฒ๐ฑ ๐ถ๐ป๐๐ฒ๐น๐น๐ถ๐ด๐ฒ๐ป๐ฐ๐ฒ is not here yet.
๐ Project page: sensenova.ai/has-gpt-6-astraโฆ
๐ Report: sensenova.ai/gpt-6/assets/doโฆ
๐ป Code & model: github.com/OpenSenseNova/Senโฆ
Lei Yang retweeted
Blog for our ECCV paper Demystifying Video Reasoning
In 1935, Erwin Schrรถdinger put a cat in a box with a Geiger counter. Until you open the box, you do not know if the cat is alive or dead. According to Schrรถdinger, the cat is alive and dead, at the same time.
90 years later, it is the best picture I have for how a video model solves a problem.
Link: hokindeng.com/schrodingers-cโฆ
A coding model may build a world model, but it is not a world model itself. The neuroscience examples, especially rats' cognition maps, are fascinating. Well worth reading.
Wrote this article in the past few days. GPT-6 stunned many people with its spatial and embodied abilities. Some people shout out: "Coding is All You Need", "Coding is AGI", "Coding is World Model".
Here is a rebuttal. hokindeng.com/coding-is-all-โฆ
Lei Yang retweeted
We hope to launch the Verification Age for video models: 50 scientists, 6 months, 100 rule-based verifiers, 300 new tasks, and a worked RL recipe.
Coding models are advancing crazily thanks to the synthetic RL envs paradigms. Verification via codes or Lean gives models super-human math/coding intelligence like that in Astra and Fable.
However, video models are still in the GPT-3 stage, where we just dump million hours video data into the model training and hope for magic.
In this work,
1) we built 100 rule-based verifiers each paired with a synthetic data generators which give 10k+ diverse samples within the task domain
2) we made additional 300 tasks generators, including classic games i.e. Snake, Gold Miner, Mario, to further scale training data distribution with million samples rendered ready available on HuggingFace
3) ~60 experiments to find a worked RL recipe for video model post-training
4) comparison studies between image models, unified models, video models - which is the best model for visual thinking?
5) failure modes of how VLM-as-Judge will not satisfy video models RL in long term
6) interpretability studies show all image models, unified models, video models emerged "Schrรถdinger Effect", CoS reasoning through diffusion steps
7) many more insights
A detailed thread [1/n]
Full support @haozhangml and FastVideo! As LightX2V contributors, we also shared H3-Turbo. Quality-preserving speedups are hard, but we share the same vision: making good models accessible on affordable GPUs. Calling it โrandom pixelsโ is unfair. We appreciate FastVideo's effort.
oh, thanks for evaluting this for us. We wish we had more compute to distill with more data (like you would have), but it is happy to see that, with our very limited dozens of GPUs, we are already generating good videos.
Also, I hope you could be less mean to us next time, as I believe fastH3 generates sufficient decent videos that many users can already use at much lower cost, definitely not a "random pixel generator"
Lei Yang retweeted
Accepted at ECCV 2026: "Demystifying Video Reasoning"
On Friday Aug 28, first author Ruisi Wang @Rui147000038622 the work at our journal club. The finding: video models don't reason across frames (Chain-of-Frames) โ they reason along diffusion denoising steps (Chain-of-Steps).
Paper: arxiv.org/abs/2603.16870
Fri Aug 28 ยท 7:30 PM PT
RSVP: lu.ma/video-t1jl
Excited to share VBVR-Pro! ๐กOur findings suggest that intermediate visual states can matter more than textual rationales, while verifiable rewards enable stronger generative RL than VLM judges. Looking forward to further exploring visual intelligence beyond language. ๐
๐กVideos and images should not be treated merely as inputs to understand or outputs to render. They can be first-class substrates for problem solving beyond language.
๐Introducing VBVR-Pro: an infrastructure suite for visual intelligence: trainable, verifiable, RL-optimizable, and experimentally controllable.
๐Homepage: video-reason.com/
SenseNova U1.5 is here. Exciting to see such a big progress since U1.
๐ฏ Highly controllable: Complex conditioned generation and precise editing
๐ผ๏ธ High resolution: Stunning 4K output with fine-grained details
โก Highly cost-effective: An 8B-MoT model that rivals the latest commercial models
Smaller model. Powerful performance. Limitless creativity.
๐ฆ๐ฒ๐ป๐๐ฒ๐ก๐ผ๐๐ฎ ๐จ๐ญ.๐ฑ ๐๐ถ๐๐ฒ โ ๐ฆ๐ต๐ฎ๐ฟ๐ฝ๐ฒ๐ฟ. ๐ ๐ผ๐ฟ๐ฒ ๐๐ผ๐ป๐๐ฟ๐ผ๐น๐น๐ฎ๐ฏ๐น๐ฒ. ๐ ๐ผ๐ฟ๐ฒ ๐๐ผ๐๐-๐๐ณ๐ณ๐ถ๐ฐ๐ถ๐ฒ๐ป๐. An ๐ผ๐ฝ๐ฒ๐ป-๐๐ผ๐๐ฟ๐ฐ๐ฒ, lightweight native unified multimodal model for visual understanding, generation & editing.
๐๐๐ถ๐น๐ ๐ณ๐ผ๐ฟ ๐ฟ๐ฒ๐ฎ๐น-๐๐ผ๐ฟ๐น๐ฑ ๐๐ถ๐๐๐ฎ๐น ๐ฎ๐ฟ๐๐ถ๐ณ๐ฎ๐ฐ๐ ๐๐ผ๐ฟ๐ธ๐ณ๐น๐ผ๐๐:
๐น๐ก๐ฎ๐๐ถ๐๐ฒ ๐ฐ๐ ๐ด๐ฒ๐ป๐ฒ๐ฟ๐ฎ๐๐ถ๐ผ๐ป with better detail, composition & realism
๐น๐๐ผ๐บ๐ฝ๐น๐ฒ๐
๐ถ๐ป๐๐๐ฟ๐๐ฐ๐๐ถ๐ผ๐ป ๐ณ๐ผ๐น๐น๐ผ๐๐ถ๐ป๐ด across subjects, counts, text, layouts & styles
๐น๐๐ป๐ต๐ฎ๐ป๐ฐ๐ฒ๐ฑ ๐๐ต๐ถ๐ป๐ฒ๐๐ฒ/๐๐ป๐ด๐น๐ถ๐๐ต ๐๐ฒ๐
๐ ๐ฟ๐ฒ๐ป๐ฑ๐ฒ๐ฟ๐ถ๐ป๐ด & ๐บ๐๐น๐๐ถ-๐๐ฒ๐
๐ ๐น๐ฎ๐๐ผ๐๐
๐น๐ฃ๐ฟ๐ฒ๐ฐ๐ถ๐๐ฒ ๐ถ๐บ๐ฎ๐ด๐ฒ ๐ฒ๐ฑ๐ถ๐๐ถ๐ป๐ด & ๐ฐ๐ผ๐ป๐๐ฟ๐ผ๐น with visual markers, bounding boxes & multi-image references
Just ๐ด๐ parameters โ outperforming same-size models in instruction following and editing preservation, while ๐ฐ๐ผ๐บ๐ฝ๐ฒ๐๐ถ๐ป๐ด ๐๐ถ๐๐ต ๐น๐ฎ๐ฟ๐ด๐ฒ ๐ฐ๐ผ๐บ๐บ๐ฒ๐ฟ๐ฐ๐ถ๐ฎ๐น ๐บ๐ผ๐ฑ๐ฒ๐น๐ ๐ถ๐ป ๐๐ฒ๐
๐ ๐ฟ๐ฒ๐ป๐ฑ๐ฒ๐ฟ๐ถ๐ป๐ด ๐ฎ๐ป๐ฑ ๐ฐ๐ผ๐บ๐ฝ๐น๐ฒ๐
๐น๐ฎ๐๐ผ๐๐๐.
๐ ๏ธGitHub: github.com/OpenSenseNova/Senโฆ
๐คHF: huggingface.co/collections/sโฆ
๐พDiscord: discord.com/invite/BuTXPHmQuโฆ
๐จSenseNova Studio: unify.light-ai.top/
Lei Yang retweeted
๐ฆ๐ฒ๐ป๐๐ฒ๐ก๐ผ๐๐ฎ ๐จ๐ญ.๐ฑ ๐๐ถ๐๐ฒ โ ๐ฆ๐ต๐ฎ๐ฟ๐ฝ๐ฒ๐ฟ. ๐ ๐ผ๐ฟ๐ฒ ๐๐ผ๐ป๐๐ฟ๐ผ๐น๐น๐ฎ๐ฏ๐น๐ฒ. ๐ ๐ผ๐ฟ๐ฒ ๐๐ผ๐๐-๐๐ณ๐ณ๐ถ๐ฐ๐ถ๐ฒ๐ป๐. An ๐ผ๐ฝ๐ฒ๐ป-๐๐ผ๐๐ฟ๐ฐ๐ฒ, lightweight native unified multimodal model for visual understanding, generation & editing.
๐๐๐ถ๐น๐ ๐ณ๐ผ๐ฟ ๐ฟ๐ฒ๐ฎ๐น-๐๐ผ๐ฟ๐น๐ฑ ๐๐ถ๐๐๐ฎ๐น ๐ฎ๐ฟ๐๐ถ๐ณ๐ฎ๐ฐ๐ ๐๐ผ๐ฟ๐ธ๐ณ๐น๐ผ๐๐:
๐น๐ก๐ฎ๐๐ถ๐๐ฒ ๐ฐ๐ ๐ด๐ฒ๐ป๐ฒ๐ฟ๐ฎ๐๐ถ๐ผ๐ป with better detail, composition & realism
๐น๐๐ผ๐บ๐ฝ๐น๐ฒ๐
๐ถ๐ป๐๐๐ฟ๐๐ฐ๐๐ถ๐ผ๐ป ๐ณ๐ผ๐น๐น๐ผ๐๐ถ๐ป๐ด across subjects, counts, text, layouts & styles
๐น๐๐ป๐ต๐ฎ๐ป๐ฐ๐ฒ๐ฑ ๐๐ต๐ถ๐ป๐ฒ๐๐ฒ/๐๐ป๐ด๐น๐ถ๐๐ต ๐๐ฒ๐
๐ ๐ฟ๐ฒ๐ป๐ฑ๐ฒ๐ฟ๐ถ๐ป๐ด & ๐บ๐๐น๐๐ถ-๐๐ฒ๐
๐ ๐น๐ฎ๐๐ผ๐๐
๐น๐ฃ๐ฟ๐ฒ๐ฐ๐ถ๐๐ฒ ๐ถ๐บ๐ฎ๐ด๐ฒ ๐ฒ๐ฑ๐ถ๐๐ถ๐ป๐ด & ๐ฐ๐ผ๐ป๐๐ฟ๐ผ๐น with visual markers, bounding boxes & multi-image references
Just ๐ด๐ parameters โ outperforming same-size models in instruction following and editing preservation, while ๐ฐ๐ผ๐บ๐ฝ๐ฒ๐๐ถ๐ป๐ด ๐๐ถ๐๐ต ๐น๐ฎ๐ฟ๐ด๐ฒ ๐ฐ๐ผ๐บ๐บ๐ฒ๐ฟ๐ฐ๐ถ๐ฎ๐น ๐บ๐ผ๐ฑ๐ฒ๐น๐ ๐ถ๐ป ๐๐ฒ๐
๐ ๐ฟ๐ฒ๐ป๐ฑ๐ฒ๐ฟ๐ถ๐ป๐ด ๐ฎ๐ป๐ฑ ๐ฐ๐ผ๐บ๐ฝ๐น๐ฒ๐
๐น๐ฎ๐๐ผ๐๐๐.
๐ ๏ธGitHub: github.com/OpenSenseNova/Senโฆ
๐คHF: huggingface.co/collections/sโฆ
๐พDiscord: discord.com/invite/BuTXPHmQuโฆ
๐จSenseNova Studio: unify.light-ai.top/
Lei Yang retweeted
๐๐ป๐๐ฟ๐ผ๐ฑ๐๐ฐ๐ถ๐ป๐ด ๐ฆ๐ฒ๐ป๐๐ฒ๐ก๐ผ๐๐ฎ ๐จ1.5-๐๐ถ๐๐ฒ-๐ฃ๐ฟ๐ฒ๐๐ถ๐ฒ๐.
An early open-source preview of our lightweight, natively unified multimodal model โ built on the native NEO-Unify architecture to natively understand, reason, generate, and edit across modalities. ๐ช๐ถ๐๐ต ๐ท๐๐๐ 8๐-๐ ๐ผ๐ง ๐ฝ๐ฎ๐ฟ๐ฎ๐บ๐ฒ๐๐ฒ๐ฟ๐, ๐ถ๐ ๐ฑ๐ฒ๐น๐ถ๐๐ฒ๐ฟ๐ ๐ด๐ฒ๐ป๐ฒ๐ฟ๐ฎ๐๐ถ๐ผ๐ป ๐ฎ๐ป๐ฑ ๐ฒ๐ฑ๐ถ๐๐ถ๐ป๐ด ๐พ๐๐ฎ๐น๐ถ๐๐ ๐๐ต๐ฎ๐ ๐ฟ๐ถ๐๐ฎ๐น๐ ๐ฐ๐ผ๐บ๐บ๐ฒ๐ฟ๐ฐ๐ถ๐ฎ๐น ๐ฐ๐น๐ผ๐๐ฒ๐ฑ-๐๐ผ๐๐ฟ๐ฐ๐ฒ ๐บ๐ผ๐ฑ๐ฒ๐น๐.
๐This preview brings:
๐น๐จ๐ฝ ๐๐ผ 4๐ ๐ฟ๐ฒ๐๐ผ๐น๐๐๐ถ๐ผ๐ป, delivering richer details and fewer visual artifacts
๐น๐ฆ๐๐ฟ๐ผ๐ป๐ด๐ฒ๐ฟ ๐๐ก/๐๐ก ๐๐ฒ๐
๐ ๐ฟ๐ฒ๐ป๐ฑ๐ฒ๐ฟ๐ถ๐ป๐ด ๐ฎ๐ป๐ฑ ๐ฐ๐ผ๐บ๐ฝ๐น๐ฒ๐
๐น๐ฎ๐๐ผ๐๐ ๐ฐ๐ผ๐บ๐ฝ๐ผ๐๐ถ๐๐ถ๐ผ๐ป
๐น๐ ๐ผ๐ฟ๐ฒ ๐ฝ๐ฟ๐ฒ๐ฐ๐ถ๐๐ฒ ๐๐ถ๐๐๐ฎ๐น ๐ฐ๐ผ๐ป๐๐ฟ๐ผ๐น with long, multi-constraint prompts
๐น๐ ๐ผ๐ฟ๐ฒ ๐ฟ๐ฒ๐น๐ถ๐ฎ๐ฏ๐น๐ฒ ๐ป๐ฎ๐๐ถ๐๐ฒ ๐ถ๐บ๐ฎ๐ด๐ฒ ๐ฒ๐ฑ๐ถ๐๐ถ๐ป๐ด across reference-guided style transfer, multi-reference composition, local infographic editing and text editing
๐Improvements over U1 on generation & editing benchmarks:
๐นQwen-Image-Bench: 47.14 โ 55.20 (w/ PE)
๐นImgEdit-Bench: 3.90 โ 4.37
๐นGEdit-Bench-en: 7.47 โ 8.17
๐นGEdit-Bench-zh: 7.42 โ 8.05
From U1 to U1.5, this open-source journey reflects our continued innovation at the foundation-model level. Meanwhile, U1 Pro, our production-ready model for creators, will open for public access soon.
๐ ๏ธ GitHub: github.com/OpenSenseNova/Senโฆ
๐ค Hugging Face: huggingface.co/sensenova/Senโฆ
๐พ Discord: discord.com/invite/BuTXPHmQuโฆ
A big thank you to @HuggingApps for building this Space! More people can now try our latest model directly, with no deployment required. Give it a try ๐ค
huggingface.co/spaces/sensenโฆ
SenseNova U1 is the best open image model you maybe didn't heard of yet
Unified language-image (like Nano Banana 2 / GPT-Image-2) that does precise generations and edits
It has a general version and a specialized infographics one, where it shines
โถ๏ธ huggingface.co/spaces/hugginโฆ
๐ The #WorldCupFinal is set! A true coronation.
Past ๐ Messi ๐ Future ๐ Yamal.
Detailed analysis by SenseNova U1 Pro predicts a 1-2 Argentina win!
๐ RT if ๐ฆ๐ท takes the 4th star
โค๏ธ LIKE if ๐ช๐ธ takes the crown
๐ช๐ฒ ๐ฎ๐๐ธ๐ฒ๐ฑ ๐ฅ๐ฎ๐ฐ๐ฐ๐ผ๐ผ๐ป ๐ช๐ผ๐ฟ๐ธ, ๐ผ๐๐ฟ ๐๐ ๐ฎ๐๐๐ถ๐๐๐ฎ๐ป๐, ๐๐ผ ๐ฝ๐ฟ๐ฒ๐ฑ๐ถ๐ฐ๐ ๐๐ผ๐ป๐ถ๐ด๐ต๐โ๐ ๐ช๐ผ๐ฟ๐น๐ฑ ๐๐๐ฝ ๐๐ถ๐ป๐ฎ๐น, then used ๐ฆ๐ฒ๐ป๐๐ฒ๐ก๐ผ๐๐ฎ ๐จ๐ญ ๐ฃ๐ฟ๐ผ to create this score prediction graphic with historical data on both teams. The call: ๐๐ฟ๐ด๐ฒ๐ป๐๐ถ๐ป๐ฎ ๐ฎโ๐ญ ๐ฆ๐ฝ๐ฎ๐ถ๐ป! ๐ฆ๐ทโฝ๐ช๐ธ
Just for fun! Whatever the result, hereโs hoping for a spectacular match tonight! ๐โจ
Congrats on the impressive GenCeption! Beyond the strong results, we are inspired by a broader message: the choice of generative pretraining shapes what a general-purpose vision model can naturally understand. Perhaps @CeyuanY's Omni Model offers a ultimate way to unify them all
Can video generation models do for vision what LLMs did for language?
Introducing GenCeption from @GoogleDeepMind: one feed-forward video model for various vision tasks โ SOTA, data-efficient, and emerging behaviors (ECCV 2026)
๐ genception.github.io
(1/8)
SenseNova-Vision, Vision Banana, and GenCeption all point to the same future: unifying vision tasks within a single model.
We believe the field is moving toward combining perception, understanding, and generation, enabling one model to see, reason, and imagine much like humans do
๐ข๐ฝ๐ฒ๐ป-๐๐ผ๐๐ฟ๐ฐ๐ถ๐ป๐ด ๐ฆ๐ฒ๐ป๐๐ฒ๐ก๐ผ๐๐ฎ-๐ฉ๐ถ๐๐ถ๐ผ๐ป-7๐-๐ ๐ผ๐ง โ ๐ผ๐ป๐ฒ ๐บ๐ผ๐ฑ๐ฒ๐น, ๐ฎ๐น๐น ๐บ๐ฎ๐ท๐ผ๐ฟ ๐๐ถ๐๐ถ๐ผ๐ป ๐๐ฎ๐๐ธ๐.
Reimagines CV as multimodal generation. Steerable by language or visual prompts. ๐ก๐ผ ๐๐ฎ๐๐ธ-๐๐ฝ๐ฒ๐ฐ๐ถ๐ณ๐ถ๐ฐ ๐ต๐ฒ๐ฎ๐ฑ๐ โ ๐๐๐ถ๐น๐น ๐ฆ๐ข๐ง๐, ๐๐๐ฟ๐ฝ๐ฎ๐๐๐ถ๐ป๐ด ๐๐ผ๐ผ๐ด๐น๐ฒ ๐๐ฒ๐ฒ๐ฝ๐ ๐ถ๐ป๐ฑ'๐ ๐ฉ๐ถ๐๐ถ๐ผ๐ป ๐๐ฎ๐ป๐ฎ๐ป๐ฎ ๐ผ๐ป ๐๐ฒ๐ด๐บ๐ฒ๐ป๐๐ฎ๐๐ถ๐ผ๐ป ๐ฎ๐ป๐ฑ ๐ฑ๐ฒ๐ป๐๐ฒ ๐ด๐ฒ๐ผ๐บ๐ฒ๐๐ฟ๐.
๐ ๐๐. ๐ฉ๐ถ๐๐ถ๐ผ๐ป ๐๐ฎ๐ป๐ฎ๐ป๐ฎ (๐๐ผ๐ผ๐ด๐น๐ฒ ๐๐ฒ๐ฒ๐ฝ๐ ๐ถ๐ป๐ฑ):
๐นReferring segmentation (RefCOCOg cIoU): 80.3 vs 73.8
๐นSemantic segmentation (Cityscapes mIoU): 71.2 vs 69.9
๐นDepth estimation (NYUv2 ฮด1): 98.1 vs 94.8
๐นSurface normal (NYUv2 mean error): 14.4 vs 17.8
Built on a decade of SenseTime's CV leadership โ #1 in China's Vision AI market for 10 consecutive years, and named a Tech Innovator in global GenAI CV by Gartner. ๐ฉ๐ถ๐๐ถ๐ผ๐ป, ๐ป๐ผ๐ ๐ป๐ฎ๐๐ถ๐๐ฒ ๐๐ผ ๐ณ๐ผ๐๐ป๐ฑ๐ฎ๐๐ถ๐ผ๐ป ๐บ๐ผ๐ฑ๐ฒ๐น๐. New tasks, defined by instruction โ not by new model heads.
An important step towards emergent intelligence from visual learning.
SenseNova-Vision just dropped, which unifies a wide range of vision tasks into a single generative model.
Not only achieving competitive performance on all these tasks, but more importantly showing the capability of doing unseen and complex vision tasks.
๐ข๐ฝ๐ฒ๐ป-๐๐ผ๐๐ฟ๐ฐ๐ถ๐ป๐ด ๐ฆ๐ฒ๐ป๐๐ฒ๐ก๐ผ๐๐ฎ-๐ฉ๐ถ๐๐ถ๐ผ๐ป-7๐-๐ ๐ผ๐ง โ ๐ผ๐ป๐ฒ ๐บ๐ผ๐ฑ๐ฒ๐น, ๐ฎ๐น๐น ๐บ๐ฎ๐ท๐ผ๐ฟ ๐๐ถ๐๐ถ๐ผ๐ป ๐๐ฎ๐๐ธ๐.
Reimagines CV as multimodal generation. Steerable by language or visual prompts. ๐ก๐ผ ๐๐ฎ๐๐ธ-๐๐ฝ๐ฒ๐ฐ๐ถ๐ณ๐ถ๐ฐ ๐ต๐ฒ๐ฎ๐ฑ๐ โ ๐๐๐ถ๐น๐น ๐ฆ๐ข๐ง๐, ๐๐๐ฟ๐ฝ๐ฎ๐๐๐ถ๐ป๐ด ๐๐ผ๐ผ๐ด๐น๐ฒ ๐๐ฒ๐ฒ๐ฝ๐ ๐ถ๐ป๐ฑ'๐ ๐ฉ๐ถ๐๐ถ๐ผ๐ป ๐๐ฎ๐ป๐ฎ๐ป๐ฎ ๐ผ๐ป ๐๐ฒ๐ด๐บ๐ฒ๐ป๐๐ฎ๐๐ถ๐ผ๐ป ๐ฎ๐ป๐ฑ ๐ฑ๐ฒ๐ป๐๐ฒ ๐ด๐ฒ๐ผ๐บ๐ฒ๐๐ฟ๐.
๐ ๐๐. ๐ฉ๐ถ๐๐ถ๐ผ๐ป ๐๐ฎ๐ป๐ฎ๐ป๐ฎ (๐๐ผ๐ผ๐ด๐น๐ฒ ๐๐ฒ๐ฒ๐ฝ๐ ๐ถ๐ป๐ฑ):
๐นReferring segmentation (RefCOCOg cIoU): 80.3 vs 73.8
๐นSemantic segmentation (Cityscapes mIoU): 71.2 vs 69.9
๐นDepth estimation (NYUv2 ฮด1): 98.1 vs 94.8
๐นSurface normal (NYUv2 mean error): 14.4 vs 17.8
Built on a decade of SenseTime's CV leadership โ #1 in China's Vision AI market for 10 consecutive years, and named a Tech Innovator in global GenAI CV by Gartner. ๐ฉ๐ถ๐๐ถ๐ผ๐ป, ๐ป๐ผ๐ ๐ป๐ฎ๐๐ถ๐๐ฒ ๐๐ผ ๐ณ๐ผ๐๐ป๐ฑ๐ฎ๐๐ถ๐ผ๐ป ๐บ๐ผ๐ฑ๐ฒ๐น๐. New tasks, defined by instruction โ not by new model heads.
Lei Yang retweeted
๐ฅVision as Unified Multimodal Generation๐ฅ
๐ฏSenseNova-Vision๐ฏ unifies vision tasks (e.g., detection, keypoints, segmentation, depth, surface normals, point maps, and camera pose) as unified multimodal model (UMM) generation *with SOTA results*
- Code: github.com/OpenSenseNova/Senโฆ
Thanks, Songyou. VisionBanana has been a great inspiration! We believe itโs time for one model to unify more vision tasks, just like GPT did for language. Weโve fully open-sourced the model, code, and data, and hope to explore this with the community.
Lei Yang retweeted
#ICML Two last-authored papers at ICML 2026 this week.
A Very Big Video Reasoning Suite.
Video models today are optimized for one thing: visual quality. Whether they can reason, track causality, follow constraints, execute multi-step plans, has been nearly impossible to study, because the field never had the data. VBVR changes that.
Over 50 researchers and engineers across 30+ institutions built:
1) 150 reasoning tasks grounded in cognitive and developmental psychology
2) 2,015,000 samples and over one million videos, roughly 1,000ร larger than the nine prior video-reasoning datasets combined
3) every task procedurally generated with deterministic ground truth, so evaluation is fully rule-based and verifiable, no LLM judges, and it agrees with human judgments
Insights:
1) Fine-tuning an open-source 14B model on VBVR lifts overall performance by 84.6 percent, a new state of the art that surpasses every proprietary system we evaluated, including Sora 2 and Veo 3.1.
2) The learned skills generalize to out-of-domain task families the model never saw, early evidence of emergent generalization in video reasoning.
3) And the honest part: gains saturate with scale, on two different architectures. A persistent gap to human performance remains that data alone cannot close. The bottleneck is architectural.
4) One principle kept surfacing throughout: controllability, doing exactly what is asked โ is the bedrock of verifiable video reasoning.
Great thanks to my collaborators @MaijunxianWang @Rui147000038622 @juyi_lin @SaraJiran @thwiedemer @Kaiagaoqy @carrot0817_ @RubyFreax Lianyu Huang Zelong Hong Jiahui Ge Qianli Ma Hang He Yifan Zhou Lingzi Guo Lantao Mei Jiachen li Hanwen Xing Tianqi Zhao Fengyuan Yu Weihang Xiao Yizheng Jiao Jaden Hou Danyang Zhang Pengcheng Xu Boyang Zhong Zehong Zhao Gaoyun Fang John Kitaoka Yile Xu Hua Xu Kenton Blacutt @tin_ng_qn @siyuansong_ @HaoranSunMr Shaoyue Wen @LinyangNeuroAI @RunmingW @Yanzhi_Wang_ @Mengyue_Yang_ @ziqiao_ma @raphaelmilliere @fredahshi Nuno Vasconcelos @DanielKhashabi Alan Yuille @du_yilun @ZimingLiu11 @Brian_Bo_Li Dahua Lin @liuziwei7 @Vikashplus Yijiang Li @drowsyleilei @caizhongang
The second paper โ "Vision Language Models Cannot Reason About Physical Transformation" โ asks a question Piaget asked children 70 years ago. Pour water into a taller, thinner glass: is it the same amount? Seven-year-olds pass this reliably. We built ConservationBench of 384 real videos of conservation tasks with matched non-conserving controls, and evaluated 112 VLMs across 23,040 trials. Humans score 98 percent; models sit near chance, with 82 of 112 under 10 percent on the strict paired test. The most telling result: models answer "better with no image at all" than with the actual video, and chain-of-thought prompting makes things worse, showing they're leaning on a textual prior, not tracking object state through change.
#videomodel #AI #research #reasoning


























