Engage VR retweeted
Ah!! We've been trying to get this working for months.
Basically, we can now capture a person and the objects they're interacting with in 3D from regular video. Motion for both, plus approximate object shape.
I've been excited about this for a while because so much of what people do involves stuff. If you want a robot to learn how to use a tool, or to understand someone's tennis swing, you probably want to know what the tool or racket is doing too.
Same goes for props in animation and everyday tasks in occupational therapy. There's a lot here.
Still imperfect, but this week it started working well enough that I wanted to show you.
Engage VR retweeted
📣 Meta Connect is only two weeks away!
You can register to watch the livestream here meta.com/en-gb/connect/?srsl…
For those who got invited in person, I will be there :)
What are you most excited about?
Engage VR retweeted
World Labsが空間知能モデル「Atlas」を発表
🔹テキスト・画像・動画・3Dを統合
🔹数枚の画像から3DGSを生成
🔹スマホ3〜5台の映像からバレットタイムやReal-to-Simを実現
🔹カメラポーズを直接指定し、最大1440p・1分の動画を生成
情報元はリプ欄。
Engage VR retweeted
Depth occlusion in WebXR in @playcanvas , no install.
A gaussian splat on my desk, feels strange to touch with my own hands...
Open on a Quest 3 / MIT Licence
github.com/arrival-space/pla…
Engage VR retweeted
Sweet. RAVEN - turns MiniMax‑H3 into a real-time video streaming engine.
It streams video chunk by chunk like a livestream, no drift, no glitches even on long runs.
huggingface.co/mvp-lab/MiniM…
Engage VR retweeted
Karsten Huitfeldt氏による空間インターフェース実験
🔹Gaussian Splattingで実環境をブラウザ上でリアルタイム変形
🔹従来の3Dメッシュを超える高精細な表現力を実現 デジタルツインや3Dナビの新たな可能性を提示。
情報元はリプ欄。
Engage VR retweeted
1 DAY TO GO! 🖤
GO GO GO!
Future Knight launches tomorrow, August 13th!
The weirdest, most nostalgic handheld-inspired shooter of the summer is right here.
Are you ready? I am ready!
#pixelart #gamedev #ドット絵 #indiegame #FutureKnight
Engage VR retweeted
生成AIやバイブコーディングではなく、シンプルな物理・数学計算で波動を再現したアニメーション。
リアルタイム/オフライン双方に応用が可能。
解説記事と実験用MaxScriptサンプルはリプ欄
Engage VR retweeted
This is exciting. Insta360 is building Gaussian Splats right into the X6.
Its new Spatial Capture feature lets you record a place in 360 and turn it into a 3D scene directly in the Insta360 app.
Full reveal August 12.
Engage VR retweeted
Orbble is now available for Apple Vision Pro.
Instead of scrolling a social feed, you’re surrounded by floating bubbles where you see each other’s Personas and connect through audio and video messages.
It’s pretty cool, and the exit animation is so satisfying.
Engage VR retweeted
Xue et al., "DepthART: Scaling Foundation Monocular Depth to Tiny Models"
Well-strategized distillation with camera-conditioned fine-tuning. 1000 FPS on RTX A6000, 200 FPS on Jetson Orin NX.
No reshoot required.
Our new Clean Plate IC-LoRA for LTX-2.3 removes people, pedestrians, and vehicles from a clip and rebuilds the empty background behind them.
🎬 Full-frame subject removal, no mask required
🏗️ Keeps architecture, ground markings & foliage intact
⚙️ Runs as a video-to-video LoRA on @ComfyUI
Engage VR retweeted
NVIDIA just revealed ArtiFixer, new research that can repair incomplete Gaussian splats.
It fills in missing areas and turns messy captures into cleaner, more complete 3D scenes.
Engage VR retweeted
Controlling a robot in AR is one thing. A real working use case is another.
Air hockey vs my Vector Robot on @specs 2024 virtual puck, real goalie.
This thing is playful, but imagine how far it may go. Tell me your ideas in a commets.
Open source: if you have a Vector, you can run it and play. Build with CLAD ( Full downgrade path that we took in our blog). Link down in the comments.
Super excited about new @Specs and NDK -> if understand right that may be the way to run VectAR fully on glasses ->>>> no extra server on Mac!!!!!!
#Spectacles #AR #Robotics #Vector #SnapAR #AugmentedReality #buildinpublic @specsfordevs @lenslist @LensStudioDev
Engage VR retweeted
Wow. These cats use an AI video model to generate a fake video of a cube copying the motion of the pixel you wanna track, then use classical techniques to extract the full 3D pose. Insane how well it works.
Introducing 📢📢ProxyPose📢📢
✨Track 6-DoF motion of any query pixel via video-to-video translation
📰ArXiv: arxiv.org/abs/2607.06555
💻Code: github.com/ruihangzhang97/pr…
🌐Webpage: ruihangzhang97.github.io/pro…
Engage VR retweeted
Valve is Getting Awfully Close to Steam Frame Release Following ‘Great on Frame’ Store Page
See more 👉roadtovr.com/valve-ready-ste…
Engage VR retweeted
🚀 **What if 3D generation did not need a complicated cascade of models?**
Most recent 3D asset generation pipelines still follow a multi-stage recipe:
🖼️ generate multi-view images → 🧱 reconstruct geometry → 🔁 convert representations → 🛠️ refine artifacts…
and hope that errors do not accumulate along the way.
In our new paper, **PixGS: Pixel-Space Diffusion for Direct 3D Gaussian Splat Generation**, accepted at **ECCV 2026** 🎉, we ask a simpler question:
> Can we generate 3D Gaussian Splats directly — in a single stage — while preserving fine-grained geometry and appearance?
Our answer is **PixGS** ✨, a pixel-space diffusion framework that directly denoises 3D Gaussian attributes instead of relying on lossy latent compression.
This allows the model to regularize the generated asset at the **splat level** 🎯, improving both geometry and appearance while avoiding many decoding artifacts seen in latent/cascade pipelines.
The key idea is to bring the strength of large 2D generative priors into 3D generation 🌍, but without forcing the 3D representation through a compressed latent bottleneck.
PixGS uses richer supervision signals — including
🔹 RGB
🔹 depth
🔹 surface normals
🔹 high-frequency structural cues
to better preserve object details and view consistency.
The result: high-quality text/image-conditioned 3DGS generation with strong performance and fast inference — around **1 second on a single A100 GPU** ⚡.
I’m especially excited about this direction because 3D Gaussian Splatting has already transformed how we render and represent scenes. PixGS suggests that the next bottleneck may not be rendering anymore, but how cleanly, directly, and efficiently we can **generate** 3D assets in the first place.
📄 Paper: arxiv.org/abs/2607.01803
Huge thanks to my co-author Cao Duy and everyone who supported this work! 🙌
#ECCV2026 #ComputerVision #GenerativeAI #3DGeneration #GaussianSplatting #DiffusionModels #AIResearch #Graphics #Robotics #QualcommAIResearch
Engage VR retweeted
Crazy impressive results using Claude Fable to build out a pose/depth previs for Seedance.
This was inspired by Josh Daws' build-- but of course I made a few tweaks I'll showcase on the channel later this week.
Another example below that shows why I think this is awesome:



















