Say less, do more. All in on immersive

Toronto
Joined December 2014
Mike Dopsa retweeted
Skate in your living room with AR/Mixed Reality!
101
357
67
4,204
181,430
Mike Dopsa retweeted
Today I am open-sourcing my custom SwiftUI animation sequencing package that I developed to drive the animations in Letters. It can do all sorts of things! github.com/jazzychad/Animati…
9
14
2
136
11,224
Mike Dopsa retweeted
Prototyped an AR game where you push around a self-balancing robot
36
102
22
901
51,756
Mike Dopsa retweeted
iOS 27 adds concentricCornerRadii to GeometryProxy. It tells you the corner radius a view needs to match the curve of the screen corner.
11
34
10
734
33,341
📢OneCanvas (NeurIPS'26 Spotlight) Code Release📢 What if a 2D VLM could see the whole scene in one view? We reproject features from every frame into a single occlusion-free canvas to make a stock VLM reason in 3D! 🔗 github.com/baranowskibrt/one… 🌐 baranowskibrt.github.io/onec…
📢 OneCanvas: 3D Scene Understanding via Panoramic Reprojection We extract features from video frames and reproject them into one occlusion-free view of the whole scene that a 2D VLM reads just like a normal image. We can center this view on any viewpoint, including an agent's own pose for situated reasoning. The same projection lets us create spatial training tasks with no human annotation, solvable only by reasoning over the 3D positions of real object features placed on an otherwise empty canvas. The result is a stock 2D VLM that reasons in 3D, setting a new state of the art across spatial benchmarks at far less compute. 🌐 baranowskibrt.github.io/onec… ▶️ youtu.be/NIaHLB9gA7s Great work by @baranowskibrt & @davech2y
1
51
331
17,190
🦏 RHINO: Reconstructing Human Interactions with Novel Objects from Monocular Videos From one moving-camera RGB video, we reconstruct a 3D human, an unseen manipulated 3D object, and the static 3D scene in one world frame Video input, then 3D output. 👉 Code and data are public!
2
17
193
11,285
Mike Dopsa retweeted
Ok this is pretty insane. Astra side-loaded a custom app for my DJI RC2 controller that takes a live video stream from my Mini 5 Pro drone, streams it to a @roboflow Workflow running RF-DETR via our Serverless Video API, & overlays the predictions back on the controller’s screen.
41
53
11
774
60,897
Mike Dopsa retweeted
Preview: LichtFeld is slowly pivoting towards an end-to-end pipeline. Where traditional SfM pipelines fail, our SLAM-based dense reconstruction runs in real time at 30 FPS and 1920 px. Four minutes of capture condensed into one. Dense point cloud and camera poses from a single monocular walk with a DJI Osmo Action 4.
12
45
6
448
25,540
Mike Dopsa retweeted
Apple is so freaking weird. They just casually drop 3D authoring into the preview app on macOS. I can sign annoying PDFs and render a scene with ray tracing for 3D graphics in the same app.
24
35
2
1,035
38,114
Mike Dopsa retweeted
I finally got sign-off from marketing to share a video. Yes, for the first time in history, this is true retinal-quality Lightfield display. No other 3D display compares. As reconfirmed time and time again by attendees at SID Display Week.
52
308
85
1,961
Mike Dopsa retweeted
Wish I (and more people) knew about this!
4
1
122
31,826
THIS IS WHAT ALL VR HEADSETS SHOULD DO TO ALL YOUR FLAT GAMES
Holy shit IT WORKS!! One shotted with GPT6 Astra I now have a fork of UEVR where I can play any UE game within a volumetric window! This actually renders the game in 3D - meaning, two real game cameras, not some depth map bullshit. Everything looks right This is an alternative (and more comfortable IMO) way to play most 2D->VR hacked games as there’s no motion sickness, and no need to redesign the UI and interaction systems Needs a lot more polish before I publish it but OMG IT WORKS!
17
24
1
365
20,076
Mike Dopsa retweeted
For robotic simulation, Atlas reconstructs a space from just a few photos and generates the photorealistic RGB and depth data any robot's sensors would observe on any trajectory. Robots can now be trained and tested in far more spaces. Until now, scanning spaces like these required expensive equipment and time-consuming capture.
6
37
14
599
149,558
Mike Dopsa retweeted
hello
71,500
35,554
12,853
546,194
90,709,522
Mike Dopsa retweeted
Sending lots of love to the Apple community on my last day as CEO. My title changes tomorrow, but the love I have for the Apple community never will. Thank you for being a constant source of inspiration. My gratitude is endless, and I’m excited for the next chapter!
10,570
26,733
3,917
317,379
28,726,529
Lift4D: Harmonizing Single-View 3D Estimation for 4D Reconstruction In-the-Wild Carnegie Mellon University lift4d.github.io/ Lift4D reconstructs the full geometry, appearance, and deformation of dynamic objects in a scene, including regions never observed by the camera, from a single monocular in-the-wild video.
2
15
145
6,949
Mike Dopsa retweeted
We live in a funny time. I asked Fable for Azure Kinect support on macOS: "Doesn't exist, the depth engine is a closed Windows/Linux binary" Me: "I know you can do it" Used the arm64 Linux build, booted it in a 182 MB VM, passed the sensor over USB C, streamed depth +IR back.
14
41
6
516
27,309
ml-headsup Large-Scale High-Quality 3D Gaussian Head Reconstruction from Multi-View Captures Apple apple.github.io/ml-headsup/ Abstract We propose HeadsUp, a scalable feed-forward method for reconstructing high-quality 3D Gaussian heads from large-scale multi-camera setups. Our method employs an efficient encoder-decoder architecture that compresses input views into a compact latent representation. This latent representation is then decoded into a set of UV-parameterized 3D Gaussians anchored to a neutral head template. This UV representation decouples the number of 3D Gaussians from the number and resolution of input images, enabling training with many high-resolution input views. We train and evaluate our model on an internal dataset with more than 10,000 subjects, which is an order of magnitude larger than existing multi-view human head datasets. HeadsUp achieves state-of-the-art reconstruction quality and generalizes to novel identities without test-time optimization. We extensively analyze the scaling behavior of our model across identities, views, and model capacity, revealing practical insights for quality-compute trade-offs. Finally, we highlight the strength of our latent space by showcasing two downstream applications: generating novel 3D identities and animating the 3D heads with expression blendshapes.
6
51
2
301
17,928
Mike Dopsa retweeted
🚀Excited to share Qwen-3D (ECCV 2026) — a generalist 3D vision–language model that does grounding, segmentation, VQA, and spatial reasoning in one place. VLMs are great at images and short clips, but long videos bury them in tokens. Our idea: put multi-view frames into a shared 3D world, so attention scales with what’s in the scene, not how many frames you feed it. 📄arxiv.org/abs/2608.02980 🌐qwen-3d.github.io
9
75
5
559
57,122
I'm releasing Roomform, an open-source alternative to the RoomPlan API. It ingests point cloud scans and extracts geometry including walls, doors, windows, objects. No rectangular-room or Manhattan layout assumptions. The model also infers structure behind occluded areas like furniture, cabinets, and unscanned corners.
Been building a system that turns point clouds and scans into reconstructed, editable environments. The goal isn’t just visual fidelity. Walls, floors, ceilings, and objects should remain separate so users and agents can understand and modify the scene.
16
78
2
693
50,626