Building Photometric and Motion Scanning Systems Since 2009. We specialize in digital humans. https://xitter.cf/t.co/VRvKbTUHj0 https://xitter.cf/t.co/YUKnRuMZs5
Suffolk
Joined January 2009
- Tweets6.4K
- Following1.9K
- Followers8.7K
- Likes122K
Pinned Tweet
We're proud to showcase some recent real-time work with 3D / 4D Gaussian splatting.
In January of 2024 we acquired a full 3DGS commercial license with Inria to allow us to offer 4DGS services to clients around the world.
We've spent the last 10 months developing our custom 4DGS software pipeline, utilizing our own Nvidia GPU cluster to batch process 100,000's of 4DGS frames rapidly, combined with our state-of-the-art custom built volumetric capture system(s).
We can capture anything from complex character interactions for visual effects shots, or dynamic fast fighting scenes, sports, acting, even capturing and storing memories of family and friends for the future! The possibilities are endless.
Our focus is always on high-quality and high-fidelity. We don't cut corners and we're continually striving to learn and improve.
The below video showcases some 6-dof spatial captures we took of @henrypearce4D's family. These scenes are played back in real-time @ 30fps inside a 3rd party engine running in a 120fps virtual environment.
This is a culmination of years of hard work and dedication and we are keen to commercialize this technology with you.
Please do reach out if you're interested in our capture systems or our 3D/4DGS processing services.
HQ YouTube Link:
youtu.be/NudQHBrkqhY
HQ Vimeo Link:
vimeo.com/936993124
#spatialcapture #vr #virtualmemories #inria #3dgs #4dgs #aeonx #ir #ximea
Music
"Vision"
by megiddo music
Special thanks to @aras_p
Infinite-Realities retweeted
this might be the most beautiful thing I've ever made.
fly a real f-16 in your browser: viperoneone.com
realistic fly-by-wire physics, volumetric clouds you fly straight through, the actual Nellis Airfield. there's even scratches on the glass encasing for the cockpit.
the sound design with synth wave is something you must experience.
Proxy models and phong shaders. That's where it's headed, back to the roots, with a diffusion layer or 2. No wonder the larger game engine studios need to pivot.
🎮 Introducing Matrix-Game 4.0 — the world’s first open-source video model game that runs in real time on a single consumer GPU.
Instead of merely watching an AI-generated world, you can now actually play inside one.
⚡ 480p at 60 FPS
⏱️ 112ms end-to-end response
🚀 Up to 83.4 FPS generation
🖥️ Runs on a single NVIDIA RTX 5090
🧠 Coding Agent turns natural-language ideas into playable game logic
🌍 Game engines maintain world states and rules, while the video model renders every frame in real time
From shooters to racing games, the same world model can support entirely different gameplay—by changing the code, not retraining the model.
Matrix-Game 4.0 completes the loop:
Player input → Game engine updates the world → Video model renders the next frame → Player interacts again
Code, model weights, and demos are now open source. Build on it, remix it, and create your own playable worlds.
🔗 GitHub: github.com/SkyworkAI/Matrix-…
🤗 Hugging Face: huggingface.co/Skywork/Matri…
🌐 Project page: matrix-game-v4-0.github.io/p…
From controllable video to runnable worlds—the barrier to creation is getting lower, and the space for imagination is getting bigger.
#SkyworkAI #MatrixGame #WorldModels #GenerativeAI #AI #OpenSource #Gaming
Infinite-Realities retweeted
T3lescope 🔭: シーンごとの最適化を必要とせず、画像から高精細な 3D メッシュを直接再構成する論文を公開しました。 視点数やシーンのスケールに頑健で、最適化ベースの手法と同等以上の精度を達成します。光沢のある物体や透明な物体も再構成できます。 詳細はスレッドに👇
Back in the early 90's this would've taken hours to render, line by line using VISTA Pro on an Amiga 1200 (with mods) just for a still frame...
Infinite-Realities retweeted
OpenDLSS 5 comes to ThreeJS. NVIDIA’s DLSS 5 neural rendering network, as @threejs compute nodes, byte for byte. github.com/bhouston/three-dl…
Infinite-Realities retweeted
クリエイター(Andras Ketzer氏)が開発する「FluidNinja」は、リアルタイムで波や水流を表現しながら、RTX 3050でも安定60fpsを実現。
処理の大部分をGPU側で担い、高品質な流体表現と軽量化を両立。ゲームの水表現が一段階進化している。
Infinite-Realities retweeted
After 3 long years, Higx Optics is finally out. 🥳
Raytraced Bokeh in Nuke, After Effects and DaVinci Resolve
Stumbled upon this fancy (and fast) way of doing raytraced bokeh while studying lens flares, which led me down the most amazing rabbit hole of insights and knowledge and got to talk to with some amazing people in the field of optics and rendering.
The road from concept to product is long, and I feel like I still have quite a long way to fulfill the original vision, but it is time to draw a line in the sand.. this is the first release, and there is a lot more coming 😊
Infinite-Realities retweeted
"Creating a custom, photorealistic 3D human head used to take days of manual sculpting or expensive 3D scanning rigs."
To do it properly so the results don't look like a stock Metahuman head, it still does. Even 3Lateral scan lead talent for their AAA rigs... and they made Metahuman!
Infinite-Realities retweeted
I'm glad to announce that I've finally finished the Minimax H3 version of my crossview-warp model finetune. For those who don't know what it is, it's a model that lets you regenerate your existing video clip from a new camera angle or with a new camera movement. Link to model👇
Infinite-Realities retweeted
The raytraced bokeh of Higx Optics running at 24fps in 4k on a RTX3080 was not in the cards when i started this project 3 years ago.
Infinite-Realities retweeted
I play with splats all day, every day, and I’ve never seen anything like this. The scale and fidelity of these worlds is insane. Welcome to Earth, Atlas.
Infinite-Realities retweeted
Two of us filmed this on a couple phones, and we used Atlas to turn it into a short film. This is just a clip from the @theworldlabs tech blog
Atlas is able to generate the parts of the scene that none of the cameras actually filmed.
It can freeze time, allowing you to reframe shots to positions never filmed, then resume.
View events from impossible angles because Atlas knows what was there.
Infinite-Realities retweeted
Introducing Atlas:
The world's first multimodal world model that generates image and video frames with pixel-perfect camera control and reconstructs them in 3D.
Model the world, move the camera, and simulate space & time.
Infinite-Realities retweeted
Alright, I went ahead and built 4DAnyone into a proper @Gradio space. I thought it was cool enough that it deserved the effort and made sure to take advantage of our @rerundotio Gradio integration.
TLDR takes in a single video and is able to output multiview consistent videos. Its kinda incredible how good the quality is. Got it working on my 5090 + DGX Spark, so it works with <32GB cards =]
Sadly, I had to make this version only output 6 videos; otherwise, it would take way too long, but its able to go all the way up to 48 videos locally. Just takes like ~20-30 minutes.
No splatting on this one, as again it would just take too much GPU time that ZeroGPU won't easily support and will eat up all your quota
This also feels like the perfect fit for a new Gradio Workflow, something I'll look into at some point.
Inference time ~5-8 minutes on the space, sped things up in the video to keep it digestible
I got nerdsnipped by @krahets with 4D Anyone. I was working on part 3 of the arkitscenes blog post for @rerundotio, but I just couldn't help but try to bring in 4d splatting from a single video into rerun since we shipped splatting support.
Did a few things here
1. spent a bunch of time optimizing the DiT model so it would run on my 5090. Got memory from ~50gb -> less than 32gb. No need for enterprise cards or super slow dgx spark
2. more importantly, I got the runtime down to ~5 minutes for going from 1 video -> 16 views. This was nearly 40 minutes before on my 5090!
3. I also got a version of 4d splatting training working, its a mess and doesn't look great but hey it works!
Really really cool work, hoping to do more with it in the future when I'm a bit less scattered with all the cool things I want to work on 😅
Infinite-Realities retweeted
3DGSをメッシュ変換するソフトを近日公開予定です。
ローカル環境で動作し、GPUなども不要です。
基本無料でどなたでもご利用いただけるように準備しています！
#3DGS #LichtFeldStudio #3DPrint
Infinite-Realities retweeted
This is the last year I create content in 2D.
To prove it I’m releasing an 11-minute 4DGS video in partnership with @4DV_ai where every single shot is dynamic 3D. Over the next 12–18 months, I'll be moving my filming exclusively to dynamic 3D.
Thank you so much to @NVIDIAAI and @Dell for making this video possible.
Infinite-Realities retweeted
Mó Yuan, Leader of the Bastion of Mó, comes to life through full facial and performance capture by martial arts legend Donnie Yen. Test your strength against him—let true steel speak and earn your answers!
