Creative Technologist & Media Artist
Ireland
Joined October 2021
- Tweets165
- Following381
- Followers312
- Likes3K
imitations; simulations; emulations
Google presents Diffusion Models Are Real-Time Game Engines
discuss: huggingface.co/papers/2408.1…
We present GameNGen, the first game engine powered entirely by a neural model that enables real-time interaction with a complex environment over long trajectories at high quality. GameNGen can interactively simulate the classic game DOOM at over 20 frames per second on a single TPU. Next frame prediction achieves a PSNR of 29.4, comparable to lossy JPEG compression. Human raters are only slightly better than random chance at distinguishing short clips of the game from clips of the simulation. GameNGen is trained in two phases: (1) an RL-agent learns to play the game and the training sessions are recorded, and (2) a diffusion model is trained to produce the next frame, conditioned on the sequence of past frames and actions. Conditioning augmentations enable stable auto-regressive generation over long trajectories.
deepmimic style transfer in unity for physically-based animations.. something so uncanny about observing physically 'accurate' humanoids.. slowly developing some sort of weird empathy for these machines🐸
cailean retweeted
There are a bunch of papers following this one. NeRFs soon will be moving and all sorts of interactive stuff.
Like moving a car around a street kind of weirdness.
We are excited to present our work at #NeurIPS22 on Generative Neural Articulated Radiance Fields! In this paper, we build on top of the capabilities of existing 3D GAN architectures and propose the first method for generating full human bodies! (1/7)
cailean retweeted
Finally ML has managed to match the SHRDLU system that Winograd wrote in 1968. It took over 50 years but now it works in the real world and is learned from data.
"Interactive Language: Talking to Robots in Real Time"
interactive-language.github.…
- Real-time, interactive, open-vocabulary, language+pixels -> actions
- A new scale (~600,000 traj.) for language-conditioned behavior
- Dataset, sim, models, code all to be released!
(1/n)...
cailean retweeted
Creative Machine v1.0 🤖 is now out and available in PDE!
As my Google Summer of Code ‘22 project with @ProcessingOrg, I developed a new Machine Learning library for beginners in ML and coding.
#gsoc #ml #MachineLearning #processing #creativecoding
ALT The completion certificate of Google Summer of Code 2022 for Jeongin Lee from a Processing Foundation.
ALT An image of Friends cast with their faces marked with red rectangles and facial landmarks marked with yellow dots.
Going to be doing a Workshop on A.I and ML for creatives later this week!
Super beginner friendly, so feel free to join ⛷
