Justin Pinkney (@Buntworthy) header
Justin Pinkney (@Buntworthy) profile picture

Playing with deep learning, computer vision and generative art. Co-creator of https://xitter.cf/t.co/sYtHB9e5Dj, ML Researcher @ MidJourney @justinpinkney@sigmoid.social

Joined January 2010
Photo by Justin Pinkney (@Buntworthy)Photo by Justin Pinkney (@Buntworthy)Photo by Justin Pinkney (@Buntworthy)Photo by Justin Pinkney (@Buntworthy)Photo by Justin Pinkney (@Buntworthy)Photo by Justin Pinkney (@Buntworthy)Photo by Justin Pinkney (@Buntworthy)Photo by Justin Pinkney (@Buntworthy)Photo by Justin Pinkney (@Buntworthy)Photo by Justin Pinkney (@Buntworthy)
I briefly shared this next frame prediction video in the 🤗 event yesterday. Here's the full thing. I still can't get over how mesmerising it is to watch.
14
89
6
478
Justin Pinkney retweeted
Introducing our V1 Video Model. It's fun, easy, and beautiful. Available at 10$/month, it's the first video model for *everyone* and it's available now.
356
553
368
3,866
1,953,690
Justin Pinkney retweeted
Supporters of safe and liveable streets - we need YOU!! Help secure a new bus gate for Mill Road in Cambridge by sending in a positive comment in support of the new Traffic Regulation Order by midnight on 13 September. Find easy ways to do this at tinyurl.com/TRO-LetsGo
2
9
12
2,100
I love this train ride
Chinese new DiT Video AI Generation model 【KLING】 Open access! Generate 120s Video with FPS30 1080P, Understand Physics Better, Model Complex Motion Accurately prompt: Traveling by train, viewing all sorts of landscapes through the window. kling.kuaishou.com/
10
1,771
The Swan Family is a series of paintings and prints that began in the early nineteenth century. It was inspired by an article published on February 14, 1837, entitled "The History Of A Fable," which appeared as part of a weekly newspaper column called “Aesop’s Tables.” In this story, it tells how two swans were turned into geese to escape their fate at being eaten alive for dinner when they hatched from eggs laid upon water lilies floating near land; but then one day while flying over fields with grazing cattle below them, these birds saw some ducks quacking about food hidden underneath grass clumps—and so did not eat any more bread crumbs thrown out onto the ground beneath themselves! This fanciful tale became popular among artists who used its imagery throughout Europe during much if not all of the Nineteenth Century (including France). By depicting various animals interacting within nature or domesticating other creatures such as cats & dogs etc., it allowed painters like John James Audubon himself along w/ many others including William Turner whose famous painting titled simply enough THE SWANS OF AVON LAKE shows three pairs mated together against backdrop of trees painted directly off-site beforehand.)'
6
1,370
Justin Pinkney retweeted
What if we met… in latent space 😳 play latentscape.com !
13
34
9
240
31,040
FYI Pokemon blip captions dataset that has been used in many academic papers for testing limited-data fine-tuning of text to image models has been subject to a DMCA notice and will have to be taken down: huggingface.co/datasets/lamb…
2
8
2,058
Oooh Würstchen 3 is released! github.com/Stability-AI/Stab… Seems like we have to wait for the face controlnet though... 😞
1
1
1
34
3,145
A while ago I trained a face conditioned diffusion model. You put a face image in (left) and a background image (top) and get out new images of the original faces (sort of). I finally got round to writing a blog post about it: justinpinkney.com/blog/2024/…
2
11
74
7,382
taking a few tenative steps down this path again, but with modern models 😊
1
10
1,689
Apparently there is a very special presenter of Cbeebies bedtime stories tomorrow.
5
1,422
Justin Pinkney retweeted
I created two variants of the popular Pokemons dataset from @Buntworthy for quickly validating the effect of better captions: * GPT-4 generated captions * LLaVA generated captions 🌋 Check them out here: huggingface.co/collections/d…
7
15
80
30,503
I don't know if it's particularly interesting anymore these days, but I did try fine tuning Würstchen v2 on Pokemon. My training script is here: github.com/justinpinkney/wue…
After so much work we now finally release Würstchen v2!!!! You can use it with @diffuserslib ! Find all information in the blog post: huggingface.co/blog/wuertsch… I can't describe how happy I'm to have this out :c Big thanks to @krasul @RisingSayak @pcuenq @multimodalart +Patrick
6
7
1
64
8,298
I think people have higher standards these days, but still makes me laugh.
1
1
16
1,140
Nvidia just released ATT3D: Amortized Text-To-3D Object Synthesis project page: research.nvidia.com/labs/tor… Text-to-3D modeling has seen exciting progress by combining generative text-to-image models with image-to-3D methods like Neural Radiance Fields. DreamFusion recently achieved high-quality results but requires a lengthy, per-prompt optimization to create 3D objects. To address this, we amortize optimization over text prompts by training on many prompts simultaneously with a unified model, instead of separately. With this, we share computation across a prompt set, training in less time than per-prompt optimization. Our framework -- Amortized text-to-3D (ATT3D) -- enables sharing of knowledge between prompts to generalize to unseen setups and smooth interpolations between text for novel assets and simple animations.
3
15
132
15,894
Oh dear so how long until llms start serving us ads? Pay to boost the probability of your brand's tokens?
3
1
7
2,104
First on demand H100s? And at $2.40 an hour! Pretty fast work from @LambdaAPI
NVIDIA H100 Tensor Core GPUs just dropped on Lambda Cloud. 1x H100 80GB PCIe instances are LIVE for only $2.40/hr. Spin up an instance while they last: https://xitter.cf/t.co/QQD7NiszUQ
1
1
9
2,321
Justin Pinkney retweeted
Donate today to our #ZeroCarbonStreets campaign via the @BigGive Green Match Fund and your donation will be DOUBLED at camcycle.org.uk/BigGreenGive… Help us support more communities like Girton work for better cycling & walking in their local neighbourhoods.
1
6
1
3
3,097
But according to the Model license in the GitHub repo the weights will be non-commercial. What happened to the whole open source ethos?
2
1
7
1,970
Hopefully this is just for the research release before the open release xitter.cf/j_stelzer/status/16515…
actually it is planned to be released in public, see
1
2
1,904