Run 70B-parameter local LLMs at home with an NVIDIA DGX Spark (1 PFLOP, 128 GB Unified Memory). Access from any laptop via WebUI or Python API for full control. #AI #LLM #NVIDIA #DGXSpark #GPU @NVIDIAAIDev youtube.com/watch?v=yOgNv4Hr…

NVIDIA DGX Spark, 1 PFLOP super computer that fits in your hands. It has 128 GB of unified RAM, this has allowed me to generate 1024 square stable diffusion images and 70b param LLM's. This is an amazing machine, everything worked great out of the box. More videos to come. #gpu #llm #GenAI @NVIDIAAIDev youtube.com/watch?v=QbqY5qfi…

Similarities and differences between human brains and GPUs. Both are about the same size/weight. So the internal processing is considerably different. GPU's draw much more power under load, brains no so much. Brains last much longer and require vastly much less infrastructure to produce. #genai #gpu

Quick review of the upcoming NVIDIA DGX Spark, a small desktop supercomputer with 128GB unified GPU RAM on Grace-Blackwell @NVIDIAAIDev #gpu youtube.com/shorts/eSdjLDyHp…

What is "Unified Memory"? Basically the CPU and GPU can share memory. We seem to be seeing this more and more, from Macs to game consoles to high end server computers. The NVIDIA DGX Spark will soon add this in a "Mac Mini" sized 128GB desktop super computer. @NVIDIAAIDev #gpu youtube.com/shorts/Bjyf4dMtf…

Want a 50X GPU speed up from sklearn with no code changes? Have a look at the latest version of CUML from @NVIDIAAIDev. #gpu #sklearn youtube.com/watch?v=khH2dCs0…

Don’t ask me how long I’ve been working on this! #2048

Polars was already amazingly fast, but now Polars GPU Engine Powered by RAPIDS cuDF is Available in Open Beta! @RAPIDSai @NVIDIAAIDev developer.nvidia.com/blog/po…

#GTC24 is in full swing and Jensen Huang's keynote introduced the Blackwell platform, which includes the newest generation of NVIDIA GPUs. In this video I give some of my main reactions. @NVIDIAAI youtube.com/watch?v=f-tFjRk4…

I am giving a way an #NVIDIA RTX 4080 SUPER, which was kindly provided by NVIDIA AI, GTC 2024 starts next week on March 18th! See this video for my top picks and details on this giveaway! #GTC24 youtube.com/watch?v=23YCQGR3…

NVIDIA #gtc24 is just around the corner, here are my picks of the sessions I will attend. This is the event for AI! You can register here, nvda.ws/3R2hdIj Also, thank to NVIDIAI will have a Geforce GTX 4080 SUPER to give away, details soon! youtube.com/watch?v=gRLrARn4…

#GTC24 is just around the corner. Thank you to @NVIDIAAI for providing this 4080 Super for a giveaway. More to come! Register here. nvda.ws/3R2hdIj My video intro! youtube.com/watch?v=1lEJchsJ…

68 YouTube videos, 65 Jupyter notebooks, and 10 programming assignments! Last night I completed the refresh of the now PyTorch-based, Generative AI infused, course. #python #PyTorch #deeplearning GitHub: github.com/jeffheaton/app_de… YouTube: youtube.com/watch?v=r7eExQWK…

Would you like to get up to 150x speed improvements with PANDA using a GPU without the major code changes usually needed? In this video I introduce the latest version of cudf, from @NVIDIAAI that can automatically fall back to CPU Pandas for the portions of your pandas code that cannot be automatically moved to the #gpu. #MachineLearning #pandas youtube.com/watch?v=ZpzPTCnh…

My first Mac App Store app! Mostly just to prove that I can release something non-trivial, written in Python, to the MacOS App Store. My program is open source, I will provide a link to the code. I will do a much more in-depth write up of the somewhat convoluted process soon, if there is interest. The actual application is a cellular automata rule evolution that system that I published in a journal. Think, evolve your own Conway's Game of Life. #machinelearning #python #osx github.com/jeffheaton/mergel…

Happy Halloween, I am a poorly constructed #stablediffusion prompt! #halloween Costume fingers!

Some of my more ancient books that I used very frequently in some of my first jobs.

Early 2000s "Have you tried rebooting your computer?" 2020s: "Have you tried to clear cache and delete cookies?"

How to Use Dual NVIDIA H100s with Keras . IN this video I look at how to use dual GPUs with Keras, working with an amazing system provided by @Exxactcorp . youtube.com/watch?v=QlFnwDSj…