Tiny Brain Meow 🔴 retweeted
Introducing PC-ALM, a local-learning alternative to backpropagation.
Our method trains 1000-layer neural nets using only local dynamics, and without backprop.
Blog: pub.sakana.ai/pc-alm/
Standard deep learning relies on backpropagation. The brain, however, cannot implement backpropagation, at least not exactly. How can a physical system, such as the brain, solve multilayer credit assignment without explicit use of backprop?
We look for inspiration in two related fields: distributed optimization and NeuroAI.
In NeuroAI, predictive coding asks each neuron activation to solve an energy-based inference problem instead of using a standard forward pass. That inference step can be implemented as energy-minimization dynamics on local prediction errors.
This perspective -- each layer as a dynamical system -- has proven promising, but performance of predictive coding hasn't scaled well with depth. Credit signals at far ends of the network struggle to diffuse into internal layers.
We turn to distributed optimization, generalizing predictive coding to use an augmented Lagrangian instead of energy. This motivation stems back to a classic 1988 paper by LeCun, showing that the Lagrange multipliers of a deep network can be identified with gradients of a supervised loss. The augmented Lagrangian then bridges LeCun's perspective to the standard predictive coding that is used in NeuroAI.
We find that this new perspective yields a natural PC-like alternative to backpropagation, resulting in a method we call PC-ALM. PC-ALM differs from PC in that it introduces dual neurons (Lagrange multipliers) as part of the layer-local dynamics, resulting in each layer acting as a PI feedback control system to minimize local prediction errors.
We find that PC-ALM is capable of propagating signals to seemingly arbitrary depth, especially in deep narrow networks where standard PC struggles to learn.
Ultimately, our motivation here is to understand how distributed physical systems, such as the brain, can compute credit signals using only local coupling and local dynamics.
PC-ALM may also inform deep learning in neuromorphic hardware, where dynamics are cheaper than on GPUs.
Paper: arxiv.org/abs/2605.31022
Code: github.com/SakanaAI/pc-alm
Tiny Brain Meow 🔴 retweeted
Wait until you become a senior engineer and realize template syntax is a prime example bike shedding. It makes almost no difference. It’s all illegible anyway.
Tiny Brain Meow 🔴 retweeted
i'm gonna start messaging recruiters on LinkedIn in hopes of getting interviews
gonna be tracking this and will post the results
Tiny Brain Meow 🔴 retweeted
Now accepting invites into meow/acc
Meow!
xitter.cf/i/communities/18512598…
Tiny Brain Meow 🔴 retweeted
Taking some inspiration from @braincel05:
So here we go with day 1 of grinding CS:
- Got my Redis RDB to write and parse in Go
- Learnt that how I place my objects in a struct affects my memory footprint...kill me
- Learnt a bit more about biquad-filters for digital signal processing
Tiny Brain Meow 🔴 retweeted
Replying to @rxjxmx
build something really simple
build a simple clone
build a clone of my previous project
build a new project
Tiny Brain Meow 🔴 retweeted
to all who are starting out in tech here is one advice:
build something that people actually uses, however STUPID it may be. Dont just make a project and dump it in your machine. deploy it SHOW IT OFFFFF. I regret now that I didnt do that.
Tiny Brain Meow 🔴 retweeted
Built a screenshot app!
Recently I tried many screenshot apps, A lot of them put watermark / ask for payment for such a basic thing or just didn't offer the customization options I wanted.
So i built one - prettify.pro
It will be free forever.
will launch it on producthunt tomorrow!
#buildinpublic
Tiny Brain Meow 🔴 retweeted
I launched the first version of saasgam.ing🥳
I'm going to launch on @ProductHunt officially tomorrow
But since you're seeing this post, here's the link for you😃
It's a Memory Game with a twist.
It promotes other SaaS products
The memory game includes🧠
lifeistooshort.today by @JoschuaBuilds 🗓️
litlyx.com by @LitLyx 📈
testscribeai.com by @PalmquistCaleb ✒️
jamstart.app by @braincel05 🎸
If you want to be featured on my product, featured in a game, or featured on the home page, send me a direct message.
I'm accepting good SaaS products for FREE at the moment.
Also, I'm thinking of creating a section for "Make a custom game" and I'll create and host a game fully customized to your SaaS product
I have 5 more games planned by next week so you can join them.
Also, don't forget to break the Upvote⬆️ button tomorrow on @ProductHunt
Link to play the memory game (first version, use desktop for a good experience): saasgam.ing/games/memory-gam…
Tiny Brain Meow 🔴 retweeted
I'm starting to work on the memory game project now😉
Currently I have 3 SaaS companies that are going to be featured
Litlyx.com by @LitLyx
jamstart.app by @braincel05
and TestScribeAI by @PalmquistCaleb
I hope to make this a long term project and turn it into a DIRECTORY of SaaS companies with multiple games🔥
Even though I'm not fulltime on this project I'll be adding 4-5 new SaaS companies (reach out to be added) and launching 1-2 games focused on gaining traction for the SaaS products every month💻
Let's make this project big🚀
I plan to start coding today and launch it on @ProductHunt on Monday.
It's still not too late to submit your SaaS for free and get featured😃
Cheers 🍻
#buildinpublic
I'm going to #buildinpublic a small project this weekend (October 5 - 6 onwards)💻
I'll make a Memory Game🧠 but with SaaS projects as the guessable objects
So,
I'm looking for 5 SaaS projects that would be willing to submit their projects (for FREE)😀
The game would have your SaaS logo, banner images, description, and link to your site.
I'll market the site in the following ways-
- @X 🐐
-@Reddit 🌐
-@YouTube Shorts📹📱
So if that sounds fun, consider leaving your SaaS in the description, the top 5 would be chosen for FREE.
In the future, I hope to make more such web games but with SaaS tools and make it a long-term project.
How does that sound?
Tiny Brain Meow 🔴 retweeted
i created a website that generates shot charts for any active NBA player, check it out and feel free to dm me feedback!
shotch.art/
Tiny Brain Meow 🔴 retweeted
get out there and go build, build anything, make weird chrome extensions (sorry for the spam), solve random problems you're having, make your own tools:
xitter.cf/alia0209/status/183753…
you can literally go do stuff, so go do stuff
ThePrimeagen@ThePrimeagen1 Oct 2024🇺🇸
United StatesConnected via United States Android AppAccount-level information, not a live location or per-post device.
go and build


























