linear algebra, SWE, machine learning, building https://xitter.cf/t.co/t728SssX4Y, 日本語学習者

null space 零空間 🇵🇭
Joined December 2022
Tiny Brain Meow 🔴 retweeted
Introducing PC-ALM, a local-learning alternative to backpropagation. Our method trains 1000-layer neural nets using only local dynamics, and without backprop. Blog: pub.sakana.ai/pc-alm/ Standard deep learning relies on backpropagation. The brain, however, cannot implement backpropagation, at least not exactly. How can a physical system, such as the brain, solve multilayer credit assignment without explicit use of backprop? We look for inspiration in two related fields: distributed optimization and NeuroAI. In NeuroAI, predictive coding asks each neuron activation to solve an energy-based inference problem instead of using a standard forward pass. That inference step can be implemented as energy-minimization dynamics on local prediction errors. This perspective -- each layer as a dynamical system -- has proven promising, but performance of predictive coding hasn't scaled well with depth. Credit signals at far ends of the network struggle to diffuse into internal layers. We turn to distributed optimization, generalizing predictive coding to use an augmented Lagrangian instead of energy. This motivation stems back to a classic 1988 paper by LeCun, showing that the Lagrange multipliers of a deep network can be identified with gradients of a supervised loss. The augmented Lagrangian then bridges LeCun's perspective to the standard predictive coding that is used in NeuroAI. We find that this new perspective yields a natural PC-like alternative to backpropagation, resulting in a method we call PC-ALM. PC-ALM differs from PC in that it introduces dual neurons (Lagrange multipliers) as part of the layer-local dynamics, resulting in each layer acting as a PI feedback control system to minimize local prediction errors. We find that PC-ALM is capable of propagating signals to seemingly arbitrary depth, especially in deep narrow networks where standard PC struggles to learn. Ultimately, our motivation here is to understand how distributed physical systems, such as the brain, can compute credit signals using only local coupling and local dynamics. PC-ALM may also inform deep learning in neuromorphic hardware, where dynamics are cheaper than on GPUs. Paper: arxiv.org/abs/2605.31022 Code: github.com/SakanaAI/pc-alm
68
397
102
2,921
454,734
Tiny Brain Meow 🔴 retweeted
On my GitHub in roughly 1 month! 😌😌😌
1
1
3
101
Tiny Brain Meow 🔴 retweeted
Comparison steals joy and blinds you
2
2
10
246
Tiny Brain Meow 🔴 retweeted
Wait until you become a senior engineer and realize template syntax is a prime example bike shedding. It makes almost no difference. It’s all illegible anyway.
Call me biased, but Vue has the cleanest templating syntax. Easy to write & expressive enough. What's your opinion?
9
1
57
5,224
Tiny Brain Meow 🔴 retweeted
We should sell the dog
4
4
60
1,413
Tiny Brain Meow 🔴 retweeted
nyanyame nyanyaju nyanyadono nyarabide nyakunyaku nyanyaku
1
1
11
196
Tiny Brain Meow 🔴 retweeted
i'm gonna start messaging recruiters on LinkedIn in hopes of getting interviews gonna be tracking this and will post the results
9
1
1
69
3,418
Tiny Brain Meow 🔴 retweeted
meow/acc
5
3
37
895
Tiny Brain Meow 🔴 retweeted
Now accepting invites into meow/acc Meow! xitter.cf/i/communities/18512598…

3
2
24
3,154
Tiny Brain Meow 🔴 retweeted
Taking some inspiration from @braincel05: So here we go with day 1 of grinding CS: - Got my Redis RDB to write and parse in Go - Learnt that how I place my objects in a struct affects my memory footprint...kill me - Learnt a bit more about biquad-filters for digital signal processing
1
1
8
265
Tiny Brain Meow 🔴 retweeted
Thank you for all the fanfiction about my egg.
1
2
86
2,152
Tiny Brain Meow 🔴 retweeted
Replying to @rxjxmx
build something really simple build a simple clone build a clone of my previous project build a new project
1
1
2
65
Tiny Brain Meow 🔴 retweeted
to all who are starting out in tech here is one advice: build something that people actually uses, however STUPID it may be. Dont just make a project and dump it in your machine. deploy it SHOW IT OFFFFF. I regret now that I didnt do that.
7
4
1
84
10,361
Tiny Brain Meow 🔴 retweeted
You lose nothing by documenting your journey
One day we all made it and we will proudly look back on our X timelines where we documented our journeys
7
1
1
30
2,376
Built a screenshot app! Recently I tried many screenshot apps, A lot of them put watermark / ask for payment for such a basic thing or just didn't offer the customization options I wanted. So i built one - prettify.pro It will be free forever. will launch it on producthunt tomorrow! #buildinpublic
4
1
5
281
Tiny Brain Meow 🔴 retweeted
I launched the first version of saasgam.ing🥳 I'm going to launch on @ProductHunt officially tomorrow But since you're seeing this post, here's the link for you😃 It's a Memory Game with a twist. It promotes other SaaS products The memory game includes🧠 lifeistooshort.today by @JoschuaBuilds 🗓️ litlyx.com by @LitLyx 📈 testscribeai.com by @PalmquistCaleb ✒️ jamstart.app by @braincel05 🎸 If you want to be featured on my product, featured in a game, or featured on the home page, send me a direct message. I'm accepting good SaaS products for FREE at the moment. Also, I'm thinking of creating a section for "Make a custom game" and I'll create and host a game fully customized to your SaaS product I have 5 more games planned by next week so you can join them. Also, don't forget to break the Upvote⬆️ button tomorrow on @ProductHunt Link to play the memory game (first version, use desktop for a good experience): saasgam.ing/games/memory-gam…
1
1
15
923
Tiny Brain Meow 🔴 retweeted
I'm starting to work on the memory game project now😉 Currently I have 3 SaaS companies that are going to be featured Litlyx.com by @LitLyx jamstart.app by @braincel05 and TestScribeAI by @PalmquistCaleb I hope to make this a long term project and turn it into a DIRECTORY of SaaS companies with multiple games🔥 Even though I'm not fulltime on this project I'll be adding 4-5 new SaaS companies (reach out to be added) and launching 1-2 games focused on gaining traction for the SaaS products every month💻 Let's make this project big🚀 I plan to start coding today and launch it on @ProductHunt on Monday. It's still not too late to submit your SaaS for free and get featured😃 Cheers 🍻 #buildinpublic
I'm going to #buildinpublic a small project this weekend (October 5 - 6 onwards)💻 I'll make a Memory Game🧠 but with SaaS projects as the guessable objects So, I'm looking for 5 SaaS projects that would be willing to submit their projects (for FREE)😀 The game would have your SaaS logo, banner images, description, and link to your site. I'll market the site in the following ways- - @X 🐐 -@Reddit 🌐 -@YouTube Shorts📹📱 So if that sounds fun, consider leaving your SaaS in the description, the top 5 would be chosen for FREE. In the future, I hope to make more such web games but with SaaS tools and make it a long-term project. How does that sound?
3
3
8
647
Tiny Brain Meow 🔴 retweeted
11
104
3
856
35,799
Tiny Brain Meow 🔴 retweeted
i created a website that generates shot charts for any active NBA player, check it out and feel free to dm me feedback! shotch.art/
4
3
15
885
Tiny Brain Meow 🔴 retweeted
get out there and go build, build anything, make weird chrome extensions (sorry for the spam), solve random problems you're having, make your own tools: xitter.cf/alia0209/status/183753… you can literally go do stuff, so go do stuff
ThePrimeagen
@ThePrimeagen1 Oct 2024
go and build
1
1
26
978