
I generate models that generate increasingly weird other stuff. -- Prev: Founder of Popgun Labs (Techstars), Founder of the @QUTCode Network.
Joined August 2013
- Tweets3.8K
- Following1.1K
- Followers4.1K
- Likes2K
It’s been refreshing to see ai people starting to take RSI seriously. Look after your wrists, good ergonomics is important. Carpal tunnel sucks.
Replying to @Esychology
Great - I’ll dm some details on why I’m using it.
Kinda cooked on this one.
My new favorite bijection for normalising flows, Predictive Rosenblatt Spline, closed form inverse.
Belief over a gaussian codebook -> posterior predict-> spline knots, all analytic. Exact log-det at any K, zero init is the exact Rosenblatt map.
If your spending tokens on solving math problems. May i suggest matrix multiplication exponent?
Probably a decent economic upside. Current best exponent ≈ 2.37
It has a closed form evaluation suite, so it can be auto researched.
Replying to @francoisfleuret
I feel like things like schmidhuber SWRM need a proper revisit, especially if you can formulate it without the rank-1 constraint of delta-net interpretations.
Replying to @Algomancer @francoisfleuret
Replying to @Algomancer
The search space between transformer fast weights in and hyper networks seems rich. Anything that let’s you learn “faster” than your learning rate is probably worth investigating.
Replying to @francoisfleuret
Not for a lack of saying.
We been saying.
xitter.cf/Algomancer/status/1800…
Replying to @francoisfleuret
Refinement strategies seem to be pretty stable. (residuals)
Fast Weights.
Normalisation.
Replying to @leonard_cor @recurseparadox
I’d need to spend more time thinking about it to form a take. Generally tho, I tend to think most things can work, the surface area to correct issues presented by anyone with a “x approach is better than y approach” seems rather non trivial.
Replying to @Algomancer @cetusian
Not the best measure, but high energy clusters predict the future better than random ones in the current varient.
Replying to @Algomancer @cetusian
So, right now - just rolling out future predicted states and comparing them.


