I generate models that generate increasingly weird other stuff. -- Prev: Founder of Popgun Labs (Techstars), Founder of the @QUTCode Network.

Joined August 2013
Include

Only show posts containing:

Exclude

Hide posts containing:

Time range
-
Minimum likes
If you like my posts, lmk what ones specifically and what you'd wanna see more of.
1
30
It’s been refreshing to see ai people starting to take RSI seriously. Look after your wrists, good ergonomics is important. Carpal tunnel sucks.
3
18
919
code soon, once i get some sleep
5
416
Adam Hibble retweeted
1
1
11
761
Gap closed.
4
2
30
6,832
Replying to @Esychology
Great - I’ll dm some details on why I’m using it.
1
30
Kinda cooked on this one. My new favorite bijection for normalising flows, Predictive Rosenblatt Spline, closed form inverse. Belief over a gaussian codebook -> posterior predict-> spline knots, all analytic. Exact log-det at any K, zero init is the exact Rosenblatt map.
1
2
21
1,120
gimme dat ω = 2 triton kernel when you find it.
175
If your spending tokens on solving math problems. May i suggest matrix multiplication exponent? Probably a decent economic upside. Current best exponent ≈ 2.37 It has a closed form evaluation suite, so it can be auto researched.
1
14
565
Replying to @francoisfleuret
I feel like things like schmidhuber SWRM need a proper revisit, especially if you can formulate it without the rank-1 constraint of delta-net interpretations.
2
450
Replying to @Algomancer
The search space between transformer fast weights in and hyper networks seems rich. Anything that let’s you learn “faster” than your learning rate is probably worth investigating.
2
134
Replying to @francoisfleuret
Not for a lack of saying. We been saying. xitter.cf/Algomancer/status/1800…
Replying to @francoisfleuret
Refinement strategies seem to be pretty stable. (residuals) Fast Weights. Normalisation.
1
4
410
I need more compute.
5
452
Wait until they find about about H-Space. Y'all ready for some curvature.
7
670
I’d need to spend more time thinking about it to form a take. Generally tho, I tend to think most things can work, the surface area to correct issues presented by anyone with a “x approach is better than y approach” seems rather non trivial.
2
38
Not the best measure, but high energy clusters predict the future better than random ones in the current varient.
1
1
23
So, right now - just rolling out future predicted states and comparing them.
1
1
22