Carl Ryden retweeted
"Domains are shallow, except the one I understand and work in." —said too many people too often
"Most domains are fundamentally pretty shallow," says @RyanGreenblatt. A concise statement of what the superintelligence worldview gets wrong, IMO. My view is the opposite: many domains are surprisingly deep, and AI won't be able to "quickly pick up a bunch of domains."
Carl Ryden retweeted
Sutton's bitter lesson is roughly: scale > algorithms
Sharing the wisdom that anyone who has made ML useful knows: neither scaling nor algorithms is the be-all and end-all
Another banger paper from Google.
If you build memory for long-horizon agents, this one is worth your time.
(bookmark it)
Really nice to see how knowledge graphs are being explored in creative ways for agents. This has lots of implications for self-evolving agents.
Technical summary below:
Agents usually pick actions by generating over an accumulating history, which leaves the procedural knowledge implicit. As trajectories get longer they lose track of objectives, call tools out of order, and repeat actions that did not work.
The Procedural Graph helps to make that knowledge explicit.
A knowledge graph stores facts as entity-relation-entity triplets. A Procedural Graph stores procedures as procedure-relation-procedure triplets, so the agent can query what to do next and under which conditions.
At each step, the framework localizes the agent's active node, and a guidance model turns the surrounding subgraph into step-level guidance that biases the next action without dictating it.
The graph rewrites itself.
An LLM refiner compares failed trajectories against successful ones and edits the topology and attributes, committing only edits that hold up on held-out validation, and keeping the rejected ones on file so the same change is not proposed twice.
Starting from a minimal skeleton it builds graphs that match or beat hand-designed ones, and it helps to repair a flawed expert priors instead of inheriting them.
Paper: academy.dair.ai/papers/proce…
Most systems today have this backwards. The model decides when to go get a fact. It should be the other way round. Trusted knowledge and a deterministic orchestrator decides what the model sees before it guesses. And only when guessing is best next action.
A language model isn't trained to be right. It's trained to sound right.
Every real agent is a neural core in a harness, and the harness is where the gains are hiding.
Our CEO @caryden shares why the high ground is what you feed it → warmhub.ai/blog/your-model-i…
Right now we have terrible definition that the "harness is defined as everything that is *not* the model." This feels like a tautology. I think about knowledge + deterministic orchestration + stochastic guessing machine = harness + model.
There so much more to say on this. More to come. A huge thank you to @brandi_haymore for helping me to focus on this one concept for this post.
The recent examples where teams have maxxed out the ARC AGI with only harness changes and even with "small" models all are designed, algorithms that employ guessing machine (LLM) that is conditioned on accumulating knowledge.
Carl Ryden retweeted
Agents write code faster than review can absorb. Review is now the slowest gate.
WarmHub's answer: The Council. Risk-routed, multi-agent review; findings verified, every run recorded.
Our CTO @JeffSchilling shares how to build your own → warmhub.ai/blog/asserting-co…
Carl Ryden retweeted
recommended reading.
shapeofthesystem.com/posts/2…
Agree 100% with this. This makes model switching, evals, traceability and trust 10x easier.
"Move non-determinism to the edges, and determinism to the core" - @DavidKPiano
Really enjoyed this talk. David shares some thoughts about making programs call LLMs vs have the LLM do everything for us...
I've recently been building agents with @flueai and it really resonates with me. I have as much determinism defined in my harness/workflow and have the LLM help the program, not the other way around, and it's been great so far.
Link to his video below, it's a great one.
the kalman filter is one of those ideas that shows up everywhere once you understand it.
robots.
drones.
self driving cars.
sensor fusion.
tracking.
navigation.
control systems.
the problem is simple:
your sensors are noisy.
gps is not perfect.
imu drifts.
encoders slip.
cameras lose track.
lidar gives uncertainty.
so the system has to ask:
what do i think is happening?
and
what did the sensor just tell me?
the kalman filter sits between those two.
prediction + measurement = better estimate.
it predicts the next state using a model.
then it looks at the noisy sensor reading.
then the kalman gain decides how much to trust the model vs how much to trust the measurement.
that is the whole loop:
predict.
measure.
update.
repeat.
this is why it is so powerful in robotics.
a robot does not get clean truth from the world.
it gets noisy signals and has to estimate reality in real time.
the kalman filter is basically uncertainty management.
not guessing.
not blindly trusting sensors.
not blindly trusting the model.
just continuously correcting belief as new data comes in.
that is what intelligence in physical systems looks like:
build a model of the world.
observe reality.
measure the error.
update the belief.
Carl Ryden retweeted
It’s amazing how powerful a handful of TV commercials will be for my Attorney General race.
Makes it difficult to inform voters that my opponent:
- voted to overturn the last election
- wrote the disastrous “bathroom bill” that nuked NC’s business climate until it was repealed
- wants to “smash the FBI into a million pieces”
- is deeply opposed to reproductive freedom
- invested in a website that’s used as a safe haven for white supremacists
- has never prosecuted a single case
But - somehow - we’ll find a way to get the word out.
Carl Ryden retweeted
Rock the BoSUSA 2024 in Raleigh, NC, this 23-25 September, while saving by securing your seats today. Roll with other industry rockstars on this 3-day conference in one of the thriving tech clusters in the U.S. 🤘
Sleep with savings tonight. Register now.
#BoS24
Carl Ryden retweeted
At BoS, entrepreneurs like @caryden find invaluable insights and support from peers. Their stories inspire us, showcasing the power of collaboration in our community.
Get your tickets for BoS Conference Europe 2024 and join this amazing community. 🌟
bit.ly/BoSEU24























