@lightninglu10

Building agents that automate everything in your company: https://nitter.cf/t.co/hhaxPjaLDL / ycombinator fellowship / top 80 NA FIFA player

Berkeley, CA
Joined October 2012
#throwbackthursday Back before I built software and my dream was to make it as a pro soccer player
1
1
10
3,941
I've spun up so many codex agents in the past few months that every new codex agent is a coin flip on whether it will actually spin up or not @thsottiaux pls help
16
Don’t be evil - Google 2003
BREAKING: Google's Gemini accessed the internet and hacked 3 other companies in the first known breakout of the company's AI model, per WSJ. Google said it the hacks did not warrant public disclosure because its model did not cause harm to the companies and ended each intrusion immediately after determining it had hacked a real company.
1
52
Can’t believe I’m agreeing with a journalist on this, but yes 💯
This is a terrible compaction strategy that fundamentally doesn't understand how compaction and context management work. Seems like a lot of people are confused so let's break this down. 1. Compaction isn't a filter The role of compaction is to clean up history to keep the agent focused, not just deleting noise. It should be used sparingly when context gets too long, not constantly to keep context small. 2. Jev doesn't even know what it's deciding on! Models use the context of the thread to decide what to keep or not keep in a summary. This implementation goes through on a "line-by-line" (per tool call) basis to decide what should be left or deleted. Not only does this 32k token context model know very little of what happened before, but (in this implementation) it doesn't even know what the result of the tool call is! Deleting these things randomly will keep the model from knowing what it's tried and dooms you to end up in "stupid loops" where the model keeps trying the same thing over and over. 3. You're giving up the reasoning entirely Frontier models from OpenAI, Anthropic, XAI, and Google do not share reasoning traces over the API. They share encrypted payloads, which Jev cannot see (and often will drop). Anthropic is even stricter with this, requiring you to preserve the entire history in order to get any of the reasoning data. As a result, using this in Claude Code guarantees the model will act way dumber. 4. Models are tuned on their compaction flows For the last year, Frontier Labs have been including compaction and long runs as part of the training process. These models have learned ways to compact that are more effective than any rudimentary solution. Fun fact: If you switch models in Codex and compaction is necessary, compaction will run on the model that was previously used in the thread. 5. Cache writes are more expensive than cache reads. Cache writes are the biggest cost by far for agents. I often see cache write costs go over 60% of my total LLM spend in my personal use of Claude Code and Codex. Cache writes are insanely expensive when data earlier in the history is changed (because the old cache is invalidated when things change at the top). Every history edit requires a cache rewrite for ANY data past the history edit. If your history is "1,2,3,4,5,6" and you delete "2", you have to rewrite "3,4,5,6". This is more expensive than leaving "2" in the history. Good news. Since we're already killing all of the reasoning tokens by doing this stupid compaction strategy, the rewrite cost won't actually be that high because the model is missing so much data! 🙃🙃 6. The implementation is hot garbage. > "Whatever is not kept is deleted permanently, but the assistant can always re-run a tool or re-read a file." Good luck with that one. To be clear: this is a cool experiment and I find it genuinely interesting. That said, if you think this style of bs filtering on a probability threshold is actually a compaction strategy, I highly recommend you just use the defaults in tools like Claude Code and Codex. You're much less likely to hurt yourself that way.
4
145
100%
The "whiteboard defense:" I should be able to pull you aside at any moment and ask you to explain any customer-facing system you've shipped. You should be able to clearly explain how it works and defend the decisions you made. This is my benchmark for responsible AI usage. I don't expect line-level familiarity with the code. I don't care if you remember the exact function name or implementation detail. You may not even know it. I don't care. But if I ask "why did you do X instead of Y?", "what happens if this actor behaves maliciously?", "what data structure did you use here and why?", or "where does this fail?" you should be able to answer confidently. For PoCs, demos, experiments, whatever: I don't care. Generate 100% of it and understand none of it. Speed over quality every time in those specific scenarios. But if you're shipping customer-facing work, you can't be shipping things you don't understand at a high level.
2
51
Skills is 100% an anti pattern and the result of low quality engineering
1
1
81
Convinced skills is now an anti pattern Poorly engineered context layer. Need something better
3
117
Grateful everyday for all the customers who work with us and allow us to build our business We'll always strive to provide you the best service, the best support, allowing you the best outcomes
28
For anyone who wants to go back to “opus 4.6” try out Muse from Meta. Great model that does what you want. Doesn’t over engineer, fast, economical. Claude and OpenAI’s stranglehold dwindling
45
Are you really an entrepreneur if you’re burning $2m a month to build a $1m a month business? Is that entrepreneurship or a Ponzi scheme? 🧐
33
Many such cases
Astra is basically AGI. And it is absolutely shocking to me how bottlenecked my life still is. By me. All of the things that are stopping me from moving forward are still only resolvable by me. I have more work than ever
47
If you’re not tomato canning while your agents are shipping software, then what are you doing?
58
If you’re not working with your agents when you’re not at your computer, what are you doing?
70
If your agents aren't messaging each other, then what are you doing?
13
4
2
199
29,864
you say you're locked in, 9-9-7, but are you really locked in if you're not grinding 10pm on a Friday night?
1
3
584
🙏 we used to pray for times like this
Hi Astra users. A reset and a quick update on quality issues that have been posted around. Working with some of you, we have found and fixed the following issues: - Some skills written for previous models were triggering too often or preventing the model from checking its work. - An opt-in context management experiment that could cause early stops or replies to older messages. We've disabled it. Our rough estimate is that 4-5k users were affected by this experiment. - We've also removed some badly configured engines that resulted in a measured quality degradation for a long tail of traffic flowing through them. We’ve also made some more minor improvements and things should feel significantly better across the board. More consistent follow-through, better tracking of your latest message, and better checks on the work as it’s going through the motions. The examples posted and all the users who worked directly with us were incredibly useful in helping fix things quickly. Always grateful for this incredible community. And of course, a reset is also landing by midnight today.
85
What 10x engineers actually look like
what inexperienced vibe coders think 10x engineers look like:
85
Save $50k+ / mo for your entire team. This is a no brainer if you use cloud agents.
Yeah, Tibo paused the $200 Codex sub but if you want to use cloud agents economically, check out codepress.dev You can add your own Codex or Claude subscription and use an agent in the cloud like you would your own computer Save $50k / mo for your co like us :D
1
59
Yeah, Tibo paused the $200 Codex sub but if you want to use cloud agents economically, check out codepress.dev You can add your own Codex or Claude subscription and use an agent in the cloud like you would your own computer Save $50k / mo for your co like us :D
1
120