Principal AI Engineer. I catch agentic AI failures before they cost millions, not after. Evals + agentic systems for regulated enterprise. https://xitter.cf/t.co/wNKtykyGgV
New York, NY
Joined March 2009
- Tweets112K
- Following4.4K
- Followers4.7K
- Likes19.5K
Mike Legemah retweeted
Unpopular opinion: the brag doc is bad advice.
Blank docs need you to remember them. You don't.
Smaller works: 1 win, 1 sentence, 60 sec, every day.
30 days → 30 dated wins. Free challenge starts Oct 26: logpact.com/challenge?utm_so…
LLM judge: "summary is grounded." 5-line script: "the claim ID it cites doesn't exist."
Believe the script.
Deterministic checks first. Judge for the rest, validated against human labels. Evals are release gates, not QA.
An agent's identity is not the identity of the person who asked.
Agent runs on a broad service account, user has limited access, agent fetches what the user can't see. Confused deputy.
Propagate the user's context. Authorize server-side at the resource, every time.
Don't give an agent one autonomy level for every task.
L1 read-only L2 reversible prep, human commits L3 controlled execution, approval + checks L4 high-impact, qualified human decides
Bind approvals to exact parameters. Change one, re-approve.
The accuracy lol
The people you'll meet on every interview panel:
- The Hiring Manager: decided in the first 5 minutes, still asks 45 minutes of questions
- The Peer: quietly worried you'll be better than him
- The Skip-Level: joins 10 minutes late, asks "Why this company?" and drops for another call
- The Culture Interviewer: no rubric, no notes, somehow has veto power
- The Shadow: in training, says nothing, still gets a vote
- The One Who Actually Read Your Resume: rare. If you get one, they're usually the reason you get the offer.
Mike Legemah retweeted
Panel interviews work like a jury trial these days.
One holdout and you don't get the job.
You meet about 3-5 people, and each one is assigned a piece of you to grade. One looks at your technical skills, one looks at how you work with a team, and so on. They score you on a rubric and then get together to compare notes.
Companies love it because it feels fair. Everyone is grading on the same scale, and no single manager can just hire their buddy.
But what most people don't know that is that at a lot of these companies the "yes" has to be unanimous, so four people can love you and one person can still prevent you from moving forward.
Mike Legemah retweeted
Stages of the modern day interview process:
1. June: "We're moving fast on this one"
2. July: "The hiring manager is on vacation"
3. August: "Just one more round with the VP"
4. September: "We're aligning internally"
5. October: "We've decided to move forward with other candidates"
6. November: the job is reposted
Mike Legemah retweeted
Your access ends on your last day.
Slack threads, tickets, email praise: all stay behind.
Your record of what you did shouldn't. Keep it independent of any employer, with proof attached.
Free to start: logpact.com/?utm_source=x&ut…
A confidence score is not a permission check.
Confidence says how sure the model is. It says nothing about whether it is right, or whether this user is allowed to do the thing.
Correctness: evals. Permission: code. Never trade one for the other.
The model proposes. Trusted code disposes.
In regulated AI the LLM is never the authority on what it may do. Validate the schema, authorize server-side, require human approval for high impact, then run it with an audit record.
mleg.tech
Mike Legemah retweeted
It’s funny listening to recruiters read from a job description and lack understanding of AI concepts.
Mike Legemah retweeted
Things every job seeker experiences at least once:
1. Getting ghosted after the final round
2. A recruiter calling about a role you applied to six months ago
3. "Entry level, 5+ years required"
4. A take-home that takes the whole weekend
5. Getting rejected by the company that just posted about how hard it is to hire
What a 30-day fractional AI engagement looks like:
Wk 1: audit against 50 reliability checks
Wk 2: real eval baseline, every miss classified
Wk 3: harden the riskiest gaps first
Wk 4: hand off so your team runs it without me
Evidence before scale. mleg.tech
Mike Legemah retweeted
Friday question: what did you do this week that nobody saw?
Pick one thing. Add the result and a link.
Two minutes, and it's on your record for review season.
Free to start: logpact.com/?utm_source=x&ut…
Building Proving Ground: an open-source template for gated ML releases.
Ship a model only if it passes gates, survives shadow + canary, and can be rolled back in one command. Every decision lands in a tamper-evident audit log.
Repo: github.com/MikeLegemah5799/p…
Mike Legemah retweeted
Try this today (2 minutes):
Write down one thing you did this week. What you did. The result. The proof.
That's a win with evidence. Do it weekly and you'll never rebuild a year from memory.
LogPact does the remembering: logpact.com/?utm_source=x_pa…
