AI systems that
survive production.
Most work in the demo and break under real traffic. I design the architecture, evaluations, and infrastructure that hold — then hand your team the keys.
Shipping LLM systems since GPT-3 · 300+ engineers trained
- model
- claude-sonnet-4.5
- tokens_in
- 3,140
- tokens_out
- 412
- cost
- $0.011
Shipped with evidence — not vibes.
Example trace — a production RAG eval, anonymized. Hover a span.
Trusted by teams who ship
From Fortune 500 to Series A — and the AI-infra companies themselves. The common thread: they needed it to work, not just demo.
The record
Not theory. Not decks. Systems that ship.
Building production LLM systems before “AI engineer” was a job title.
The capability stays after the engagement ends. You keep the muscle.
Enterprise, fintech, funds, and the eval companies other labs rely on.
From the lab · private beta 2026
evalOS
The eval layer I kept rebuilding for clients, now a product. One line of code turns on OpenTelemetry-native observability, a swapped-position judge panel, and human-in-the-loop quality gates.
Explore evalOS- OpenTelemetry-nativeIngests your existing spans
- Judge panel3 model families, positions swapped
- Quality gatesShip only past your thresholds
- Cost + driftDashboards that flag regressions
What I do
Three things. Done well.
Production architecture
RAG, agents, and eval loops that hold under real traffic — not benchmark traffic.
Technical due diligence
For funds and acquirers: what's actually under the hood, and what breaks at scale.
Fractional AI leadership
Senior technical direction through high-growth phases, without the $500K hire.
Nothing below $10K. Priced on outcomes, not hours.
How we engage
Two ways in.
Embed & execute
I integrate with your team — standups, PRs, Slack — and stay until it ships. Not a deck and a disappearance.
- Duration
- 3 months minimum
- Model
- Embedded, weekly
- Best for
- Core builds, overhauls
Target & resolve
A specific problem, scoped and solved. Fixed scope, fixed timeline, fixed price. You get the deliverable, not a report about it.
- Duration
- 2 weeks minimum
- Model
- Fixed scope
- Best for
- Evals, pre-raise cleanup
The bench
When it needs more firepower.
Not contractors — collaborators. Each could run their own shop.
Ship with evidence.
I take on limited engagements. If it's not a fit, I'll tell you. If it is, we move fast.
Response within 48 hours · no sales process · direct conversation