Han Lee

I build and operate machine learning systems. I am the guy to call for fixing spaghetti codes, processes, and orgs.

Start here

Browse by topic

Evaluation and Alignment: The Seminal Papers

A practical guide to building AI evaluation systems, grounded in the research that shaped the field.

Early access at Manning (50% off)

Recent posts

Browse all posts

Jev and the return of AI/ML Engineering

Examining Jev's probability calibration, structured outputs, latency, and cost against open source LLMs, with experiments and reliability diagrams.

Stop Being Permanent Underclass. Implement a Token Factory.

AI transformation is not a cost-control exercise. Companies should implement centralized token factories that give employees governed agents, route work across models, and turn operational traces into a continuous-learning system.

Data Aggregation Is Not a Moat

Data aggregation used to be valuable because collection, access, parsing, transformation, storage, analysis, and maintenance were expensive. Browser agents and foundation models compress that operating cost, which means many data moats built on non-proprietary public data are weaker than they look.

Hidden Technical Debt of AI Systems: Agent Harness

The agent is the model plus the harness. The runtime is where the harness lives. As models get better, the structure we put around them turns from scaffolding into ceiling. Sutton's Bitter Lesson is now arriving on the harness, and the asymmetry between training-time and production-time harnesses is where most of the next debt will accumulate.

Browse my projects and technical notebooks.