All writing

Coming soon · 7 min read

Evaluating AI systems instead of prompts

Useful evaluation follows the full product path, not just the prompt and response.

This essay is in progress. I’m using this space to develop practical notes from building and evaluating production AI systems.

Want to discuss the idea before it’s published? Send me a note.