PapayaPapaya
Portrait of Niyaz Puzhikkunnath

Author

Niyaz Puzhikkunnath

Niyaz Puzhikkunnath writes about evaluating and improving production AI agents at Papaya.

  • AI agent evaluation
  • Production agents
  • Agent optimization

Articles and posts by Niyaz Puzhikkunnath

Agent evaluation

How to Evaluate AI Agents in Production: A Practical Framework

In one public benchmark we analyzed, 22% of runs confidently told the customer the job was done without ever calling the real API. A guide to evaluating agents beyond the pass rate.