Inference.Daily
AI QA

Why Your contract review Needs an Eval Harness Yesterday

A field report on computer-use agents and what it changes for analysts.

By Priya Raman3 min read

There is a version of this story that is mostly hype. There is another version, the one we are interested in, that is mostly engineering.

The skeptical read is that we are watching a feature, not a platform. The optimistic read is that live web browsing is exactly the kind of feature that becomes a platform when nobody is paying attention.

What Inflection actually shipped with Command R+ 2 is less a single capability and more a cluster of small, compounding improvements — the kind that only show up when you put a real workflow on top.

The cost curve matters here. Claude 4.5 Sonnet is roughly an order of magnitude cheaper per token than the equivalent model 18 months ago, and that changes which problems are worth automating at all.

Eval harnesses, once an afterthought, are becoming the most important piece of code in many AI projects. Stripe's team treats theirs the way an SRE team treats a runbook.

Inside Databricks, the rollout looked less like a moonshot and more like a slow migration. A pilot, a champion, a quiet expansion, a budget line.

Inside Duolingo, the rollout looked less like a moonshot and more like a slow migration. A pilot, a champion, a quiet expansion, a budget line.

None of this guarantees a clean story. DeepSeek could ship a model next month that rearranges the assumptions in this piece. But the direction of travel, for now, is clear enough to plan around.

#enterprise#benchmarks#multimodal#safety

Related reading

More in AI QA

More from Inference Daily

Keep reading