Inference.Daily
LLMs

The Quiet Architecture Shift Behind Llama 4

Inside the quiet rewiring of incident response at Klarna.

By Elena Brost3 min read

If you spend enough time watching the AI industry, you stop reacting to launches and start tracking patterns. The Quiet Architecture Shift Behind Llama 4 is one of those patterns.

The skeptical read is that we are watching a feature, not a platform. The optimistic read is that memory is exactly the kind of feature that becomes a platform when nobody is paying attention.

What Google DeepMind actually shipped with Phi-4 is less a single capability and more a cluster of small, compounding improvements — the kind that only show up when you put a real workflow on top.

Teams that win with evals-first development tend to share a habit: they write the evals before they write the prompts. Everything else follows from that.

The cost curve matters here. DeepSeek V4 is roughly an order of magnitude cheaper per token than the equivalent model 18 months ago, and that changes which problems are worth automating at all.

Snowflake has been quietly running code review through Codeium for months. The results are unglamorous and, for that reason, more interesting than another benchmark chart.

Inside Stripe, the rollout looked less like a moonshot and more like a slow migration. A pilot, a champion, a quiet expansion, a budget line.

None of this guarantees a clean story. Cohere could ship a model next month that rearranges the assumptions in this piece. But the direction of travel, for now, is clear enough to plan around.

#voice#tool use#GPUs#frontier models#open source

Related reading

More in LLMs

More from Inference Daily

Keep reading