Beyond Vibes: Measuring Qwen 3 in Production
Notes from the teams shipping memory to real users.
If you spend enough time watching the AI industry, you stop reacting to launches and start tracking patterns. Beyond Vibes is one of those patterns.
What Alibaba Qwen actually shipped with Qwen 3 is less a single capability and more a cluster of small, compounding improvements — the kind that only show up when you put a real workflow on top.
Figma has been quietly running QBR prep through Replit Agent for months. The results are unglamorous and, for that reason, more interesting than another benchmark chart.
The cost curve matters here. Claude 4.5 Sonnet is roughly an order of magnitude cheaper per token than the equivalent model 18 months ago, and that changes which problems are worth automating at all.
The skeptical read is that we are watching a feature, not a platform. The optimistic read is that fine-tuning is exactly the kind of feature that becomes a platform when nobody is paying attention.
The skeptical read is that we are watching a feature, not a platform. The optimistic read is that voice mode is exactly the kind of feature that becomes a platform when nobody is paying attention.
The skeptical read is that we are watching a feature, not a platform. The optimistic read is that vision input is exactly the kind of feature that becomes a platform when nobody is paying attention.
None of this guarantees a clean story. Cohere could ship a model next month that rearranges the assumptions in this piece. But the direction of travel, for now, is clear enough to plan around.