Drift in multi-day agentic tasks
Instruction adherence degrades measurably past a horizon our tooling had not previously instrumented.
Two models for work that outlives a single turn: they hold state across tools, recover from their own mistakes, and say when they are unsure instead of inventing a finish line.
The headline change is horizon length. Both models were trained and tuned for tasks that run across days rather than minutes, which changes what matters: not the quality of a single answer, but whether the model still remembers the constraint you gave it on Monday by the time it is writing the summary on Thursday.
In practice that meant spending most of our effort on three unglamorous problems — keeping the original instruction in view, noticing when a tool call has quietly failed, and distinguishing "finished" from "out of ideas". None of those show up in a chat demo.
An earlier draft of the system card reported a refusal benchmark improvement of nine points over the previous generation. That number was wrong. The evaluation split had been contaminated by training data, and the model was not being tested on the thing the card claimed it was testing.
The suite has been rebuilt with a held-out split and a continuous contamination check, and the affected claim has been withdrawn from the card rather than quietly restated. The rebuilt benchmark shows a smaller improvement than the original figure, which is the number we now report.
The release gate now covers tool misuse and instruction drift over multi-day runs, plus the standing suites for cyber uplift, bio risk, and refusal behaviour under pressure. Results are in the system card, including the evaluations where the models did not improve on their predecessors.
| Attribute | Cortex 5.1 | Pulse 5.1 |
|---|---|---|
| Context window | 1M tokens | 1M tokens |
| Intended work | Long-horizon agents, ambiguous briefs, analysis | Production traffic, coding, support, extraction |
| Latency profile | Deliberate | Interactive |
| Relative cost | $$$$ | $$ |
| Availability | Pro, Team, Enterprise, API | Free, Pro, Team, Enterprise, API |
Both models are available today on the API and in the Resonance apps. Existing deployments pinned to the previous generation keep working; the console shows an upgrade estimate before you switch, and spend caps carry over unchanged.
If the model fails your task, that is useful information. We would rather hear it than have you quietly build around us.
Instruction adherence degrades measurably past a horizon our tooling had not previously instrumented.
What happens when a capability threshold is crossed partway through a training run.
How to move a pinned deployment across generations and prove nothing regressed.