
Opera:长程编码智能体的语言批评框架
将纠错作为持续笔记跟踪,直到诊断问题被解决。
为什么重要
为长程代码 Agent 提供可跟踪、可审计的测试时纠错机制。
阅读原文arxiv.org
AI 解读(根据原文生成)
Salesforce AI Research 提出 Opera,一个用于长程编码智能体的 verbal critic 框架。它把每次纠错视为持续存在的笔记,通过周期性和事件驱动触发决定何时复查,用类型化算子诊断问题,在交付前基于可见证据审计反馈,并跟踪智能体后续动作以区分表面遵从与真正解决。作为测试时 critic,Opera 在多个基准和策略模型上提升非 critic 智能体的 resolve rate;其引导的 rollouts 还可用于微调 Qwen3.5-9B。代码已在 GitHub 提供。
要点(AI 据原文整理,数字均已与原文核对)
- Opera improves the resolve rate of non-critic agents by up to 12.4, 15.0, and 8.9 percentage points on Terminal-Bench 2.1, a SWE-Bench Pro subset, and DeepSWE v1.1, respectively.
- Opera achieves the highest mean resolve rate among competitive critic baselines on all three benchmarks.
- Fine-tuning Qwen3.5-9B on Opera-guided rollouts improves its resolve rate on held-out SWE-Bench Pro repositories by 10.2 percentage points without a critic at inference time.