Hugging Face 團隊公開跨多種程式代理框架的強化式學習作法,透過代理 proxy 擷取 token 與 logprob 來訓練,不用改寫 harness 本身
中文摘要
貼文宣稱 LFM2.5-2.6B 在四種框架下從 42% 提升到 54%,工具呼叫減少 31%,單框架訓練則在該框架進步更大。以上數字僅來自這則貼文的單方面說法,尚未看到完整評測條件與基準定義。
一龍馬判讀
對開源模型團隊來說,這代表可能用更低改造成本適配 Claude Code、Codex 等不同框架,但實際泛化效果仍要看後續可重現的程式碼與模型。
原文節錄
Hugging Face · @huggingface
The same model, with the same weights, scores 62% in one agent harness…
取得全文 · 不代表內容已獨立查證
完整收錄文字與來源
The same model, with the same weights, scores 62% in one agent harness and 33% in another. @adithya_s_k and the @huggingface team just released the ultimate guide to multi-harness RL, and it's one of the most practical RL write-ups this year, and everything open! The trick is simple. Don't touch the harness. Point it at a proxy instead of the model. The proxy speaks all four API formats coding agents use (OpenAI Chat Completions, OpenAI Responses, Anthropic Messages, Gemini). It records the exact token ids and logprobs vLLM sampled, and you train on that. You don't change a single line of Claude Code, Codex or OpenCode. Results: 🔹 Trained across 4 harnesses at once, LFM2.5-2.6B by @liquidai went from 42% to 54% 🔹 31% fewer tool calls, thanks to a small bonus for solving tasks in fewer steps 🔹 Training in OpenCode alone took OpenCode from 34% to 58%, but the multi-harness model improved everywhere They also tried the shortcut everyone reaches for: fine-tune on 3,189 successful rollouts from Qwen3.8-27B. Imitation plateaued at 47.5%, below both RL runs. Copying a bigger model doesn't get you there. Practice does. The best part is that everything is open: the capture proxy in OpenEnv, the trainer in TRL, the tasks, the SFT data, the training code and all seven trained models. Agents will run in dozens of harnesses. Now open models can be trained for each of them, by anyone. Read it here 👇 https://huggingface.co/spaces/FineEnvs/multi-harness-rl
- 收錄日期
- 2026-10-02
- 來源
- Nitter RSS(公開貼文)
- 抓取時間
- 2026/10/02 23:47(台北)