一龍馬/AI 情報站讀懂消息背後的脈絡
星期六
搜尋

他認為,電腦操作代理後來可行的關鍵,是先在大量通用任務上取得能力,再收斂到像素與鍵盤操作,也就是他所稱的「專精型通才」

中文摘要

Jim Fan 回顧 OpenAI 2016 年的 World of Bits:代理從螢幕像素操作滑鼠、嘗試訂聯合航空機票,卻得靠逐項手刻獎勵函數與從零開始的強化學習,重新摸索整套網頁視覺語言。他認為,電腦操作代理後來可行的關鍵,是先在大量通用任務上取得能力,再收斂到像素與鍵盤操作,也就是他所稱的「專精型通才」。貼文宣稱 GPT-6 Astra 如今已能可靠完成當年的訂票目標,但未附測試方法或成功率。

一龍馬判讀

這段第一手回顧點出代理研發路線從單一任務強化學習,轉向通用預訓練後再專精;不過「可靠」仍是作者判斷,不能視為正式評測結論。

原文節錄

Jim Fan · @DrJimFan

Good old days at OpenAI in 2016: an agent stares at screen pixels, moves a mouse, and books a flight on United.…

取得全文 · 不代表內容已獨立查證

查看原文
完整收錄文字與來源

Good old days at OpenAI in 2016: an agent stares at screen pixels, moves a mouse, and books a flight on United. We called it World of Bits, inside OpenAI Universe. 10 yrs later, Astra is reincarnated in the same universe. Even the naming is astronomically correct 😆 Universe was perhaps the most ambitious AI infra project at the time, but we couldn't quite figure out how to solve it. A policy with zero prior knowledge of what a "submit" button does has to rediscover the entire internet visual lingua by trial and error. In retrospect, RL from scratch against hand-drawn, per-task "artisan" reward functions on a bunch of Pascal Titan X GPUs was completely doomed. To solve computer use agent, the right way turns out to be boiling the ocean first (hillclimb on every general task you can find), and then specialize back down to the screen pixels and keystrokes. Or simply, a "Specialized Generalist". Lessons learned: one step ahead of everyone, you're a pioneer. Three steps ahead, you're a prophet. Five steps ahead, you're a martyr. Congrats, GPT-6! That United flight finally gets booked, reliably this time. The 2016 intern in me has a big smile.

收錄日期
2026-09-05
來源
Nitter RSS(公開貼文)
抓取時間
2026/09/05 06:13(台北)