← 所有日期 · 2026-10-10
① 工具精度focus 工具与夹爪 mesh 准不准② 正式实验抓贝果加 / 不加 focus 各 20 次:结果与每次回放③ 具体分析每次合爪失败在哪一步、为什么

② 正式实验:抓贝果,加 / 不加 focus(每组 20 次)

同一个起点反复跑,只比抓取这一步:夹爪张开、停在原味贝果正上方 12 cm,抓起这只贝果,离起始高度 3 cm 以上并保持 1 秒算成功。每组 20 次,gpt-6-sol(推理强度 max,Codex),服务就绪后 20 分钟。失败原因的逐次分析在 ③ 具体分析。

结果

组运行次数贝果抬起过 3 cm 以上其中保持住 1 秒(成功)其中不到 1 秒又滑掉合爪次数第一次下发动作(中位 s)输入 token(中位)
加 focus20633492055.8M
不加 focus20945601365.6M

成功数两组差别不显著(双侧 Fisher 精确检验 p = 1.0);抬起过 3 cm 以上的运行数,两组差别也不显著(p = 0.51)。有的运行不是靠合爪抬起来的(例如加 focus 的 main_g2e_02:把合着的手指伸进孔里再张开,从里面撑住孔壁抬起)。另有 3 次 agent 没能启动(安装 Codex 超时),不计入,已补跑。

设定(展开) 起始状态三路相机画面

起始状态(腕部相机 / 肩上相机 / 对面相机)。成功在线判定,并要求两次独立重放复现。两组任务说明相同,都要求每次下发动作带一段说明(只为诊断):

**Every `r.submit(...)` must carry a `note`** (the call is refused without one): one short paragraph on what this motion is for, the numbers it is based on, what you expect to happen, and how you will check it afterwards.

加 focus 组多出的一段(原文):

## Focus tool (required)
`r.focus(center, radius, note)` returns the triangle mesh of the surfaces your cameras see in the **current** frame within `radius` m (at most 0.15) of `center` ([x, y, z] m, env-local world frame), with the robot's own body removed: `{"vertices": (N,3) m, "faces": (M,3), "path": PLY file, "meta": per-camera counts}`. It is built only from the current depth and camera calibration (the same data as `r.get_obs(depth=True)`); surfaces no camera sees are absent. `note` is required: what this focus is on and what you want to learn from it.
**Before every gripper close you must call `r.focus(...)` on the region the fingers will touch**, and base the approach and the close on that mesh.

focus 工具的精度见 ① 工具精度。

每次运行(点名字进回放:左录像 · 中 agent 每轮的推理和动作 · 右 focus 与合爪真值)

组运行结果用时 (s)合爪次数focus 调用首次合爪:离轴 (cm)高度 (cm)与径向夹角 (°)指垫在孔内贝果最大抬升 (cm)
加 focusmain_g0a_01_focus未成功1299230.22.9753否0.1
加 focusmain_g0a_03_focus未成功1280234.31.943否3.3
加 focusmain_g0b_04_focus未成功1231254.52.181否5.9
加 focusmain_g0c_01_focus未成功1290261.91.772否0.4
加 focusmain_g0c_02_focus未成功1295284.31.672是2.0
加 focusmain_g0d_01_focus成功867254.62.251否5.8
加 focusmain_g0d_02_focus未成功1354234.22.271否2.6
加 focusmain_g1a_01_focus未成功1272374.01.098是2.4
加 focusmain_g1a_03_focus未成功1376344.61.710是2.1
加 focusmain_g1b_02_focus未成功1249343.81.992否1.0
加 focusmain_g1e_02_focus未成功1230154.71.020是2.5
加 focusmain_g2a_01_focus未成功1277373.91.352是2.9
加 focusmain_g2a_03_focus未成功1204384.21.662是1.6
加 focusmain_g2b_02_focus未成功1205264.21.891否1.8
加 focusmain_g2c_01_focus未成功1886263.31.7389否0.3
加 focusmain_g2e_01_focus未成功1305275.71.672是0.2
加 focusmain_g2e_02_focus成功1239244.41.694是1.9
加 focusmain_v1g0_01_focus未成功1411483.91.8690否1.0
加 focusmain_v1g0_03_focus成功11945133.21.8590否3.8
加 focusmain_v1g0b_01_focus未成功1213264.61.183是0.2
不加 focusmain_g0a_04_nofocus未成功1297304.11.6214是5.0
不加 focusmain_g0b_01_nofocus成功675203.62.261否6.0
不加 focusmain_g0b_05_nofocus未成功1289303.51.2890否3.4
不加 focusmain_g0e_01_nofocus未成功1324300.41.4774否3.6
不加 focusmain_g0e_02_nofocus未成功1284504.42.1320否2.1
不加 focusmain_g1a_02_nofocus成功1515404.42.210否7.4
不加 focusmain_g1b_01_nofocus未成功1236203.81.533是5.5
不加 focusmain_g1b_03_nofocus成功948103.30.2480否8.5
不加 focusmain_g1c_01_nofocus未成功1554404.01.621是1.7
不加 focusmain_g1c_02_nofocus未成功1342303.13.002否2.3
不加 focusmain_g1d_01_nofocus未成功1361200.31.5329否2.1
不加 focusmain_g1e_01_nofocus未成功1608203.91.660是2.2
不加 focusmain_g2a_02_nofocus成功619104.71.444是7.3
不加 focusmain_g2a_04_nofocus未成功1259200.91.4389否1.6
不加 focusmain_g2b_01_nofocus未成功1212300.72.0671否1.4
不加 focusmain_g2b_03_nofocus未成功1404603.92.249否2.9
不加 focusmain_g2d_01_nofocus未成功1310205.51.294是2.4
不加 focusmain_v1g0_02_nofocus未成功1239304.61.572是1.0
不加 focusmain_v1g0_04_nofocus未成功1233304.31.673是0.9
不加 focusmain_v1g0c_01_nofocus未成功1202600.32.5789否2.7