- 領域
- 機械零件
- 任務類別
- 由圖面建立實體模型
- 存取模式
- 檔案,無圖形介面的 CAD 核心
- 交付項目
- 一個 STEP 實體
- 驗證器
- 確定性幾何驗證:3 項門檻檢查、10 個檢查項目
- 時間限制
- 45 分鐘
- 資料切分
- 公開樣本,絕不納入任何訓練集或評測集
參考圖面
DUF-S-001, rev A.
以第三角投影法繪製的三視圖,與標準模型由同一組參數生成,因此圖面與答案不會產生出入。琥珀色標示的是驗證器所量測的帶公差的孔。
實際執行
比較各個提交。
記錄的驗證器結果。黃色標示未通過的檢查項目;展開報告即可查看每一項量測。
已提交
output/bracket.step ← tests/gold/bracket.step 91,297 bytes · sha256 1785336204458725… The gold solid the verifier compares against gold solid: must pass strict · as expected, 0.87 s
output/bracket.step ← written by solution/solve.py (85,015 bytes, built in 0.61 s) solution/solve.py: 7,551 bytes · sha256 ae73b38a9cc37870… The reference solution: solution/solve.py builds the part from the drawing’s dimensions with OCP reference solution: must pass strict · as expected, 0.91 s
output/bracket.step ← tests/probes/alt_rebuilt.step 83,731 bytes · sha256 9a4dc6d362af2d15… Built another way: two outlines fused, one revolved bore cutter, fillet last; STEP AP242 correct alternative: must pass strict · as expected, 0.88 s
output/bracket.step ← tests/probes/alt_bore_18009.step 91,386 bytes · sha256 00e293e59fc76bb1… The bore at Ø18.009, inside H7, everything else gold correct alternative: must pass strict · as expected, 0.82 s
output/bracket.step ← tests/probes/alt_split_faces.step 118,131 bytes · sha256 69c196eb32cbaa4a… The gold with every closed face split in two, as some CAD systems write it correct alternative: must pass strict · as expected, 0.87 s
output/bracket.step ← tests/probes/empty.step 0 bytes · sha256 e3b0c44298fc1c14… An empty bracket.step reward hack: must score exactly 0 · as expected, 0.68 s
output/bracket.step ← a note, and no output/bracket.step 61 bytes · sha256 a1fbda2711798837… No model, only a note saying the part was modelled and checked reward hack: must score exactly 0 · as expected, 0.68 s
output/bracket.step ← tests/probes/scaled_copy.step 96,498 bytes · sha256 7a19df708266b18d… The gold solid scaled by 1.02 plausible mistake: must fail strict, caught by C1 to C8 · as expected, 0.91 s
output/bracket.step ← tests/probes/bore_oversize.step 91,317 bytes · sha256 201c90aa78c85c88… The bore 0.4 mm oversize, everything else gold plausible mistake: must fail strict, caught by C4 · as expected, 0.82 s
output/bracket.step ← tests/probes/three_holes.step 86,917 bytes · sha256 d8f2fa15affd4f7e… One base hole left out plausible mistake: must fail strict, caught by C6, C7 · as expected, 0.88 s
output/bracket.step ← tests/probes/mirrored.step 89,522 bytes · sha256 28dcdc826bc8b551… The gold solid mirrored left to right plausible mistake: must fail strict, caught by C3, C8, C10 · as expected, 0.91 s
output/bracket.step ← tests/probes/spline_faces.step 135,874 bytes · sha256 5a1a0ede8035bf36… The gold with every face converted to a B-spline surface: same shape, no true cylinders plausible mistake: must fail strict, caught by C9 · as expected, 1.87 s
驗證器輸出・gold 嚴格通過・獎勵 1・分數 1.00
所有門檻檢查與檢查項目皆通過。
完整驗證器輸出
$ bash tests/test.sh output/bracket.step G1 ok output/bracket.step exists, is not empty and reads as STEP: 91297 bytes, read as STEP G2 ok exactly one closed, valid solid with positive volume: 1 closed valid solid, 25 faces, volume 209268.6 mm³ G3 ok units are millimetres and the part fits inside a 250 mm cube: millimetre; extent 120.00 × 80.00 × 84.00 mm C1 ok Envelope: 120.000 × 80.000 × 84.000 expected 120.0 × 80.0 × 84.0 ±0.10 · w10 C2 ok Volume: 209.27 cm³ (+0.00%) expected 209.27 cm³ ±0.5% · w10 C3 ok Overlap with the gold (IoU): 1.0000 expected ≥ 0.995 · w10 C4 ok Bore diameter: Ø18.0000, 3 sections within 0.0000 expected Ø18 H7: 18.000 to 18.018 · w20 C5 ok Bore axis: position, square to B: X 60.000, Z 52.000; square 0.0000 expected X 60.00, Z 52.00 ±0.05; square ≤ 0.02 · w10 C6 ok Through holes: count and diameter: 4 through, all Ø9.000 expected 4 × Ø9.0 ±0.10, through · w10 C7 ok Hole pattern: centre positions: 4 of 4 within 0.10, worst 0.000 expected 90.0 × 36.0 from (15, 14), ±0.10 · w10 C8 ok Slot: width, length, centre: 10.000 × 30.000 at (42.000, 30.000) expected 10.0 × 30.0 at (42, 30) ±0.10 · w10 C9 ok Feature types: all present · faces: 2 cone, 13 cylinder, 10 plane expected bore and holes true cylinders; R6 fillet, 4 × R10, 2 × 1×45° chamfers · w5 C10 ok Handedness: slot X 42.00 < bore X 60.00: left expected slot left of the bore, seen from the front · w5 strict_pass true reward 1 score 1.00
驗證器輸出・solve_py 嚴格通過・獎勵 1・分數 1.00
所有門檻檢查與檢查項目皆通過。
完整驗證器輸出
$ bash tests/test.sh output/bracket.step G1 ok output/bracket.step exists, is not empty and reads as STEP: 85015 bytes, read as STEP G2 ok exactly one closed, valid solid with positive volume: 1 closed valid solid, 24 faces, volume 209265.5 mm³ G3 ok units are millimetres and the part fits inside a 250 mm cube: millimetre; extent 120.00 × 80.00 × 84.00 mm C1 ok Envelope: 120.000 × 80.000 × 84.000 expected 120.0 × 80.0 × 84.0 ±0.10 · w10 C2 ok Volume: 209.27 cm³ (+0.00%) expected 209.27 cm³ ±0.5% · w10 C3 ok Overlap with the gold (IoU): 1.0000 expected ≥ 0.995 · w10 C4 ok Bore diameter: Ø18.0090, 3 sections within 0.0000 expected Ø18 H7: 18.000 to 18.018 · w20 C5 ok Bore axis: position, square to B: X 60.000, Z 52.000; square 0.0000 expected X 60.00, Z 52.00 ±0.05; square ≤ 0.02 · w10 C6 ok Through holes: count and diameter: 4 through, all Ø9.000 expected 4 × Ø9.0 ±0.10, through · w10 C7 ok Hole pattern: centre positions: 4 of 4 within 0.10, worst 0.000 expected 90.0 × 36.0 from (15, 14), ±0.10 · w10 C8 ok Slot: width, length, centre: 10.000 × 30.000 at (42.000, 30.000) expected 10.0 × 30.0 at (42, 30) ±0.10 · w10 C9 ok Feature types: all present · faces: 2 cone, 12 cylinder, 10 plane expected bore and holes true cylinders; R6 fillet, 4 × R10, 2 × 1×45° chamfers · w5 C10 ok Handedness: slot X 42.00 < bore X 60.00: left expected slot left of the bore, seen from the front · w5 strict_pass true reward 1 score 1.00
驗證器輸出・alt_rebuilt 嚴格通過・獎勵 1・分數 1.00
所有門檻檢查與檢查項目皆通過。
完整驗證器輸出
$ bash tests/test.sh output/bracket.step G1 ok output/bracket.step exists, is not empty and reads as STEP: 83731 bytes, read as STEP G2 ok exactly one closed, valid solid with positive volume: 1 closed valid solid, 24 faces, volume 209268.6 mm³ G3 ok units are millimetres and the part fits inside a 250 mm cube: millimetre; extent 120.00 × 80.00 × 84.00 mm C1 ok Envelope: 120.000 × 80.000 × 84.000 expected 120.0 × 80.0 × 84.0 ±0.10 · w10 C2 ok Volume: 209.27 cm³ (+0.00%) expected 209.27 cm³ ±0.5% · w10 C3 ok Overlap with the gold (IoU): 1.0000 expected ≥ 0.995 · w10 C4 ok Bore diameter: Ø18.0000, 3 sections within 0.0000 expected Ø18 H7: 18.000 to 18.018 · w20 C5 ok Bore axis: position, square to B: X 60.000, Z 52.000; square 0.0000 expected X 60.00, Z 52.00 ±0.05; square ≤ 0.02 · w10 C6 ok Through holes: count and diameter: 4 through, all Ø9.000 expected 4 × Ø9.0 ±0.10, through · w10 C7 ok Hole pattern: centre positions: 4 of 4 within 0.10, worst 0.000 expected 90.0 × 36.0 from (15, 14), ±0.10 · w10 C8 ok Slot: width, length, centre: 10.000 × 30.000 at (42.000, 30.000) expected 10.0 × 30.0 at (42, 30) ±0.10 · w10 C9 ok Feature types: all present · faces: 2 cone, 12 cylinder, 10 plane expected bore and holes true cylinders; R6 fillet, 4 × R10, 2 × 1×45° chamfers · w5 C10 ok Handedness: slot X 42.00 < bore X 60.00: left expected slot left of the bore, seen from the front · w5 strict_pass true reward 1 score 1.00
驗證器輸出・alt_bore_18009 嚴格通過・獎勵 1・分數 1.00
所有門檻檢查與檢查項目皆通過。
完整驗證器輸出
$ bash tests/test.sh output/bracket.step G1 ok output/bracket.step exists, is not empty and reads as STEP: 91386 bytes, read as STEP G2 ok exactly one closed, valid solid with positive volume: 1 closed valid solid, 25 faces, volume 209265.5 mm³ G3 ok units are millimetres and the part fits inside a 250 mm cube: millimetre; extent 120.00 × 80.00 × 84.00 mm C1 ok Envelope: 120.000 × 80.000 × 84.000 expected 120.0 × 80.0 × 84.0 ±0.10 · w10 C2 ok Volume: 209.27 cm³ (+0.00%) expected 209.27 cm³ ±0.5% · w10 C3 ok Overlap with the gold (IoU): 1.0000 expected ≥ 0.995 · w10 C4 ok Bore diameter: Ø18.0090, 3 sections within 0.0000 expected Ø18 H7: 18.000 to 18.018 · w20 C5 ok Bore axis: position, square to B: X 60.000, Z 52.000; square 0.0000 expected X 60.00, Z 52.00 ±0.05; square ≤ 0.02 · w10 C6 ok Through holes: count and diameter: 4 through, all Ø9.000 expected 4 × Ø9.0 ±0.10, through · w10 C7 ok Hole pattern: centre positions: 4 of 4 within 0.10, worst 0.000 expected 90.0 × 36.0 from (15, 14), ±0.10 · w10 C8 ok Slot: width, length, centre: 10.000 × 30.000 at (42.000, 30.000) expected 10.0 × 30.0 at (42, 30) ±0.10 · w10 C9 ok Feature types: all present · faces: 2 cone, 13 cylinder, 10 plane expected bore and holes true cylinders; R6 fillet, 4 × R10, 2 × 1×45° chamfers · w5 C10 ok Handedness: slot X 42.00 < bore X 60.00: left expected slot left of the bore, seen from the front · w5 strict_pass true reward 1 score 1.00
驗證器輸出・alt_split_faces 嚴格通過・獎勵 1・分數 1.00
所有門檻檢查與檢查項目皆通過。
完整驗證器輸出
$ bash tests/test.sh output/bracket.step G1 ok output/bracket.step exists, is not empty and reads as STEP: 118131 bytes, read as STEP G2 ok exactly one closed, valid solid with positive volume: 1 closed valid solid, 32 faces, volume 209268.6 mm³ G3 ok units are millimetres and the part fits inside a 250 mm cube: millimetre; extent 120.00 × 80.00 × 84.00 mm C1 ok Envelope: 120.000 × 80.000 × 84.000 expected 120.0 × 80.0 × 84.0 ±0.10 · w10 C2 ok Volume: 209.27 cm³ (+0.00%) expected 209.27 cm³ ±0.5% · w10 C3 ok Overlap with the gold (IoU): 1.0000 expected ≥ 0.995 · w10 C4 ok Bore diameter: Ø18.0000, 3 sections within 0.0000 expected Ø18 H7: 18.000 to 18.018 · w20 C5 ok Bore axis: position, square to B: X 60.000, Z 52.000; square 0.0000 expected X 60.00, Z 52.00 ±0.05; square ≤ 0.02 · w10 C6 ok Through holes: count and diameter: 4 through, all Ø9.000 expected 4 × Ø9.0 ±0.10, through · w10 C7 ok Hole pattern: centre positions: 4 of 4 within 0.10, worst 0.000 expected 90.0 × 36.0 from (15, 14), ±0.10 · w10 C8 ok Slot: width, length, centre: 10.000 × 30.000 at (42.000, 30.000) expected 10.0 × 30.0 at (42, 30) ±0.10 · w10 C9 ok Feature types: all present · faces: 4 cone, 18 cylinder, 10 plane expected bore and holes true cylinders; R6 fillet, 4 × R10, 2 × 1×45° chamfers · w5 C10 ok Handedness: slot X 42.00 < bore X 60.00: left expected slot left of the bore, seen from the front · w5 strict_pass true reward 1 score 1.00
驗證器輸出・empty 嚴格未通過・獎勵 0・分數 0.00
G1 FAIL output/bracket.step exists, is not empty and reads as STEP: the file is empty (0 bytes)
完整驗證器輸出
$ bash tests/test.sh output/bracket.step G1 FAIL output/bracket.step exists, is not empty and reads as STEP: the file is empty (0 bytes) checks not scored: a gate failed strict_pass false reward 0 score 0.00
驗證器輸出・claim_only 嚴格未通過・獎勵 0・分數 0.00
G1 FAIL output/bracket.step exists, is not empty and reads as STEP: no file at output/bracket.step
完整驗證器輸出
$ bash tests/test.sh output/bracket.step G1 FAIL output/bracket.step exists, is not empty and reads as STEP: no file at output/bracket.step checks not scored: a gate failed strict_pass false reward 0 score 0.00
驗證器輸出・scaled_copy 嚴格未通過・獎勵 0・分數 0.10
C1 FAIL Envelope: 122.400 × 81.600 × 85.680 expected 120.0 × 80.0 × 84.0 ±0.10 · w10 C2 FAIL Volume: 222.08 cm³ (+6.12%) expected 209.27 cm³ ±0.5% · w10 C3 FAIL Overlap with the gold (IoU): 0.8386 expected ≥ 0.995 · w10 C4 FAIL Bore diameter: Ø18.3600, 3 sections within 0.0000 expected Ø18 H7: 18.000 to 18.018 · w20 C5 FAIL Bore axis: position, square to B: X 61.200, Z 53.040; square 0.0000 expected X 60.00, Z 52.00 ±0.05; square ≤ 0.02 · w10 C6 FAIL Through holes: count and diameter: 4 through, all Ø9.180 expected 4 × Ø9.0 ±0.10, through · w10 C7 FAIL Hole pattern: centre positions: 0 of 4 within 0.10, worst 2.100 expected 90.0 × 36.0 from (15, 14), ±0.10 · w10 C8 FAIL Slot: width, length, centre: 10.200 × 30.600 at (42.840, 30.600) expected 10.0 × 30.0 at (42, 30) ±0.10 · w10
完整驗證器輸出
$ bash tests/test.sh output/bracket.step G1 ok output/bracket.step exists, is not empty and reads as STEP: 96498 bytes, read as STEP G2 ok exactly one closed, valid solid with positive volume: 1 closed valid solid, 25 faces, volume 222077.5 mm³ G3 ok units are millimetres and the part fits inside a 250 mm cube: millimetre; extent 122.40 × 81.60 × 85.68 mm C1 FAIL Envelope: 122.400 × 81.600 × 85.680 expected 120.0 × 80.0 × 84.0 ±0.10 · w10 C2 FAIL Volume: 222.08 cm³ (+6.12%) expected 209.27 cm³ ±0.5% · w10 C3 FAIL Overlap with the gold (IoU): 0.8386 expected ≥ 0.995 · w10 C4 FAIL Bore diameter: Ø18.3600, 3 sections within 0.0000 expected Ø18 H7: 18.000 to 18.018 · w20 C5 FAIL Bore axis: position, square to B: X 61.200, Z 53.040; square 0.0000 expected X 60.00, Z 52.00 ±0.05; square ≤ 0.02 · w10 C6 FAIL Through holes: count and diameter: 4 through, all Ø9.180 expected 4 × Ø9.0 ±0.10, through · w10 C7 FAIL Hole pattern: centre positions: 0 of 4 within 0.10, worst 2.100 expected 90.0 × 36.0 from (15, 14), ±0.10 · w10 C8 FAIL Slot: width, length, centre: 10.200 × 30.600 at (42.840, 30.600) expected 10.0 × 30.0 at (42, 30) ±0.10 · w10 C9 ok Feature types: all present · faces: 2 cone, 13 cylinder, 10 plane expected bore and holes true cylinders; R6 fillet, 4 × R10, 2 × 1×45° chamfers · w5 C10 ok Handedness: slot X 42.84 < bore X 61.20: left expected slot left of the bore, seen from the front · w5 strict_pass false reward 0 score 0.10
驗證器輸出・bore_oversize 嚴格未通過・獎勵 0・分數 0.80
C4 FAIL Bore diameter: Ø18.4000, 3 sections within 0.0000 expected Ø18 H7: 18.000 to 18.018 · w20
完整驗證器輸出
$ bash tests/test.sh output/bracket.step G1 ok output/bracket.step exists, is not empty and reads as STEP: 91317 bytes, read as STEP G2 ok exactly one closed, valid solid with positive volume: 1 closed valid solid, 25 faces, volume 209130.1 mm³ G3 ok units are millimetres and the part fits inside a 250 mm cube: millimetre; extent 120.00 × 80.00 × 84.00 mm C1 ok Envelope: 120.000 × 80.000 × 84.000 expected 120.0 × 80.0 × 84.0 ±0.10 · w10 C2 ok Volume: 209.13 cm³ (-0.07%) expected 209.27 cm³ ±0.5% · w10 C3 ok Overlap with the gold (IoU): 0.9993 expected ≥ 0.995 · w10 C4 FAIL Bore diameter: Ø18.4000, 3 sections within 0.0000 expected Ø18 H7: 18.000 to 18.018 · w20 C5 ok Bore axis: position, square to B: X 60.000, Z 52.000; square 0.0000 expected X 60.00, Z 52.00 ±0.05; square ≤ 0.02 · w10 C6 ok Through holes: count and diameter: 4 through, all Ø9.000 expected 4 × Ø9.0 ±0.10, through · w10 C7 ok Hole pattern: centre positions: 4 of 4 within 0.10, worst 0.000 expected 90.0 × 36.0 from (15, 14), ±0.10 · w10 C8 ok Slot: width, length, centre: 10.000 × 30.000 at (42.000, 30.000) expected 10.0 × 30.0 at (42, 30) ±0.10 · w10 C9 ok Feature types: all present · faces: 2 cone, 13 cylinder, 10 plane expected bore and holes true cylinders; R6 fillet, 4 × R10, 2 × 1×45° chamfers · w5 C10 ok Handedness: slot X 42.00 < bore X 60.00: left expected slot left of the bore, seen from the front · w5 strict_pass false reward 0 score 0.80
驗證器輸出・three_holes 嚴格未通過・獎勵 0・分數 0.80
C6 FAIL Through holes: count and diameter: 3 through, all Ø9.000 expected 4 × Ø9.0 ±0.10, through · w10 C7 FAIL Hole pattern: centre positions: 3 of 4 within 0.10, worst 0.000, 1 missing expected 90.0 × 36.0 from (15, 14), ±0.10 · w10
完整驗證器輸出
$ bash tests/test.sh output/bracket.step G1 ok output/bracket.step exists, is not empty and reads as STEP: 86917 bytes, read as STEP G2 ok exactly one closed, valid solid with positive volume: 1 closed valid solid, 24 faces, volume 210032.0 mm³ G3 ok units are millimetres and the part fits inside a 250 mm cube: millimetre; extent 120.00 × 80.00 × 84.00 mm C1 ok Envelope: 120.000 × 80.000 × 84.000 expected 120.0 × 80.0 × 84.0 ±0.10 · w10 C2 ok Volume: 210.03 cm³ (+0.36%) expected 209.27 cm³ ±0.5% · w10 C3 ok Overlap with the gold (IoU): 0.9964 expected ≥ 0.995 · w10 C4 ok Bore diameter: Ø18.0000, 3 sections within 0.0000 expected Ø18 H7: 18.000 to 18.018 · w20 C5 ok Bore axis: position, square to B: X 60.000, Z 52.000; square 0.0000 expected X 60.00, Z 52.00 ±0.05; square ≤ 0.02 · w10 C6 FAIL Through holes: count and diameter: 3 through, all Ø9.000 expected 4 × Ø9.0 ±0.10, through · w10 C7 FAIL Hole pattern: centre positions: 3 of 4 within 0.10, worst 0.000, 1 missing expected 90.0 × 36.0 from (15, 14), ±0.10 · w10 C8 ok Slot: width, length, centre: 10.000 × 30.000 at (42.000, 30.000) expected 10.0 × 30.0 at (42, 30) ±0.10 · w10 C9 ok Feature types: all present · faces: 2 cone, 12 cylinder, 10 plane expected bore and holes true cylinders; R6 fillet, 4 × R10, 2 × 1×45° chamfers · w5 C10 ok Handedness: slot X 42.00 < bore X 60.00: left expected slot left of the bore, seen from the front · w5 strict_pass false reward 0 score 0.80
驗證器輸出・mirrored 嚴格未通過・獎勵 0・分數 0.75
C3 FAIL Overlap with the gold (IoU): 0.9686 expected ≥ 0.995 · w10 C8 FAIL Slot: width, length, centre: 10.000 × 30.000 at (78.000, 30.000) expected 10.0 × 30.0 at (42, 30) ±0.10 · w10 C10 FAIL Handedness: slot X 78.00 > bore X 60.00: right expected slot left of the bore, seen from the front · w5
完整驗證器輸出
$ bash tests/test.sh output/bracket.step G1 ok output/bracket.step exists, is not empty and reads as STEP: 89522 bytes, read as STEP G2 ok exactly one closed, valid solid with positive volume: 1 closed valid solid, 25 faces, volume 209268.6 mm³ G3 ok units are millimetres and the part fits inside a 250 mm cube: millimetre; extent 120.00 × 80.00 × 84.00 mm C1 ok Envelope: 120.000 × 80.000 × 84.000 expected 120.0 × 80.0 × 84.0 ±0.10 · w10 C2 ok Volume: 209.27 cm³ (+0.00%) expected 209.27 cm³ ±0.5% · w10 C3 FAIL Overlap with the gold (IoU): 0.9686 expected ≥ 0.995 · w10 C4 ok Bore diameter: Ø18.0000, 3 sections within 0.0000 expected Ø18 H7: 18.000 to 18.018 · w20 C5 ok Bore axis: position, square to B: X 60.000, Z 52.000; square 0.0000 expected X 60.00, Z 52.00 ±0.05; square ≤ 0.02 · w10 C6 ok Through holes: count and diameter: 4 through, all Ø9.000 expected 4 × Ø9.0 ±0.10, through · w10 C7 ok Hole pattern: centre positions: 4 of 4 within 0.10, worst 0.000 expected 90.0 × 36.0 from (15, 14), ±0.10 · w10 C8 FAIL Slot: width, length, centre: 10.000 × 30.000 at (78.000, 30.000) expected 10.0 × 30.0 at (42, 30) ±0.10 · w10 C9 ok Feature types: all present · faces: 2 cone, 13 cylinder, 10 plane expected bore and holes true cylinders; R6 fillet, 4 × R10, 2 × 1×45° chamfers · w5 C10 FAIL Handedness: slot X 78.00 > bore X 60.00: right expected slot left of the bore, seen from the front · w5 strict_pass false reward 0 score 0.75
驗證器輸出・spline_faces 嚴格未通過・獎勵 0・分數 0.95
C9 FAIL Feature types: missing: bore cylinder; 0/4 hole cylinders; R6 fillet ×0; R10 rounds ×0; 1×45° chamfers ×0 · faces: 25 B-spline expected bore and holes true cylinders; R6 fillet, 4 × R10, 2 × 1×45° chamfers · w5
完整驗證器輸出
$ bash tests/test.sh output/bracket.step G1 ok output/bracket.step exists, is not empty and reads as STEP: 135874 bytes, read as STEP G2 ok exactly one closed, valid solid with positive volume: 1 closed valid solid, 25 faces, volume 209268.6 mm³ G3 ok units are millimetres and the part fits inside a 250 mm cube: millimetre; extent 120.00 × 80.00 × 84.00 mm C1 ok Envelope: 120.000 × 80.000 × 84.000 expected 120.0 × 80.0 × 84.0 ±0.10 · w10 C2 ok Volume: 209.27 cm³ (+0.00%) expected 209.27 cm³ ±0.5% · w10 C3 ok Overlap with the gold (IoU): 1.0000 expected ≥ 0.995 · w10 C4 ok Bore diameter: Ø18.0000, 3 sections within 0.0000 expected Ø18 H7: 18.000 to 18.018 · w20 C5 ok Bore axis: position, square to B: X 60.000, Z 52.000; square 0.0000 expected X 60.00, Z 52.00 ±0.05; square ≤ 0.02 · w10 C6 ok Through holes: count and diameter: 4 through, all Ø9.000 expected 4 × Ø9.0 ±0.10, through · w10 C7 ok Hole pattern: centre positions: 4 of 4 within 0.10, worst 0.000 expected 90.0 × 36.0 from (15, 14), ±0.10 · w10 C8 ok Slot: width, length, centre: 10.000 × 30.000 at (42.000, 30.000) expected 10.0 × 30.0 at (42, 30) ±0.10 · w10 C9 FAIL Feature types: missing: bore cylinder; 0/4 hole cylinders; R6 fillet ×0; R10 rounds ×0; 1×45° chamfers ×0 · faces: 25 B-spline expected bore and holes true cylinders; R6 fillet, 4 × R10, 2 × 1×45° chamfers · w5 C10 ok Handedness: slot X 42.00 < bore X 60.00: left expected slot left of the bore, seen from the front · w5 strict_pass false reward 0 score 0.95
任務說明
AI 代理收到的指示。
提供給 AI 代理的指示,以及它可以存取的檔案與工具。
instruction.md818 位元組
# Model the bracket on drawing DUF-S-001 `project/drawing.svg` is a released drawing (rev A) of a mounting bracket. Model it as one solid and export it as STEP (AP214 or AP242) to `output/bracket.step`. - Work in millimetres. Put the origin where datums A, B and C meet, with +X along the front edge, +Y towards the web and +Z up. - Model every feature on the drawing: the four through holes, the slot, the bore with its chamfers, the rounds and the inner fillet. - Model the Ø18 H7 bore at a diameter inside its tolerance (18.000 to 18.018). - The drawing governs. Where it is silent, ISO 2768-m applies. - Python 3.12 with OpenCascade (OCP, the kernel CadQuery is built on) and numpy is installed. You have no network access. When the file is written, say so in one line. Do not describe checks you did not run.
- AI 代理可看到
project/drawing.svg與一個空的output/資料夾,位於/workspace- 工具
- 一個 shell、附 OpenCascade(OCP)與 numpy 的 Python 3.12(依 Dockerfile 安裝);無網路
- 對其隱藏
tests/中的標準實體、探針與檢查項目(只在執行結束後才複製進來),以及solution/中的參考解法- 變體
- 生成器將每個尺寸、孔位排列與配合都作為參數,因此一個類別可產生許多不同的任務
交付項目與驗證器
依幾何評分,逐一特徵檢查。
先進行門檻檢查:缺少、損壞或單位錯誤的答案得 0 分。接著是十個加權檢查項目,每一個都是附有明訂公差的量測。先進行整體形狀比較,再對每個帶公差的特徵分別量測,方法是在提交的實體上切出剖面,並檢查其各面的類型。
- 檔案
output/bracket.step,STEP AP214 或 AP242,恰好一個實體- 座標系
- 公釐,原點位於基準 A、B 與 C,Z 軸朝上;驗證器在比較前也會依基準面進行對齊
- 不評分
- 特徵樹、本體名稱、顏色、圖層、模型的建立方式
- 獎勵
- 只有在每項門檻檢查與十個檢查項目全部通過時(嚴格通過)為 1,否則為 0。這是訓練獎勵
- 分數
- 通過的檢查項目權重總和除以 100;任何門檻檢查未通過即為 0。它顯示答案錯在哪裡
門檻檢查
| 門檻檢查 | 必須成立 |
|---|---|
| G1 | output/bracket.step 存在、非空白,且可作為 STEP 讀取 |
| G2 | 恰好包含一個封閉、有效且體積為正的實體 |
| G3 | 單位為公釐,且零件可放入 250 mm 的立方體內 |
檢查項目
| 檢查項目 | 量測內容 | 目標值 | 公差 | 權重 |
|---|---|---|---|---|
| C1 | 外包絡 | 120.0 × 80.0 × 84.0 mm | ±0.10 mm | 10 |
| C2 | 體積 | 209.27 cm³(標準實體) | ±0.5% | 10 |
| C3 | 與標準實體的重疊程度,依 A、B、C 對齊 | 交集比聯集(IoU) | 至少 0.995 | 10 |
| C4 | 孔徑,以三個剖面中的孔壁擬合圓 | Ø18 H7 | 18.000 至 18.018 mm | 20 |
| C5 | 孔軸:位置,以及與 B 的垂直度 | X 60.00, Z 52.00 | ±0.05 mm;0.02 mm | 10 |
| C6 | 底座的貫穿孔:數量與直徑 | 4 × Ø9.0,貫穿 | ±0.10 mm | 10 |
| C7 | 孔位排列:中心位置 | 90.0 × 36.0,第一個孔位於 (15, 14) | ±0.10 mm | 10 |
| C8 | 槽:寬度、長度、中心 | 10.0 × 30.0,中心 (42, 30) | ±0.10 mm | 10 |
| C9 | 存在的特徵類型 | 孔與各貫穿孔皆為真圓柱面;R6 內圓角、四個 R10 外圓角、兩個 1 × 45° 孔倒角 | 依面類型;半徑依 ISO 2768-m | 5 |
| C10 | 左右方向 | 從正面看,槽位於孔的左側 | 完全一致 | 5 |
C4 在圖面與模型上以琥珀色標示,是整體形狀比較無法取代的檢查項目。
探針
必須拒絕的錯誤答案,必須通過的正確答案。
在任務出貨前,其驗證器會針對參考解法的輸出、刻意錯誤的答案,以及以另一種方式建立的正確替代解法執行。獎勵作弊必須恰好得到 0 分,每個看似合理的錯誤都必須在其設計要觸發的檢查項目上嚴格未通過,而參考解法與每個正確的替代解法都必須通過。下方每一列都來自記錄的執行。
所有探針提交與量測結果
| 提交 | 內容說明 | 類型 | 驗證器的量測結果 | 由誰抓出 | 分數 | 嚴格 |
|---|---|---|---|---|---|---|
gold | 驗證器用來比對的標準實體 | 標準實體 | 外包絡誤差 0.10 以內;體積 +0.00%;重疊 1.0000;孔徑 Ø18.0000 | 無 | 1.00 | 通過 |
solve_py | 參考解法:solution/solve.py 依圖面尺寸,以 OCP 建立零件 | 參考解法 | 外包絡誤差 0.10 以內;體積 +0.00%;重疊 1.0000;孔徑 Ø18.0090 | 無 | 1.00 | 通過 |
alt_rebuilt | 以另一種方式建立:兩個輪廓融合、一個旋轉成形的孔切削體、最後再加圓角;STEP AP242 | 正確的替代解法 | 外包絡誤差 0.10 以內;體積 +0.00%;重疊 1.0000;孔徑 Ø18.0000 | 無 | 1.00 | 通過 |
alt_bore_18009 | 孔徑為 Ø18.009,在 H7 範圍內,其餘皆與標準實體相同 | 正確的替代解法 | 外包絡誤差 0.10 以內;體積 +0.00%;重疊 1.0000;孔徑 Ø18.0090 | 無 | 1.00 | 通過 |
alt_split_faces | 將標準實體的每個封閉面一分為二,如同某些 CAD 系統的寫出方式 | 正確的替代解法 | 外包絡誤差 0.10 以內;體積 +0.00%;重疊 1.0000;孔徑 Ø18.0000 | 無 | 1.00 | 通過 |
empty | 空白的 bracket.step | 獎勵作弊 | 檔案為空白(0 位元組) | G1 | 0.00 | 未通過 |
claim_only | 沒有模型,只有一則聲稱零件已建模並檢查完畢的備註 | 獎勵作弊 | output/bracket.step 沒有檔案 | G1 | 0.00 | 未通過 |
scaled_copy | 將標準實體縮放 1.02 倍 | 看似合理的錯誤 | 外包絡 122.400 × 81.600 × 85.680; 體積 +6.12%; 重疊 0.8386; 孔徑 Ø18.3600 | C1 至 C8 | 0.10 | 未通過 |
bore_oversize | 孔徑過大 0.4 mm,其餘皆與標準實體相同 | 看似合理的錯誤 | 外包絡誤差 0.10 以內;體積 -0.07%;重疊 0.9993;孔徑 Ø18.4000 | C4 | 0.80 | 未通過 |
three_holes | 漏掉一個底座孔 | 看似合理的錯誤 | 外包絡誤差 0.10 以內;體積 +0.36%;重疊 0.9964;孔徑 Ø18.0000;貫穿孔 3 個貫穿,皆為 Ø9.000;孔位排列 4 個中 3 個在 0.10 以內,最大偏差 0.000,缺少 1 個 | C6, C7 | 0.80 | 未通過 |
mirrored | 將標準實體左右鏡像 | 看似合理的錯誤 | 外包絡誤差 0.10 以內;體積 +0.00%;重疊 0.9686;孔徑 Ø18.0000;槽 10.000 × 30.000,位於 (78.000, 30.000);左右方向 槽 X 78.00 > 孔 X 60.00:右 | C3, C8, C10 | 0.75 | 未通過 |
spline_faces | 將標準實體的每個面都轉換為 B-spline 曲面:形狀相同,但沒有真圓柱面 | 看似合理的錯誤 | 外包絡誤差 0.10 以內;體積 +0.00%;重疊 1.0000;孔徑 Ø18.0000;沒有真圓柱面、圓錐面或平面 | C9 | 0.95 | 未通過 |
由 tests/run_results.json 生成,即下一節中的執行。孔徑過大的提交通過了外包絡、體積與重疊檢查,只有在量測孔徑時才被抓出,與我們自己的幾何研究結果相同。B-spline 複本的形狀正確,只在特徵類型上未通過:CAM 系統或檢驗人員在其中找不到可作為孔來選取的真圓柱面。
tests/verify.py・C4 與 C5 如何量測孔def measure_bore(solid):
"""The Ø18 H7 bore. Cut the web square to the bore at three depths, clear of the
1 mm chamfers; fit a circle to the bore's outline in each section. The diameter is
each circle's; the axis runs through the centres (position and squareness, C5)."""
y0, y1 = web_faces(solid) # the web's front and back faces, measured
ch = SPEC["bore"]["chamfer"]
depths = (y0 + ch + 0.5, (y0 + y1) / 2, y1 - ch - 0.5)
nominal = np.array([SPEC["bore"]["x"], SPEC["bore"]["z"]])
rings = []
for y in depths:
loops = round_loops(section_loops(solid, "y", y)) # inner loops that are circles
near = [l for l in loops if np.linalg.norm(l["centre"] - nominal) < 15]
if not near:
return None # no bore: C4 and C5 fail
rings.append(min(near, key=lambda l: np.linalg.norm(l["centre"] - nominal)))
shift = np.linalg.norm(rings[2]["centre"] - rings[0]["centre"])
tilt = shift * (y1 - y0) / (depths[2] - depths[0]) # over the web's thickness
return dict(d=[l["d"] for l in rings], centre=rings[1]["centre"], square=float(tilt),
roundness=max(l["roundness"] for l in rings))
在零件上量測,而非從檔案讀取
驗證器從不相信特徵本身的標籤。它在避開倒角的三個深度上,垂直於孔切開實體,並在每個剖面中對孔的輪廓擬合一個圓。在每個剖面中,直徑都必須落在 18 µm 的 H7 公差帶內;通過各圓心的軸線則決定位置與垂直度。
各孔與槽也以相同方式量測,剖面位於底座靠近兩個面處以及厚度中間,因此只有貫穿的孔才會被計入。特徵類型(C9)是唯一從各面本身定義讀取的檢查項目。
任務資料夾
交付內容,逐一檔案說明。
下載內容包含下列每一個檔案,包括記錄的執行,以及重現該執行所需的腳本。
| 路徑 | 內容說明 | 大小 |
|---|---|---|
task.toml | ID、領域、存取模式、時間限制、資料切分、容器、驗證器指令、獎勵規則、解法指令、權利 | 1.1 KB |
instruction.md | 上方的任務說明 | 818 B |
environment/Dockerfile | AI 代理的容器:Python 3.12、透過 OCP 使用 OpenCascade、numpy、圖面;執行時不會擷取任何內容 | 1.0 KB |
environment/project/drawing.svg | 參考圖面,rev A | 21.6 KB |
tests/test.sh | 執行驗證器;會先寫入獎勵 0,因此即使當機或逾時,仍以 0 分計 | 836 B |
tests/verify.py | 門檻檢查與十個檢查項目 | 27.0 KB |
tests/gold/bracket.step | 標準實體,位於評測方 | 91.3 KB |
tests/probes/ | 探針:8 個 STEP 實體、一個空白檔案、一則僅含聲稱的備註,以及說明每個提交必須得到幾分的 probes.json | 796.1 KB |
tests/run_probes.py | 執行參考解法,接著以驗證器檢查其輸出、標準實體與每個探針,並核對每個結果 | 5.1 KB |
tests/run_results.json | 本頁所呈現的執行 | 36.9 KB |
solution/solve.sh | 執行 solve.py 並寫出 output/bracket.step | 398 B |
solution/solve.py | 參考解法:依圖面尺寸以 OCP 建立支架,不讀取標準實體 | 7.6 KB |
下載任務資料夾 ZIP,177.3 KB・公開的生成樣本,並非評測項目
上述執行是在 Dockerfile 建置的容器中、關閉網路的情況下進行:先在沒有 tests/ 的情況下執行參考解法,之後才加入並執行驗證器。
想要為您的評測框架取得這類任務嗎?
告訴我們您正在訓練的能力,以及您的評測框架所採用的格式。查看我們用來建立任務的工程與 CAD 資料,以及我們如何打造環境。