squaredcuber commited on
Commit
b330a5e
·
verified ·
1 Parent(s): da9f38a

Add model card

Browse files
Files changed (1) hide show
  1. README.md +83 -0
README.md ADDED
@@ -0,0 +1,83 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: nvidia-open-model-license
4
+ license_link: https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-open-model-license/
5
+ base_model: nvidia/GR00T-N1.7-3B
6
+ tags:
7
+ - robotics
8
+ - humanoid
9
+ - vla
10
+ - gr00t
11
+ - asimov
12
+ - mujoco
13
+ pipeline_tag: robotics
14
+ ---
15
+
16
+ # GR00T N1.7 for the Asimov 1 humanoid (simulation)
17
+
18
+ A fine-tune of [NVIDIA GR00T N1.7-3B](https://huggingface.co/nvidia/GR00T-N1.7-3B) for
19
+ [Menlo Research's Asimov 1](https://github.com/menloresearch/asimov-1), an open-source humanoid, in the
20
+ configuration that actually ships: 25 DOF, passive printed "dummy hands" (no grippers), one monocular head
21
+ camera. As far as we know this is the first GR00T policy for Asimov.
22
+
23
+ **Simulation only.** It has not been run on a real robot.
24
+
25
+ ## Tasks and results
26
+
27
+ Three language-conditioned tabletop tasks in MuJoCo. Evaluation is closed loop on 50 held-out layouts per
28
+ task, with seeds disjoint from every training seed. The policy runs at 20 Hz, predicts 16-step chunks and
29
+ executes 8 of them per call. Success must hold for 0.5 s.
30
+
31
+ | Task | Instruction example | ckpt 6000 | **ckpt 10000** | 95% CI (10000) |
32
+ |---|---|---|---|---|
33
+ | Push (one fist) | "push the purple block onto the orange pad" | 46% | **84%** | 0.71–0.92 |
34
+ | Button | "press the red button" | 36% | **64%** | 0.50–0.76 |
35
+ | Box (bimanual squeeze, carry, place) | "lift the box and put it on the shelf" | 2% | **56%** | 0.42–0.69 |
36
+
37
+ - **Main failures at step 10000:**
38
+ - push: block short of the pad (5), block never moved (3)
39
+ - button: no press (10), partial press (6), wrong button (2)
40
+ - box: dropped or not placed (16)
41
+ - **Not converged:** success was still rising steeply between steps 6000 and 10000, so longer training should help.
42
+ - **Open-loop** on training episodes: action MAE 0.027 rad.
43
+ - **Inference:** 95 ms per call on an L40 (PyTorch eager).
44
+
45
+ Example rollouts (one success and one failure per task) are in `results/closedloop_checkpoint-10000/videos/`.
46
+
47
+ ## Training
48
+
49
+ - **Data:** 900 scripted-expert demonstrations, 300 per task. That is 155k frames at 20 Hz, 43 instructions,
50
+ randomized object poses, colors, distractors, lighting and camera jitter.
51
+ - **Observation:**
52
+ - head camera, 256×256
53
+ - joint positions: left and right arm (5 each), waist yaw, neck yaw and pitch
54
+ - the instruction
55
+ - **Action:** absolute joint targets for the same 13 DOF, learned as RELATIVE (delta from current state),
56
+ 16-step horizon.
57
+ - **Fine-tune:** `NEW_EMBODIMENT`, default GR00T recipe (projector and action head trained, backbone frozen).
58
+ 10,000 steps at batch 64, learning rate 1e-4, color jitter. One L40 for 2 h 43 m. Loss went from 0.095 to 0.010.
59
+ - **Checkpoints:** `checkpoints/checkpoint-{2000..10000}`, with weights and processor but no optimizer state.
60
+
61
+ ## Simplifications and assumptions
62
+
63
+ These are deliberate scope cuts for v1:
64
+
65
+ - **Pelvis welded:** legs held at the standing pose. Balance is the locomotion controller's job on hardware.
66
+ - **Hand collision shapes:** convex hulls of Menlo's printed dummy-hand files. Mass (0.18 kg) and mounting are
67
+ assumptions.
68
+ - **Head camera:** mounted pitched 45° down inside the head with a 75° vertical FOV. The neck's 19.5° downward
69
+ limit cannot see the table on its own. This needs checking against the real camera mount.
70
+ - **Box task:** the carton is held by friction only (μ 0.5, no welds). It uses a 0.30–0.34 m carton because
71
+ Asimov's fists only face each other in a narrow band, set by one-sided shoulder roll and a 5-DOF arm.
72
+
73
+ ## Code
74
+
75
+ Simulation tasks, scripted experts, dataset export, GR00T modality config, closed-loop evaluation and the
76
+ one-shot training script: `asimov-groot` (to be published).
77
+
78
+ ## License
79
+
80
+ Licensed by NVIDIA Corporation under the
81
+ [NVIDIA Open Model License](https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-open-model-license/).
82
+ This is a derivative of nvidia/GR00T-N1.7-3B, which uses nvidia/Cosmos-Reason2-2B, under the same license.
83
+ The Asimov robot model is from menloresearch/asimov-1 (GPL-2.0 software / CERN-OHL-S-2.0 hardware).