File size: 1,096 Bytes
2ab1b43
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
---
tags:
- microduck
- robotics
- reinforcement-learning
- onnx
library_name: microduck
pipeline_tag: robotics
base_model: Nico-robot/microduck-tug-of-war
base_model_relation: finetune
---

# tug-puller2

Tug of War puller, fine-tuned from Nico-robot/microduck-tug-of-war (via our tug-puller1) by self-play against its own earlier checkpoint with a stronger pull reward. Plain network, no seed tables.

A **perpetual** policy for the [microduck](https://github.com/pollen-robotics/microduck) (61-D observation, 14 actions, 50 Hz). Runs until told otherwise — a gait, loaded into a policy slot.

## Run it on a robot

```bash
sudo robotctl policy load <slot> juicenv/microduck-tug-puller2
```

The observation normalizer is baked into `policy.onnx`; feed raw observations.
`manifest.json` follows schema 2 of the microduck policy manifest (`docs/policy-manifest.md` in the daemon repo).

A remix of [Nico-robot/microduck-tug-of-war](https://huggingface.co/Nico-robot/microduck-tug-of-war).

## Training

- **repo**: `pollen-robotics/microduck_rl`
- **branch**: `main`
- **commit**: `4b675ebf4`