File size: 2,022 Bytes
c61c435 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 | # Oasis Action World Model Integration
ADAM treats Oasis as a first-class trainer named `Oasis Action World Model`.
It uses the existing `Oasis-Game-Trainer/roblox_action_flow_app.py` worker and
keeps training and playable inference in separate processes.
## Dataset Layout
Use one or more recorder folders. Multiple folders can be supplied with
semicolon separators.
```text
My_Oasis_Dataset/
dataset_info.json
actions.jsonl
frames/
frame_00000000.png
frame_00000001.png
```
Each `actions.jsonl` row must identify the frame and its labels:
```json
{"session_id":"run1","frame_index":1,"filename":"frame_00000001.png","w":1,"a":0,"s":0,"d":0,"jump":0,"mouse_dx":0.0,"mouse_dy":0.0,"zoom":0.0}
```
Rows describe the action for the transition into that frame. ADAM validates
missing frames, invalid labels, duplicate or gapped frame indexes, broken
images, inconsistent resolutions, empty sequences, and missing action columns.
It does not guess missing labels.
## Minecraft Beta-Style Recording Notes
Record your own gameplay. Start with `256x144` at 8-12 FPS for a first pipeline
test, then increase data before long runs. Keep every clip as its own session or
recording folder so training never learns fake transitions between worlds.
Capture a mix of walking forward, strafing, turning, jumping, climbing, terrain
changes, interiors, caves, water, sky, and short idle moments. Avoid long
standing-still stretches; idle is useful, but a dataset dominated by idle frames
will make the model ignore controls.
A good smoke dataset is 300-1,000 labelled frames. A more meaningful first
Minecraft experiment is 5,000-20,000 labelled frames with clean W/A/S/D/Space
coverage and synchronized frame/action timestamps.
## RTX 3060 12 GB Starting Point
Use `256x144`, batch size `2`, mixed precision `fp32`, gradient accumulation
`1`, prediction horizon `3`, loader workers `2`, save every `5` epochs, preview
every `5` epochs, and 5-10 epochs for a pipeline test. Try `fp16` only after
FP32 is stable.
|