pepijn223 HF Staff commited on
Commit
9523451
·
verified ·
1 Parent(s): 2641c35

Use scalable annotation runtime, shared human-video module and optional Flora captions

Browse files
Files changed (1) hide show
  1. README.md +8 -6
README.md CHANGED
@@ -38,7 +38,8 @@ tags:
38
  ![LeRobot Annotation Studio — robot video to language](assets/studio-cover.png)
39
 
40
  Enter a LeRobot v3 dataset, choose annotations, review an estimate, then sign in
41
- with Hugging Face to run a CPU Job using the selected vision model through Inference Providers.
 
42
  Jobs and inference are billed to the signed-in user's personal account.
43
  The Space itself uses free CPU hardware and has no shared HF access token.
44
 
@@ -62,8 +63,9 @@ A Studio adapter preserves the quoted first-frame-only workflow, full-resolution
62
  image edits, spending/time guards and the media viewer. End-frame editing remains
63
  available in the CLI but is not included in the Studio's single-edit quote.
64
 
65
- In **Model → Subtask captions**, choose **NVIDIA Flora-Captioner** to relabel
66
- the intervals generated by the selected vision model. Flora preserves those
 
67
  boundaries; the relabeled subtasks then feed plans, memory and human videos.
68
  It uses NVIDIA's pinned native frame planner, video processor, mixed BF16/FP32
69
  loader and greedy decoder with BEFORE/TARGET/AFTER context. The input uses the
@@ -72,12 +74,12 @@ there is no silent fallback to the original VLM text.
72
 
73
  Flora has no hosted Inference Provider route. Selecting it runs the worker on an
74
  H200 CUDA Job; the quote reserves the entire GPU timeout, including installation,
75
- weight downloads and startup. Other annotations still use the selected VLM through
76
  Inference Providers. The default keeps the CPU workflow.
77
  [Flora's model card](https://huggingface.co/nvidia/Flora-Captioner) limits use to
78
  noncommercial research. Code and weight revisions are pinned in `flora_captioner.py`
79
- and each run manifest. This option is experimental; a paired 25-episode ABC
80
- captioning comparison is being evaluated separately from boundary detection.
81
 
82
  The default **tuned Qwen3.8** preset uses the action-phase prompt developed on
83
  ABC, timestamped contact sheets at 2 fps, 1,200 frames per request, and up to
 
38
  ![LeRobot Annotation Studio — robot video to language](assets/studio-cover.png)
39
 
40
  Enter a LeRobot v3 dataset, choose annotations, review an estimate, then sign in
41
+ with Hugging Face to run a Job using the selected annotation model. General vision
42
+ models use a CPU Job and Inference Providers; Flora uses an H200 GPU Job.
43
  Jobs and inference are billed to the signed-in user's personal account.
44
  The Space itself uses free CPU hardware and has no shared HF access token.
45
 
 
63
  image edits, spending/time guards and the media viewer. End-frame editing remains
64
  available in the CLI but is not included in the Studio's single-edit quote.
65
 
66
+ In the **Model** selector, choose **NVIDIA Flora-Captioner** to relabel
67
+ the intervals generated by its Qwen3.8 27B helper. The helper is shown beneath
68
+ the selector and in the review, with its provider rates. Flora preserves those
69
  boundaries; the relabeled subtasks then feed plans, memory and human videos.
70
  It uses NVIDIA's pinned native frame planner, video processor, mixed BF16/FP32
71
  loader and greedy decoder with BEFORE/TARGET/AFTER context. The input uses the
 
74
 
75
  Flora has no hosted Inference Provider route. Selecting it runs the worker on an
76
  H200 CUDA Job; the quote reserves the entire GPU timeout, including installation,
77
+ weight downloads and startup. Other annotations use the helper VLM through
78
  Inference Providers. The default keeps the CPU workflow.
79
  [Flora's model card](https://huggingface.co/nvidia/Flora-Captioner) limits use to
80
  noncommercial research. Code and weight revisions are pinned in `flora_captioner.py`
81
+ and each run manifest. This option is experimental. `benchmark_flora.py` supports
82
+ a paired 25-episode ABC captioning comparison separately from boundary detection.
83
 
84
  The default **tuned Qwen3.8** preset uses the action-phase prompt developed on
85
  ABC, timestamped contact sheets at 2 fps, 1,200 frames per request, and up to