Spaces:
Sleeping
Sleeping
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,48 +1,20 @@
|
|
| 1 |
---
|
| 2 |
title: DialNav Challenge
|
| 3 |
-
emoji:
|
| 4 |
-
colorFrom:
|
| 5 |
colorTo: indigo
|
| 6 |
sdk: gradio
|
| 7 |
app_file: app.py
|
| 8 |
-
pinned:
|
| 9 |
-
license:
|
| 10 |
-
short_description: '@ ECCV 2026 Embodied Agent and Dialog Workshop'
|
| 11 |
-
sdk_version: 5.43.1
|
| 12 |
-
tags:
|
| 13 |
-
- leaderboard
|
| 14 |
---
|
| 15 |
|
| 16 |
-
#
|
| 17 |
|
| 18 |
-
|
| 19 |
|
| 20 |
-
|
| 21 |
-
```json
|
| 22 |
-
{
|
| 23 |
-
"config": {
|
| 24 |
-
"model_dtype": "torch.float16", # or torch.bfloat16 or 8bit or 4bit
|
| 25 |
-
"model_name": "path of the model on the hub: org/model",
|
| 26 |
-
"model_sha": "revision on the hub",
|
| 27 |
-
},
|
| 28 |
-
"results": {
|
| 29 |
-
"task_name": {
|
| 30 |
-
"metric_name": score,
|
| 31 |
-
},
|
| 32 |
-
"task_name2": {
|
| 33 |
-
"metric_name": score,
|
| 34 |
-
}
|
| 35 |
-
}
|
| 36 |
-
}
|
| 37 |
-
```
|
| 38 |
|
| 39 |
-
|
| 40 |
|
| 41 |
-
|
| 42 |
-
|
| 43 |
-
# Code logic for more complex edits
|
| 44 |
-
|
| 45 |
-
You'll find
|
| 46 |
-
- the main table' columns names and properties in `src/display/utils.py`
|
| 47 |
-
- the logic to read all results and request files, then convert them in dataframe lines, in `src/leaderboard/read_evals.py`, and `src/populate.py`
|
| 48 |
-
- the logic to allow or filter submissions in `src/submission/submit.py` and `src/submission/check_validity.py`
|
|
|
|
| 1 |
---
|
| 2 |
title: DialNav Challenge
|
| 3 |
+
emoji: 🧭
|
| 4 |
+
colorFrom: blue
|
| 5 |
colorTo: indigo
|
| 6 |
sdk: gradio
|
| 7 |
app_file: app.py
|
| 8 |
+
pinned: false
|
| 9 |
+
license: apache-2.0
|
|
|
|
|
|
|
|
|
|
|
|
|
| 10 |
---
|
| 11 |
|
| 12 |
+
# DialNav Challenge Evaluation Server
|
| 13 |
|
| 14 |
+
This Space hosts the evaluation server and leaderboard for the DialNav Challenge.
|
| 15 |
|
| 16 |
+
The DialNav Challenge benchmarks dialog-enabled embodied navigation agents. Participants may modify the navigator, the guide, or both components. The goal is to improve navigation success by using dialogue effectively.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 17 |
|
| 18 |
+
This challenge is organized as an open benchmark rather than a hidden-test competition. Since the guide component may require access to target information in order to provide meaningful assistance, all input splits, including the test split, may be released to participants. The leaderboard is intended to support reproducible comparison across dialog-enabled navigation systems.
|
| 19 |
|
| 20 |
+
Only registered teams are eligible for the final leaderboard and awards. Please use the same team name in the registration form and on this evaluation server.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|