lee1o21k21 commited on
Commit
a2d00a9
·
verified ·
1 Parent(s): 921fc43

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -37
README.md CHANGED
@@ -1,48 +1,20 @@
1
  ---
2
  title: DialNav Challenge
3
- emoji: 🥇
4
- colorFrom: green
5
  colorTo: indigo
6
  sdk: gradio
7
  app_file: app.py
8
- pinned: true
9
- license: mit
10
- short_description: '@ ECCV 2026 Embodied Agent and Dialog Workshop'
11
- sdk_version: 5.43.1
12
- tags:
13
- - leaderboard
14
  ---
15
 
16
- # Start the configuration
17
 
18
- Most of the variables to change for a default leaderboard are in `src/env.py` (replace the path for your leaderboard) and `src/about.py` (for tasks).
19
 
20
- Results files should have the following format and be stored as json files:
21
- ```json
22
- {
23
- "config": {
24
- "model_dtype": "torch.float16", # or torch.bfloat16 or 8bit or 4bit
25
- "model_name": "path of the model on the hub: org/model",
26
- "model_sha": "revision on the hub",
27
- },
28
- "results": {
29
- "task_name": {
30
- "metric_name": score,
31
- },
32
- "task_name2": {
33
- "metric_name": score,
34
- }
35
- }
36
- }
37
- ```
38
 
39
- Request files are created automatically by this tool.
40
 
41
- If you encounter problem on the space, don't hesitate to restart it to remove the create eval-queue, eval-queue-bk, eval-results and eval-results-bk created folder.
42
-
43
- # Code logic for more complex edits
44
-
45
- You'll find
46
- - the main table' columns names and properties in `src/display/utils.py`
47
- - the logic to read all results and request files, then convert them in dataframe lines, in `src/leaderboard/read_evals.py`, and `src/populate.py`
48
- - the logic to allow or filter submissions in `src/submission/submit.py` and `src/submission/check_validity.py`
 
1
  ---
2
  title: DialNav Challenge
3
+ emoji: 🧭
4
+ colorFrom: blue
5
  colorTo: indigo
6
  sdk: gradio
7
  app_file: app.py
8
+ pinned: false
9
+ license: apache-2.0
 
 
 
 
10
  ---
11
 
12
+ # DialNav Challenge Evaluation Server
13
 
14
+ This Space hosts the evaluation server and leaderboard for the DialNav Challenge.
15
 
16
+ The DialNav Challenge benchmarks dialog-enabled embodied navigation agents. Participants may modify the navigator, the guide, or both components. The goal is to improve navigation success by using dialogue effectively.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
17
 
18
+ This challenge is organized as an open benchmark rather than a hidden-test competition. Since the guide component may require access to target information in order to provide meaningful assistance, all input splits, including the test split, may be released to participants. The leaderboard is intended to support reproducible comparison across dialog-enabled navigation systems.
19
 
20
+ Only registered teams are eligible for the final leaderboard and awards. Please use the same team name in the registration form and on this evaluation server.