TanujInsane commited on
Commit ·
a2d30b7
1
Parent(s): cfd8bf6
fix: add grader field to all 3 tasks in openenv.yaml
Browse files- openenv.yaml +6 -0
openenv.yaml
CHANGED
|
@@ -61,6 +61,8 @@ tasks:
|
|
| 61 |
Documents are pre-extracted and normalized. This task serves as an introduction
|
| 62 |
to the environment and API.
|
| 63 |
|
|
|
|
|
|
|
| 64 |
parameters:
|
| 65 |
num_documents: 100
|
| 66 |
num_categories: 5
|
|
@@ -90,6 +92,8 @@ tasks:
|
|
| 90 |
Includes time constraints per action. Requires the agent to balance
|
| 91 |
processing time with accuracy.
|
| 92 |
|
|
|
|
|
|
|
| 93 |
parameters:
|
| 94 |
num_documents: 500
|
| 95 |
num_categories: 10
|
|
@@ -127,6 +131,8 @@ tasks:
|
|
| 127 |
speed-accuracy tradeoffs. Documents may contain mixed formats
|
| 128 |
and ambiguous classification cases.
|
| 129 |
|
|
|
|
|
|
|
| 130 |
parameters:
|
| 131 |
num_documents: 1000
|
| 132 |
num_categories: 22
|
|
|
|
| 61 |
Documents are pre-extracted and normalized. This task serves as an introduction
|
| 62 |
to the environment and API.
|
| 63 |
|
| 64 |
+
grader: ".grading:AgentGrader"
|
| 65 |
+
|
| 66 |
parameters:
|
| 67 |
num_documents: 100
|
| 68 |
num_categories: 5
|
|
|
|
| 92 |
Includes time constraints per action. Requires the agent to balance
|
| 93 |
processing time with accuracy.
|
| 94 |
|
| 95 |
+
grader: ".grading:AgentGrader"
|
| 96 |
+
|
| 97 |
parameters:
|
| 98 |
num_documents: 500
|
| 99 |
num_categories: 10
|
|
|
|
| 131 |
speed-accuracy tradeoffs. Documents may contain mixed formats
|
| 132 |
and ambiguous classification cases.
|
| 133 |
|
| 134 |
+
grader: ".grading:AgentGrader"
|
| 135 |
+
|
| 136 |
parameters:
|
| 137 |
num_documents: 1000
|
| 138 |
num_categories: 22
|