Instructions to use humanlong/improving-self-evolution-mbpp with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use humanlong/improving-self-evolution-mbpp with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("humanlong/improving-self-evolution-mbpp", device_map="auto") - Notebooks
- Google Colab
- Kaggle
File size: 764 Bytes
0508458 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 | [
{
"candidate": "spectral_soft/round_5/evaluation",
"reference": "base/evaluation",
"pass1_delta": 0.0225,
"pass1_ci95": [
0.012,
0.0335
],
"noninferior_at_1pct": true,
"coverage4_delta": -0.3152965855006672,
"coverage4_ci95": [
-0.39445073313153484,
-0.2395721128340615
],
"paired_eligible_tasks": 245
},
{
"candidate": "spectral_soft/round_5/evaluation",
"reference": "spd_hard/round_5/evaluation",
"pass1_delta": -0.01175,
"pass1_ci95": [
-0.019,
-0.00475
],
"noninferior_at_1pct": false,
"coverage4_delta": 0.2929389999111115,
"coverage4_ci95": [
0.23322470344098753,
0.3531874808062307
],
"paired_eligible_tasks": 251
}
]
|