On-Fly-Jev / eval /generation_test.json
Quazim0t0's picture
Fix stale decision_config.json (T=1.0, matches weights); README calibration note; add fast-decisions dev eval + generation test
e11d5a2 verified
Raw History Blame Contribute Delete
6.15 kB
{
"text_on_fly_jev": {
"The best way to learn a new language is": " that learning and data collection.\n\n- data dataset dataset dataset dataset dataset dataset dataset dataset dataset datase dataset dat",
"Once upon a time, in a small village,": " a timelesssit time periods. Where time periods time periods time periods time periods time periods. time time periods time periods. time time time periods time periods t",
"Question: What is 12 + 7?\nAnswer:": " Thermalization of thermalization and healing and healing heat heating healing heat heating healing heat heating healing heating healing heating healing heating healing healing healing hea",
"The capital of France is": " available resources for functions and resources for fun resources.\n<thinking>> function f is fun function f function f function f function f f",
"To fix a flat bicycle tire, first": " flag fff fffff fff ffff fffff fffff fffffff fffffffffffff",
"Dear customer, we are sorry that your order": "s.\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n"
},
"text_base": {
"The best way to learn a new language is": " too.\n<thinking> </thinking> </thinking> <output> <output> <output> <output> ",
"Once upon a time, in a small village,": " then, there's a lot of times that there's a lot of times that there are times that there are times that there are times that there",
"Question: What is 12 + 7?\nAnswer:": " Thermalization and automation of thermalization and automation of thermalization and automation of thermalization and automation of thermalization and automation.\n<thi",
"The capital of France is": " available forces. Therefore, there are many different types of them, which is available for them.\n\n<thinking> </",
"To fix a flat bicycle tire, first": "-time, and then, then, there are many different types of the two-sided types. There are many different types of the type",
"Dear customer, we are sorry that your order": "s are not available.\n\nThere are many different types of them, but they are not available for them. They are not ava"
},
"decisions": [
{
"state": "I just got promoted at work and I cannot stop smiling!",
"ms": 17.0,
"answers": {
"emotion": {
"choice": "anger",
"probabilities": {
"joy": 0.3035,
"sadness": 0.0721,
"anger": 0.5874,
"fear": 0.037
},
"answer_confidence": 0.5874
}
}
},
{
"state": "My dog passed away this morning. The house feels empty.",
"ms": 14.4,
"answers": {
"emotion": {
"choice": "sadness",
"probabilities": {
"joy": 0.0014,
"sadness": 0.9951,
"anger": 0.0015,
"fear": 0.002
},
"answer_confidence": 0.9951
}
}
},
{
"state": {
"body": "I was billed twice this month. Refund me or I cancel today."
},
"ms": 18.0,
"answers": {
"dept": {
"choice": "sales",
"probabilities": {
"billing": 0.138,
"tech": 0.1042,
"sales": 0.7578
},
"answer_confidence": 0.7578
},
"urgency": {
"score": 1.2698,
"legend": {
"0": "low",
"1": "normal",
"2": "urgent"
},
"probabilities": {
"0": 0.3101,
"1": 0.1101,
"2": 0.5798
},
"answer_confidence": 0.5798
},
"churn": {
"noul": 0.7419,
"answer_confidence": 0.7419
}
}
},
{
"state": {
"body": "Hi! Just wanted to say the new dashboard looks great. No issues."
},
"ms": 16.6,
"answers": {
"churn": {
"noul": 0.5718,
"answer_confidence": 0.5718
},
"urgency": {
"score": 0.5155,
"legend": {
"0": "low",
"1": "normal",
"2": "urgent"
},
"probabilities": {
"0": 0.6625,
"1": 0.1595,
"2": 0.178
},
"answer_confidence": 0.6625
}
}
},
{
"state": "The movie was a complete waste of two hours; the plot made no sense.",
"ms": 18.4,
"answers": {
"sentiment": {
"choice": "negative",
"probabilities": {
"positive": 0.0,
"negative": 1.0
},
"answer_confidence": 1.0
}
}
},
{
"state": "Apple shares rose 4% after the company beat quarterly earnings estimates.",
"ms": 15.6,
"answers": {
"topic": {
"choice": "business",
"probabilities": {
"world": 0.0012,
"sports": 0.0021,
"business": 0.9898,
"sci/tech": 0.0069
},
"answer_confidence": 0.9898
}
}
},
{
"state": "wake me up at seven tomorrow",
"ms": 17.6,
"answers": {
"intent": {
"choice": "alarm_set",
"probabilities": {
"alarm_set": 0.7857,
"weather_query": 0.0028,
"play_music": 0.0,
"calendar_query": 0.2115
},
"answer_confidence": 0.7857
}
}
},
{
"state": {
"premise": "A man is playing a guitar on stage.",
"hypothesis": "A man is performing music."
},
"ms": 17.9,
"answers": {
"nli": {
"choice": "entailment",
"probabilities": {
"entailment": 0.6857,
"neutral": 0.2582,
"contradiction": 0.0561
},
"answer_confidence": 0.6857
}
}
},
{
"state": {
"passage": "Water boils at 100 degrees Celsius at sea level.",
"question": "does water boil at 100 degrees celsius at sea level"
},
"ms": 18.3,
"answers": {
"answer": {
"noul": 0.7025,
"answer_confidence": 0.7025
}
}
},
{
"state": {
"health": 20,
"ammo": 12,
"enemies": [
{
"name": "imp",
"distance": 3,
"angle": -10
}
],
"position": "open room"
},
"ms": 24.4,
"answers": {
"action": {
"choice": "turn_left",
"probabilities": {
"attack": 0.3304,
"retreat": 0.0219,
"explore": 0.2533,
"turn_left": 0.3572,
"turn_right": 0.0372
},
"answer_confidence": 0.3572
}
}
}
]
}