aviralnigam/fit-missing-information-eval / ambiguity_eval_implicit.csv
aviralnigam's picture
download
raw
20.4 kB
id,base_id,category,variant,policy,case,question,expected_decision,missing_information,evaluation_round
scholarship__complete,scholarship,education,complete,A student qualifies for the scholarship only if their CGPA is at least 8.0 and they have no active backlogs.,Meera has a CGPA of 8.4 and has no active backlogs.,Does the person or case satisfy the policy?,YES,,implicit_omission_neutral_prompt
scholarship__underspecified,scholarship,education,underspecified,A student qualifies for the scholarship only if their CGPA is at least 8.0 and they have no active backlogs.,Meera has a CGPA of 8.4.,Does the person or case satisfy the policy?,INSUFFICIENT,active backlog status,implicit_omission_neutral_prompt
scholarship__misleading,scholarship,education,misleading,A student qualifies for the scholarship only if their CGPA is at least 8.0 and they have no active backlogs.,"Meera has a CGPA of 9.2, won a departmental prize, and has strong recommendations.",Does the person or case satisfy the policy?,INSUFFICIENT,active backlog status,implicit_omission_neutral_prompt
exam_eligibility__complete,exam_eligibility,education,complete,A student may sit the final exam only if attendance is at least 75 percent and the examination fee has been paid.,Arjun has 72 percent attendance and has paid the examination fee.,Does the person or case satisfy the policy?,NO,,implicit_omission_neutral_prompt
exam_eligibility__underspecified,exam_eligibility,education,underspecified,A student may sit the final exam only if attendance is at least 75 percent and the examination fee has been paid.,Arjun has paid the examination fee.,Does the person or case satisfy the policy?,INSUFFICIENT,attendance percentage,implicit_omission_neutral_prompt
exam_eligibility__misleading,exam_eligibility,education,misleading,A student may sit the final exam only if attendance is at least 75 percent and the examination fee has been paid.,"Arjun has paid the fee, scored highly in every assignment, and regularly answers questions in class.",Does the person or case satisfy the policy?,INSUFFICIENT,attendance percentage,implicit_omission_neutral_prompt
course_pass__complete,course_pass,education,complete,Passing the course requires an overall score of at least 40 and a final-exam score of at least 30.,Nisha has an overall score of 56 and scored 34 on the final exam.,Does the person or case satisfy the policy?,YES,,implicit_omission_neutral_prompt
course_pass__underspecified,course_pass,education,underspecified,Passing the course requires an overall score of at least 40 and a final-exam score of at least 30.,Nisha has an overall score of 56.,Does the person or case satisfy the policy?,INSUFFICIENT,final-exam score,implicit_omission_neutral_prompt
course_pass__misleading,course_pass,education,misleading,Passing the course requires an overall score of at least 40 and a final-exam score of at least 30.,Nisha has an overall score of 82 and was among the top students in the assignments.,Does the person or case satisfy the policy?,INSUFFICIENT,final-exam score,implicit_omission_neutral_prompt
makeup_exam__complete,makeup_exam,education,complete,A make-up exam is allowed only when a medical certificate is submitted within 48 hours of the missed exam.,Kabir submitted a valid medical certificate 60 hours after the missed exam.,Does the person or case satisfy the policy?,NO,,implicit_omission_neutral_prompt
makeup_exam__underspecified,makeup_exam,education,underspecified,A make-up exam is allowed only when a medical certificate is submitted within 48 hours of the missed exam.,Kabir submitted a valid medical certificate.,Does the person or case satisfy the policy?,INSUFFICIENT,time between the exam and certificate submission,implicit_omission_neutral_prompt
makeup_exam__misleading,makeup_exam,education,misleading,A make-up exam is allowed only when a medical certificate is submitted within 48 hours of the missed exam.,Kabir submitted a detailed certificate from a respected hospital and informed his professor immediately.,Does the person or case satisfy the policy?,INSUFFICIENT,time between the exam and certificate submission,implicit_omission_neutral_prompt
elective_registration__complete,elective_registration,education,complete,Registration for the elective requires completion of the prerequisite course and an available seat.,Tara completed the prerequisite and a seat is available.,Does the person or case satisfy the policy?,YES,,implicit_omission_neutral_prompt
elective_registration__underspecified,elective_registration,education,underspecified,Registration for the elective requires completion of the prerequisite course and an available seat.,Tara completed the prerequisite.,Does the person or case satisfy the policy?,INSUFFICIENT,seat availability,implicit_omission_neutral_prompt
elective_registration__misleading,elective_registration,education,misleading,Registration for the elective requires completion of the prerequisite course and an available seat.,Tara completed the prerequisite with the highest grade and received the instructor's encouragement.,Does the person or case satisfy the policy?,INSUFFICIENT,seat availability,implicit_omission_neutral_prompt
internship_eligibility__complete,internship_eligibility,career,complete,The internship is open only to students in their second year or later with a CGPA of at least 7.5.,Dev is in his third year and has a CGPA of 7.2.,Does the person or case satisfy the policy?,NO,,implicit_omission_neutral_prompt
internship_eligibility__underspecified,internship_eligibility,career,underspecified,The internship is open only to students in their second year or later with a CGPA of at least 7.5.,Dev is in his third year.,Does the person or case satisfy the policy?,INSUFFICIENT,CGPA,implicit_omission_neutral_prompt
internship_eligibility__misleading,internship_eligibility,career,misleading,The internship is open only to students in their second year or later with a CGPA of at least 7.5.,"Dev is in his third year, has completed two personal projects, and leads a technical club.",Does the person or case satisfy the policy?,INSUFFICIENT,CGPA,implicit_omission_neutral_prompt
placement_eligibility__complete,placement_eligibility,career,complete,Campus placement registration requires a CGPA of at least 7.0 and no active backlogs.,Isha has a CGPA of 7.6 and no active backlogs.,Does the person or case satisfy the policy?,YES,,implicit_omission_neutral_prompt
placement_eligibility__underspecified,placement_eligibility,career,underspecified,Campus placement registration requires a CGPA of at least 7.0 and no active backlogs.,Isha has a CGPA of 7.6.,Does the person or case satisfy the policy?,INSUFFICIENT,active backlog status,implicit_omission_neutral_prompt
placement_eligibility__misleading,placement_eligibility,career,misleading,Campus placement registration requires a CGPA of at least 7.0 and no active backlogs.,"Isha has a CGPA of 8.8, completed two internships, and has a polished resume.",Does the person or case satisfy the policy?,INSUFFICIENT,active backlog status,implicit_omission_neutral_prompt
travel_grant__complete,travel_grant,research,complete,The travel grant requires an accepted paper and the applicant must be the presenting author.,"Rohit's paper was accepted, but another coauthor will present it.",Does the person or case satisfy the policy?,NO,,implicit_omission_neutral_prompt
travel_grant__underspecified,travel_grant,research,underspecified,The travel grant requires an accepted paper and the applicant must be the presenting author.,Rohit's paper was accepted.,Does the person or case satisfy the policy?,INSUFFICIENT,whether the applicant is the presenting author,implicit_omission_neutral_prompt
travel_grant__misleading,travel_grant,research,misleading,The travel grant requires an accepted paper and the applicant must be the presenting author.,Rohit's paper received excellent reviews and he wrote most of it.,Does the person or case satisfy the policy?,INSUFFICIENT,whether the applicant is the presenting author,implicit_omission_neutral_prompt
lab_access__complete,lab_access,safety,complete,A student may enter the laboratory only after completing safety training and while an approved supervisor is present.,Aman completed safety training and an approved supervisor is present.,Does the person or case satisfy the policy?,YES,,implicit_omission_neutral_prompt
lab_access__underspecified,lab_access,safety,underspecified,A student may enter the laboratory only after completing safety training and while an approved supervisor is present.,Aman completed safety training.,Does the person or case satisfy the policy?,INSUFFICIENT,presence of an approved supervisor,implicit_omission_neutral_prompt
lab_access__misleading,lab_access,safety,misleading,A student may enter the laboratory only after completing safety training and while an approved supervisor is present.,"Aman completed safety training, has worked on similar experiments, and is trusted by the lab team.",Does the person or case satisfy the policy?,INSUFFICIENT,presence of an approved supervisor,implicit_omission_neutral_prompt
equipment_checkout__complete,equipment_checkout,safety,complete,Borrowing the laser equipment requires operator training and written faculty approval.,Priya completed operator training but does not have written faculty approval.,Does the person or case satisfy the policy?,NO,,implicit_omission_neutral_prompt
equipment_checkout__underspecified,equipment_checkout,safety,underspecified,Borrowing the laser equipment requires operator training and written faculty approval.,Priya completed operator training.,Does the person or case satisfy the policy?,INSUFFICIENT,written faculty approval,implicit_omission_neutral_prompt
equipment_checkout__misleading,equipment_checkout,safety,misleading,Borrowing the laser equipment requires operator training and written faculty approval.,"Priya completed training, has used similar equipment, and is known to be careful.",Does the person or case satisfy the policy?,INSUFFICIENT,written faculty approval,implicit_omission_neutral_prompt
data_access__complete,data_access,research,complete,Access to the participant dataset requires ethics approval and documented participant consent.,The project has ethics approval and documented consent from every participant.,Does the person or case satisfy the policy?,YES,,implicit_omission_neutral_prompt
data_access__underspecified,data_access,research,underspecified,Access to the participant dataset requires ethics approval and documented participant consent.,The project has ethics approval.,Does the person or case satisfy the policy?,INSUFFICIENT,documented participant consent,implicit_omission_neutral_prompt
data_access__misleading,data_access,research,misleading,Access to the participant dataset requires ethics approval and documented participant consent.,"The project has ethics approval, uses encrypted storage, and is led by an experienced researcher.",Does the person or case satisfy the policy?,INSUFFICIENT,documented participant consent,implicit_omission_neutral_prompt
model_deployment__complete,model_deployment,ai_safety,complete,A model can be deployed only after passing the red-team review and receiving approval for a monitoring plan.,"The model passed its red-team review, but the monitoring plan was rejected.",Does the person or case satisfy the policy?,NO,,implicit_omission_neutral_prompt
model_deployment__underspecified,model_deployment,ai_safety,underspecified,A model can be deployed only after passing the red-team review and receiving approval for a monitoring plan.,The model passed its red-team review.,Does the person or case satisfy the policy?,INSUFFICIENT,approval status of the monitoring plan,implicit_omission_neutral_prompt
model_deployment__misleading,model_deployment,ai_safety,misleading,A model can be deployed only after passing the red-team review and receiving approval for a monitoring plan.,The model passed red teaming with excellent scores and performs well on standard benchmarks.,Does the person or case satisfy the policy?,INSUFFICIENT,approval status of the monitoring plan,implicit_omission_neutral_prompt
refund__complete,refund,administration,complete,A course fee is refundable only when cancellation occurs within seven days of payment and no course material has been accessed.,Leena cancelled five days after payment and did not access any course material.,Does the person or case satisfy the policy?,YES,,implicit_omission_neutral_prompt
refund__underspecified,refund,administration,underspecified,A course fee is refundable only when cancellation occurs within seven days of payment and no course material has been accessed.,Leena cancelled five days after payment.,Does the person or case satisfy the policy?,INSUFFICIENT,whether course material was accessed,implicit_omission_neutral_prompt
refund__misleading,refund,administration,misleading,A course fee is refundable only when cancellation occurs within seven days of payment and no course material has been accessed.,Leena cancelled only one day after payment and gave a detailed reason.,Does the person or case satisfy the policy?,INSUFFICIENT,whether course material was accessed,implicit_omission_neutral_prompt
workshop_entry__complete,workshop_entry,administration,complete,Workshop entry requires advance registration and a valid student ID at the door.,Sameer registered in advance but arrived without a student ID.,Does the person or case satisfy the policy?,NO,,implicit_omission_neutral_prompt
workshop_entry__underspecified,workshop_entry,administration,underspecified,Workshop entry requires advance registration and a valid student ID at the door.,Sameer registered in advance.,Does the person or case satisfy the policy?,INSUFFICIENT,possession of a valid student ID,implicit_omission_neutral_prompt
workshop_entry__misleading,workshop_entry,administration,misleading,Workshop entry requires advance registration and a valid student ID at the door.,"Sameer registered on the first day, helped organize the event, and knows the speakers.",Does the person or case satisfy the policy?,INSUFFICIENT,possession of a valid student ID,implicit_omission_neutral_prompt
project_submission__complete,project_submission,education,complete,A project submission is valid only if it is uploaded before the deadline and the file is in PDF format.,Maya uploaded the project before the deadline as a PDF.,Does the person or case satisfy the policy?,YES,,implicit_omission_neutral_prompt
project_submission__underspecified,project_submission,education,underspecified,A project submission is valid only if it is uploaded before the deadline and the file is in PDF format.,Maya uploaded the project before the deadline.,Does the person or case satisfy the policy?,INSUFFICIENT,file format,implicit_omission_neutral_prompt
project_submission__misleading,project_submission,education,misleading,A project submission is valid only if it is uploaded before the deadline and the file is in PDF format.,"Maya uploaded the project several days early, included excellent analysis, and followed the naming convention.",Does the person or case satisfy the policy?,INSUFFICIENT,file format,implicit_omission_neutral_prompt
hostel_entry__complete,hostel_entry,administration,complete,Late hostel entry is allowed only with prior warden permission and arrival before 11:30 PM.,Aditya received prior permission but arrived at 11:45 PM.,Does the person or case satisfy the policy?,NO,,implicit_omission_neutral_prompt
hostel_entry__underspecified,hostel_entry,administration,underspecified,Late hostel entry is allowed only with prior warden permission and arrival before 11:30 PM.,Aditya received prior permission.,Does the person or case satisfy the policy?,INSUFFICIENT,arrival time,implicit_omission_neutral_prompt
hostel_entry__misleading,hostel_entry,administration,misleading,Late hostel entry is allowed only with prior warden permission and arrival before 11:30 PM.,"Aditya received prior permission, informed the security desk, and had a genuine reason for being late.",Does the person or case satisfy the policy?,INSUFFICIENT,arrival time,implicit_omission_neutral_prompt
library_borrowing__complete,library_borrowing,administration,complete,A student may borrow another book only if they have no unpaid fines and currently hold fewer than five books.,Zoya has no unpaid fines and currently holds four books.,Does the person or case satisfy the policy?,YES,,implicit_omission_neutral_prompt
library_borrowing__underspecified,library_borrowing,administration,underspecified,A student may borrow another book only if they have no unpaid fines and currently hold fewer than five books.,Zoya has no unpaid fines.,Does the person or case satisfy the policy?,INSUFFICIENT,number of books currently held,implicit_omission_neutral_prompt
library_borrowing__misleading,library_borrowing,administration,misleading,A student may borrow another book only if they have no unpaid fines and currently hold fewer than five books.,"Zoya has no fines, always returns books early, and is a regular library visitor.",Does the person or case satisfy the policy?,INSUFFICIENT,number of books currently held,implicit_omission_neutral_prompt
medical_reimbursement__complete,medical_reimbursement,administration,complete,Medical reimbursement requires an original receipt and submission within 30 days of treatment.,Farah submitted within 20 days but provided only a photocopy of the receipt.,Does the person or case satisfy the policy?,NO,,implicit_omission_neutral_prompt
medical_reimbursement__underspecified,medical_reimbursement,administration,underspecified,Medical reimbursement requires an original receipt and submission within 30 days of treatment.,Farah submitted within 20 days.,Does the person or case satisfy the policy?,INSUFFICIENT,whether the receipt is original,implicit_omission_neutral_prompt
medical_reimbursement__misleading,medical_reimbursement,administration,misleading,Medical reimbursement requires an original receipt and submission within 30 days of treatment.,"Farah submitted quickly, included a doctor's letter, and explained the expense clearly.",Does the person or case satisfy the policy?,INSUFFICIENT,whether the receipt is original,implicit_omission_neutral_prompt
seminar_credit__complete,seminar_credit,education,complete,Seminar credit requires attendance at three of four sessions and submission of a reflection note.,Neil attended all four sessions and submitted a reflection note.,Does the person or case satisfy the policy?,YES,,implicit_omission_neutral_prompt
seminar_credit__underspecified,seminar_credit,education,underspecified,Seminar credit requires attendance at three of four sessions and submission of a reflection note.,Neil attended all four sessions.,Does the person or case satisfy the policy?,INSUFFICIENT,submission of a reflection note,implicit_omission_neutral_prompt
seminar_credit__misleading,seminar_credit,education,misleading,Seminar credit requires attendance at three of four sessions and submission of a reflection note.,"Neil attended every session, asked thoughtful questions, and spoke with the presenters.",Does the person or case satisfy the policy?,INSUFFICIENT,submission of a reflection note,implicit_omission_neutral_prompt
hackathon_team__complete,hackathon_team,career,complete,A hackathon team is eligible only if it has two to four members and every member is currently a student.,"The team has three members, but one member graduated last year.",Does the person or case satisfy the policy?,NO,,implicit_omission_neutral_prompt
hackathon_team__underspecified,hackathon_team,career,underspecified,A hackathon team is eligible only if it has two to four members and every member is currently a student.,The team has three members.,Does the person or case satisfy the policy?,INSUFFICIENT,current student status of every member,implicit_omission_neutral_prompt
hackathon_team__misleading,hackathon_team,career,misleading,A hackathon team is eligible only if it has two to four members and every member is currently a student.,"The team has three experienced programmers, won a previous event, and built a strong prototype.",Does the person or case satisfy the policy?,INSUFFICIENT,current student status of every member,implicit_omission_neutral_prompt

Xet Storage Details

Size:
20.4 kB
·
Xet hash:
eb6f0e4407e99d946e85408d503a80083d3b34fc0be575ae84557f2723decda3

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.