AI & ML interests

CnakeCharmer

dleemiller 
posted an update 10 days ago
view post
Post
188
Zero-shot encoder models cannot provide information that elucidates why they chose their classification.

This is a first of it's kind model that addresses that issue directly. dleemiller/AbsoluteZero-nli-4b

AbsoluteZero-nli outputs traces that gives observability to NLI.

Traces enable users to inspect and determine how to augment hypotheses to fix or improve classification. This could be done in conjunction with automation for grouping classification failures and using an LLM to test changes to the hypothesis against a holdout set.

🥇https://huggingface.co/spaces/dleemiller/open-nli-leaderboard
dleemiller 
posted an update 14 days ago
view post
Post
2,428
Join the competition!

We have 45 models scored (and growing), across 44 public benchmarks. My goal for this space is to push the limits on NLI and the breadth of tasks these models can perform in. Contributions are encouraged, as well as suggestions for additional benchmarks.

Right now, all models are cross encoders (Sentence Transformers 🥰), but LLMs are welcome too!



dleemiller/open-nli-leaderboard
  • 4 replies
·