Add evaluation results

#6
by SaylorTwift HF Staff - opened

Add evaluation results for LiquidAI/LFM3-1.7B

Summary

This PR adds the benchmark results published on the model card for LiquidAI/LFM3-1.7B to .eval_results/, following the Hugging Face Hub evaluation-results specification.

Benchmarks Added

Benchmarks Skipped (Not Registered on Hub)

These benchmarks are on the model card but have no registered eval.yaml on the Hub:

  • LiveClaw (45.60)
  • BrowseComp-Plus, OpenClaw subset (37.00)
  • WebArena-Verified (38.42)
  • EnterpriseOps-Gym (28.20)
  • AutomationBench, public (41.29)
  • BFCL V4 (71.39)
  • ToolSandbox (80.36)
  • MCP-Atlas (32.57)
  • τ³-bench, 4 domains (68.01)
  • LiveCodeBench v6 (73.46)
  • LiveCodeBench Pro 25Q2 (31.74)
  • SciCode (28.47)
  • IFEval (96.66)
  • IFBench (73.03)
  • Multi-IF (89.10)
  • AA-Omniscience (0.50; accuracy 7.07; non-hallucination 92.93)
  • AA-LCR (52.83)
  • RULER 128K (65.56)

They can be added once their authors register an eval.yaml on the Hub.

Mapping notes

  • Claw-Eval General (EN) average (68.64): the Hub task's headline is pass^3, so only that score is added.
  • Humanity's Last Exam with tools (13.90): only the no-tools score is added, marked with a note.

Source

Files Added

  • .eval_results/LFM3-1.7B.yaml

Verification

The scores come from the benchmark tables on the model card, as measured by Liquid AI. No verified token is included, because these were not run via HF Jobs with inspect-ai.


To upload:

hf upload LiquidAI/LFM3-1.7B .eval_results .eval_results --create-pr --commit-message "Add evaluation results"
SaylorTwift changed pull request status to open
Liquid AI org

Thank you!

mlabonne changed pull request status to merged

Sign up or log in to comment