Sentence Similarity
sentence-transformers
Safetensors
English
bert
retrieval
legal
agriculture
eu-law
cap
text-embeddings-inference
Instructions to use stonarini/grepac-e5-small with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use stonarini/grepac-e5-small with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("stonarini/grepac-e5-small") sentences = [ "That is a happy person", "That is a happy dog", "That is a very happy person", "Today is a sunny day" ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [4, 4] - Notebooks
- Google Colab
- Kaggle
|
Download README.md from stonarini/grepac-e5-small: direct link, hf CLI and curl.
- Browser
- Download file 2.03 kB
-
https://huggingface.co/stonarini/grepac-e5-small/resolve/main/README.md
- Command line
-
hf download hf://stonarini/grepac-e5-small/README.md
-
curl -L -o README.md https://huggingface.co/stonarini/grepac-e5-small/resolve/main/README.md
2.03 kB
| language: [en] | |
| license: mit | |
| library_name: sentence-transformers | |
| pipeline_tag: sentence-similarity | |
| base_model: intfloat/multilingual-e5-small | |
| tags: [sentence-transformers, retrieval, legal, agriculture, eu-law, cap] | |
| # grepac-e5-small | |
| [`intfloat/multilingual-e5-small`](https://huggingface.co/intfloat/multilingual-e5-small) | |
| fine-tuned on CPU to find the right article of the EU Common Agricultural Policy (CAP) | |
| regulations for a question. It powers [grePAC](https://huggingface.co/spaces/stonarini/grepac). | |
| Code and training pipeline: [github.com/stonarini/grepac](https://github.com/stonarini/grepac). | |
| ## Usage | |
| Same `query: ` / `passage: ` prefixes as the base model. | |
| ```python | |
| from sentence_transformers import SentenceTransformer | |
| model = SentenceTransformer("stonarini/grepac-e5-small") | |
| q = model.encode(["query: When will I receive my CAP payments?"], normalize_embeddings=True) | |
| p = model.encode(["passage: Article 44 Payment to beneficiaries\n..."], normalize_embeddings=True) | |
| print(q @ p.T) | |
| ``` | |
| ## Training | |
| The training data is generated, with no hand-written examples: | |
| - a local LLM (Mistral 7B Instruct v0.3) writes questions for each paragraph, plus rule-based queries from titles and definitions | |
| - each question gets a hard negative, a paragraph from another article that looks similar | |
| ~3000 training examples over +200 articles. MultipleNegativesRankingLoss, 2 epochs, batch 32, learning rate 2e-5, 73 minutes on a 4-core laptop CPU. | |
| ## Evaluation | |
| 60 hand-written and hand-checked questions, each with the articles that answer it. Scored per article. | |
| | | right article first | in top 3 | in top 5 | MRR@10 | | |
| |---|---|---|---|---| | |
| | base model | 0.667 | 0.833 | 0.867 | 0.750 | | |
| | grepac-e5-small | 0.717 | 0.900 | 0.900 | 0.797 | | |
| The test is too small to be conclusive: 11 questions improved and 8 got worse. Real searches from the site will be the next test set. | |
| ## License | |
| MIT, like the base model. Regulation texts: EUR-Lex, © European Union, reused under the Commission's reuse policy. | |