Zero-Shot Image Classification
Transformers
Safetensors
sentence-transformers
mllama
image-text-to-text
mmeb
text-generation-inference
Instructions to use intfloat/mmE5-mllama-11b-instruct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use intfloat/mmE5-mllama-11b-instruct with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("zero-shot-image-classification", model="intfloat/mmE5-mllama-11b-instruct") pipe( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/hub/parrots.png", candidate_labels=["animals", "humans", "landscape"], )# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("intfloat/mmE5-mllama-11b-instruct") model = AutoModelForMultimodalLM.from_pretrained("intfloat/mmE5-mllama-11b-instruct", device_map="auto") - sentence-transformers
How to use intfloat/mmE5-mllama-11b-instruct with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("intfloat/mmE5-mllama-11b-instruct") sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Notebooks
- Google Colab
- Kaggle
Commit History
-
Update custom_st.py
Verified signaturecbb328b -
align data format in demo with model training
e990ec5 -
remove unnecessary space before instruction
03bac29
-
Fix task tag (#4)
Verified signature- Fix task tag (428ded83059de880372f404382d07e6df59e30c1) Co-authored-by: Merve Noyan <merve@users.noreply.huggingface.co>993f09d
-
Update README.md
Verified signature354f8f3 -
Finalize Sentence Transformers integration (#3)
Verified signature- Finalize Sentence Transformers integration (501f1f440cb512754532cfa281332455bca94268) - Remove unneeded spaces before texts in image-text setups (211fa5c2e04bd58fd52324c6f57111a69e3037b0)4b9f4ca
-
Update README.md
71d439f -
Create custom_st.py (#2)
Verified signature- Upload README.md with huggingface_hub (d553fa4a69fefa90695ced98a56771ed8c23c647) - Create custom_st.py (d4b7753e4b68e46a1b04dbcae8965e24cc57054f) - Update custom_st.py (31932a6c194ac72e9188576ba1bc19132c13711d) - use only `<|image|>` (cbde83efa53606c8ab4326f31ea9ea4c737f39a9) - return `<|begin_of_text|>` (46f332ef39fac617a5736ffabc0733914b60b440) - remove `<|begin_of_text|>` (519b6b5cdf39e4437db4eea2c67f263892872bfe) - Update README.md (b620de43ac130d2c246b250e3d4a576f276a211e) - Update custom_st.py (7f44eb9c6998bd23545dcdba73c2518e4e4d69f2) Co-authored-by: Solomatin Roman <Samoed@users.noreply.huggingface.co>4c104a7 -
Set use_cache to false
078d6bc
-
Upload README.md with huggingface_hub
97fe6cd
-
Add correct pipeline tag (#1)
Verified signature- Add correct pipeline tag (cb0b730aec190fbd927e5d34827f5e716cb0ad52) Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co>5a522de
-
Add preprocessor_config.json
c713514
-
Upload folder using huggingface_hub
Verified signaturede9df37 -
Upload folder using huggingface_hub
Verified signature2c28206 -
initial commit
Verified signature2c32592