Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

JacobLinCool
/
embeddinggemma-2-multimodal-late-interaction

Feature Extraction
sentence-transformers
Safetensors
embedding_gemma2
multi-vector
late-interaction
colbert
meanmaxsim
multimodal
text
image
audio
embeddinggemma-2
matryoshka
Model card Files Files and versions
xet
Community

Instructions to use JacobLinCool/embeddinggemma-2-multimodal-late-interaction with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • sentence-transformers

    How to use JacobLinCool/embeddinggemma-2-multimodal-late-interaction with sentence-transformers:

    from sentence_transformers import MultiVectorEncoder
    
    model = MultiVectorEncoder("JacobLinCool/embeddinggemma-2-multimodal-late-interaction")
    
    queries = ["Which planet is known as the Red Planet?"]
    documents = [
    	"Venus is often called Earth's twin because of its similar size and proximity.",
    	"Mars, known for its reddish appearance, is often referred to as the Red Planet.",
    	"Jupiter, the largest planet in our solar system, has a prominent red spot.",
    ]
    
    query_embeddings = model.encode_query(queries)
    document_embeddings = model.encode_document(documents)
    
    similarities = model.similarity(query_embeddings, document_embeddings)
    print(similarities)
  • Notebooks
  • Google Colab
  • Kaggle
embeddinggemma-2-multimodal-late-interaction / evaluation_report /figures
1.04 MB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 2 commits
JacobLinCool's picture
JacobLinCool
Update to G4 Scale-Up checkpoint (B4-LI256: 87.40% Flickr8k R@1, 53.67% Clotho R@10, 81.45% SciFact nDCG@10)
2f79745 verified 21 days ago
  • length_bias_diagnostics.png
    360 kB
    xet
    Update to G4 Scale-Up checkpoint (B4-LI256: 87.40% Flickr8k R@1, 53.67% Clotho R@10, 81.45% SciFact nDCG@10) 21 days ago
  • main_comparison.png
    143 kB
    xet
    Update to G4 Scale-Up checkpoint (B4-LI256: 87.40% Flickr8k R@1, 53.67% Clotho R@10, 81.45% SciFact nDCG@10) 21 days ago
  • pareto_latency_recall.png
    191 kB
    xet
    Update to G4 Scale-Up checkpoint (B4-LI256: 87.40% Flickr8k R@1, 53.67% Clotho R@10, 81.45% SciFact nDCG@10) 21 days ago
  • training_loss_curves.png
    347 kB
    xet
    Update to G4 Scale-Up checkpoint (B4-LI256: 87.40% Flickr8k R@1, 53.67% Clotho R@10, 81.45% SciFact nDCG@10) 21 days ago