Instructions to use BAAI/llm-embedder with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use BAAI/llm-embedder with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="BAAI/llm-embedder")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("BAAI/llm-embedder") model = AutoModel.from_pretrained("BAAI/llm-embedder", device_map="auto") - Inference
- Notebooks
- Google Colab
- Kaggle
Commit History
-
Add exported onnx model 'model_O3.onnx'
Verified signatureHello! *This pull request has been automatically generated from the [`export_optimized_onnx_model`](https://sbert.net/docs/package_reference/util.html#sentence_transformers.backend.export_optimized_onnx_model) function from the Sentence Transformers library.* ## Config ```python OptimizationConfig( optimization_level=2, optimize_for_gpu=False, fp16=False, optimize_with_onnxruntime_only=None, enable_transformers_specific_optimizations=True, disable_gelu=None, disable_gelu_fusion=False, disable_layer_norm=None, disable_layer_norm_fusion=False, disable_attention=None, disable_attention_fusion=False, disable_skip_layer_norm=None, disable_skip_layer_norm_fusion=False, disable_bias_skip_layer_norm=None, disable_bias_skip_layer_norm_fusion=False, disable_bias_gelu=None, disable_bias_gelu_fusion=False, disable_embed_layer_norm=True, disable_embed_layer_norm_fusion=True, enable_gelu_approximation=True, use_mask_index=False, no_attention_mask=False, disable_shape_inferen…8730946
-
Adding `safetensors` variant of this model (#8)
- Adding `safetensors` variant of this model (a8ac50516d12b468a8ec7ccd06a2ad64d8e0e69a) Co-authored-by: Metal Whale <metalwhale@users.noreply.huggingface.co>c3e8ac8
-
Update README.md (#7)
- Update README.md (32cfcafcfdd5c16479bf9995da7e3db3d209630c) Co-authored-by: namespace-Pt <namespace-Pt@users.noreply.huggingface.co>b635676 -
Update README.md (#6)
- Update README.md (1661329696483c2d43fae5f241c862deaa8b9dc6) Co-authored-by: namespace-Pt <namespace-Pt@users.noreply.huggingface.co>31a500a
-
Update README.md (#4)
- Update README.md (c5a80429b472525af5f9bd6a5ff4f10ff4cf63b1) Co-authored-by: namespace-Pt <namespace-Pt@users.noreply.huggingface.co>f20d0dd
-
update
46636b5
-
upload
01fe9c0 -
initial commit
59ebfa5