Sentence Similarity
sentence-transformers
Safetensors
bert
feature-extraction
Generated from Trainer
dataset_size:6300
loss:CachedMultipleNegativesRankingLoss
text-embeddings-inference
Instructions to use truong1301/bi-encode-HG-DOCS with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use truong1301/bi-encode-HG-DOCS with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("truong1301/bi-encode-HG-DOCS") sentences = [ "How can AnimateDiff, a motion adapter for pretrained diffusion models, be used to generate videos from images?", "Performs a single real input radix-2 transformation on the provided data Kind: instance method ofP2FFT The input data array The output data array The output offset The input offset The step", "AnimateDiffis an adapter model that inserts a motion module into a pretrained diffusion model to animate an image. The adapter is trained on video clips to learn motion which is used to condition the generation process to create a video. It is faster and easier to only train the adapter and it can be loaded into most diffusion models, effectively turning them into “video models”. Start by loading aMotionAdapter. Then load a finetuned Stable Diffusion model with theAnimateDiffPipeline. Create a prompt and generate the video.", "Utility class to handle streaming of tokens generated by whisper speech-to-text models. Callback functions are invoked when each of the following events occur: Kind: static class ofgeneration/streamers" ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [4, 4] - Notebooks
- Google Colab
- Kaggle
Download tokenizer_config.json from truong1301/bi-encode-HG-DOCS: direct link, hf CLI and curl.
- Browser
- Download file 1.46 kB
-
https://huggingface.co/truong1301/bi-encode-HG-DOCS/resolve/main/tokenizer_config.json
- Command line
-
hf download hf://truong1301/bi-encode-HG-DOCS/tokenizer_config.json
-
curl -L -o tokenizer_config.json https://huggingface.co/truong1301/bi-encode-HG-DOCS/resolve/main/tokenizer_config.json
1.46 kB
| { | |
| "added_tokens_decoder": { | |
| "0": { | |
| "content": "[PAD]", | |
| "lstrip": false, | |
| "normalized": false, | |
| "rstrip": false, | |
| "single_word": false, | |
| "special": true | |
| }, | |
| "100": { | |
| "content": "[UNK]", | |
| "lstrip": false, | |
| "normalized": false, | |
| "rstrip": false, | |
| "single_word": false, | |
| "special": true | |
| }, | |
| "101": { | |
| "content": "[CLS]", | |
| "lstrip": false, | |
| "normalized": false, | |
| "rstrip": false, | |
| "single_word": false, | |
| "special": true | |
| }, | |
| "102": { | |
| "content": "[SEP]", | |
| "lstrip": false, | |
| "normalized": false, | |
| "rstrip": false, | |
| "single_word": false, | |
| "special": true | |
| }, | |
| "103": { | |
| "content": "[MASK]", | |
| "lstrip": false, | |
| "normalized": false, | |
| "rstrip": false, | |
| "single_word": false, | |
| "special": true | |
| } | |
| }, | |
| "clean_up_tokenization_spaces": false, | |
| "cls_token": "[CLS]", | |
| "do_basic_tokenize": true, | |
| "do_lower_case": true, | |
| "extra_special_tokens": {}, | |
| "mask_token": "[MASK]", | |
| "max_length": 128, | |
| "model_max_length": 256, | |
| "never_split": null, | |
| "pad_to_multiple_of": null, | |
| "pad_token": "[PAD]", | |
| "pad_token_type_id": 0, | |
| "padding_side": "right", | |
| "sep_token": "[SEP]", | |
| "stride": 0, | |
| "strip_accents": null, | |
| "tokenize_chinese_chars": true, | |
| "tokenizer_class": "BertTokenizer", | |
| "truncation_side": "right", | |
| "truncation_strategy": "longest_first", | |
| "unk_token": "[UNK]" | |
| } | |