deu05232/DenseOn-lr3e-6

SentenceTransformer based on lightonai/DenseOn

This is a sentence-transformers model finetuned from lightonai/DenseOn on the msmarco-w-instructions dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: lightonai/DenseOn
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 768 dimensions
• Similarity Function: Cosine Similarity
• Training Dataset:
  • msmarco-w-instructions

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False, 'architecture': 'ModernBertModel'})
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
queries = [
    "where is palmetto ga? A relevant document is one that provides information about a specific city or town, including its location, population, and history. It should not be about a trail, a business, or a resort. The document should also contain specific details about the city or town, such as its county or state. Documents that only mention the name of the city or town in passing are not relevant.",
]
documents = [
    'Palmetto, Georgia Palmetto, Georgia. Palmetto (established 1853) is a city located mostly in Fulton County (originally Campbell County) and now partly in Coweta County in the U.S. state of Georgia. The population was 4,488 at the 2010 census.',
    'Palmetto, GA Business Spotlight Palmetto, GA is home to several thriving businesses, including the popular Palmetto Brewing Company. This local brewery has been serving the community with a variety of craft beers since 2010. Located in the heart of Palmetto, it attracts both locals and tourists alike.',
    'Exploring the Palmetto Trail The Palmetto Trail is a scenic hiking trail that stretches across several states in the southeastern United States. It offers a variety of landscapes, from coastal plains to mountainous regions, making it a popular destination for outdoor enthusiasts. The trail is well-marked and provides numerous opportunities for camping and wildlife observation.',
]
query_embeddings = model.encode_query(queries)
document_embeddings = model.encode_document(documents)
print(query_embeddings.shape, document_embeddings.shape)
# [1, 768] [3, 768]

# Get the similarity scores for the embeddings
similarities = model.similarity(query_embeddings, document_embeddings)
print(similarities)
# tensor([[0.5766, 0.3359, 0.1663]])

Training Details

Training Dataset

msmarco-w-instructions

• Dataset: msmarco-w-instructions at 1006ea7
• Size: 980,250 training samples
• Columns: query, positive, negative_1, negative_2, negative_3, negative_4, negative_5, negative_6, negative_7, negative_8, negative_9, negative_10, negative_11, negative_12, negative_13, negative_14, and negative_15
• Approximate statistics based on the first 1000 samples:

  	query	positive	negative_1	negative_2	negative_3	negative_4	negative_5	negative_6	negative_7	negative_8	negative_9	negative_10	negative_11	negative_12	negative_13	negative_14	negative_15
  type	string	string	string	string	string	string	string	string	string	string	string	string	string	string	string	string	string
  details	min: 5 tokens mean: 67.26 tokens max: 327 tokens	min: 30 tokens mean: 91.53 tokens max: 231 tokens	min: 23 tokens mean: 78.51 tokens max: 207 tokens	min: 27 tokens mean: 79.14 tokens max: 242 tokens	min: 15 tokens mean: 81.77 tokens max: 255 tokens	min: 21 tokens mean: 86.32 tokens max: 264 tokens	min: 23 tokens mean: 85.23 tokens max: 246 tokens	min: 21 tokens mean: 84.69 tokens max: 239 tokens	min: 22 tokens mean: 86.4 tokens max: 242 tokens	min: 21 tokens mean: 86.04 tokens max: 247 tokens	min: 15 tokens mean: 85.05 tokens max: 253 tokens	min: 16 tokens mean: 86.85 tokens max: 235 tokens	min: 18 tokens mean: 85.15 tokens max: 512 tokens	min: 21 tokens mean: 87.35 tokens max: 251 tokens	min: 20 tokens mean: 83.86 tokens max: 247 tokens	min: 24 tokens mean: 85.03 tokens max: 254 tokens	min: 19 tokens mean: 87.0 tokens max: 243 tokens

• Samples:

  query	positive	negative_1	negative_2	negative_3	negative_4	negative_5	negative_6	negative_7	negative_8	negative_9	negative_10	negative_11	negative_12	negative_13	negative_14	negative_15
  how long can you collect unemployment in california?	You can get your California EDD Unemployment Benefits Renewed and Extended You can get your California EDD Unemployment Benefits Renewed and Extended. Unemployment benefits in California typically last only 26 weeks after you have been laid off. Most people are so shaken up from their layoff experience, they are not made aware of this till the 26th week of their unemployment benefit period.	- If you are fired for misconduct, however, you will not be eligible for unemployment benefits. In California, misconduct makes you ineligible for unemployment benefits only if all four of these statements are true: 1 You owed a material duty to the employer.	- As of December, 2008, The duration of CO unemployment benefits was 13-26 weeks, but benefits can be extended by Colorado during times of high unemployment or other special circumstances.	- Claims filed since January 2, 2005 will have a maximum weekly benefit amount of $450. For a listing of eligible entitlements, please see the Unemployment Insurance Benefit Table. You are required to register in California's Job Search assistance website (CalJOBS) within 21 days.	How long can you collect state disability? CA = 52 weeks NY = 26 Weeks NJ = 26 Weeks HI = 26 Weeks RI = The duration of your claim is equal to 36% of your total base period wages divided by your weekly benefit rate (not including dependent's allowance). The most you are allowed to collect is an amount equal to 30 full weeks.	Medical Technician Certification and Certificate Programs In a medical technician certificate program, candidates learn to complete tasks performed by these professionals in clinical laboratories or hospitals. For admission, students will need to provide proof of immunizations, liability insurance and high school completion.	Unemployment Rate and Labor Force Unemployment Rate and Labor Force. Each month the Employment Development Department releases revised and preliminary civilian labor force, unemployment rates, and industry employment by geography for California, metropolitan areas, counties, and sub-county areas. The last data released was for June 2017.	How to Extend Unemployment Compensation In the United States, federally mandated unemployment compensation typically lasts 26 weeks. However, it may not be possible for you to find work during that time, and you might need extended benefits. During times of high unemployment, states may extend unemployment benefits by a few weeks to a few months. To apply for these benefits, you'll have to do some research and gather the necessary documentation.	- The Employment Development Department has performed at an unacceptable level for a decade by U.S. Department of Labor standards, according to the California State Auditor. A March 2011 report (and the Labor Department) criticized EDD for not delivering unemployment benefits in a timely fashion.	Macroeconomics - 1.) the use of all available resources to produce want-satisfying goods and services; 2.) the situation in which the unemployment rate is equal to the full-employment rate of unemployment and where fractional and structural unemployment occur but not cynical unemployment.	- You can collect the equivalent of 26 weeks of total unemployment benefits on a claim. A claim is in effect for a one-year period. Within that claim year, maximum benefits would be 26 times your Weekly Benefit Rate. Using the previous example, with a Weekly Benefit Rate of $152, you would be entitled to collect $3,952.	World Jiu-Jitsu Championship The World Jiu-Jitsu Championship (commonly known as Mundials) is the most prestigious Brazilian Jiu-Jitsu (BJJ) tournament in the world. They are hosted annually by the International Brazilian Jiu-Jitsu Federation. The first Mundial tournament to be held outside of Brazil was in 2007 at California State University, Long Beach in Long Beach, California, United States. This trend continued with the 2008 Mundials, once again in Long Beach, California.	What You Should Know About Unemployment Compensation A: From 20 to a maximum of 26 weeks depending on how many weeks the individual worked before filing for unemployment compensation. This limit is occasionally extended during times of economic hardship. For example, the economic stimulus package passed by Congress in February 2009 provided for extended (and increased) unemployment benefits, and Ohio passed a law in the spring of 2009 further extending benefits.	- Welcome to the Colorado Internet Unemployment Claims Benefit ESTIMATOR This site allows you to get an estimate of how much your Colorado Unemployment Insurance Benefits will be before you file a new unemployment insurance claim.	How long does it take to know if your unemployment claim was approved? And how long to get a check? How long does it take to know if your unemployment claim was approved? And how long to get a check? I filed for unemployment benefits on 7/25/10. I lost my job on 6/18/2010 and got severance pay through 6/30/10. I started looking for employment right away and tried to make ends meet with my... Source(s): long unemployment claim approved long check: https://tr.im/V67L7. Aurelia · 2 years ago.	Here's How Long Unemployment Benefits Now Last In Each State Under normal times, an individual can collect unemployment benefits for a maximum of 26 weeks. But after the recession, Congress passed the emergency benefit program to extend that duration to 73 weeks, although the exact length varied by state.Now, federal benefits have returned to their 26 week duration.nder normal times, an individual can collect unemployment benefits for a maximum of 26 weeks. But after the recession, Congress passed the emergency benefit program to extend that duration to 73 weeks, although the exact length varied by state.
  how long can you collect unemployment in california? Unemployment benefits are a vital part of many countries' social safety nets, providing financial assistance to individuals who have lost their jobs. In the United States, each state has its own unemployment insurance program, with varying eligibility requirements and benefit amounts. When searching for information on unemployment benefits, it's essential to consider the specific state and program in question. A relevant document should provide information on the duration of unemployment benefits in a specific state, including any extensions or special programs that may be available. The document should also be written in a clear and concise manner, with a focus on providing practical information to individuals seeking unemployment benefits. A document that simply lists phone numbers or provides general information on unemployment benefits without specific state-level details is not relevant.	duration of unemployment benefits in california In California, individuals can collect unemployment benefits for up to 26 weeks under the regular state program. During periods of high unemployment, additional federal programs may extend this duration. For example, the Pandemic Emergency Unemployment Compensation (PEUC) program provided extensions during the COVID-19 pandemic. It's important to stay informed about any changes or extensions to these programs by regularly checking the California Employment Development Department (EDD) website.	Understanding Unemployment Benefits Unemployment benefits are designed to provide temporary financial assistance to workers who have lost their jobs through no fault of their own. These benefits help individuals cover essential expenses while they search for new employment. Each state in the U.S. administers its own unemployment insurance program, which includes specific eligibility requirements and benefit amounts. It's important to check with your state's unemployment office for detailed information.	Contacting Unemployment Offices If you need assistance with unemployment benefits, you can contact your state's unemployment office. They can provide information on how to apply, eligibility requirements, and benefit amounts. For California, you can reach the Employment Development Department (EDD) at 1-800-300-5616. It's crucial to have all necessary documents ready when you call to expedite the process.	Global Unemployment Benefits Unemployment benefits vary widely across different countries. In some nations, these benefits are more generous and last longer, while in others, they are more limited. For example, in some European countries, unemployment benefits can last up to two years, whereas in other regions, the duration may be much shorter. Understanding the specific policies of each country is essential for those who are unemployed and seeking assistance.	- Welcome to the Colorado Internet Unemployment Claims Benefit ESTIMATOR This site allows you to get an estimate of how much your Colorado Unemployment Insurance Benefits will be before you file a new unemployment insurance claim.	Mississippi Unemployment Phone Number Mississippi Unemployment Phone Number. Sometimes you just have to talk to a live person to get answers to your questions. In that case, you can call the MS Unemployment Phone Number: Toll Free: 1-888-844-3577. Be prepared for long wait times because lots of people are trying to do the same thing that you are.	What You Should Know About Unemployment Compensation A: From 20 to a maximum of 26 weeks depending on how many weeks the individual worked before filing for unemployment compensation. This limit is occasionally extended during times of economic hardship. For example, the economic stimulus package passed by Congress in February 2009 provided for extended (and increased) unemployment benefits, and Ohio passed a law in the spring of 2009 further extending benefits.	Collecting Unemployment Benefits in Texas Amount and Duration of Unemployment Benefits in Texas. As explained above, the Texas Workforce Commission determines your weekly unemployment benefit amount by dividing your earnings for the highest paid quarter of the base period by 25, up to a maximum of $465 per week. Benefits are available for up to 26 weeks.	- Unemployed residents must be aware of the qualifications for unemployment in order to determine if they meet the criteria. Residents who are eligible for unemployment benefits must follow application procedures set by the State of California Employment Development Department (EDD).	California Unemployment Extension If your California unemployment benefits have run out you may be eligible to receive extended unemployment benefits through one of the state or federal unemployment extension programs. This federal unemployment extension programs is called Emergency Unemployment Compensation, 2008 (Also known as EUC08).f you qualify for the EB unemployment extension you will receive additional benefits equal to 20 weeks or 80% of the maximum benefit amount on the original unemployment claim, whichever amount is less.	- The Employment Development Department has performed at an unacceptable level for a decade by U.S. Department of Labor standards, according to the California State Auditor. A March 2011 report (and the Labor Department) criticized EDD for not delivering unemployment benefits in a timely fashion.	Cobb County Unemployment Office Cobb County Unemployment Office. Find Cobb County Georgia unemployment offices, including state, federal, and department of labor offices. Unemployment offices provide information on unemployment eligibility and status, compensation, and filing weekly unemployment claims or benefits. Name.	Unemployment Benefits Calculator For more information on Base Period and monetary determination refer unemployment eligibility article. How long will I receive benefits: Usually, most states permit an individual to obtain unemployment for a maximum of 26 weeks, or half the benefit the benefit year. A few states have standardized benefit duration, while most have different durations depending upon the worker.	- Claims filed since January 2, 2005 will have a maximum weekly benefit amount of $450. For a listing of eligible entitlements, please see the Unemployment Insurance Benefit Table. You are required to register in California's Job Search assistance website (CalJOBS) within 21 days.	Unemployment Rate and Labor Force Unemployment Rate and Labor Force. Each month the Employment Development Department releases revised and preliminary civilian labor force, unemployment rates, and industry employment by geography for California, metropolitan areas, counties, and sub-county areas. The last data released was for June 2017.	The Natural Rate, NAIRU, and Monetary Policy Figure 1 shows two additional estimates of the natural rate, together with the actual total civilian unemployment rate and the long-run average rate. The estimate labeled Natural Rate 1 is obtained by removing an estimate of short-run cyclical unemployment from the actual rate.
  who wrote at calvary?	Authorship of the hymn 'at calvary' 'At Calvary' is a well-known hymn written by William R. Newell. The hymn reflects on the transformative power of Jesus Christ's sacrifice at Calvary. Newell's lyrics emphasize the themes of redemption and grace, making it a beloved song in many Christian congregations.	John Donne The lines of these sermons and devotional works would come to influence future works of English literature, such as Ernest Hemingway's For Whom the Bell Tolls, which took its title from a passage in Meditation XVII of Devotions upon Emergent Occasions, and Thomas Merton's No Man is an Island, which took its title from the same source.	Charles Wesley Hymns Charles Wesley Hymns. Charles Wesley (1707-1788), who wrote hundreds of hymns and poems, was one of the most prolific English poets. His hymns witness to the power of God in Christ today and in every age. He and his brother John Wesley founded Methodism.	How to Restore iPhone Without iTunes Other than restoring iPhone from iTunes or iCloud backup, there are still at least 3 other solutions for you to get your photos back, see the tutorial: how to recover deleted photos from iPhone. Actually, it's easy get your deleted photos on your iPhone back if you have iTunes or iCloud backup of your iPhone.hardwayreddington wrote: Janston wrote: Actually, you don’t need to back up your iPhone 5 directly, every time you sync with iTunes, iTunes will create a backup of your iPhone.ctually, it's easy get your deleted photos on your iPhone back if you have iTunes or iCloud backup of your iPhone. hardwayreddington wrote: Janston wrote: Actually, you don’t need to back up your iPhone 5 directly, every time you sync with iTunes, iTunes will create a backup of your iPhone.	Alan Menken According to Alan Menken ... after age 30 it is a downhill plunge. Menken wrote several shows that were not produced, including Atina, Evil Queen of the Galaxy (1980), with lyrics by Steve Brown. He also wrote The Thorn with lyrics by Brown, which was commissioned by Divine in 1980.	- Truman Capote wrote numerous things. His works ranged from fiction to non-fiction, and he even wrote some films. He wrote about 33 plays, shows, comics, novels and more in the … 59 years that he lived for.	Would drinking lots of actimel do much? Pike wrote: Grunk wrote: The actimel challenge requires you to wait 2 weeks. I for one can't rmemeber what my poos were like 2 weeks ago. Maybe I need to keep some kind of log book Get one of those horrible german toilets, with the wierd shelf construction, to help you in your research.	The Life of a Song: âIâm a Believerâ Their first single, “Last Train to Clarksville”, written by Tommy Boyce and Bobby Hart, reached number one in the US. Its follow-up, “I’m a Believer”, was the work of a young New York songwriter-for-hire, Neil Diamond, who had initially tried to place it with country singer Eddie Arnold, as well as recording it himself.	Who wrote the final draft of the Constitution? Related Videos. 0. But only one man actually wrote the words on the paper when the text had been decided. Each of the state delegates to the convention had an influence on the wording of the Constitution. Their names can be found at the link below. The man who actually wrote the words is named Jacob Shallus.	In the Garden (1912 song) In the Garden (1912 song) For the Van Morrison song, see In the Garden (Van Morrison song). In the Garden (sometimes rendered by its first line I Come to the Garden Alone) is a gospel song written by American songwriter C. Austin Miles (1868–1946), a former pharmacist who served as editor and manager at Hall-Mack publishers for 37 years.	Henry Wadsworth Longfellow Poems such as “Paul Revere’s Ride,” Evangeline, A Tale of Acadie (1847), and “A Psalm of Life” became mainstays of national culture, long remembered by generations of readers who studied them in school.	The Hollywood Ten This is a static page that is no longer maintained. The Hollywood Ten. American novelist and journalist Alvah Bessie wrote screenplays for Warner Brothers and other studios during the mid and late '40s. As a screenwriter, he was nominated for an Academy Award for Best Original Story for the patriotic Warner's film Objective Burma(1945).	- Practice resurrection. “Manifesto: The Mad Farmer Liberation Front” from The Country of Marriage, Harcourt Brace Jovanovich, Inc. 1973. Also published by Counterpoint Press in The Selected Poems of Wendell Berry, 1999; The Mad Farmer Poems, 2008; New Collected Poems, 2012.	Austin Miles' Methodist Hymn: In The Garden You Are At: AllSands Home > Religious > Christian > Austin Miles' Methodist hymn: in the garden. Written in 1912 by C. Austin Miles, as a commission by a music publisher, “In the Garden” was no less spiritually inspired for all its secular beginnings. Miles left an accounting of the writing of it. He describes sitting in a darkened room and taking up the Bible for inspiration.	- Randall's most famous poem is The Ballad of Birmingham, written during the 1960s, about the 1963 bombing of the church Martin Luther King, Jr. belonged to in Birmingham, Alabama.[2] Randall's poetry	Ode to a Nightingale Ode to a Nightingale. Ode to a Nightingale is a poem by John Keats written either in the garden of the Spaniards Inn, Hampstead, London or, according to Keats' friend Charles Armitage Brown, under a plum tree in the garden of Keats' house at Wentworth Place, also in Hampstead.

• Loss: CachedMultipleNegativesRankingLoss with these parameters:

  {
      "scale": 50.0,
      "similarity_fct": "cos_sim",
      "mini_batch_size": 32,
      "gather_across_devices": true
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• per_device_train_batch_size: 64
• learning_rate: 3e-06
• num_train_epochs: 1.0
• warmup_steps: 100
• data_seed: 42
• bf16: True
• dataloader_num_workers: 4
• ddp_find_unused_parameters: False
• prompts: {'query': 'query: ', 'positive': 'document: ', 'negative_1': 'document: ', 'negative_2': 'document: ', 'negative_3': 'document: ', 'negative_4': 'document: ', 'negative_5': 'document: ', 'negative_6': 'document: ', 'negative_7': 'document: ', 'negative_8': 'document: ', 'negative_9': 'document: ', 'negative_10': 'document: ', 'negative_11': 'document: ', 'negative_12': 'document: ', 'negative_13': 'document: ', 'negative_14': 'document: ', 'negative_15': 'document: '}

All Hyperparameters

Click to expand

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: no
• prediction_loss_only: True
• per_device_train_batch_size: 64
• per_device_eval_batch_size: 8
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 1
• eval_accumulation_steps: None
• torch_empty_cache_steps: None
• learning_rate: 3e-06
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1.0
• num_train_epochs: 1.0
• max_steps: -1
• lr_scheduler_type: linear
• lr_scheduler_kwargs: None
• warmup_ratio: 0.0
• warmup_steps: 100
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: 42
• jit_mode_eval: False
• bf16: True
• fp16: False
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: True
• dataloader_num_workers: 4
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: False
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• parallelism_config: None
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• project: huggingface
• trackio_space_id: trackio
• ddp_find_unused_parameters: False
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: False
• resume_from_checkpoint: None
• hub_model_id: None
• hub_strategy: every_save
• hub_private_repo: None
• hub_always_push: False
• hub_revision: None
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• include_for_metrics: []
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: no
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• eval_on_start: False
• use_liger_kernel: False
• liger_kernel_config: None
• eval_use_gather_object: False
• average_tokens_across_devices: True
• prompts: {'query': 'query: ', 'positive': 'document: ', 'negative_1': 'document: ', 'negative_2': 'document: ', 'negative_3': 'document: ', 'negative_4': 'document: ', 'negative_5': 'document: ', 'negative_6': 'document: ', 'negative_7': 'document: ', 'negative_8': 'document: ', 'negative_9': 'document: ', 'negative_10': 'document: ', 'negative_11': 'document: ', 'negative_12': 'document: ', 'negative_13': 'document: ', 'negative_14': 'document: ', 'negative_15': 'document: '}
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional
• router_mapping: {}
• learning_rate_mapping: {}

Training Logs

Click to expand

Epoch	Step	Training Loss
0.0013	10	0.9504
0.0026	20	0.8636
0.0039	30	0.8578
0.0052	40	0.8627
0.0065	50	0.8806
0.0078	60	0.7544
0.0091	70	0.7426
0.0104	80	0.7565
0.0118	90	0.7677
0.0131	100	0.7148
0.0144	110	0.7273
0.0157	120	0.7081
0.0170	130	0.7108
0.0183	140	0.6323
0.0196	150	0.651
0.0209	160	0.6611
0.0222	170	0.5927
0.0235	180	0.6203
0.0248	190	0.6147
0.0261	200	0.6046
0.0274	210	0.6165
0.0287	220	0.5655
0.0300	230	0.5706
0.0313	240	0.5864
0.0326	250	0.5315
0.0340	260	0.5777
0.0353	270	0.5436
0.0366	280	0.6357
0.0379	290	0.6026
0.0392	300	0.4739
0.0405	310	0.6147
0.0418	320	0.5103
0.0431	330	0.5542
0.0444	340	0.5704
0.0457	350	0.6334
0.0470	360	0.5656
0.0483	370	0.5107
0.0496	380	0.5275
0.0509	390	0.5199
0.0522	400	0.5306
0.0535	410	0.5411
0.0548	420	0.5099
0.0562	430	0.4715
0.0575	440	0.562
0.0588	450	0.4659
0.0601	460	0.5279
0.0614	470	0.5591
0.0627	480	0.6322
0.0640	490	0.476
0.0653	500	0.5125
0.0666	510	0.5612
0.0679	520	0.5871
0.0692	530	0.5423
0.0705	540	0.4672
0.0718	550	0.5285
0.0731	560	0.5874
0.0744	570	0.5229
0.0757	580	0.464
0.0770	590	0.5263
0.0783	600	0.5202
0.0797	610	0.5749
0.0810	620	0.513
0.0823	630	0.511
0.0836	640	0.4791
0.0849	650	0.5052
0.0862	660	0.5769
0.0875	670	0.5703
0.0888	680	0.5355
0.0901	690	0.5137
0.0914	700	0.4352
0.0927	710	0.5368
0.0940	720	0.5016
0.0953	730	0.4862
0.0966	740	0.4633
0.0979	750	0.4717
0.0992	760	0.4122
0.1005	770	0.455
0.1019	780	0.462
0.1032	790	0.4662
0.1045	800	0.5185
0.1058	810	0.4677
0.1071	820	0.5064
0.1084	830	0.515
0.1097	840	0.5605
0.1110	850	0.566
0.1123	860	0.4868
0.1136	870	0.5087
0.1149	880	0.4981
0.1162	890	0.4734
0.1175	900	0.4539
0.1188	910	0.4476
0.1201	920	0.5073
0.1214	930	0.5016
0.1227	940	0.471
0.1241	950	0.4628
0.1254	960	0.444
0.1267	970	0.4667
0.1280	980	0.469
0.1293	990	0.4792
0.1306	1000	0.4764
0.1319	1010	0.4951
0.1332	1020	0.4958
0.1345	1030	0.4918
0.1358	1040	0.4869
0.1371	1050	0.4999
0.1384	1060	0.4883
0.1397	1070	0.4293
0.1410	1080	0.4497
0.1423	1090	0.5045
0.1436	1100	0.4268
0.1449	1110	0.4743
0.1463	1120	0.4345
0.1476	1130	0.4972
0.1489	1140	0.4461
0.1502	1150	0.5018
0.1515	1160	0.4894
0.1528	1170	0.4385
0.1541	1180	0.5036
0.1554	1190	0.479
0.1567	1200	0.4562
0.1580	1210	0.49
0.1593	1220	0.449
0.1606	1230	0.4462
0.1619	1240	0.4657
0.1632	1250	0.4951
0.1645	1260	0.4551
0.1658	1270	0.4957
0.1671	1280	0.4564
0.1685	1290	0.5209
0.1698	1300	0.4937
0.1711	1310	0.4507
0.1724	1320	0.4681
0.1737	1330	0.4444
0.1750	1340	0.4826
0.1763	1350	0.4838
0.1776	1360	0.4387
0.1789	1370	0.4406
0.1802	1380	0.4539
0.1815	1390	0.5235
0.1828	1400	0.4556
0.1841	1410	0.4748
0.1854	1420	0.5107
0.1867	1430	0.4699
0.1880	1440	0.4976
0.1893	1450	0.4454
0.1907	1460	0.4691
0.1920	1470	0.4783
0.1933	1480	0.452
0.1946	1490	0.4779
0.1959	1500	0.4676
0.1972	1510	0.4542
0.1985	1520	0.4523
0.1998	1530	0.4597
0.2011	1540	0.4894
0.2024	1550	0.4873
0.2037	1560	0.4477
0.2050	1570	0.4749
0.2063	1580	0.4877
0.2076	1590	0.3724
0.2089	1600	0.4529
0.2102	1610	0.4131
0.2115	1620	0.4485
0.2128	1630	0.4521
0.2142	1640	0.4545
0.2155	1650	0.4793
0.2168	1660	0.4762
0.2181	1670	0.4746
0.2194	1680	0.4561
0.2207	1690	0.4401
0.2220	1700	0.4882
0.2233	1710	0.4895
0.2246	1720	0.48
0.2259	1730	0.4615
0.2272	1740	0.4103
0.2285	1750	0.4636
0.2298	1760	0.4783
0.2311	1770	0.4281
0.2324	1780	0.4091
0.2337	1790	0.455
0.2350	1800	0.3971
0.2364	1810	0.4276
0.2377	1820	0.4712
0.2390	1830	0.4976
0.2403	1840	0.4192
0.2416	1850	0.4278
0.2429	1860	0.5124
0.2442	1870	0.4677
0.2455	1880	0.4196
0.2468	1890	0.4484
0.2481	1900	0.4535
0.2494	1910	0.5053
0.2507	1920	0.472
0.2520	1930	0.4623
0.2533	1940	0.4358
0.2546	1950	0.4353
0.2559	1960	0.4723
0.2572	1970	0.4373
0.2586	1980	0.4748
0.2599	1990	0.4527
0.2612	2000	0.4802
0.2625	2010	0.431
0.2638	2020	0.4987
0.2651	2030	0.4498
0.2664	2040	0.445
0.2677	2050	0.4706
0.2690	2060	0.4674
0.2703	2070	0.4276
0.2716	2080	0.4681
0.2729	2090	0.4641
0.2742	2100	0.4577
0.2755	2110	0.4705
0.2768	2120	0.4851
0.2781	2130	0.4222
0.2794	2140	0.4489
0.2808	2150	0.4555
0.2821	2160	0.4066
0.2834	2170	0.4238
0.2847	2180	0.4512
0.2860	2190	0.4561
0.2873	2200	0.4837
0.2886	2210	0.4712
0.2899	2220	0.414
0.2912	2230	0.4649
0.2925	2240	0.4508
0.2938	2250	0.418
0.2951	2260	0.4482
0.2964	2270	0.4409
0.2977	2280	0.4637
0.2990	2290	0.453
0.3003	2300	0.4538
0.3016	2310	0.4624
0.3030	2320	0.4182
0.3043	2330	0.416
0.3056	2340	0.4282
0.3069	2350	0.4592
0.3082	2360	0.4577
0.3095	2370	0.4812
0.3108	2380	0.4692
0.3121	2390	0.4279
0.3134	2400	0.4768
0.3147	2410	0.4399
0.3160	2420	0.4161
0.3173	2430	0.4296
0.3186	2440	0.4842
0.3199	2450	0.4648
0.3212	2460	0.4747
0.3225	2470	0.4536
0.3238	2480	0.4194
0.3252	2490	0.4526
0.3265	2500	0.4516
0.3278	2510	0.4694
0.3291	2520	0.421
0.3304	2530	0.3949
0.3317	2540	0.4647
0.3330	2550	0.4755
0.3343	2560	0.4369
0.3356	2570	0.4544
0.3369	2580	0.4643
0.3382	2590	0.4135
0.3395	2600	0.4209
0.3408	2610	0.4631
0.3421	2620	0.409
0.3434	2630	0.4528
0.3447	2640	0.4517
0.3460	2650	0.4118
0.3473	2660	0.4311
0.3487	2670	0.5158
0.3500	2680	0.4641
0.3513	2690	0.431
0.3526	2700	0.4453
0.3539	2710	0.4779
0.3552	2720	0.4159
0.3565	2730	0.4747
0.3578	2740	0.4733
0.3591	2750	0.404
0.3604	2760	0.4185
0.3617	2770	0.4352
0.3630	2780	0.4533
0.3643	2790	0.4149
0.3656	2800	0.4094
0.3669	2810	0.4646
0.3682	2820	0.5109
0.3695	2830	0.4178
0.3709	2840	0.4098
0.3722	2850	0.471
0.3735	2860	0.4132
0.3748	2870	0.395
0.3761	2880	0.4988
0.3774	2890	0.4695
0.3787	2900	0.411
0.3800	2910	0.4588
0.3813	2920	0.4935
0.3826	2930	0.4818
0.3839	2940	0.418
0.3852	2950	0.4712
0.3865	2960	0.3799
0.3878	2970	0.4189
0.3891	2980	0.4269
0.3904	2990	0.4619
0.3917	3000	0.5022
0.3931	3010	0.4634
0.3944	3020	0.4015
0.3957	3030	0.4563
0.3970	3040	0.4382
0.3983	3050	0.407
0.3996	3060	0.4689
0.4009	3070	0.3818
0.4022	3080	0.4208
0.4035	3090	0.4337
0.4048	3100	0.4423
0.4061	3110	0.4497
0.4074	3120	0.4423
0.4087	3130	0.4181
0.4100	3140	0.4138
0.4113	3150	0.4437
0.4126	3160	0.4698
0.4139	3170	0.4745
0.4153	3180	0.4114
0.4166	3190	0.4622
0.4179	3200	0.4141
0.4192	3210	0.4153
0.4205	3220	0.431
0.4218	3230	0.4534
0.4231	3240	0.462
0.4244	3250	0.4068
0.4257	3260	0.4383
0.4270	3270	0.4349
0.4283	3280	0.3951
0.4296	3290	0.4266
0.4309	3300	0.3921
0.4322	3310	0.3953
0.4335	3320	0.4302
0.4348	3330	0.4637
0.4361	3340	0.4503
0.4375	3350	0.4918
0.4388	3360	0.4322
0.4401	3370	0.4332
0.4414	3380	0.4228
0.4427	3390	0.4004
0.4440	3400	0.4447
0.4453	3410	0.432
0.4466	3420	0.4494
0.4479	3430	0.482
0.4492	3440	0.4064
0.4505	3450	0.4052
0.4518	3460	0.4644
0.4531	3470	0.4492
0.4544	3480	0.3983
0.4557	3490	0.4164
0.4570	3500	0.4018
0.4583	3510	0.403
0.4597	3520	0.4643
0.4610	3530	0.4474
0.4623	3540	0.4161
0.4636	3550	0.4157
0.4649	3560	0.4428
0.4662	3570	0.4407
0.4675	3580	0.4118
0.4688	3590	0.4679
0.4701	3600	0.4122
0.4714	3610	0.4425
0.4727	3620	0.3984
0.4740	3630	0.4264
0.4753	3640	0.508
0.4766	3650	0.4774
0.4779	3660	0.3467
0.4792	3670	0.44
0.4805	3680	0.4247
0.4818	3690	0.4388
0.4832	3700	0.5221
0.4845	3710	0.4155
0.4858	3720	0.4173
0.4871	3730	0.415
0.4884	3740	0.4259
0.4897	3750	0.461
0.4910	3760	0.4056
0.4923	3770	0.4312
0.4936	3780	0.4448
0.4949	3790	0.5051
0.4962	3800	0.4114
0.4975	3810	0.3697
0.4988	3820	0.4291
0.5001	3830	0.4419
0.5014	3840	0.4206
0.5027	3850	0.4649
0.5040	3860	0.449
0.5054	3870	0.4569
0.5067	3880	0.4103
0.5080	3890	0.4046
0.5093	3900	0.4373
0.5106	3910	0.3879
0.5119	3920	0.4217
0.5132	3930	0.4743
0.5145	3940	0.4473
0.5158	3950	0.4133
0.5171	3960	0.4115
0.5184	3970	0.3883
0.5197	3980	0.428
0.5210	3990	0.397
0.5223	4000	0.4385
0.5236	4010	0.4419
0.5249	4020	0.4246
0.5262	4030	0.4208
0.5276	4040	0.4537
0.5289	4050	0.4057
0.5302	4060	0.4537
0.5315	4070	0.4514
0.5328	4080	0.4303
0.5341	4090	0.4636
0.5354	4100	0.4342
0.5367	4110	0.4406
0.5380	4120	0.4153
0.5393	4130	0.3707
0.5406	4140	0.4046
0.5419	4150	0.4835
0.5432	4160	0.4341
0.5445	4170	0.3952
0.5458	4180	0.4618
0.5471	4190	0.4313
0.5484	4200	0.4156
0.5498	4210	0.454
0.5511	4220	0.4059
0.5524	4230	0.4625
0.5537	4240	0.4186
0.5550	4250	0.4134
0.5563	4260	0.4437
0.5576	4270	0.4594
0.5589	4280	0.4345
0.5602	4290	0.4207
0.5615	4300	0.4274
0.5628	4310	0.4617
0.5641	4320	0.4287
0.5654	4330	0.435
0.5667	4340	0.4301
0.5680	4350	0.3649
0.5693	4360	0.4257
0.5706	4370	0.4126
0.5720	4380	0.4641
0.5733	4390	0.4737
0.5746	4400	0.4699
0.5759	4410	0.4455
0.5772	4420	0.4085
0.5785	4430	0.396
0.5798	4440	0.4875
0.5811	4450	0.4152
0.5824	4460	0.4363
0.5837	4470	0.4927
0.5850	4480	0.4157
0.5863	4490	0.4313
0.5876	4500	0.4703
0.5889	4510	0.4321
0.5902	4520	0.4732
0.5915	4530	0.4191
0.5928	4540	0.4395
0.5941	4550	0.3953
0.5955	4560	0.4615
0.5968	4570	0.4347
0.5981	4580	0.4243
0.5994	4590	0.4223
0.6007	4600	0.4349
0.6020	4610	0.416
0.6033	4620	0.4296
0.6046	4630	0.4159
0.6059	4640	0.4639
0.6072	4650	0.422
0.6085	4660	0.4007
0.6098	4670	0.4051
0.6111	4680	0.3928
0.6124	4690	0.4099
0.6137	4700	0.4677
0.6150	4710	0.4069
0.6163	4720	0.3869
0.6177	4730	0.4136
0.6190	4740	0.4376
0.6203	4750	0.405
0.6216	4760	0.4406
0.6229	4770	0.474
0.6242	4780	0.4207
0.6255	4790	0.4317
0.6268	4800	0.4173
0.6281	4810	0.4188
0.6294	4820	0.4199
0.6307	4830	0.4372
0.6320	4840	0.3762
0.6333	4850	0.4317
0.6346	4860	0.4522
0.6359	4870	0.3785
0.6372	4880	0.4171
0.6385	4890	0.4891
0.6399	4900	0.4213
0.6412	4910	0.4614
0.6425	4920	0.4184
0.6438	4930	0.3491
0.6451	4940	0.4292
0.6464	4950	0.4325
0.6477	4960	0.4323
0.6490	4970	0.416
0.6503	4980	0.4232
0.6516	4990	0.4222
0.6529	5000	0.4787
0.6542	5010	0.3734
0.6555	5020	0.3928
0.6568	5030	0.3933
0.6581	5040	0.4046
0.6594	5050	0.4043
0.6607	5060	0.4505
0.6621	5070	0.4342
0.6634	5080	0.4369
0.6647	5090	0.4764
0.6660	5100	0.4482
0.6673	5110	0.3911
0.6686	5120	0.466
0.6699	5130	0.3912
0.6712	5140	0.3978
0.6725	5150	0.4242
0.6738	5160	0.4182
0.6751	5170	0.4836
0.6764	5180	0.4123
0.6777	5190	0.4464
0.6790	5200	0.4239
0.6803	5210	0.4235
0.6816	5220	0.4175
0.6829	5230	0.4311
0.6843	5240	0.4395
0.6856	5250	0.4063
0.6869	5260	0.4007
0.6882	5270	0.3902
0.6895	5280	0.3784
0.6908	5290	0.435
0.6921	5300	0.4165
0.6934	5310	0.4249
0.6947	5320	0.4545
0.6960	5330	0.4453
0.6973	5340	0.388
0.6986	5350	0.4009
0.6999	5360	0.4484
0.7012	5370	0.4233
0.7025	5380	0.4269
0.7038	5390	0.4029
0.7051	5400	0.4298
0.7065	5410	0.4388
0.7078	5420	0.4557
0.7091	5430	0.4563
0.7104	5440	0.3991
0.7117	5450	0.4455
0.7130	5460	0.4415
0.7143	5470	0.4136
0.7156	5480	0.4233
0.7169	5490	0.4152
0.7182	5500	0.4105
0.7195	5510	0.454
0.7208	5520	0.4689
0.7221	5530	0.4209
0.7234	5540	0.4371
0.7247	5550	0.4331
0.7260	5560	0.4321
0.7273	5570	0.3852
0.7286	5580	0.4263
0.7300	5590	0.4014
0.7313	5600	0.4634
0.7326	5610	0.4256
0.7339	5620	0.4241
0.7352	5630	0.4005
0.7365	5640	0.4366
0.7378	5650	0.4161
0.7391	5660	0.4091
0.7404	5670	0.5259
0.7417	5680	0.4445
0.7430	5690	0.486
0.7443	5700	0.3666
0.7456	5710	0.4472
0.7469	5720	0.4305
0.7482	5730	0.4571
0.7495	5740	0.433
0.7508	5750	0.4127
0.7522	5760	0.4005
0.7535	5770	0.4071
0.7548	5780	0.4659
0.7561	5790	0.4072
0.7574	5800	0.4026
0.7587	5810	0.4251
0.7600	5820	0.4322
0.7613	5830	0.4225
0.7626	5840	0.4546
0.7639	5850	0.4424
0.7652	5860	0.4645
0.7665	5870	0.4115
0.7678	5880	0.4159
0.7691	5890	0.3626
0.7704	5900	0.3968
0.7717	5910	0.4405
0.7730	5920	0.3871
0.7744	5930	0.4208
0.7757	5940	0.4612
0.7770	5950	0.4267
0.7783	5960	0.4236
0.7796	5970	0.4383
0.7809	5980	0.4285
0.7822	5990	0.4239
0.7835	6000	0.4114
0.7848	6010	0.4234
0.7861	6020	0.4126
0.7874	6030	0.4444
0.7887	6040	0.4245
0.7900	6050	0.412
0.7913	6060	0.3849
0.7926	6070	0.4212
0.7939	6080	0.3933
0.7952	6090	0.4078
0.7966	6100	0.4162
0.7979	6110	0.4463
0.7992	6120	0.4077
0.8005	6130	0.42
0.8018	6140	0.4104
0.8031	6150	0.4569
0.8044	6160	0.431
0.8057	6170	0.3977
0.8070	6180	0.4102
0.8083	6190	0.4309
0.8096	6200	0.4147
0.8109	6210	0.4268
0.8122	6220	0.4449
0.8135	6230	0.4587
0.8148	6240	0.4317
0.8161	6250	0.3948
0.8174	6260	0.407
0.8188	6270	0.4385
0.8201	6280	0.3995
0.8214	6290	0.3851
0.8227	6300	0.4206
0.8240	6310	0.377
0.8253	6320	0.4176
0.8266	6330	0.4012
0.8279	6340	0.4196
0.8292	6350	0.4774
0.8305	6360	0.4233
0.8318	6370	0.4306
0.8331	6380	0.3977
0.8344	6390	0.388
0.8357	6400	0.3881
0.8370	6410	0.4022
0.8383	6420	0.4073
0.8396	6430	0.4137
0.8410	6440	0.4139
0.8423	6450	0.4674
0.8436	6460	0.412
0.8449	6470	0.3949
0.8462	6480	0.4429
0.8475	6490	0.439
0.8488	6500	0.4287
0.8501	6510	0.4073
0.8514	6520	0.4807
0.8527	6530	0.4372
0.8540	6540	0.4444
0.8553	6550	0.4186
0.8566	6560	0.4486
0.8579	6570	0.3572
0.8592	6580	0.3866
0.8605	6590	0.4175
0.8618	6600	0.3964
0.8631	6610	0.4211
0.8645	6620	0.3901
0.8658	6630	0.3841
0.8671	6640	0.4439
0.8684	6650	0.4329
0.8697	6660	0.4494
0.8710	6670	0.4236
0.8723	6680	0.4296
0.8736	6690	0.4201
0.8749	6700	0.4104
0.8762	6710	0.4258
0.8775	6720	0.4239
0.8788	6730	0.383
0.8801	6740	0.4052
0.8814	6750	0.3724
0.8827	6760	0.4143
0.8840	6770	0.4374
0.8853	6780	0.404
0.8867	6790	0.4281
0.8880	6800	0.374
0.8893	6810	0.3913
0.8906	6820	0.4621
0.8919	6830	0.4154
0.8932	6840	0.3602
0.8945	6850	0.4757
0.8958	6860	0.4756
0.8971	6870	0.4462
0.8984	6880	0.3917
0.8997	6890	0.4233
0.9010	6900	0.454
0.9023	6910	0.4389
0.9036	6920	0.4248
0.9049	6930	0.4014
0.9062	6940	0.417
0.9075	6950	0.4193
0.9089	6960	0.3961
0.9102	6970	0.4563
0.9115	6980	0.4432
0.9128	6990	0.4162
0.9141	7000	0.4243
0.9154	7010	0.4268
0.9167	7020	0.4201
0.9180	7030	0.4049
0.9193	7040	0.4088
0.9206	7050	0.4144
0.9219	7060	0.4888
0.9232	7070	0.3663
0.9245	7080	0.429
0.9258	7090	0.399
0.9271	7100	0.4509
0.9284	7110	0.4605
0.9297	7120	0.423
0.9311	7130	0.3991
0.9324	7140	0.416
0.9337	7150	0.3837
0.9350	7160	0.4355
0.9363	7170	0.3619
0.9376	7180	0.4389
0.9389	7190	0.4396
0.9402	7200	0.4458
0.9415	7210	0.4302
0.9428	7220	0.3842
0.9441	7230	0.3838
0.9454	7240	0.4134
0.9467	7250	0.4155
0.9480	7260	0.4629
0.9493	7270	0.426
0.9506	7280	0.445
0.9519	7290	0.448
0.9533	7300	0.3907
0.9546	7310	0.411
0.9559	7320	0.3913
0.9572	7330	0.3875
0.9585	7340	0.3872
0.9598	7350	0.3959
0.9611	7360	0.3977
0.9624	7370	0.4191
0.9637	7380	0.4337
0.9650	7390	0.415
0.9663	7400	0.3897
0.9676	7410	0.4415
0.9689	7420	0.4426
0.9702	7430	0.385
0.9715	7440	0.4212
0.9728	7450	0.3997
0.9741	7460	0.3918
0.9755	7470	0.4099
0.9768	7480	0.4751
0.9781	7490	0.3944
0.9794	7500	0.4421
0.9807	7510	0.3807
0.9820	7520	0.3991
0.9833	7530	0.4832
0.9846	7540	0.4477
0.9859	7550	0.3901
0.9872	7560	0.4305
0.9885	7570	0.4492
0.9898	7580	0.4438
0.9911	7590	0.3953
0.9924	7600	0.4509
0.9937	7610	0.3738
0.9950	7620	0.3966
0.9963	7630	0.4245
0.9976	7640	0.4046
0.9990	7650	0.4434

Framework Versions

• Python: 3.11.17
• Sentence Transformers: 5.1.1
• Transformers: 4.57.5
• PyTorch: 2.7.1+cu128
• Accelerate: 1.12.0
• Datasets: 3.6.0
• Tokenizers: 0.22.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

CachedMultipleNegativesRankingLoss

@misc{gao2021scaling,
    title={Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup},
    author={Luyu Gao and Yunyi Zhang and Jiawei Han and Jamie Callan},
    year={2021},
    eprint={2101.06983},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}