onet-match / biencoder /README.md
BenjaminChan12's picture
Upload onet-match model bundle v0.3.0
b0ef25b verified
|
Raw History Blame Contribute Delete
40.4 kB
---
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- dense
- generated_from_trainer
- dataset_size:86430
- loss:MultipleNegativesRankingLoss
base_model: BAAI/bge-base-en-v1.5
widget:
- source_sentence: Order supplies.
sentences:
- 'Barbers. Provide barbering services, such as cutting, trimming, shampooing, and
styling hair; trimming beards; or giving shaves. Tasks: Clean and sterilize scissors,
combs, clippers, and other instruments. Question patrons regarding desired services
and haircut styles. Drape and pin protective cloths around customers'' shoulders.
Apply lather and shave beards or neck and temple hair contours, using razors.
Shape and trim beards and moustaches, using scissors. Perform clerical and administrative
duties such as keeping records, paying bills, and hiring and supervising personnel.
Keep card files on clientele, recording notes of work done, products used and
fees charged after each visit. Stay informed of the latest styles and hair care
techniques. Shampoo hair. Order supplies.'
- 'Food Servers, Nonrestaurant. Serve food to individuals outside of a restaurant
environment, such as in hotel rooms, hospital rooms, residential care facilities,
or cars. Tasks: Clean or sterilize dishes, kitchen utensils, equipment, or facilities.
Monitor food distribution, ensuring that meals are delivered to the correct recipients
and that guidelines, such as those for special diets, are followed. Examine trays
to ensure that they contain required items. Load trays with accessories, such
as eating utensils, napkins, or condiments. Total checks, present them to customers,
and accept payment for services. Monitor food preparation or serving techniques
to ensure that proper procedures are followed. Remove trays and stack dishes for
return to kitchen after meals are finished. Carry food, silverware, or linen on
trays or use carts to carry trays. Record amounts and types of special food items
served to customers. Stock service stations with items, such as ice, napkins,
or straws.'
- 'Locker Room, Coatroom, and Dressing Room Attendants. Provide personal items to
patrons or customers in locker rooms, dressing rooms, or coatrooms. Tasks: Clean
facilities such as floors or locker rooms. Provide towels and sheets to clients
in public baths, steam rooms, and restrooms. Operate washing machines and dryers
to clean soiled apparel and towels. Refer guest problems or complaints to supervisors.
Collect soiled linen or clothing for laundering. Maintain a lost-and-found collection.
Activate emergency action plans and administer first aid, as necessary. Clean
and polish footwear, using brushes, sponges, cleaning fluid, polishes, waxes,
liquid or sole dressing, and daubers. Procure beverages, food, and other items
as requested. Check supplies to ensure adequate availability, and order new supplies
when necessary.'
- source_sentence: Glass Washer
sentences:
- 'Rock Splitters, Quarry. Separate blocks of rough dimension stone from quarry
mass using jackhammers, wedges, or chop saws. Tasks: Locate grain line patterns
to determine how rocks will split when cut. Set charges of explosives to split
rock. Drill holes along outlines, using jackhammers. Drill holes into sides of
stones broken from masses, insert dogs or attach slings, and direct removal of
stones. Remove pieces of stone from larger masses, using jackhammers, wedges,
and other tools. Insert wedges and feathers into holes, and drive wedges with
sledgehammers to split stone sections from masses. Mark dimensions or outlines
on stone prior to cutting, using rules and chalk lines.'
- 'Dishwashers. Clean dishes, kitchen, food preparation equipment, or utensils.
Tasks: Wash dishes, glassware, flatware, pots, or pans, using dishwashers or by
hand. Maintain kitchen work areas, equipment, or utensils in clean and orderly
condition. Place clean dishes, utensils, or cooking equipment in storage areas.
Sweep or scrub floors. Stock supplies, such as food or utensils, in serving stations,
cupboards, refrigerators, or salad bars. Sort and remove trash, placing it in
designated pickup areas. Transfer supplies or equipment between storage and work
areas, by hand or using hand trucks. Receive and store supplies. Clean garbage
cans with water or steam. Prepare and package individual place settings.'
- 'Cooks, Private Household. Prepare meals in private homes. Includes personal chefs.
Tasks: Peel, wash, trim, and cook vegetables and meats, and bake breads and pastries.
Cool, package, label, and freeze foods for later consumption and provide instructions
for reheating. Plan menus according to employers'' needs and diet restrictions.
Shop for or order food and kitchen supplies and equipment. Prepare meals in private
homes according to employers'' recipes or tastes, handling all meals for the family
and possibly for other household staff. Keep records pertaining to menus, finances,
and other business-related issues. Stock, organize, and clean kitchens and cooking
utensils. Direct the operation and organization of kitchens and all food-related
activities, including the presentation and serving of food. Create and explore
new cuisines. Serve meals and snacks to employing families and their guests.'
- source_sentence: Apply material to fill gaps in surfaces.
sentences:
- 'Floor Layers, Except Carpet, Wood, and Hard Tiles. Apply blocks, strips, or sheets
of shock-absorbing, sound-deadening, or decorative coverings to floors. Tasks:
Cut covering and foundation materials, according to blueprints and sketches. Cut
flooring material to fit around obstructions. Trim excess covering materials,
tack edges, and join sections of covering material to form tight joint. Lay out,
position, and apply shock-absorbing, sound-deadening, or decorative coverings
to floors, walls, and cabinets, following guidelines to keep courses straight
and create designs. Sweep, scrape, sand, or chip dirt and irregularities to clean
base surfaces, correcting imperfections that may show through the covering. Inspect
surface to be covered to ensure that it is firm and dry. Form a smooth foundation
by stapling plywood or Masonite over the floor or by brushing waterproof compound
onto surface and filling cracks with plaster, putty, or grout to seal pores. Apply
adhesive cement to floor or wall material to join and adhere foundation material.
Determine traffic areas and decide location of seams. Remove excess cement to
clean finished surface.'
- 'Floor Sanders and Finishers. Scrape and sand wooden floors to smooth surfaces
using floor scraper and floor sanding machine, and apply coats of finish. Tasks:
Inspect floors for smoothness. Scrape and sand floor edges and areas inaccessible
to floor sanders, using scrapers, disk-type sanders, and sandpaper. Attach sandpaper
to rollers of sanding machines. Guide sanding machines over surfaces of floors
until surfaces are smooth. Apply filler compound and coats of finish to floors
to seal wood.'
- 'Dining Room and Cafeteria Attendants and Bartender Helpers. Facilitate food service.
Clean tables; remove dirty dishes; replace soiled table linens; set tables; replenish
supply of clean linens, silverware, glassware, and dishes; supply service bar
with food; and serve items such as water, condiments, and coffee to patrons. Tasks:
Serve ice water, coffee, rolls, or butter to patrons. Wipe tables or seats with
dampened cloths or replace dirty tablecloths. Scrape and stack dirty dishes and
carry dishes and other tableware to kitchens for cleaning. Greet and seat customers.
Clean up spilled food or drink or broken dishes and remove empty bottles and trash.
Maintain adequate supplies of items, such as clean linens, silverware, glassware,
dishes, or trays. Locate items requested by customers. Fill beverage or ice dispensers.
Perform serving, cleaning, or stocking duties in establishments, such as cafeterias
or dining rooms, to facilitate customer service. Carry trays from food counters
to tables for cafeteria patrons.'
- source_sentence: Bar Host
sentences:
- 'Hosts and Hostesses, Restaurant, Lounge, and Coffee Shop. Welcome patrons, seat
them at tables or in lounge, and help ensure quality of facilities and service.
Tasks: Provide guests with menus. Greet guests and seat them at tables or in waiting
areas. Maintain contact with kitchen staff, management, serving staff, and customers
to ensure that dining details are handled properly and customers'' concerns are
addressed. Assign patrons to tables suitable for their needs and according to
rotation so that servers receive an appropriate number of seatings. Operate cash
registers to accept payments for food and beverages. Supervise and coordinate
activities of dining room staff to ensure that patrons receive prompt and courteous
service. Answer telephone calls and respond to inquiries or transfer calls. Assist
other restaurant workers by serving food and beverages, or by bussing tables.
Prepare cash receipts after establishments close, and make bank deposits. Take
and prepare to-go orders.'
- 'Baristas. Prepare or serve specialty coffee or other beverages. Serve food such
as baked goods or sandwiches to patrons. Tasks: Receive and process customer payments.
Prepare or serve hot or cold beverages, such as coffee, espresso drinks, blended
coffees, or teas. Take customer orders and convey them to other employees for
preparation. Clean service or seating areas. Prepare or serve menu items, such
as sandwiches or salads. Take out garbage. Describe menu items to customers, or
suggest products that might appeal to them. Demonstrate the use of retail equipment,
such as espresso machines. Order, receive, or stock supplies or retail products.
Serve prepared foods, such as muffins, biscotti, or bagels.'
- 'Travel Guides. Plan, organize, and conduct long-distance travel, tours, and expeditions
for individuals and groups. Tasks: Explain hunting and fishing laws to groups
to ensure compliance. Lead individuals or groups to tour site locations and describe
points of interest. Pilot airplanes or drive land and water vehicles to transport
tourists to activity or tour sites. Arrange for tour or expedition details such
as accommodations, transportation, equipment, and the availability of medical
personnel. Plan tour itineraries, applying knowledge of travel routes and destination
sites. Resolve any problems with itineraries, service, or accommodations. Sell
or rent equipment, clothing, and supplies related to expeditions. Attend to special
needs of tour participants. Sell travel packages. Evaluate services received on
the tour, and report findings to tour organizers.'
- source_sentence: Massage, shampoo, and condition patron's hair and scalp to clean
them and remove excess oil. Treat scalp conditions and hair loss, using specialized
lotions, shampoos, or equipment such as infrared lamps or vibrating equipment.
sentences:
- 'Shampooers. Shampoo and rinse customers'' hair. Tasks: Massage, shampoo, and
condition patron''s hair and scalp to clean them and remove excess oil. Advise
patrons with chronic or potentially contagious scalp conditions to seek medical
treatment. Maintain treatment records. Treat scalp conditions and hair loss, using
specialized lotions, shampoos, or equipment such as infrared lamps or vibrating
equipment.'
- 'Dermatologists. Diagnose and treat diseases relating to the skin, hair, and nails.
May perform both medical and dermatological surgery functions. Tasks: Perform
incisional biopsies to diagnose melanoma. Perform skin surgery to improve appearance,
make early diagnoses, or control diseases such as skin cancer. Counsel patients
on topics such as the need for annual dermatologic screenings, sun protection,
skin cancer awareness, or skin and lymph node self-examinations. Diagnose and
treat skin conditions such as acne, dandruff, athlete''s foot, moles, psoriasis,
or skin cancer. Record patients'' health histories. Conduct or order diagnostic
tests such as chest radiographs (x-rays), microbiologic tests, or endocrinologic
tests. Read current literature, talk with colleagues, and participate in professional
organizations or conferences to keep abreast of developments in dermatology. Provide
dermatologic consultation to other health professionals. Refer patients to other
specialists, as needed. Instruct interns or residents in diagnosis and treatment
of dermatological diseases.'
- 'Cooks, Fast Food. Prepare and cook food in a fast food restaurant with a limited
menu. Duties of these cooks are limited to preparation of a few basic items and
normally involve operating large-volume single-purpose cooking equipment. Tasks:
Maintain sanitation, health, and safety standards in work areas. Clean food preparation
areas, cooking surfaces, and utensils. Operate large-volume cooking equipment,
such as grills, deep-fat fryers, or griddles. Take food and drink orders and receive
payment from customers. Prepare specialty foods, such as pizzas, fish and chips,
sandwiches, or tacos, following specific methods that usually require short preparation
time. Verify that prepared food meets requirements for quality and quantity. Prepare
and serve beverages, such as coffee or fountain drinks. Serve orders to customers
at windows, counters, or tables. Wash, cut, and prepare foods designated for cooking.
Clean, stock, and restock workstations and display cases.'
pipeline_tag: sentence-similarity
library_name: sentence-transformers
---
# SentenceTransformer based on BAAI/bge-base-en-v1.5
This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [BAAI/bge-base-en-v1.5](https://huggingface.co/BAAI/bge-base-en-v1.5). It maps inputs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, classification, clustering, and more.
## Model Details
### Model Description
- **Model Type:** Sentence Transformer
- **Base model:** [BAAI/bge-base-en-v1.5](https://huggingface.co/BAAI/bge-base-en-v1.5) <!-- at revision a5beb1e3e68b9ab74eb54cfd186867f64f240e1a -->
- **Maximum Sequence Length:** 256 tokens
- **Output Dimensionality:** 768 dimensions
- **Similarity Function:** Cosine Similarity
- **Supported Modality:** Text
<!-- - **Training Dataset:** Unknown -->
<!-- - **Language:** Unknown -->
<!-- - **License:** Unknown -->
### Model Sources
- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
- **Repository:** [Sentence Transformers on GitHub](https://github.com/huggingface/sentence-transformers)
- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
### Full Model Architecture
```
SentenceTransformer(
(0): Transformer({'transformer_task': 'feature-extraction', 'modality_config': {'text': {'method': 'forward', 'method_output_name': 'last_hidden_state'}}, 'module_output_name': 'token_embeddings', 'architecture': 'BertModel'})
(1): Pooling({'embedding_dimension': 768, 'pooling_mode': 'cls', 'include_prompt': True})
(2): Normalize({'module_input_name': 'sentence_embedding', 'module_output_name': 'sentence_embedding'})
)
```
## Usage
### Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
```bash
pip install -U sentence-transformers
```
Then you can load this model and run inference.
```python
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
"Massage, shampoo, and condition patron's hair and scalp to clean them and remove excess oil. Treat scalp conditions and hair loss, using specialized lotions, shampoos, or equipment such as infrared lamps or vibrating equipment.",
"Shampooers. Shampoo and rinse customers' hair. Tasks: Massage, shampoo, and condition patron's hair and scalp to clean them and remove excess oil. Advise patrons with chronic or potentially contagious scalp conditions to seek medical treatment. Maintain treatment records. Treat scalp conditions and hair loss, using specialized lotions, shampoos, or equipment such as infrared lamps or vibrating equipment.",
"Dermatologists. Diagnose and treat diseases relating to the skin, hair, and nails. May perform both medical and dermatological surgery functions. Tasks: Perform incisional biopsies to diagnose melanoma. Perform skin surgery to improve appearance, make early diagnoses, or control diseases such as skin cancer. Counsel patients on topics such as the need for annual dermatologic screenings, sun protection, skin cancer awareness, or skin and lymph node self-examinations. Diagnose and treat skin conditions such as acne, dandruff, athlete's foot, moles, psoriasis, or skin cancer. Record patients' health histories. Conduct or order diagnostic tests such as chest radiographs (x-rays), microbiologic tests, or endocrinologic tests. Read current literature, talk with colleagues, and participate in professional organizations or conferences to keep abreast of developments in dermatology. Provide dermatologic consultation to other health professionals. Refer patients to other specialists, as needed. Instruct interns or residents in diagnosis and treatment of dermatological diseases.",
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[1.0000, 0.9103, 0.3532],
# [0.9103, 1.0000, 0.3842],
# [0.3532, 0.3842, 1.0000]])
```
<!--
### Direct Usage (Transformers)
<details><summary>Click to see the direct usage in Transformers</summary>
</details>
-->
<!--
### Downstream Usage (Sentence Transformers)
You can finetune this model on your own dataset.
<details><summary>Click to expand</summary>
</details>
-->
<!--
### Out-of-Scope Use
*List how the model may foreseeably be misused and address what users ought not to do with the model.*
-->
<!--
## Bias, Risks and Limitations
*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
-->
<!--
### Recommendations
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
-->
## Training Details
### Training Dataset
#### Unnamed Dataset
* Size: 86,430 training samples
* Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
* Approximate statistics based on the first 100 samples:
| | anchor | positive | negative |
|:---------|:-----------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------|
| type | string | string | string |
| modality | text | text | text |
| details | <ul><li>min: 3 tokens</li><li>mean: 21.51 tokens</li><li>max: 124 tokens</li></ul> | <ul><li>min: 135 tokens</li><li>mean: 223.47 tokens</li><li>max: 256 tokens</li></ul> | <ul><li>min: 124 tokens</li><li>mean: 216.68 tokens</li><li>max: 256 tokens</li></ul> |
* Samples:
| anchor | positive | negative |
|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| <code>Monitor personnel or equipment locations and utilization to coordinate service and schedules.</code> | <code>Dispatchers, Except Police, Fire, and Ambulance. Schedule and dispatch workers, work crews, equipment, or service vehicles for conveyance of materials, freight, or passengers, or for normal installation, service, or emergency repairs rendered outside the place of business. Duties may include using radio, telephone, or computer to transmit assignments and compiling statistics and reports on work progress. Tasks: Schedule or dispatch workers, work crews, equipment, or service vehicles to appropriate locations, according to customer requests, specifications, or needs, using radios or telephones. Confer with customers or supervising personnel to address questions, problems, or requests for service or equipment. Relay work orders, messages, or information to or from work crews, supervisors, or field inspectors, using telephones or two-way radios. Oversee all communications within specifically assigned territories. Receive or prepare work orders. Record and maintain files or records of custo...</code> | <code>First-Line Supervisors of Material-Moving Machine and Vehicle Operators. Directly supervise and coordinate activities of material-moving machine and vehicle operators and helpers. Tasks: Enforce safety rules and regulations. Resolve worker problems or collaborate with employees to assist in problem resolution. Confer with customers, supervisors, contractors, or other personnel to exchange information or to resolve problems. Plan work assignments and equipment allocations to meet transportation, operations or production goals. Examine, measure, or weigh cargo or materials to determine specific handling requirements. Explain and demonstrate work tasks to new workers or assign training tasks to experienced workers. Drive vehicles or operate machines or equipment to complete work assignments or to assist workers. Inspect or test materials, stock, vehicles, equipment, or facilities to ensure that they are safe, free of defects, and consistent with specifications. Maintain or verify records ...</code> |
| <code>Evaluate and grade students' class work, assignments, and papers. Compile bibliographies of specialized materials for outside reading assignments. Plan, evaluate, and revise curricula, course content, course materials, and methods of instruction.</code> | <code>Health Specialties Teachers, Postsecondary. Teach courses in health specialties, in fields such as dentistry, laboratory technology, medicine, pharmacy, public health, therapy, and veterinary medicine. Tasks: Prepare course materials, such as syllabi, homework assignments, and handouts. Evaluate and grade students' class work, assignments, and papers. Supervise laboratory sessions. Prepare and deliver lectures to undergraduate or graduate students on topics such as public health, stress management, and work site health promotion. Maintain student attendance records, grades, and other required records. Initiate, facilitate, and moderate classroom discussions. Perform administrative duties, such as serving as department head. Plan, evaluate, and revise curricula, course content, course materials, and methods of instruction. Supervise undergraduate or graduate teaching, internship, and research work. Write grant proposals to procure external research funding.</code> | <code>Teaching Assistants, Postsecondary. Assist faculty or other instructional staff in postsecondary institutions by performing instructional support activities, such as developing teaching materials, leading discussion groups, preparing and giving examinations, and grading examinations or papers. Tasks: Teach undergraduate-level courses. Evaluate and grade examinations, assignments, or papers, and record grades. Lead discussion sections, tutorials, or laboratory sections. Develop teaching materials, such as syllabi, visual aids, answer keys, supplementary notes, or course Web sites. Return assignments to students in accordance with established deadlines. Prepare or proctor examinations. Tutor or mentor students who need additional instruction. Complete laboratory projects prior to assigning them to students so that any needed modifications can be made. Demonstrate use of laboratory equipment and enforce laboratory rules. Provide assistance to faculty members or staff with laboratory or fi...</code> |
| <code>LPC (Licensed Professional Counselor)</code> | <code>Substance Abuse and Behavioral Disorder Counselors. Counsel and advise individuals with alcohol, tobacco, drug, or other problems, such as gambling and eating disorders. May counsel individuals, families, or groups or engage in prevention programs. Tasks: Counsel clients or patients, individually or in group sessions, to assist in overcoming dependencies, adjusting to life, or making changes. Develop client treatment plans based on research, clinical experience, and client histories. Complete and maintain accurate records or reports regarding the patients' histories and progress, services provided, or other required information. Review and evaluate clients' progress in relation to measurable goals described in treatment and care plans. Plan or implement follow-up or aftercare programs for clients to be discharged from treatment programs. Intervene as an advocate for clients or patients to resolve emergency problems in crisis situations. Coordinate counseling efforts with mental health ...</code> | <code>Psychiatrists. Diagnose, treat, and help prevent mental disorders. Tasks: Prescribe, direct, or administer psychotherapeutic treatments or medications to treat mental, emotional, or behavioral disorders. Gather and maintain patient information and records, including social or medical history obtained from patients, relatives, or other professionals. Collaborate with physicians, psychologists, social workers, psychiatric nurses, or other professionals to discuss treatment plans and progress. Analyze and evaluate patient data or test findings to diagnose nature or extent of mental disorder. Examine or conduct laboratory or diagnostic tests on patients to provide information on general physical condition or mental disorder. Advise or inform guardians, relatives, or significant others of patients' conditions or treatment. Teach, take continuing education classes, attend conferences or seminars, or conduct research and publish findings to increase understanding of mental, emotional, or beha...</code> |
* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
```json
{
"scale": 20.0,
"similarity_fct": "cos_sim",
"gather_across_devices": false,
"directions": [
"query_to_doc"
],
"partition_mode": "joint",
"hardness_mode": null,
"hardness_strength": 0.0
}
```
### Training Hyperparameters
#### Non-Default Hyperparameters
- `per_device_train_batch_size`: 32
- `num_train_epochs`: 1.0
- `learning_rate`: 2e-05
- `warmup_steps`: 0.1
- `bf16`: True
- `seed`: 13
- `dataloader_drop_last`: True
- `batch_sampler`: no_duplicates
#### All Hyperparameters
<details><summary>Click to expand</summary>
- `per_device_train_batch_size`: 32
- `num_train_epochs`: 1.0
- `max_steps`: -1
- `learning_rate`: 2e-05
- `lr_scheduler_type`: linear
- `lr_scheduler_kwargs`: None
- `warmup_steps`: 0.1
- `optim`: adamw_torch_fused
- `optim_args`: None
- `weight_decay`: 0.0
- `adam_beta1`: 0.9
- `adam_beta2`: 0.999
- `adam_epsilon`: 1e-08
- `optim_target_modules`: None
- `gradient_accumulation_steps`: 1
- `average_tokens_across_devices`: True
- `max_grad_norm`: 1.0
- `label_smoothing_factor`: 0.0
- `bf16`: True
- `fp16`: False
- `bf16_full_eval`: False
- `fp16_full_eval`: False
- `tf32`: None
- `gradient_checkpointing`: False
- `gradient_checkpointing_kwargs`: None
- `torch_compile`: False
- `torch_compile_backend`: None
- `torch_compile_mode`: None
- `use_liger_kernel`: False
- `liger_kernel_config`: None
- `use_cache`: False
- `neftune_noise_alpha`: None
- `torch_empty_cache_steps`: None
- `auto_find_batch_size`: False
- `log_on_each_node`: True
- `logging_nan_inf_filter`: True
- `include_num_input_tokens_seen`: no
- `log_level`: passive
- `log_level_replica`: warning
- `disable_tqdm`: False
- `project`: huggingface
- `trackio_space_id`: None
- `trackio_bucket_id`: None
- `trackio_static_space_id`: None
- `per_device_eval_batch_size`: 8
- `prediction_loss_only`: True
- `eval_on_start`: False
- `eval_do_concat_batches`: True
- `eval_use_gather_object`: False
- `eval_accumulation_steps`: None
- `include_for_metrics`: []
- `batch_eval_metrics`: False
- `save_only_model`: False
- `save_on_each_node`: False
- `enable_jit_checkpoint`: False
- `push_to_hub`: False
- `hub_private_repo`: None
- `hub_model_id`: None
- `hub_strategy`: every_save
- `hub_always_push`: False
- `hub_revision`: None
- `load_best_model_at_end`: False
- `ignore_data_skip`: False
- `restore_callback_states_from_checkpoint`: False
- `full_determinism`: False
- `seed`: 13
- `data_seed`: None
- `use_cpu`: False
- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
- `parallelism_config`: None
- `dataloader_drop_last`: True
- `dataloader_num_workers`: 0
- `dataloader_pin_memory`: True
- `dataloader_persistent_workers`: False
- `dataloader_prefetch_factor`: None
- `dataloader_multiprocessing_context`: None
- `dataloader_in_order`: True
- `remove_unused_columns`: True
- `label_names`: None
- `train_sampling_strategy`: random
- `length_column_name`: length
- `ddp_find_unused_parameters`: None
- `ddp_bucket_cap_mb`: None
- `ddp_broadcast_buffers`: False
- `ddp_static_graph`: None
- `ddp_backend`: None
- `ddp_timeout`: 1800
- `fsdp`: None
- `fsdp_config`: None
- `deepspeed`: None
- `debug`: []
- `skip_memory_metrics`: True
- `do_predict`: False
- `resume_from_checkpoint`: None
- `local_rank`: -1
- `prompts`: None
- `batch_sampler`: no_duplicates
- `multi_dataset_batch_sampler`: proportional
- `router_mapping`: {}
- `learning_rate_mapping`: {}
- `warmup_ratio`: None
</details>
### Training Logs
| Epoch | Step | Training Loss |
|:------:|:----:|:-------------:|
| 0.0185 | 50 | 1.9022 |
| 0.0370 | 100 | 1.5915 |
| 0.0556 | 150 | 1.3720 |
| 0.0741 | 200 | 1.2408 |
| 0.0926 | 250 | 1.1932 |
| 0.1111 | 300 | 1.1975 |
| 0.1296 | 350 | 1.1545 |
| 0.1481 | 400 | 1.1773 |
| 0.1667 | 450 | 1.1016 |
| 0.1852 | 500 | 1.0493 |
| 0.2037 | 550 | 1.0801 |
| 0.2222 | 600 | 1.0625 |
| 0.2407 | 650 | 1.0571 |
| 0.2593 | 700 | 1.0372 |
| 0.2778 | 750 | 1.0246 |
| 0.2963 | 800 | 1.0371 |
| 0.3148 | 850 | 1.0390 |
| 0.3333 | 900 | 1.0582 |
| 0.3519 | 950 | 0.9769 |
| 0.3704 | 1000 | 1.0329 |
| 0.3889 | 1050 | 0.9404 |
| 0.4074 | 1100 | 0.9647 |
| 0.4259 | 1150 | 0.9529 |
| 0.4444 | 1200 | 0.9591 |
| 0.4630 | 1250 | 0.9728 |
| 0.4815 | 1300 | 0.9986 |
| 0.5 | 1350 | 0.9136 |
| 0.5185 | 1400 | 0.9103 |
| 0.5370 | 1450 | 0.9732 |
| 0.5556 | 1500 | 0.9494 |
| 0.5741 | 1550 | 0.9376 |
| 0.5926 | 1600 | 0.9817 |
| 0.6111 | 1650 | 0.9150 |
| 0.6296 | 1700 | 0.8862 |
| 0.6481 | 1750 | 0.9127 |
| 0.6667 | 1800 | 0.9235 |
| 0.6852 | 1850 | 0.8775 |
| 0.7037 | 1900 | 0.9424 |
| 0.7222 | 1950 | 0.9302 |
| 0.7407 | 2000 | 0.8816 |
| 0.7593 | 2050 | 0.8695 |
| 0.7778 | 2100 | 0.9353 |
| 0.7963 | 2150 | 0.8622 |
| 0.8148 | 2200 | 0.8260 |
| 0.8333 | 2250 | 0.8790 |
| 0.8519 | 2300 | 0.8760 |
| 0.8704 | 2350 | 0.8948 |
| 0.8889 | 2400 | 0.8505 |
| 0.9074 | 2450 | 0.8825 |
| 0.9259 | 2500 | 0.8907 |
| 0.9444 | 2550 | 0.8187 |
| 0.9630 | 2600 | 0.8896 |
| 0.9815 | 2650 | 0.8607 |
| 1.0 | 2700 | 0.8769 |
### Training Time
- **Training**: 58.1 minutes
### Framework Versions
- Python: 3.14.6
- Sentence Transformers: 6.2.0
- Transformers: 5.20.2
- PyTorch: 2.14.1
- Accelerate: 1.15.0
- Datasets: 5.1.0
- Tokenizers: 0.23.3
## Additional Resources
- [Training and Finetuning Embedding Models with Sentence Transformers](https://huggingface.co/blog/train-sentence-transformers): the end-to-end guide for training or finetuning Sentence Transformer models.
- [Introduction to Matryoshka Embedding Models](https://huggingface.co/blog/matryoshka): variable-size embeddings that can be truncated with minimal quality loss.
- [Binary and Scalar Embedding Quantization for Significantly Faster & Cheaper Retrieval](https://huggingface.co/blog/embedding-quantization): post-training compression of embedding vectors.
- [Multimodal Embedding & Reranker Models with Sentence Transformers](https://huggingface.co/blog/multimodal-sentence-transformers): use text, image, audio, and video models through the same API.
- [Training and Finetuning Multimodal Embedding & Reranker Models with Sentence Transformers](https://huggingface.co/blog/train-multimodal-sentence-transformers): train multimodal embedding models, with a Visual Document Retrieval walkthrough.
## Citation
### BibTeX
#### Sentence Transformers
```bibtex
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
```
#### MultipleNegativesRankingLoss
```bibtex
@misc{oord2019representationlearningcontrastivepredictive,
title={Representation Learning with Contrastive Predictive Coding},
author={Aaron van den Oord and Yazhe Li and Oriol Vinyals},
year={2019},
eprint={1807.03748},
archivePrefix={arXiv},
primaryClass={cs.LG},
url={https://arxiv.org/abs/1807.03748},
}
```
<!--
## Glossary
*Clearly define terms in order to be accessible across audiences.*
-->
<!--
## Model Card Authors
*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
-->
<!--
## Model Card Contact
*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
-->