Sentence Similarity
sentence-transformers
Safetensors
English
onet
occupation-classification
job-title-normalization
soc-codes
career-exploration
resume-parsing
reranker
riasec
Instructions to use BenjaminChan12/onet-match with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use BenjaminChan12/onet-match with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("BenjaminChan12/onet-match") sentences = [ "That is a happy person", "That is a happy dog", "That is a very happy person", "Today is a sunny day" ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [4, 4] - Notebooks
- Google Colab
- Kaggle
|
Download biencoder/README.md from BenjaminChan12/onet-match: direct link, hf CLI and curl.
- Browser
- Download file 40.4 kB
-
https://huggingface.co/BenjaminChan12/onet-match/resolve/main/biencoder/README.md
- Command line
-
hf download hf://BenjaminChan12/onet-match/biencoder/README.md
-
curl -L -o README.md https://huggingface.co/BenjaminChan12/onet-match/resolve/main/biencoder/README.md
40.4 kB
metadata
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- dense
- generated_from_trainer
- dataset_size:86430
- loss:MultipleNegativesRankingLoss
base_model: BAAI/bge-base-en-v1.5
widget:
- source_sentence: Order supplies.
sentences:
- >-
Barbers. Provide barbering services, such as cutting, trimming,
shampooing, and styling hair; trimming beards; or giving shaves. Tasks:
Clean and sterilize scissors, combs, clippers, and other instruments.
Question patrons regarding desired services and haircut styles. Drape
and pin protective cloths around customers' shoulders. Apply lather and
shave beards or neck and temple hair contours, using razors. Shape and
trim beards and moustaches, using scissors. Perform clerical and
administrative duties such as keeping records, paying bills, and hiring
and supervising personnel. Keep card files on clientele, recording notes
of work done, products used and fees charged after each visit. Stay
informed of the latest styles and hair care techniques. Shampoo hair.
Order supplies.
- >-
Food Servers, Nonrestaurant. Serve food to individuals outside of a
restaurant environment, such as in hotel rooms, hospital rooms,
residential care facilities, or cars. Tasks: Clean or sterilize dishes,
kitchen utensils, equipment, or facilities. Monitor food distribution,
ensuring that meals are delivered to the correct recipients and that
guidelines, such as those for special diets, are followed. Examine trays
to ensure that they contain required items. Load trays with accessories,
such as eating utensils, napkins, or condiments. Total checks, present
them to customers, and accept payment for services. Monitor food
preparation or serving techniques to ensure that proper procedures are
followed. Remove trays and stack dishes for return to kitchen after
meals are finished. Carry food, silverware, or linen on trays or use
carts to carry trays. Record amounts and types of special food items
served to customers. Stock service stations with items, such as ice,
napkins, or straws.
- >-
Locker Room, Coatroom, and Dressing Room Attendants. Provide personal
items to patrons or customers in locker rooms, dressing rooms, or
coatrooms. Tasks: Clean facilities such as floors or locker rooms.
Provide towels and sheets to clients in public baths, steam rooms, and
restrooms. Operate washing machines and dryers to clean soiled apparel
and towels. Refer guest problems or complaints to supervisors. Collect
soiled linen or clothing for laundering. Maintain a lost-and-found
collection. Activate emergency action plans and administer first aid, as
necessary. Clean and polish footwear, using brushes, sponges, cleaning
fluid, polishes, waxes, liquid or sole dressing, and daubers. Procure
beverages, food, and other items as requested. Check supplies to ensure
adequate availability, and order new supplies when necessary.
- source_sentence: Glass Washer
sentences:
- >-
Rock Splitters, Quarry. Separate blocks of rough dimension stone from
quarry mass using jackhammers, wedges, or chop saws. Tasks: Locate grain
line patterns to determine how rocks will split when cut. Set charges of
explosives to split rock. Drill holes along outlines, using jackhammers.
Drill holes into sides of stones broken from masses, insert dogs or
attach slings, and direct removal of stones. Remove pieces of stone from
larger masses, using jackhammers, wedges, and other tools. Insert wedges
and feathers into holes, and drive wedges with sledgehammers to split
stone sections from masses. Mark dimensions or outlines on stone prior
to cutting, using rules and chalk lines.
- >-
Dishwashers. Clean dishes, kitchen, food preparation equipment, or
utensils. Tasks: Wash dishes, glassware, flatware, pots, or pans, using
dishwashers or by hand. Maintain kitchen work areas, equipment, or
utensils in clean and orderly condition. Place clean dishes, utensils,
or cooking equipment in storage areas. Sweep or scrub floors. Stock
supplies, such as food or utensils, in serving stations, cupboards,
refrigerators, or salad bars. Sort and remove trash, placing it in
designated pickup areas. Transfer supplies or equipment between storage
and work areas, by hand or using hand trucks. Receive and store
supplies. Clean garbage cans with water or steam. Prepare and package
individual place settings.
- >-
Cooks, Private Household. Prepare meals in private homes. Includes
personal chefs. Tasks: Peel, wash, trim, and cook vegetables and meats,
and bake breads and pastries. Cool, package, label, and freeze foods for
later consumption and provide instructions for reheating. Plan menus
according to employers' needs and diet restrictions. Shop for or order
food and kitchen supplies and equipment. Prepare meals in private homes
according to employers' recipes or tastes, handling all meals for the
family and possibly for other household staff. Keep records pertaining
to menus, finances, and other business-related issues. Stock, organize,
and clean kitchens and cooking utensils. Direct the operation and
organization of kitchens and all food-related activities, including the
presentation and serving of food. Create and explore new cuisines. Serve
meals and snacks to employing families and their guests.
- source_sentence: Apply material to fill gaps in surfaces.
sentences:
- >-
Floor Layers, Except Carpet, Wood, and Hard Tiles. Apply blocks, strips,
or sheets of shock-absorbing, sound-deadening, or decorative coverings
to floors. Tasks: Cut covering and foundation materials, according to
blueprints and sketches. Cut flooring material to fit around
obstructions. Trim excess covering materials, tack edges, and join
sections of covering material to form tight joint. Lay out, position,
and apply shock-absorbing, sound-deadening, or decorative coverings to
floors, walls, and cabinets, following guidelines to keep courses
straight and create designs. Sweep, scrape, sand, or chip dirt and
irregularities to clean base surfaces, correcting imperfections that may
show through the covering. Inspect surface to be covered to ensure that
it is firm and dry. Form a smooth foundation by stapling plywood or
Masonite over the floor or by brushing waterproof compound onto surface
and filling cracks with plaster, putty, or grout to seal pores. Apply
adhesive cement to floor or wall material to join and adhere foundation
material. Determine traffic areas and decide location of seams. Remove
excess cement to clean finished surface.
- >-
Floor Sanders and Finishers. Scrape and sand wooden floors to smooth
surfaces using floor scraper and floor sanding machine, and apply coats
of finish. Tasks: Inspect floors for smoothness. Scrape and sand floor
edges and areas inaccessible to floor sanders, using scrapers, disk-type
sanders, and sandpaper. Attach sandpaper to rollers of sanding machines.
Guide sanding machines over surfaces of floors until surfaces are
smooth. Apply filler compound and coats of finish to floors to seal
wood.
- >-
Dining Room and Cafeteria Attendants and Bartender Helpers. Facilitate
food service. Clean tables; remove dirty dishes; replace soiled table
linens; set tables; replenish supply of clean linens, silverware,
glassware, and dishes; supply service bar with food; and serve items
such as water, condiments, and coffee to patrons. Tasks: Serve ice
water, coffee, rolls, or butter to patrons. Wipe tables or seats with
dampened cloths or replace dirty tablecloths. Scrape and stack dirty
dishes and carry dishes and other tableware to kitchens for cleaning.
Greet and seat customers. Clean up spilled food or drink or broken
dishes and remove empty bottles and trash. Maintain adequate supplies of
items, such as clean linens, silverware, glassware, dishes, or trays.
Locate items requested by customers. Fill beverage or ice dispensers.
Perform serving, cleaning, or stocking duties in establishments, such as
cafeterias or dining rooms, to facilitate customer service. Carry trays
from food counters to tables for cafeteria patrons.
- source_sentence: Bar Host
sentences:
- >-
Hosts and Hostesses, Restaurant, Lounge, and Coffee Shop. Welcome
patrons, seat them at tables or in lounge, and help ensure quality of
facilities and service. Tasks: Provide guests with menus. Greet guests
and seat them at tables or in waiting areas. Maintain contact with
kitchen staff, management, serving staff, and customers to ensure that
dining details are handled properly and customers' concerns are
addressed. Assign patrons to tables suitable for their needs and
according to rotation so that servers receive an appropriate number of
seatings. Operate cash registers to accept payments for food and
beverages. Supervise and coordinate activities of dining room staff to
ensure that patrons receive prompt and courteous service. Answer
telephone calls and respond to inquiries or transfer calls. Assist other
restaurant workers by serving food and beverages, or by bussing tables.
Prepare cash receipts after establishments close, and make bank
deposits. Take and prepare to-go orders.
- >-
Baristas. Prepare or serve specialty coffee or other beverages. Serve
food such as baked goods or sandwiches to patrons. Tasks: Receive and
process customer payments. Prepare or serve hot or cold beverages, such
as coffee, espresso drinks, blended coffees, or teas. Take customer
orders and convey them to other employees for preparation. Clean service
or seating areas. Prepare or serve menu items, such as sandwiches or
salads. Take out garbage. Describe menu items to customers, or suggest
products that might appeal to them. Demonstrate the use of retail
equipment, such as espresso machines. Order, receive, or stock supplies
or retail products. Serve prepared foods, such as muffins, biscotti, or
bagels.
- >-
Travel Guides. Plan, organize, and conduct long-distance travel, tours,
and expeditions for individuals and groups. Tasks: Explain hunting and
fishing laws to groups to ensure compliance. Lead individuals or groups
to tour site locations and describe points of interest. Pilot airplanes
or drive land and water vehicles to transport tourists to activity or
tour sites. Arrange for tour or expedition details such as
accommodations, transportation, equipment, and the availability of
medical personnel. Plan tour itineraries, applying knowledge of travel
routes and destination sites. Resolve any problems with itineraries,
service, or accommodations. Sell or rent equipment, clothing, and
supplies related to expeditions. Attend to special needs of tour
participants. Sell travel packages. Evaluate services received on the
tour, and report findings to tour organizers.
- source_sentence: >-
Massage, shampoo, and condition patron's hair and scalp to clean them and
remove excess oil. Treat scalp conditions and hair loss, using specialized
lotions, shampoos, or equipment such as infrared lamps or vibrating
equipment.
sentences:
- >-
Shampooers. Shampoo and rinse customers' hair. Tasks: Massage, shampoo,
and condition patron's hair and scalp to clean them and remove excess
oil. Advise patrons with chronic or potentially contagious scalp
conditions to seek medical treatment. Maintain treatment records. Treat
scalp conditions and hair loss, using specialized lotions, shampoos, or
equipment such as infrared lamps or vibrating equipment.
- >-
Dermatologists. Diagnose and treat diseases relating to the skin, hair,
and nails. May perform both medical and dermatological surgery
functions. Tasks: Perform incisional biopsies to diagnose melanoma.
Perform skin surgery to improve appearance, make early diagnoses, or
control diseases such as skin cancer. Counsel patients on topics such as
the need for annual dermatologic screenings, sun protection, skin cancer
awareness, or skin and lymph node self-examinations. Diagnose and treat
skin conditions such as acne, dandruff, athlete's foot, moles,
psoriasis, or skin cancer. Record patients' health histories. Conduct or
order diagnostic tests such as chest radiographs (x-rays), microbiologic
tests, or endocrinologic tests. Read current literature, talk with
colleagues, and participate in professional organizations or conferences
to keep abreast of developments in dermatology. Provide dermatologic
consultation to other health professionals. Refer patients to other
specialists, as needed. Instruct interns or residents in diagnosis and
treatment of dermatological diseases.
- >-
Cooks, Fast Food. Prepare and cook food in a fast food restaurant with a
limited menu. Duties of these cooks are limited to preparation of a few
basic items and normally involve operating large-volume single-purpose
cooking equipment. Tasks: Maintain sanitation, health, and safety
standards in work areas. Clean food preparation areas, cooking surfaces,
and utensils. Operate large-volume cooking equipment, such as grills,
deep-fat fryers, or griddles. Take food and drink orders and receive
payment from customers. Prepare specialty foods, such as pizzas, fish
and chips, sandwiches, or tacos, following specific methods that usually
require short preparation time. Verify that prepared food meets
requirements for quality and quantity. Prepare and serve beverages, such
as coffee or fountain drinks. Serve orders to customers at windows,
counters, or tables. Wash, cut, and prepare foods designated for
cooking. Clean, stock, and restock workstations and display cases.
pipeline_tag: sentence-similarity
library_name: sentence-transformers
SentenceTransformer based on BAAI/bge-base-en-v1.5
This is a sentence-transformers model finetuned from BAAI/bge-base-en-v1.5. It maps inputs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, classification, clustering, and more.
Model Details
Model Description
- Model Type: Sentence Transformer
- Base model: BAAI/bge-base-en-v1.5
- Maximum Sequence Length: 256 tokens
- Output Dimensionality: 768 dimensions
- Similarity Function: Cosine Similarity
- Supported Modality: Text
Model Sources
- Documentation: Sentence Transformers Documentation
- Repository: Sentence Transformers on GitHub
- Hugging Face: Sentence Transformers on Hugging Face
Full Model Architecture
SentenceTransformer(
(0): Transformer({'transformer_task': 'feature-extraction', 'modality_config': {'text': {'method': 'forward', 'method_output_name': 'last_hidden_state'}}, 'module_output_name': 'token_embeddings', 'architecture': 'BertModel'})
(1): Pooling({'embedding_dimension': 768, 'pooling_mode': 'cls', 'include_prompt': True})
(2): Normalize({'module_input_name': 'sentence_embedding', 'module_output_name': 'sentence_embedding'})
)
Usage
Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
pip install -U sentence-transformers
Then you can load this model and run inference.
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
"Massage, shampoo, and condition patron's hair and scalp to clean them and remove excess oil. Treat scalp conditions and hair loss, using specialized lotions, shampoos, or equipment such as infrared lamps or vibrating equipment.",
"Shampooers. Shampoo and rinse customers' hair. Tasks: Massage, shampoo, and condition patron's hair and scalp to clean them and remove excess oil. Advise patrons with chronic or potentially contagious scalp conditions to seek medical treatment. Maintain treatment records. Treat scalp conditions and hair loss, using specialized lotions, shampoos, or equipment such as infrared lamps or vibrating equipment.",
"Dermatologists. Diagnose and treat diseases relating to the skin, hair, and nails. May perform both medical and dermatological surgery functions. Tasks: Perform incisional biopsies to diagnose melanoma. Perform skin surgery to improve appearance, make early diagnoses, or control diseases such as skin cancer. Counsel patients on topics such as the need for annual dermatologic screenings, sun protection, skin cancer awareness, or skin and lymph node self-examinations. Diagnose and treat skin conditions such as acne, dandruff, athlete's foot, moles, psoriasis, or skin cancer. Record patients' health histories. Conduct or order diagnostic tests such as chest radiographs (x-rays), microbiologic tests, or endocrinologic tests. Read current literature, talk with colleagues, and participate in professional organizations or conferences to keep abreast of developments in dermatology. Provide dermatologic consultation to other health professionals. Refer patients to other specialists, as needed. Instruct interns or residents in diagnosis and treatment of dermatological diseases.",
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[1.0000, 0.9103, 0.3532],
# [0.9103, 1.0000, 0.3842],
# [0.3532, 0.3842, 1.0000]])
Training Details
Training Dataset
Unnamed Dataset
- Size: 86,430 training samples
- Columns:
anchor,positive, andnegative - Approximate statistics based on the first 100 samples:
anchor positive negative type string string string modality text text text details - min: 3 tokens
- mean: 21.51 tokens
- max: 124 tokens
- min: 135 tokens
- mean: 223.47 tokens
- max: 256 tokens
- min: 124 tokens
- mean: 216.68 tokens
- max: 256 tokens
- Samples:
anchor positive negative Monitor personnel or equipment locations and utilization to coordinate service and schedules.Dispatchers, Except Police, Fire, and Ambulance. Schedule and dispatch workers, work crews, equipment, or service vehicles for conveyance of materials, freight, or passengers, or for normal installation, service, or emergency repairs rendered outside the place of business. Duties may include using radio, telephone, or computer to transmit assignments and compiling statistics and reports on work progress. Tasks: Schedule or dispatch workers, work crews, equipment, or service vehicles to appropriate locations, according to customer requests, specifications, or needs, using radios or telephones. Confer with customers or supervising personnel to address questions, problems, or requests for service or equipment. Relay work orders, messages, or information to or from work crews, supervisors, or field inspectors, using telephones or two-way radios. Oversee all communications within specifically assigned territories. Receive or prepare work orders. Record and maintain files or records of custo...First-Line Supervisors of Material-Moving Machine and Vehicle Operators. Directly supervise and coordinate activities of material-moving machine and vehicle operators and helpers. Tasks: Enforce safety rules and regulations. Resolve worker problems or collaborate with employees to assist in problem resolution. Confer with customers, supervisors, contractors, or other personnel to exchange information or to resolve problems. Plan work assignments and equipment allocations to meet transportation, operations or production goals. Examine, measure, or weigh cargo or materials to determine specific handling requirements. Explain and demonstrate work tasks to new workers or assign training tasks to experienced workers. Drive vehicles or operate machines or equipment to complete work assignments or to assist workers. Inspect or test materials, stock, vehicles, equipment, or facilities to ensure that they are safe, free of defects, and consistent with specifications. Maintain or verify records ...Evaluate and grade students' class work, assignments, and papers. Compile bibliographies of specialized materials for outside reading assignments. Plan, evaluate, and revise curricula, course content, course materials, and methods of instruction.Health Specialties Teachers, Postsecondary. Teach courses in health specialties, in fields such as dentistry, laboratory technology, medicine, pharmacy, public health, therapy, and veterinary medicine. Tasks: Prepare course materials, such as syllabi, homework assignments, and handouts. Evaluate and grade students' class work, assignments, and papers. Supervise laboratory sessions. Prepare and deliver lectures to undergraduate or graduate students on topics such as public health, stress management, and work site health promotion. Maintain student attendance records, grades, and other required records. Initiate, facilitate, and moderate classroom discussions. Perform administrative duties, such as serving as department head. Plan, evaluate, and revise curricula, course content, course materials, and methods of instruction. Supervise undergraduate or graduate teaching, internship, and research work. Write grant proposals to procure external research funding.Teaching Assistants, Postsecondary. Assist faculty or other instructional staff in postsecondary institutions by performing instructional support activities, such as developing teaching materials, leading discussion groups, preparing and giving examinations, and grading examinations or papers. Tasks: Teach undergraduate-level courses. Evaluate and grade examinations, assignments, or papers, and record grades. Lead discussion sections, tutorials, or laboratory sections. Develop teaching materials, such as syllabi, visual aids, answer keys, supplementary notes, or course Web sites. Return assignments to students in accordance with established deadlines. Prepare or proctor examinations. Tutor or mentor students who need additional instruction. Complete laboratory projects prior to assigning them to students so that any needed modifications can be made. Demonstrate use of laboratory equipment and enforce laboratory rules. Provide assistance to faculty members or staff with laboratory or fi...LPC (Licensed Professional Counselor)Substance Abuse and Behavioral Disorder Counselors. Counsel and advise individuals with alcohol, tobacco, drug, or other problems, such as gambling and eating disorders. May counsel individuals, families, or groups or engage in prevention programs. Tasks: Counsel clients or patients, individually or in group sessions, to assist in overcoming dependencies, adjusting to life, or making changes. Develop client treatment plans based on research, clinical experience, and client histories. Complete and maintain accurate records or reports regarding the patients' histories and progress, services provided, or other required information. Review and evaluate clients' progress in relation to measurable goals described in treatment and care plans. Plan or implement follow-up or aftercare programs for clients to be discharged from treatment programs. Intervene as an advocate for clients or patients to resolve emergency problems in crisis situations. Coordinate counseling efforts with mental health ...Psychiatrists. Diagnose, treat, and help prevent mental disorders. Tasks: Prescribe, direct, or administer psychotherapeutic treatments or medications to treat mental, emotional, or behavioral disorders. Gather and maintain patient information and records, including social or medical history obtained from patients, relatives, or other professionals. Collaborate with physicians, psychologists, social workers, psychiatric nurses, or other professionals to discuss treatment plans and progress. Analyze and evaluate patient data or test findings to diagnose nature or extent of mental disorder. Examine or conduct laboratory or diagnostic tests on patients to provide information on general physical condition or mental disorder. Advise or inform guardians, relatives, or significant others of patients' conditions or treatment. Teach, take continuing education classes, attend conferences or seminars, or conduct research and publish findings to increase understanding of mental, emotional, or beha... - Loss:
MultipleNegativesRankingLosswith these parameters:{ "scale": 20.0, "similarity_fct": "cos_sim", "gather_across_devices": false, "directions": [ "query_to_doc" ], "partition_mode": "joint", "hardness_mode": null, "hardness_strength": 0.0 }
Training Hyperparameters
Non-Default Hyperparameters
per_device_train_batch_size: 32num_train_epochs: 1.0learning_rate: 2e-05warmup_steps: 0.1bf16: Trueseed: 13dataloader_drop_last: Truebatch_sampler: no_duplicates
All Hyperparameters
Click to expand
per_device_train_batch_size: 32num_train_epochs: 1.0max_steps: -1learning_rate: 2e-05lr_scheduler_type: linearlr_scheduler_kwargs: Nonewarmup_steps: 0.1optim: adamw_torch_fusedoptim_args: Noneweight_decay: 0.0adam_beta1: 0.9adam_beta2: 0.999adam_epsilon: 1e-08optim_target_modules: Nonegradient_accumulation_steps: 1average_tokens_across_devices: Truemax_grad_norm: 1.0label_smoothing_factor: 0.0bf16: Truefp16: Falsebf16_full_eval: Falsefp16_full_eval: Falsetf32: Nonegradient_checkpointing: Falsegradient_checkpointing_kwargs: Nonetorch_compile: Falsetorch_compile_backend: Nonetorch_compile_mode: Noneuse_liger_kernel: Falseliger_kernel_config: Noneuse_cache: Falseneftune_noise_alpha: Nonetorch_empty_cache_steps: Noneauto_find_batch_size: Falselog_on_each_node: Truelogging_nan_inf_filter: Trueinclude_num_input_tokens_seen: nolog_level: passivelog_level_replica: warningdisable_tqdm: Falseproject: huggingfacetrackio_space_id: Nonetrackio_bucket_id: Nonetrackio_static_space_id: Noneper_device_eval_batch_size: 8prediction_loss_only: Trueeval_on_start: Falseeval_do_concat_batches: Trueeval_use_gather_object: Falseeval_accumulation_steps: Noneinclude_for_metrics: []batch_eval_metrics: Falsesave_only_model: Falsesave_on_each_node: Falseenable_jit_checkpoint: Falsepush_to_hub: Falsehub_private_repo: Nonehub_model_id: Nonehub_strategy: every_savehub_always_push: Falsehub_revision: Noneload_best_model_at_end: Falseignore_data_skip: Falserestore_callback_states_from_checkpoint: Falsefull_determinism: Falseseed: 13data_seed: Noneuse_cpu: Falseaccelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}parallelism_config: Nonedataloader_drop_last: Truedataloader_num_workers: 0dataloader_pin_memory: Truedataloader_persistent_workers: Falsedataloader_prefetch_factor: Nonedataloader_multiprocessing_context: Nonedataloader_in_order: Trueremove_unused_columns: Truelabel_names: Nonetrain_sampling_strategy: randomlength_column_name: lengthddp_find_unused_parameters: Noneddp_bucket_cap_mb: Noneddp_broadcast_buffers: Falseddp_static_graph: Noneddp_backend: Noneddp_timeout: 1800fsdp: Nonefsdp_config: Nonedeepspeed: Nonedebug: []skip_memory_metrics: Truedo_predict: Falseresume_from_checkpoint: Nonelocal_rank: -1prompts: Nonebatch_sampler: no_duplicatesmulti_dataset_batch_sampler: proportionalrouter_mapping: {}learning_rate_mapping: {}warmup_ratio: None
Training Logs
| Epoch | Step | Training Loss |
|---|---|---|
| 0.0185 | 50 | 1.9022 |
| 0.0370 | 100 | 1.5915 |
| 0.0556 | 150 | 1.3720 |
| 0.0741 | 200 | 1.2408 |
| 0.0926 | 250 | 1.1932 |
| 0.1111 | 300 | 1.1975 |
| 0.1296 | 350 | 1.1545 |
| 0.1481 | 400 | 1.1773 |
| 0.1667 | 450 | 1.1016 |
| 0.1852 | 500 | 1.0493 |
| 0.2037 | 550 | 1.0801 |
| 0.2222 | 600 | 1.0625 |
| 0.2407 | 650 | 1.0571 |
| 0.2593 | 700 | 1.0372 |
| 0.2778 | 750 | 1.0246 |
| 0.2963 | 800 | 1.0371 |
| 0.3148 | 850 | 1.0390 |
| 0.3333 | 900 | 1.0582 |
| 0.3519 | 950 | 0.9769 |
| 0.3704 | 1000 | 1.0329 |
| 0.3889 | 1050 | 0.9404 |
| 0.4074 | 1100 | 0.9647 |
| 0.4259 | 1150 | 0.9529 |
| 0.4444 | 1200 | 0.9591 |
| 0.4630 | 1250 | 0.9728 |
| 0.4815 | 1300 | 0.9986 |
| 0.5 | 1350 | 0.9136 |
| 0.5185 | 1400 | 0.9103 |
| 0.5370 | 1450 | 0.9732 |
| 0.5556 | 1500 | 0.9494 |
| 0.5741 | 1550 | 0.9376 |
| 0.5926 | 1600 | 0.9817 |
| 0.6111 | 1650 | 0.9150 |
| 0.6296 | 1700 | 0.8862 |
| 0.6481 | 1750 | 0.9127 |
| 0.6667 | 1800 | 0.9235 |
| 0.6852 | 1850 | 0.8775 |
| 0.7037 | 1900 | 0.9424 |
| 0.7222 | 1950 | 0.9302 |
| 0.7407 | 2000 | 0.8816 |
| 0.7593 | 2050 | 0.8695 |
| 0.7778 | 2100 | 0.9353 |
| 0.7963 | 2150 | 0.8622 |
| 0.8148 | 2200 | 0.8260 |
| 0.8333 | 2250 | 0.8790 |
| 0.8519 | 2300 | 0.8760 |
| 0.8704 | 2350 | 0.8948 |
| 0.8889 | 2400 | 0.8505 |
| 0.9074 | 2450 | 0.8825 |
| 0.9259 | 2500 | 0.8907 |
| 0.9444 | 2550 | 0.8187 |
| 0.9630 | 2600 | 0.8896 |
| 0.9815 | 2650 | 0.8607 |
| 1.0 | 2700 | 0.8769 |
Training Time
- Training: 58.1 minutes
Framework Versions
- Python: 3.14.6
- Sentence Transformers: 6.2.0
- Transformers: 5.20.2
- PyTorch: 2.14.1
- Accelerate: 1.15.0
- Datasets: 5.1.0
- Tokenizers: 0.23.3
Additional Resources
- Training and Finetuning Embedding Models with Sentence Transformers: the end-to-end guide for training or finetuning Sentence Transformer models.
- Introduction to Matryoshka Embedding Models: variable-size embeddings that can be truncated with minimal quality loss.
- Binary and Scalar Embedding Quantization for Significantly Faster & Cheaper Retrieval: post-training compression of embedding vectors.
- Multimodal Embedding & Reranker Models with Sentence Transformers: use text, image, audio, and video models through the same API.
- Training and Finetuning Multimodal Embedding & Reranker Models with Sentence Transformers: train multimodal embedding models, with a Visual Document Retrieval walkthrough.
Citation
BibTeX
Sentence Transformers
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
MultipleNegativesRankingLoss
@misc{oord2019representationlearningcontrastivepredictive,
title={Representation Learning with Contrastive Predictive Coding},
author={Aaron van den Oord and Yazhe Li and Oriol Vinyals},
year={2019},
eprint={1807.03748},
archivePrefix={arXiv},
primaryClass={cs.LG},
url={https://arxiv.org/abs/1807.03748},
}