mast-benchmark/100k-corpus-2026
Viewer • Updated • 100k • 57
AI & ML interests
None defined yet.
Recent Activity
View all activity
nthakur
updated 2
datasets 6 days ago
nthakur
published a
dataset 6 days ago
nthakur
updated a
dataset 6 days ago
nthakur
published a
dataset 6 days ago
nthakur
authored 2
papers 4 months ago
nthakur
authored a
paper 12 months ago
nthakur
authored 3
papers about 1 year ago
FreshStack: Building Realistic Benchmarks for Evaluating Retrieval on Technical Documents
Paper • 2504.13128 • Published • 7
Chatbot Arena Meets Nuggets: Towards Explanations and Diagnostics in the Evaluation of LLM Responses
Paper • 2504.20006 • Published
Fixing Data That Hurts Performance: Cascading LLMs to Relabel Hard Negatives for Robust Information Retrieval
Paper • 2505.16967 • Published • 24
crystina-z
authored a
paper about 1 year ago
Post
1942
Last year, I curated & generated a few multilingual SFT and DPO datasets by translating English SFT/DPO datasets into 9-10 languages using the mistralai/Mistral-7B-Instruct-v0.2 model.
I hope it helps the community for pretraining/instruction tuning multilingual LLMs! I added a small diagram to briefly describe which datasets are added and their sources.
Happy to collaborate in either using these datasets for instruction FT, or wishes to extend translated versions of newer SFT/DPO english datasets!
nthakur/multilingual-sft-and-dpo-datasets-67eaf56fe3feca5a57cf7d74
I hope it helps the community for pretraining/instruction tuning multilingual LLMs! I added a small diagram to briefly describe which datasets are added and their sources.
Happy to collaborate in either using these datasets for instruction FT, or wishes to extend translated versions of newer SFT/DPO english datasets!
nthakur/multilingual-sft-and-dpo-datasets-67eaf56fe3feca5a57cf7d74
crystina-z
authored 7
papers over 1 year ago
Spacerini: Plug-and-play Search Engines with Pyserini and Hugging Face
Paper • 2302.14534 • Published • 1
Zero-Shot Listwise Document Reranking with a Large Language Model
Paper • 2305.02156 • Published • 2
Evaluating Embedding APIs for Information Retrieval
Paper • 2305.06300 • Published • 1
GAIA Search: Hugging Face and Pyserini Interoperability for NLP Training Data Exploration
Paper • 2306.01481 • Published • 2
What Do Llamas Really Think? Revealing Preference Biases in Language Model Representations
Paper • 2311.18812 • Published
NoMIRACL: Knowing When You Don't Know for Robust Multilingual Retrieval-Augmented Generation
Paper • 2312.11361 • Published • 1
Mr. TyDi: A Multi-lingual Benchmark for Dense Retrieval
Paper • 2108.08787 • Published