BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agent
Paper
• 2508.06600 • Published
• 41
AI & ML interests
None defined yet.
nthakurÂ
authored a paper 7 months ago
nthakurÂ
authored 3 papers 10 months ago
FreshStack: Building Realistic Benchmarks for Evaluating Retrieval on Technical Documents
Paper
• 2504.13128 • Published
• 7
Chatbot Arena Meets Nuggets: Towards Explanations and Diagnostics in the Evaluation of LLM Responses
Paper
• 2504.20006 • Published
Fixing Data That Hurts Performance: Cascading LLMs to Relabel Hard Negatives for Robust Information Retrieval
Paper
• 2505.16967 • Published
• 24
Post
1868
Last year, I curated & generated a few multilingual SFT and DPO datasets by translating English SFT/DPO datasets into 9-10 languages using the mistralai/Mistral-7B-Instruct-v0.2 model.
I hope it helps the community for pretraining/instruction tuning multilingual LLMs! I added a small diagram to briefly describe which datasets are added and their sources.
Happy to collaborate in either using these datasets for instruction FT, or wishes to extend translated versions of newer SFT/DPO english datasets!
nthakur/multilingual-sft-and-dpo-datasets-67eaf56fe3feca5a57cf7d74
I hope it helps the community for pretraining/instruction tuning multilingual LLMs! I added a small diagram to briefly describe which datasets are added and their sources.
Happy to collaborate in either using these datasets for instruction FT, or wishes to extend translated versions of newer SFT/DPO english datasets!
nthakur/multilingual-sft-and-dpo-datasets-67eaf56fe3feca5a57cf7d74
nthakurÂ
authored a paper about 1 year ago
ronakÂ
authored 6 papers over 1 year ago
RankVicuna: Zero-Shot Listwise Document Reranking with Open-Source Large Language Models
Paper
• 2309.15088 • Published
Zero-Shot Listwise Document Reranking with a Large Language Model
Paper
• 2305.02156 • Published
• 2
The Expando-Mono-Duo Design Pattern for Text Ranking with Pretrained Sequence-to-Sequence Models
Paper
• 2101.05667 • Published
RankZephyr: Effective and Robust Zero-Shot Listwise Reranking is a Breeze!
Paper
• 2312.02724 • Published
Vector Search with OpenAI Embeddings: Lucene Is All You Need
Paper
• 2308.14963 • Published
Prompts as Auto-Optimized Training Hyperparameters: Training Best-in-Class IR Models from Scratch with 10 Gold Labels
Paper
• 2406.11706 • Published
• 1
nthakurÂ
authored 2 papers over 1 year ago
Post
3789
🦢 The SWIM-IR dataset contains 29 million text-retrieval training pairs across 27 diverse languages. It is one of the largest synthetic multilingual datasets generated using PaLM 2 on Wikipedia! 🔥🔥
SWIM-IR dataset contains three subsets :
- Cross-lingual:
- Monolingual:
- Indic Cross-lingual:
Check it out:
https://huggingface.co/collections/nthakur/swim-ir-dataset-662ddaecfc20896bf14dd9b7
SWIM-IR dataset contains three subsets :
- Cross-lingual:
nthakur/swim-ir-cross-lingual- Monolingual:
nthakur/swim-ir-monolingual- Indic Cross-lingual:
nthakur/indic-swim-ir-cross-lingualCheck it out:
https://huggingface.co/collections/nthakur/swim-ir-dataset-662ddaecfc20896bf14dd9b7
nthakurÂ
authored 5 papers about 2 years ago
Resources for Brewing BEIR: Reproducible Reference Models and an Official Leaderboard
Paper
• 2306.07471 • Published
NoMIRACL: Knowing When You Don't Know for Robust Multilingual Retrieval-Augmented Generation
Paper
• 2312.11361 • Published
• 1
HAGRID: A Human-LLM Collaborative Dataset for Generative Information-Seeking with Attribution
Paper
• 2307.16883 • Published
Augmented SBERT: Data Augmentation Method for Improving Bi-Encoders for Pairwise Sentence Scoring Tasks
Paper
• 2010.08240 • Published
Evaluating Embedding APIs for Information Retrieval
Paper
• 2305.06300 • Published
• 1