Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models
Paper
•
2402.13064
•
Published
•
50
Synthetic Data Generation
A curated list of papers focusing on synthetic data generation
-
-
Textbooks Are All You Need II: phi-1.5 technical report
Paper • 2309.05463 • Published • 87 -
DataDreamer: A Tool for Synthetic Data Generation and Reproducible LLM Workflows
Paper • 2402.10379 • Published • 32 -
Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models
Paper • 2312.06585 • Published • 29 -
HuggingFaceTB/cosmopedia
Viewer • Updated • 31.1M • 6.09k • 632 -
OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset
Paper • 2402.10176 • Published • 38 -
Efficient Exploration for LLMs
Paper • 2402.00396 • Published • 23 -
Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling
Paper • 2401.16380 • Published • 51 -
Unitxt: Flexible, Shareable and Reusable Data Preparation and Evaluation for Generative AI
Paper • 2401.14019 • Published • 24