Post-training dataCOLM 2026
MegaScience
Open post-training datasets for scientific reasoning, including the 1.25M-instance MegaScience mixture and TextbookReasoning.
- HF · all datasets
- 127.7K downloads
- Open corpus
- 1.25M instances
GeezerVisonThe World Wide Web, restored to 800 pixels of glory. |
| Home|About|Gaming cabinet|Archives|How it works|Starter sites |
GeezerVison is showing sinclaircoder.github.io — Open Source | Zengzhi Wang Open-source resources
Data
Open corpora for scientific and mathematical reasoning. Post-training dataCOLM 2026 MegaScienceOpen post-training datasets for scientific reasoning, including the 1.25M-instance MegaScience mixture and TextbookReasoning.
Pre-training dataAI4Math @ ICML 2025 MegaMath-Web-Pro-MaxA 70B+ token math-web corpus curated and refined for reinforcement-learning-friendly mid-training.
Pre-training dataCOLM 2025 MegaMathA 371B-token open math corpus unifying web, code, and synthetic mathematical data.
Pre-training dataNeurIPS D&B 2024 MathPileA quality-first, 9.5B-token math corpus spanning textbooks, papers, forums, and the web.
Models & tools
Ways to refine corpora and study reasoning behavior. Data refinementICML 2025 ProXTiny language models that programmatically refine corpora, with 500B+ open DCLM-Pro tokens.
Models & pre-training dataAI4Math @ ICML 2025 OctoThinkerOpen mid-training recipes, models, and pre-training data for reinforcement-learning-friendly reasoning.
|
| You are visitor 01402503 — GeezerVison does not store the pages you look up. Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required. |