Spaces:
Running on CPU Upgrade
Running on CPU Upgrade
Commit ·
32ef17b
1
Parent(s): bee1bde
add acknowledgments
Browse files
app/src/content/chapters/7-conclusions.mdx
CHANGED
|
@@ -19,4 +19,8 @@ Beyond faster generation, we answered several questions about best practices but
|
|
| 19 |
- **Source filtering**: Should we filter documents before or after rephrasing? For instance, applying a math prompt to non-mathematical documents likely wastes compute and adds noise.
|
| 20 |
- **Larger ablations and mixtures**: We want to run more extensive mixture experiments, exploring how synthetic data interacts with source data at scale, in line with the recent [smol-data](https://huggingface.co/spaces/HuggingFaceTB/smol-data) effort.
|
| 21 |
|
| 22 |
-
The playbook is open. Build on it.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
- **Source filtering**: Should we filter documents before or after rephrasing? For instance, applying a math prompt to non-mathematical documents likely wastes compute and adds noise.
|
| 20 |
- **Larger ablations and mixtures**: We want to run more extensive mixture experiments, exploring how synthetic data interacts with source data at scale, in line with the recent [smol-data](https://huggingface.co/spaces/HuggingFaceTB/smol-data) effort.
|
| 21 |
|
| 22 |
+
The playbook is open. Build on it.
|
| 23 |
+
|
| 24 |
+
## Acknowledgements
|
| 25 |
+
|
| 26 |
+
We thank Ratish Puduppully for sharing the G-Vendi paper and discussion around diversity scores. We are thankful to the anonymous CoLM reviewers for their detailed feedback.
|