Tag: fine-tuning dataset
-
Data Is the Actual Job: Formats, Quality, Splits and Synthetic Data
Your fine-tuning dataset decides everything the loop does not. Formats, deduplication, decontamination, honest splits, synthetic data and model collapse.