Logic Before Language: Pre-pretraining on Formal Derivations Fosters Skill Acquisition and Compressibility

Part of

LLM Self-Distillation For Enhanced Reasoning