MAMMOTH: A Multi-Modal End-to-End Policy for Off-Road Mobility Robust to Missing Modality