80.4 GB
synquid's picture
Set max_position_embeddings to 131072 (128k), the context length used in SFT and RL training
2241b67 verified