Any plans to release the training recipe?

#21

by nskwal - opened 16 days ago

Discussion

nskwal

16 days ago

Are there any plans to release the training recipe and configuration used with Megatron-LM?

okuchaiev

NVIDIA org 11 days ago

Have you seen this https://arxiv.org/pdf/2508.14444 ?

Jackmego

9 days ago

•

edited 9 days ago

@okuchaiev Is there any detailed scripts regarding how to generate training data and how to perform phased pre-training & sft to reproduce the metrics and conclusions of the paper?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment