File tree Expand file tree Collapse file tree 1 file changed +1
-2
lines changed
examples/puzzletron/mbridge_distillation Expand file tree Collapse file tree 1 file changed +1
-2
lines changed Original file line number Diff line number Diff line change @@ -30,6 +30,7 @@ docker run --gpus all -it --rm \
3030 -v /path/to/your/project:/workspace \
3131 -v ${MODELOPT_DIR} :/opt/Model-Optimizer \
3232 -v ${MODELOPT_DIR} /modelopt:/opt/venv/lib/python3.12/site-packages/modelopt \
33+ -w /opt/Model-Optimizer \
3334 nvcr.io/nvidia/nemo:26.02 \
3435 /bin/bash
3536```
@@ -64,8 +65,6 @@ This will create:
6465Run distillation directly from HuggingFace checkpoints (student and teacher) with tokenized dataset:
6566
6667``` bash
67- # Run from /opt/Model-Optimizer directory inside the container
68- cd /opt/Model-Optimizer
6968torchrun --nproc_per_node=8 examples/puzzletron/mbridge_distillation/distill_hf.py \
7069 --student_hf_path /path/to/student/huggingface/checkpoint \
7170 --teacher_hf_path /path/to/teacher/huggingface/checkpoint \
You can’t perform that action at this time.
0 commit comments