Skip to content

Support MTP loss mask_type v1 and multi mtp_config#1919

Open
x54-729 wants to merge 14 commits into
InternLM:mainfrom
x54-729:mtp_260616
Open

Support MTP loss mask_type v1 and multi mtp_config#1919
x54-729 wants to merge 14 commits into
InternLM:mainfrom
x54-729:mtp_260616

remove mtp_loss sum in moe.py; change total_loss sum in train_engine.py

0bcbace
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 error and 1 warning
lint
failed Jun 22, 2026 in 2m 22s