Issues

• [recipe/docs] DeepSeek-V4-Pro recipes on H100: raise dist_env.timeout_minutes, enable the #3893 prewarm / shared HybridEP JIT cache, and document offline Hub resolution

  community-request
  NVIDIA-NeMo/Automodel#4229 · Filter by author linmuchuiyang opened on Oct 9, 2026

• [bug] distributed.defer_fsdp_grad_sync: false has no effect for MoE models under pipeline parallelism (r0.6.0 / NGC 26.08)

  community-request
  NVIDIA-NeMo/Automodel#4228 · Filter by author linmuchuiyang opened on Oct 9, 2026
  

• [bug] deepseek_v41_flash_tulu3_packed_cp8_32k.yaml: training completes on its target 16 × 4 GB200, but the update-99 checkpoint save OOMs in TE FusedAdam.state_dict (BF16 → FP32 moment expansion); the same save completes at 32 nodes (8.2 TB, 1:41)

  community-request
  NVIDIA-NeMo/Automodel#4209 · Filter by author linmuchuiyang opened on Oct 8, 2026
  

• Qwen3.8-Flash-Next: TypeError 'NoneType' object is not subscriptable at config.layer_types[layer_idx] when building GatedDeltaNet layers (layer_types left None)

  NVIDIA-NeMo/Automodel#4205 · Filter by author janbernloehr opened on Oct 8, 2026
  

• Audit packed-sequence metadata contracts across models, CP/PP, and MTP

  NVIDIA-NeMo/Automodel#4173 · Filter by author HuiyingLi opened on Oct 6, 2026
  

• ci: a PR that is green against a stale base can turn main red and fail other contributors' PRs

  community-requestwaiting-on-maintainers
  NVIDIA-NeMo/Automodel#4170 · Filter by author kabirvashisht4-glitch opened on Oct 6, 2026

• EOD Mask Loss and Document Boundary Features Not Functional

  bugcommunity-requestwaiting-on-maintainers
  NVIDIA-NeMo/Automodel#4157 · Filter by author bigben-dev777 opened on Oct 5, 2026
  2

• [Perf] Qwen3.8-Flash-Next: flex QSA mask memory at long sequences

  community-request
  NVIDIA-NeMo/Automodel#4147 · Filter by author rouchenzi opened on Oct 5, 2026
  3

  

• Qwen3.8-Flash-Next requires extra template handling for non-reasoning SFT data

  community-requestwaiting-on-customer
  NVIDIA-NeMo/Automodel#4145 · Filter by author rouchenzi opened on Oct 4, 2026
  2

  

• Explore supporting KohakuFA

  enhancement
  NVIDIA-NeMo/Automodel#4134 · Filter by author akoumpa opened on Oct 4, 2026
  

• [RFC] Explore deprecation of DDP in favor of FSDP2

  enhancement
  NVIDIA-NeMo/Automodel#4122 · Filter by author akoumpa opened on Oct 2, 2026
  1

• ChatDataset never supervises the end-of-turn token for GLM chat templates

  community-requestwaiting-on-customer
  NVIDIA-NeMo/Automodel#4108 · Filter by author waynel96 opened on Oct 1, 2026
  2

  

• fake_balanced_gate skips router computation, confounding load-balance benchmarks

  NVIDIA-NeMo/Automodel#4106 · Filter by author akoumpa opened on Oct 1, 2026
  

• [Tracking] followup checkpoint I/O architecture, correctness, performance, and memory

  ckptenhancementPerformancePoR
  NVIDIA-NeMo/Automodel#4096 · Filter by author akoumpa opened on Oct 1, 2026
  

• Kimi K3 MXFP4 support

  community-requestenhancementwaiting-on-maintainers
  NVIDIA-NeMo/Automodel#4078 · Filter by author sophiayyya opened on Oct 1, 2026
  

• Support checkpointing and export of adapted MoE router biases

  NVIDIA-NeMo/Automodel#4075 · Filter by author yuhezhang-ai opened on Sep 30, 2026
  

• kimi_k25_vl PEFT and full-weight exports disagree on the outer model

  bugcommunity-requestwaiting-on-maintainers
  NVIDIA-NeMo/Automodel#4051 · Filter by author stanley1208 opened on Sep 29, 2026

• EvalPort: portable interchange for ToolCallAccuracyEvaluator results

  community-requestwaiting-on-maintainers
  NVIDIA-NeMo/Automodel#4031 · Filter by author adhabnr-ux opened on Sep 27, 2026

• Loss Divergence after 250 Steps during Gemma 4 4B Joint Drafter Fine-Tuning

  bugcommunity-requestwaiting-on-maintainers
  NVIDIA-NeMo/Automodel#4022 · Filter by author niveditaapr21 opened on Sep 25, 2026
  6

  

• [RFC] Adopt PyTorch per-parameter mixed precision in AutoModel FSDP2

  enhancement
  NVIDIA-NeMo/Automodel#4021 · Filter by author HuiyingLi opened on Sep 25, 2026
  2

  

• Question about pretraining model support

  community-requestenhancementwaiting-on-customer
  NVIDIA-NeMo/Automodel#4012 · Filter by author imezx opened on Sep 24, 2026
  4

• [Tracking] Qwen3.8-Flash-Next perf

  NVIDIA-NeMo/Automodel#3971 · Filter by author HuiyingLi opened on Sep 22, 2026
  

• [Tracking] Kimi K3 performance and correctness

  PoR
  NVIDIA-NeMo/Automodel#3957 · Filter by author HuiyingLi opened on Sep 21, 2026
  

• [Tracking] DSV4.1 perf

  enhancement
  NVIDIA-NeMo/Automodel#3956 · Filter by author HuiyingLi opened on Sep 21, 2026
  3

  

• GLM-5.3-Flash: which Transformers version produced the published HF logit parity?

  community-requestwaiting-on-maintainers
  NVIDIA-NeMo/Automodel#3940 · Filter by author waynel96 opened on Sep 18, 2026
  8