Issues

• multichoice verifiers grade 'Answer: b' as wrong and read the first letter of a word as the choice

  bugcommunity-request
  NVIDIA-NeMo/RL#5196 · Filter by author dundysm opened on Nov 12, 2026

• rewards: answer extraction spans every <answer> block, so repeated tags score 0

  bugcommunity-request
  NVIDIA-NeMo/RL#5193 · Filter by author dundysm opened on Nov 12, 2026

• FLOPs tracker undercounts Moonlight: DeepSeek-V3 branch ignores n_shared_experts and first_k_dense_replace

  bugcommunity-request
  NVIDIA-NeMo/RL#5188 · Filter by author dundysm opened on Nov 12, 2026

• Resumed Gym calls: reasoning_ended and the grammar after a prefix-recovery cut

  bug
  NVIDIA-NeMo/RL#5177 · Filter by author terrykong opened on Nov 12, 2026

• Unify all resource configuration under the top-level cluster block

  Feature
  NVIDIA-NeMo/RL#5174 · Filter by author yuki-97 opened on Nov 11, 2026

• Qwen3.5+ (GDN) Megatron training on B200: logprob and train passes disagree (probs_ratio >> 1), GRPO collapses

  accuracybugcommunity-request
  NVIDIA-NeMo/RL#5173 · Filter by author ran-avniran opened on Nov 11, 2026

• [Feature] Support divergence-masked policy-gradient losses with a sampling-policy KL

  algorithmFeatureneeds-design
  NVIDIA-NeMo/RL#5170 · Filter by author RayenTian opened on Nov 11, 2026

• Cache CUTE_DSL_CACHE_DIR in persistent compile caches (follow-up to #4715)

  Feature
  NVIDIA-NeMo/RL#5148 · Filter by author terrykong opened on Nov 10, 2026
  

• feat(trtllm): support generation-side expert TP (ETP > 1) in nccl_reshard refit

  Feature
  NVIDIA-NeMo/RL#5131 · Filter by author shuyixiong opened on Nov 9, 2026
  

• Rename forest-training call-linking fields (request_replay, candidate_replay, …) in Gym and RL

  DocumentationFeature
  NVIDIA-NeMo/RL#5123 · Filter by author terrykong opened on Nov 8, 2026
  

• Megatron Inference token capture: forest training loses capture on every continued Gym call

  NVIDIA-NeMo/RL#5119 · Filter by author terrykong opened on Nov 7, 2026
  

• SingleController: consolidate EOF tails and allow borrowing without raw-prompt repayment

  bug
  NVIDIA-NeMo/RL#5099 · Filter by author RayenTian opened on Nov 6, 2026

• [Tracking] AutoModel backend support for Single Controller

  Feature
  NVIDIA-NeMo/RL#5090 · Filter by author sharonyu-115 opened on Nov 5, 2026
  1

  

• Megatron critic does not mask router padding outside Forest

  bug
  NVIDIA-NeMo/RL#5089 · Filter by author bg51717 opened on Nov 5, 2026
  

• Investigate recurring median probability-error failures in DAPO Mistral Medium 3.5 128B

  accuracybug
  NVIDIA-NeMo/RL#5071 · Filter by author terrykong opened on Nov 4, 2026

• refactor(config): split checkpointing into save and load sections

  NVIDIA-NeMo/RL#5067 · Filter by author yuki-97 opened on Nov 4, 2026

• Async GRPO rejects DAPO reward scaling: scale_rewards is not applied in async_grpo_train

  community-requestFeature
  NVIDIA-NeMo/RL#5062 · Filter by author linmuchuiyang opened on Nov 4, 2026

• SingleController parity with legacy GRPO/PPO: remaining features and validation gaps

  Feature
  NVIDIA-NeMo/RL#5044 · Filter by author yuki-97 opened on Nov 3, 2026

• Align v1's dynamic-sampling reward metrics with the SingleController naming

  bugDocumentation
  NVIDIA-NeMo/RL#5039 · Filter by author RayenTian opened on Nov 3, 2026

• Rollout marks EOS-terminated responses as truncated when the final environment observation is cut

  bugcommunity-request
  NVIDIA-NeMo/RL#5016 · Filter by author damienen opened on Nov 2, 2026

• refactor(reward-penalties): share one malformed-think-tag predicate between the echo and capture paths

  enhancement
  NVIDIA-NeMo/RL#5008 · Filter by author bg51717 opened on Oct 31, 2026
  

• data-plane: keep CUDA work on each rank's own GPU (follow-up to #4966)

  bug
  NVIDIA-NeMo/RL#5004 · Filter by author zyzhou5 opened on Oct 30, 2026

• feat(generation): add CoreWeave Dedicated Inference backend with checkpoint hot-load

  community-requestFeaturewaiting-on-maintainers
  NVIDIA-NeMo/RL#4964 · Filter by author anson627 opened on Oct 28, 2026

• Generation-node restart: replacement refit fails and router ignores new endpoints

  bug
  NVIDIA-NeMo/RL#4937 · Filter by author zyzhou5 opened on Oct 27, 2026

• bbox_giou_reward is unbounded: reversed-corner or NaN boxes score far above 1 (RefCOCO env)

  bugcommunity-request
  NVIDIA-NeMo/RL#4871 · Filter by author jimmy-holdout opened on Oct 23, 2026