Skip to content

[Feature] Add GLM-5.3 KDA projection and head alignment - #2326

Draft
qescccczmr wants to merge 2 commits into
mainfrom
qesccczmr
Draft

qescccczmr wants to merge 2 commits into
mainfrom
qesccczmr

Conversation

@qescccczmr

Copy link
Copy Markdown
Collaborator

Summary

  • Add opt-in GLM-5.3 KDA projection and output-head alignment support.
  • Keep the alignment path compatible with rollout router expert IDs.
  • Add focused alignment tests.

Validation

  • tests/ops/test_lmdeploy_alignment.py — 20 passed

@qescccczmr
qescccczmr marked this pull request as draft November 19, 2026 04:39

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant