Skip to content

From NVIDIA Megatron-LM for visibility - #18

Open
RaymondLi0 wants to merge 7507 commits into
bigcode-project:multi-query-attentionfrom
NVIDIA:main
Open

From NVIDIA Megatron-LM for visibility#18
RaymondLi0 wants to merge 7507 commits into
bigcode-project:multi-query-attentionfrom
NVIDIA:main

Conversation

@RaymondLi0

@RaymondLi0 RaymondLi0 commented Jan 24, 2023

Copy link
Copy Markdown
Collaborator

No description provided.

@RaymondLi0
RaymondLi0 changed the base branch from multi-query-attention to before-merge June 20, 2023 20:12
@RaymondLi0
RaymondLi0 changed the base branch from before-merge to multi-query-attention June 20, 2023 20:12
ko3n1g and others added 27 commits June 29, 2026 18:23
@ko3n1g
build: bump transformer-engine to release_v2.16.post (#5517)
b9f7fb6 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@janEbert
Fix isort target Python version (#5567)
819912c 
Signed-off-by: janEbert <janpabloe@nvidia.com>
@janEbert
Fix PR template typo (#5566)
7b6eb02 
Signed-off-by: janEbert <janpabloe@nvidia.com>
@anlthms
Deduplicate tensor-splitting utility (#5545)
872442a 
Signed-off-by: Anil Thomas <anlthms@users.noreply.github.com>
@Phlip79 @ko3n1g
Add CI duties to oncall (#5510)
99b56a7 
Signed-off-by: Philip Petrakian <ppetrakian@nvidia.com>
Co-authored-by: oliver könig <okoenig@nvidia.com>
@yashaswikarnati
Thread dp_cp/expt_dp process groups through checkpoint load path (#5579)
817c1d5 
Signed-off-by: ykarnati <ykarnati@nvidia.com>
@rapatel
Fix TEGroupedMLP pre-backward unshard in fine-grained FSDP hooks for … (
f285ea5 
#4990)

Signed-off-by: Ritesh Patel <ripatel@nvidia.com>
@maanug-nv
[training migration] Finish ModelBuilder integration (#5516)
223e244 
Signed-off-by: Maanu Grover <maanug@nvidia.com>
@github-actions
Update copy-pr-bot.yaml [skip ci]
4849143
@Phlip79
Use NVIDIA inference credentials for Claude actions (#5589)
a3d761b 
Signed-off-by: Philip Petrakian <ppetrakian@nvidia.com>
@Phlip79
Update PR instructions (#5592)
36d11ce 
Signed-off-by: Philip Petrakian <ppetrakian@nvidia.com>
@Phlip79
Update mcore skill owners (#5586)
f972da7 
Signed-off-by: Philip Petrakian <ppetrakian@nvidia.com>
@github-actions
chore: rotate oncall schedule
8b3d8a5
@Phlip79
Add /claude fix workflow for on-demand PR fixes (#4862)
3c08255 
Signed-off-by: Philip Petrakian <ppetrakian@nvidia.com>
@github-actions
Update copy-pr-bot.yaml [skip ci]
4c4a8ee
@cspades
[Megatron-FSDP] MaxPoolAllocator for double-buffering hybrid architec…
adfe9e1 
…tures. (#5462)

Signed-off-by: Cory Ye <cye@nvidia.com>
@Pearblossom-M
fix(tensor_parallel): _reduce returns unreduced tensor for non-contig… (
60f338a 
#5338)

Signed-off-by: ma-jh <3364870135@qq.com>
@jenchen13 @realAsma @claude
Add Auto Quantize in ModelOpt quantize example (#4821)
2b551c6 
Signed-off-by: Jennifer Chen <jennifchen@nvidia.com>
Signed-off-by: realAsma <akuriparambi@nvidia.com>
Co-authored-by: realAsma <akuriparambi@nvidia.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@lhb8125 @yaox12
[Main][feat] Support CUDA Graph capture offloading modules (#3697)
69c4868 
Signed-off-by: Hongbin Liu <hongbinl@nvidia.com>
Signed-off-by: hongbinl <hongbinl@nvidia.com>
Signed-off-by: Hongbin Liu <lhb8125@users.noreply.github.com>
Co-authored-by: Xin Yao <xiny@nvidia.com>
@yashaswikarnati @claude
E2E heterogenous non colocated MiMo training (#5602)
0522099 
Signed-off-by: ykarnati <ykarnati@nvidia.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@jiemingz
Optimize memory usage of partial CUDA graphs (#5451)
5e4fe9b 
Signed-off-by: Jieming Zhang <jiemingz@nvidia.com>
Signed-off-by: root <jiemingz@nvidia.com>
@wujingyue
Document stacked dependent PR handling in split PR skill (#5496)
ee623a9 
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
@Phlip79
Fix Claude reaction permissions (#5613)
060371c 
Signed-off-by: Philip Petrakian <ppetrakian@nvidia.com>
@balasaajay
Fix smoke BERT/T5 test failures (#5629)
6608a05 
Signed-off-by: Ajay Balasa <abalasa@nvidia.com>
@wujingyue @claude
Add NCCL symmetric-memory staging to experimental FSDP (#5440)
25f6117 
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@balasaajay
Add smoke test notification functionality and update notify script (#…
d89aae5 
…5631)

Signed-off-by: Ajay Balasa <abalasa@nvidia.com>
@balasaajay
Update golden value files for GPT-3 weekly (#5459)
4828d65 
Signed-off-by: Ajay Balasa <abalasa@nvidia.com>
github-actions Bot and others added 30 commits July 31, 2026 00:27
@github-actions
Update copy-pr-bot.yaml [skip ci]
6513e3e
@svcnemo-autobot
ci(cache): AUT-1188 harden container cache selection (#6160)
8543ae4 
Signed-off-by: svcnemo-autobot <svcnemo-autobot@nvidia.com>
@svcnemo-autobot
ci(nvskills): AUT-1188 fix reusable workflow startup failure (#6162)
b19b1f4 
Signed-off-by: svcnemo-autobot <svcnemo-autobot@nvidia.com>
@wujingyue
Add MFSDP runtime schedule design (#6031)
d3519d5 
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
@utkarsh530 Utkarsh Utkarsh
@claude @shanmugamr1992 @guihong-nv
Feature/enable inference optimized qwen moe (#5700)
8339200 
Signed-off-by: Utkarsh Utkarsh <uutkarsh@nvidia.com>
Signed-off-by: Shanmugam Ramasamy <111910568+shanmugamr1992@users.noreply.github.com>
Signed-off-by: shanmugamr1992 <shanmugamr@nvidia.com>
Co-authored-by: Utkarsh Utkarsh <uutkarsh@nvidia.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Shanmugam Ramasamy <111910568+shanmugamr1992@users.noreply.github.com>
Co-authored-by: Guihong Li <guihongl@nvidia.com>
Co-authored-by: shanmugamr1992 <shanmugamr@nvidia.com>
@wdykas root
root root root root root root
Bs invar moe (#4871)
57deb43 
Signed-off-by: William Dykas <wdykas@nvidia.com>
Signed-off-by: root <root@nvl72103-T09.cm.cluster>
Signed-off-by: root <root@nvl72094-T13.cm.cluster>
Signed-off-by: root <root@nvl72098-T15.cm.cluster>
Signed-off-by: root <root@nvl72077-T17.cm.cluster>
Signed-off-by: root <root@nvl72005-T13.cm.cluster>
Signed-off-by: root <root@nvl72053-T14.cm.cluster>
Signed-off-by: root <root@nvl72151-T17.cm.cluster>
Co-authored-by: root <root@nvl72103-T09.cm.cluster>
Co-authored-by: root <root@nvl72094-T13.cm.cluster>
Co-authored-by: root <root@nvl72098-T15.cm.cluster>
Co-authored-by: root <root@nvl72077-T17.cm.cluster>
Co-authored-by: root <root@nvl72005-T13.cm.cluster>
Co-authored-by: root <root@nvl72053-T14.cm.cluster>
Co-authored-by: root <root@nvl72151-T17.cm.cluster>
@balasaajay
chore: update pytest version to 9.1.1 in pyproject.toml and uv.lock (#…
4ac5ad0 
…6170)

Signed-off-by: Ajay Balasa <abalasa@nvidia.com>
@lmcafee-nvidia @santhnm2
Fix LRU block accounting for resumed requests (#5995)
ee38649 
Signed-off-by: Lawrence McAfee <lmcafee@nvidia.com>
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
Co-authored-by: Keshav Santhanam <ksanthanam@nvidia.com>
@zhongbozhu
[Main] update moe single weight unit test (#6035)
d378bfb 
Signed-off-by: Zhongbo Zhu <zhongboz@nvidia.com>
@dimapihtar
fix ckpt conversion issue (#6151)
801d7e6 
Signed-off-by: dimapihtar <dpykhtar@nvidia.com>
Signed-off-by: Dmytro Pykhtar <dpykhtar@nvidia.com>
@Connor-XY
Add determinism developer documentation (#5718)
07fdc08 
Signed-off-by: Yan Xu <yxu1@nvidia.com>
@github-actions
Update copy-pr-bot.yaml [skip ci]
4d129d8
@wujingyue @svcnvidia-nemo-ci
Add MFSDP v2 MCore integration with FullyShardedOptimizer (#5865)
313f6e9 
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
Signed-off-by: svcnvidia-nemo-ci <svcnvidia-nemo-ci@nvidia.com>
Co-authored-by: svcnvidia-nemo-ci <svcnvidia-nemo-ci@nvidia.com>
@nvcsathe
Add streaming replies for dynamic engine (#5727)
1addfbd 
Signed-off-by: Chaitra Sathe <csathe@nvidia.com>
@balasaajay
deps: Update urllib3 to version 2.7.0 (#6182)
2cbe71d 
Signed-off-by: Ajay Balasa <abalasa@nvidia.com>
@balasaajay
deps: Update black dependency to version 26.3.0 (#6180)
f2d4dfa 
Signed-off-by: Ajay Balasa <abalasa@nvidia.com>
@wujingyue
Add meta-parameter support (#5369)
1678db5 
Signed-off-by: Jingyue Wu <wujingyue@gmail.com>
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
@wujingyue
Fix tied parameters (#6164)
714c24a 
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
Signed-off-by: Jingyue Wu <wujingyue@gmail.com>
@svcnemo-autobot
chore(ci): AUT-1231 bump preflight workflow template (#6198)
9829b3f 
Signed-off-by: svcnemo-autobot <svcnemo-autobot@nvidia.com>
@wujingyue
Clarify single communication stream benefits (#6177)
42460a7 
Signed-off-by: Jingyue Wu <jingyuew@nvidia.com>
@xuantengh
Bump black version in pre-commit config to match pyproject.toml (#6201)
df2da78 
Signed-off-by: Xuanteng Huang <xuantengh@nvidia.com>
@dimapihtar
set weights_only=True (#6150)
dac95f3 
Signed-off-by: dimapihtar <dpykhtar@nvidia.com>
Signed-off-by: Dmytro Pykhtar <dpykhtar@nvidia.com>
@fanshiqing @JF-D
[fix] Give same-key GTP chain neighbours distinct gather buffers (#6207)
c2fd827 
Signed-off-by: Shiqing Fan <shiqingf@nvidia.com>
Co-authored-by: Jiangfei Duan <jiangfeid@nvidia.com>
@philipcmonk
Fix gradient reduction issue when EP=1, EP=TP, and EGTP != GTP (#6080)
abf04f4 
Signed-off-by: Philip Monk <pmonk@nvidia.com>
@deepakn94
Apply black 26.3.0 formatting to four files it now reformats (#6210)
b4587a3 
Signed-off-by: Deepak Narayanan <dnarayanan@nvidia.com>
@Mellonta
Add context-parallel causal conv1d support (#5917)
708f0a5 
Signed-off-by: Haoran Zhang <haoranz@nvidia.com>
@CarlosGomes98
Refactor TE fused ops integration into mixin (#4630)
43b1fc8 
Signed-off-by: CarlosGomes98 <cgomes@nvidia.com>
@fanshiqing
[feat] Add reduce-scatter-with-fp32-accumulation support for GTP (#6200)
23b2ff2 
Signed-off-by: Shiqing Fan <shiqingf@nvidia.com>
@svcnemo-autobot
chore(ci): AUT-1298 bump community workflow to v1.8.7 (#6219)
5adbee2 
Signed-off-by: svcnemo-autobot <svcnemo-autobot@nvidia.com>
@paulwambergue @ilml
fix: pretrain_hybrid.py --help (#6211)
0896be0 
Signed-off-by: Paul Wambergue <paul.wambergue@mistral.ai>
Co-authored-by: Tom Long <tolong@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone