Skip to content

perf(optim): implement Gram Newton-Schulz for Muon #301

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
KakaruHayate wants to merge 1 commit into
base: muon_lynxnet2
Choose a base branch
from

perf: optimize Muon with GramNS and fix fp16 spectral norm stability

8d6a177
Select commit
Loading
Failed to load commit list.
Open

perf(optim): implement Gram Newton-Schulz for Muon #301

perf: optimize Muon with GramNS and fix fp16 spectral norm stability
8d6a177
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs