Skip to content

fix initialize nn.Linear weights. needed for modernbert - #164

Merged
wpertsch merged 2 commits into
mainfrom
fix-init-weights-linear
Mar 23, 2026
Merged

fix initialize nn.Linear weights. needed for modernbert#164
wpertsch merged 2 commits into
mainfrom
fix-init-weights-linear

Conversation

@wpertsch

Copy link
Copy Markdown
Contributor

No description provided.

@fschlatt fschlatt left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's a good spot to fix it 👍 . I just have two minor suggestions.

Comment thread lightning_ir/base/model.py Outdated
Co-authored-by: Ferdinand Schlatt <ferdinand.schlatt@uni-jena.de>
@fschlatt
fschlatt self-requested a review March 23, 2026 17:26
@wpertsch
wpertsch merged commit 03e8def into main Mar 23, 2026
2 of 7 checks passed
@wpertsch
wpertsch deleted the fix-init-weights-linear branch March 23, 2026 17:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants