Skip to content

attention block for obs assimilation #70

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
bnb32 wants to merge 29 commits into from
Closed

attention block for obs assimilation #70

Show file tree
Hide file tree
Changes from 15 commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
7effbdf
attention block for obs assimilation
bnb32 Mar 5, 2026
c78c00b
linting
bnb32 Mar 5, 2026
f8b074f
test fix
bnb32 Mar 5, 2026
a67474a
split out base layer with tokenization and encoding and renamed atten…
bnb32 Mar 6, 2026
678361e
project field deprecated -> workspace
bnb32 Mar 7, 2026
af0dc38
refactor Sup3rCrossAttention: rename mlp_head to final_proj and updat…
bnb32 Mar 9, 2026
e9b34b7
chore: remove deprecated linter configurations and update linter work…
bnb32 Mar 9, 2026
29c4819
linting
bnb32 Mar 9, 2026
818aaf7
fix pos encoding dimensionality
bnb32 Mar 9, 2026
3142569
vectorized positional encoding computation
bnb32 Mar 10, 2026
d03a9ae
moved pooling before encoding
bnb32 Mar 10, 2026
98852ed
linting
bnb32 Mar 10, 2026
b73fb0a
attn and encoding tests for patch_size > 1
bnb32 Mar 10, 2026
0f0bab7
Enhance Sup3rCrossAttention and TokenizeEncodeBase layers with patch …
bnb32 Mar 16, 2026
f1ddfdc
Refactor TokenizeEncodeBase layer for improved NaN handling and dynam…
bnb32 Mar 19, 2026
ca4b63d
Fix NaN handling in TokenizeEncodeBase and update Sup3rCrossAttention…
bnb32 Mar 20, 2026
11485b8
reverting llm lies
bnb32 Mar 20, 2026
099665e
Refactor test_double_skip to use set for index checks
bnb32 Mar 20, 2026
7721079
`use_bias=False` for dense layer tokenization
bnb32 Mar 21, 2026
bb6bd67
Fix mask shape in test_cross_attn_2d for correct dimensionality
bnb32 Mar 21, 2026
07b6e01
Add lat / lon / time based encoding.
bnb32 Mar 22, 2026
28395e1
Update version in pixi.lock and refactor test layers for TokenizeEnco…
bnb32 Mar 23, 2026
c83b7f7
- Split TokenizeEncode class into Tokenizer and PositionEncoder classes.
bnb32 Mar 29, 2026
6d60642
Enhance MultiHeadAttention to support optional positional encodings f…
bnb32 Mar 29, 2026
1cc9283
Refactor MultiHeadAttention and Sup3rCrossAttention to remove dropout…
bnb32 Mar 30, 2026
458df2b
Refactor PositionEncoder frequency encoding parameters; simplify Sup3…
bnb32 Mar 30, 2026
7c72d70
Add clarification on positional encodings in Sup3rCrossAttention; ref…
bnb32 Mar 31, 2026
4308699
Removed index based positional encoding. Base attention layer uses su…
bnb32 Apr 2, 2026
8aa248b
Refactor PositionEncoder: remove generic positional encoding method a…
bnb32 Apr 3, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 0 additions & 4 deletions .github/linters/.flake8
View file
Open in desktop

This file was deleted.

Loading
Loading