Skip to content

Fa upstream3#561

Merged
fsx950223 merged 13 commits into
aiter_merge_releasefrom
fa_upstream3
May 29, 2025
Merged

Fa upstream3#561
fsx950223 merged 13 commits into
aiter_merge_releasefrom
fa_upstream3

Conversation

@fsx950223

@fsx950223 fsx950223 commented May 29, 2025

Copy link
Copy Markdown

Please direct your PRs to the upstream vllm (https://github.com/vllm-project/vllm.git)

Accepting PRs into the ROCm fork (https://github.com/ROCm/vllm) will require a clear previously communicated exception

fsx950223 added 13 commits May 8, 2025 05:34
Signed-off-by: fsx950223 <fsx950223@outlook.com>
Signed-off-by: fsx950223 <fsx950223@outlook.com>
Signed-off-by: fsx950223 <fsx950223@outlook.com>
Signed-off-by: fsx950223 <fsx950223@outlook.com>
Signed-off-by: fsx950223 <fsx950223@outlook.com>
Signed-off-by: fsx950223 <fsx950223@outlook.com>
Signed-off-by: fsx950223 <fsx950223@outlook.com>
Signed-off-by: fsx950223 <fsx950223@outlook.com>
Signed-off-by: fsx950223 <fsx950223@outlook.com>
Signed-off-by: fsx950223 <fsx950223@outlook.com>
Signed-off-by: fsx950223 <fsx950223@outlook.com>
Signed-off-by: fsx950223 <fsx950223@outlook.com>
Signed-off-by: fsx950223 <fsx950223@outlook.com>
@fsx950223 fsx950223 merged commit 720729c into aiter_merge_release May 29, 2025
4 of 6 checks passed
fsx950223 added a commit that referenced this pull request May 29, 2025
* integrate aiter

Signed-off-by: fsx950223 <fsx950223@outlook.com>

* add env variable

Signed-off-by: fsx950223 <fsx950223@outlook.com>

* rename function

Signed-off-by: fsx950223 <fsx950223@outlook.com>

* optimize kernels with small query lens

Signed-off-by: fsx950223 <fsx950223@outlook.com>

* change condition

Signed-off-by: fsx950223 <fsx950223@outlook.com>

* add rocm aiter backend

Signed-off-by: fsx950223 <fsx950223@outlook.com>

* new fa impl

Signed-off-by: fsx950223 <fsx950223@outlook.com>

* update api

Signed-off-by: fsx950223 <fsx950223@outlook.com>

* optimize performance

Signed-off-by: fsx950223 <fsx950223@outlook.com>

* remove try catch

Signed-off-by: fsx950223 <fsx950223@outlook.com>

* clean code

Signed-off-by: fsx950223 <fsx950223@outlook.com>

---------

Signed-off-by: fsx950223 <fsx950223@outlook.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant