Moe kernels refactor#529

Open

Datta0 wants to merge 21 commits intounslothai:mainfrom

Datta0:moe_kernels_refactor

Commits on Mar 3, 2026

MoE Kernel (#2465)

jeromeku
authored and
Datta0
committed
Llama4 MoE Grouped GEMM (#2639)

jeromeku
authored and
Datta0
committed
Create LICENSE

danielhanchen
authored and
Datta0
committed
Fix Typos in Documentation and Comments (#2721)

leopardracer
authored and
Datta0
committed
Docs: Fix typo and improve MoE docstrings (#2784)

kilavvy
authored and
Datta0
committed
MoE kernels AGPLv3

danielhanchen
authored and
Datta0
committed
Formatting & bug fixes (#3563)

committed
Vllm guided decoding params (#3662)

committed
Revert "[FIX] Vllm guided decoding params (#3662)"

danielhanchen
authored and
Datta0
committed
auto fixes from pre-commit.com hooks

pre-commit-ci[bot]
authored and
Datta0
committed
Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks"

danielhanchen
authored and
Datta0
committed
auto fixes from pre-commit.com hooks

pre-commit-ci[bot]
authored and
Datta0
committed
Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks"

danielhanchen
authored and
Datta0
committed
auto fixes from pre-commit.com hooks

pre-commit-ci[bot]
authored and
Datta0
committed
Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks"

danielhanchen
authored and
Datta0
committed
Improve moe kernels for unsloth fine tuning (#3812)

committed
fix for tma (#4023)

leizhenyuan
authored and
Datta0
committed
fix(ROCm): prevent false TMA support detection on AMD GPUs (#4126)

GoldenGrapeGentleman
authored and
Datta0
committed
Restructure imports for moe stuff and fixup qwen3moe extractor
Datta0
committed
Update headers
Datta0
committed
Merge remote-tracking branch 'origin/main' into moe_kernels_refactor
Datta0
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Moe kernels refactor#529

Moe kernels refactor#529
Datta0 wants to merge 21 commits intounslothai:mainfrom
Datta0:moe_kernels_refactor

Commits on Mar 3, 2026

MoE Kernel (#2465)

Llama4 MoE Grouped GEMM (#2639)

Create LICENSE

Fix Typos in Documentation and Comments (#2721)

Docs: Fix typo and improve MoE docstrings (#2784)

MoE kernels AGPLv3

Formatting & bug fixes (#3563)

Vllm guided decoding params (#3662)

Revert "[FIX] Vllm guided decoding params (#3662)"

auto fixes from pre-commit.com hooks

Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks"

auto fixes from pre-commit.com hooks

Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks"

auto fixes from pre-commit.com hooks

Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks"

Improve moe kernels for unsloth fine tuning (#3812)

fix for tma (#4023)

fix(ROCm): prevent false TMA support detection on AMD GPUs (#4126)

Restructure imports for moe stuff and fixup qwen3moe extractor

Update headers

Merge remote-tracking branch 'origin/main' into moe_kernels_refactor