Skip to content

Commit 2c128ab

Browse files
JackyJqzmeta-codesync[bot]
authored andcommitted
Update OSS ads_mkl README for TLX kernel packages
Summary: - Add the `multi_cta_norm_fusion` and `gdpa_megakernel` packages to the top-level OSS project table. - Document the TLX `fbtriton==3.6.1` dependency alongside the existing CuteDSL dependency. - Link the top-level quick-start section to each OSS package README. Reviewed By: mengluy0125 Differential Revision: D109745502 fbshipit-source-id: 35f601ffd855182056d70a812fd4134dfcc3dd86
1 parent fa0205a commit 2c128ab

1 file changed

Lines changed: 15 additions & 3 deletions

File tree

README.md

Lines changed: 15 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -4,12 +4,12 @@ High-performance GPU kernels for Meta Ads Recommendation Systems, developed by M
44

55
## Projects
66

7-
More coming soon!
8-
97
| Project | Description | Architecture | Path |
108
|---------|-------------|--------------|------|
119
| [GDPA](gdpa/) | Generalized Dot Product Attention kernels | Blackwell (SM100) | `gdpa/` |
1210
| [TLX Block Attention](block_attention/) | Triton TLX block attention kernels | Blackwell (SM100) | `block_attention/` |
11+
| [TLX Multi-CTA Norm Fusion](multi_cta_norm_fusion/) | Triton TLX fused matmul with RMSNorm and LayerNorm kernels | Blackwell (SM100) | `multi_cta_norm_fusion/` |
12+
| [TLX GDPA Megakernel](gdpa_megakernel/) | Triton TLX generalized dot product attention megakernel | Blackwell (SM100) | `gdpa_megakernel/` |
1313

1414
## Requirements
1515

@@ -18,22 +18,34 @@ More coming soon!
1818
- NVIDIA GPU with Hopper (SM90) or Blackwell (SM100) architecture
1919
- CUDA >= 12.0
2020
- [nvidia-cutlass-dsl](https://github.com/NVIDIA/cutlass) >= 4.1.0
21+
- `fbtriton==3.6.1` for TLX packages
2122

2223
## Installation
2324

25+
For CuteDSL GDPA:
26+
2427
```bash
2528
pip install nvidia-cutlass-dsl>=4.1.0 torch einops
2629
```
2730

31+
For TLX packages, see the project-specific `environment.yml` files or install the matching Triton build:
32+
33+
```bash
34+
pip install fbtriton==3.6.1
35+
```
36+
2837
## Quick Start
2938

3039
See individual project READMEs for detailed usage:
3140

3241
- [GDPA Quick Start](gdpa/README.md#quick-start)
42+
- [TLX Block Attention Quick Start](block_attention/README.md#quick-start)
43+
- [TLX Multi-CTA Norm Fusion](multi_cta_norm_fusion/README.md)
44+
- [TLX GDPA Megakernel](gdpa_megakernel/README.md)
3345

3446
## Contributors
3547

36-
**Meta Ads AI:** Jiaqi Xu, Chao Chen, Hongtao Yu, Dev Shanker, Jacky Zhou, Han Xu, Jake Siso, Xiaoyi Liu, Huayu Li, Markus Hoehnerbach, Manman Ren
48+
**Meta Ads AI:** Jiaqi Xu, Chao Chen, Hongtao Yu, Dev Shanker, Junqing (Jacky) Zhou, Han Xu, Jake Siso, Xiaoyi Liu, Huayu Li, Markus Hoehnerbach, Manman Ren
3749

3850
More contributors will be added as we publish more kernels.
3951

0 commit comments

Comments
 (0)