You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We as members, contributors, and leaders pledge to make participation in our community a harassment-free experience for everyone, regardless of age, body size, visible or invisible disability, ethnicity, sex characteristics, gender identity and expression, level of experience, education, socio-economic status, nationality, personal appearance, race, caste, color, religion, or sexual identity and orientation.
6
+
7
+
We pledge to act and interact in ways that contribute to an open, welcoming, diverse, inclusive, and healthy community.
8
+
9
+
## Our Standards
10
+
11
+
Examples of behavior that contributes to a positive environment for our community include:
12
+
13
+
- Demonstrating empathy and kindness toward other people
14
+
- Being respectful of differing opinions, viewpoints, and experiences
15
+
- Giving and gracefully accepting constructive feedback
16
+
- Accepting responsibility and apologizing to those affected by our mistakes, and learning from the experience
17
+
- Focusing on what is best not just for us as individuals, but for the overall community
18
+
19
+
Examples of unacceptable behavior include:
20
+
21
+
- The use of sexualized language or imagery, and sexual attention or advances of any kind
22
+
- Trolling, insulting or derogatory comments, and personal or political attacks
23
+
- Public or private harassment
24
+
- Publishing others' private information, such as a physical or email address, without their explicit permission
25
+
- Other conduct which could reasonably be considered inappropriate in a professional setting
26
+
27
+
## Enforcement Responsibilities
28
+
29
+
Community leaders are responsible for clarifying and enforcing our standards of acceptable behavior and will take appropriate and fair corrective action in response to any behavior that they deem inappropriate, threatening, offensive, or harmful.
30
+
31
+
Community leaders have the right and responsibility to remove, edit, or reject comments, commits, code, wiki edits, issues, and other contributions that are not aligned to this Code of Conduct, and will communicate reasons for moderation decisions when appropriate.
32
+
33
+
## Scope
34
+
35
+
This Code of Conduct applies within all community spaces, and also applies when an individual is officially representing the community in public spaces. Examples of representing our community include using an official e-mail address, posting via an official social media account, or acting as an appointed representative at an online or offline event.
36
+
37
+
## Enforcement
38
+
39
+
Instances of abusive, harassing, or otherwise unacceptable behavior may be reported to the community leaders responsible for enforcement in the WeChat Group. All complaints will be reviewed and investigated promptly and fairly.
40
+
41
+
All community leaders are obligated to respect the privacy and security of the reporter of any incident.
42
+
43
+
## Enforcement Guidelines
44
+
45
+
Community leaders will follow these Community Impact Guidelines in determining the consequences for any action they deem in violation of this Code of Conduct:
46
+
47
+
### 1. Correction
48
+
49
+
**Community Impact**: Use of inappropriate language or other behavior deemed unprofessional or unwelcome in the community.
50
+
51
+
**Consequence**: A private, written warning from community leaders, providing clarity around the nature of the violation and an explanation of why the behavior was inappropriate. A public apology may be requested.
52
+
53
+
### 2. Warning
54
+
55
+
**Community Impact**: A violation through a single incident or series of actions.
56
+
57
+
**Consequence**: A warning with consequences for continued behavior. No interaction with the people involved, including unsolicited interaction with those enforcing the Code of Conduct, for a specified period of time. This includes avoiding interactions in community spaces as well as external channels like social media. Violating these terms may lead to a temporary or permanent ban.
58
+
59
+
### 3. Temporary Ban
60
+
61
+
**Community Impact**: A serious violation of community standards, including sustained inappropriate behavior.
62
+
63
+
**Consequence**: A temporary ban from any sort of interaction or public communication with the community for a specified period of time. No public or private interaction with the people involved, including unsolicited interaction with those enforcing the Code of Conduct, is allowed during this period. Violating these terms may lead to a permanent ban.
64
+
65
+
### 4. Permanent Ban
66
+
67
+
**Community Impact**: Demonstrating a pattern of violation of community standards, including sustained inappropriate behavior, harassment of an individual, or aggression toward or disparagement of classes of individuals.
68
+
69
+
**Consequence**: A permanent ban from any sort of public interaction within the community.
70
+
71
+
## Attribution
72
+
73
+
This Code of Conduct is adapted from the [Contributor Covenant][homepage], version 2.1, available at [https://www.contributor-covenant.org/version/2/1/code_of_conduct.html][v2.1].
74
+
75
+
Community Impact Guidelines were inspired by [Mozilla's code of conduct enforcement ladder][Mozilla CoC].
76
+
77
+
For answers to common questions about this code of conduct, see the FAQ at [https://www.contributor-covenant.org/faq][FAQ]. Translations are available at [https://www.contributor-covenant.org/translations][translations].
Copy file name to clipboardExpand all lines: README.md
+39-8Lines changed: 39 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,9 +4,9 @@
4
4
5
5
## Introduction
6
6
7
-
FlagGems is a high-performance general operator library implemented in [OpenAI Triton](https://github.com/openai/triton). It aims to provide a suite of kernel functions to accelerate LLM training and inference.
7
+
FlagGems is a high-performance general operator library implemented in [OpenAI Triton](https://github.com/openai/triton). It builds on a collection of backend neutral kernels that aims to accelerate LLM training and inference across diverse hardware platforms.
8
8
9
-
By registering with the ATen backend of PyTorch, FlagGems facilitates a seamless transition, allowing users to switch to the Triton function library without the need to modify their model code. Users can still utilize the ATen backend as usual while experiencing significant performance enhancement. The Triton language offers benefits in readability, user-friendliness and performance comparable to CUDA. This convenience allows developers to engage in the development of FlagGems with minimal learning investment.
9
+
By registering with the ATen backend of PyTorch, FlagGems facilitates a seamless transition, allowing model developers to switch to Triton without changing the low level APIs. Users can still use their familiar Pytorch APIs as usual and benefit from new hardware acceleration technologies. For kernel developers, the Triton language offers readability, user-friendliness and performance comparable to CUDA. This convenience allows developers to engage in the development of FlagGems with minimal learning investment.
10
10
11
11
We created WeChat group for FlagGems. Scan the QR code to join the group chat! To get the first hand message about our updates and new release, or having any questions or ideas, join us now!
12
12
@@ -16,41 +16,61 @@ We created WeChat group for FlagGems. Scan the QR code to join the group chat! T
16
16
17
17
## Features
18
18
19
+
FlagGems provides the following technical features.
20
+
21
+
- A large collection of PyTorch compatible operators
22
+
- Hand optimized performance for selective operators
- Multi-backend interface enabling support of diverse hardware platforms
27
+
- Over 10 supported backends
28
+
- C++ Triton function dispatcher (working in progress)
29
+
30
+
## More About Features
31
+
19
32
### Multi-Backend Hardware Support
33
+
20
34
FlagGems supports a wide range of hardware platforms and has been extensively tested across different hardware configurations.
21
35
22
36
### Automatic Codegen
37
+
23
38
FlagGems provides an automatic code generation mechanism that enables developers to easily generate both pointwise and fused operators.
24
39
The auto-generation system supports a variety of needs, including standard element-wise computations, non-tensor parameters, and specifying output types.
25
-
For more details, please refer to pointwise_dynamic(docs/pointwise_dynamic.md).
40
+
For more details, please refer to [pointwise_dynamic](docs/pointwise_dynamic.md).
26
41
27
42
### LibEntry
43
+
28
44
FlagGems introduces `LibEntry`, which independently manages the kernel cache and bypasses the runtime of `Autotuner`, `Heuristics`, and `JitFunction`. To use it, simply decorate the Triton kernel with LibEntry.
29
45
30
46
`LibEntry` also supports direct wrapping of `Autotuner`, `Heuristics`, and `JitFunction`, preserving full tuning functionality. However, it avoids nested runtime type invocations, eliminating redundant parameter processing. This means no need for binding or type wrapping, resulting in a simplified cache key format and reduced unnecessary key computation.
31
47
32
48
### C++ Runtime
49
+
33
50
FlagGems can be installed either as a pure Python package or as a package with C++ extensions. The C++ runtime is designed to address the overhead of the Python runtime and improve end-to-end performance.
34
51
For more details, please refer to [c++ extensions](docs/build_flaggems_with_c_extensions.md).
0 commit comments