[English|中文版]

Introduction

FlagGems-sglang is part of FlagOS. FlagGems-sglang is a deep neural network computing library oriented towards multiple chip backends. It provides high-performance implementations of common deep learning operators, supporting efficient computation in fields such as deep learning, computer vision, natural language processing, and artificial intelligence.

FlagGems-sglang is a high-performance deep learning operator library implemented using the Triton programming language launched by OpenAI.

Features

• Operators have undergone deep performance tuning
• Triton kernel call optimization
• Flexible multi-backend support mechanism
• Support for common deep learning operators (ReLU, etc.)

Quick Installation

Install Dependencies

pip install -U scikit-build-core>=0.11 pybind11 ninja cmake

Install FlagGems-sglang

git clone https://github.com/flagos-ai/FlagGems-sglang.git
cd FlagGems-sglang
pip install  .

Usage Example

import torch
import flaggems_sglang

# Create a tensor
x = torch.randn(1024, device='cuda')

# Apply ReLU activation
y = flaggems_sglang.ops.relu(x)

This project is licensed under the Apache (version 2.0) License.