Skip to content

Commit 088820f

Browse files
authored
fix README (#12)
1 parent 48b48eb commit 088820f

1 file changed

Lines changed: 27 additions & 24 deletions

File tree

README.md

Lines changed: 27 additions & 24 deletions
Original file line numberDiff line numberDiff line change
@@ -7,21 +7,16 @@ A vLLM plugin built on the FlagOS unified multi-chip backend.
77

88
0. Install vllm from the official [v0.11.0](https://github.com/vllm-project/vllm/tree/v0.11.0) (optional if the correct version is installed) or from the fork [vllm-FL](https://github.com/flagos-ai/vllm-FL).
99

10-
1. Clone the repository:
1110

12-
```sh
13-
git clone https://github.com/flagos-ai/vllm-plugin-FL
14-
```
11+
1. Install FlagGems
1512

16-
2. Install FlagGems
17-
18-
2.1 Install Build Dependencies
13+
1.1 Install Build Dependencies
1914

2015
```sh
21-
pip install -U scikit-build-core>=0.11 pybind11 ninja cmake
16+
pip install -U scikit-build-core==0.11 pybind11 ninja cmake
2217
```
2318

24-
2.3 Installation FlagGems
19+
1.2 Installation FlagGems
2520

2621
```shell
2722
git clone https://github.com/flagos-ai/FlagGems
@@ -31,36 +26,44 @@ A vLLM plugin built on the FlagOS unified multi-chip backend.
3126
pip install --no-build-isolation -e .
3227
```
3328

34-
3. Install FlagCX
29+
2. Install FlagCX
3530

36-
3.1 Clone the repository:
31+
2.1 Clone the repository:
3732
```sh
38-
git clone GitHub - flagos-ai/FlagCX
39-
git checkout -b v0.3.0
33+
git clone https://github.com/flagos-ai/FlagCX.git
34+
cd FlagCX
35+
git checkout v0.3.0
4036
```
4137

42-
3.2 Build the library with different flags targeting to different platforms:
38+
2.2 Build the library with different flags targeting to different platforms:
4339
```sh
44-
cd FlagCX
4540
make USE_NVIDIA=1
4641
```
4742

48-
3.3 Set environment
43+
2.3 Set environment
4944
```sh
50-
export FLAGCX_PATH=${pwd}
45+
export FLAGCX_PATH="$pwd"
5146
```
5247

53-
3.4 Installation FlagGems
48+
2.4 Installation FlagGems
5449
```sh
55-
cd FlagCX/plugin/torch/
50+
cd plugin/torch/
5651
python setup.py develop --adaptor nvidia/ascend
5752
```
5853

59-
4. Install vllm-plugin-fl
54+
3. Install vllm-plugin-fl
6055

61-
```sh
62-
pip install --no-build-isolation -e .
63-
```
56+
3.1 Clone the repository:
57+
58+
```sh
59+
git clone https://github.com/flagos-ai/vllm-plugin-FL
60+
```
61+
62+
3.2 install
63+
```sh
64+
cd vllm-plugin-fl
65+
pip install --no-build-isolation -e .
66+
```
6467

6568
If there are multiple plugins in the current environment, you can specify use vllm-plugin-fl via VLLM_PLUGINS='fl'.
6669

@@ -88,4 +91,4 @@ if __name__ == '__main__':
8891
prompt = output.prompt
8992
generated_text = output.outputs[0].text
9093
print(f"Prompt: {prompt!r}, Generated text: {generated_text!r}")
91-
```
94+
```

0 commit comments

Comments
 (0)