Skip to content

Commit c9902fd

Browse files
authored
docs: add Homebrew installation to README (#834)
1 parent 3abc58d commit c9902fd

2 files changed

Lines changed: 37 additions & 1 deletion

File tree

README.md

Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -40,6 +40,7 @@ length of 512 tokens:
4040
- [Distributed Tracing](#distributed-tracing)
4141
- [gRPC](#grpc)
4242
- [Local Install](#local-install)
43+
- [Apple Silicon (Homebrew)](#apple-silicon-homebrew)
4344
- [Docker Build](#docker-build)
4445
- [Apple M1/M2 Arm](#apple-m1m2-arm64-architectures)
4546
- [Examples](#examples)
@@ -492,6 +493,22 @@ grpcurl -d '{"inputs": "What is Deep Learning"}' -plaintext 0.0.0.0:8080 tei.v1.
492493

493494
## Local install
494495

496+
### Apple Silicon (Homebrew)
497+
498+
On Apple Silicon (M1/M2/M3/M4), you can install a prebuilt binary via Homebrew:
499+
500+
```shell
501+
brew install text-embeddings-inference
502+
```
503+
504+
Then launch Text Embeddings Inference with Metal acceleration:
505+
506+
```shell
507+
model=Qwen/Qwen3-Embedding-0.6B
508+
509+
text-embeddings-router --model-id $model --port 8080
510+
```
511+
495512
### CPU
496513

497514
You can also opt to install `text-embeddings-inference` locally.

docs/source/en/local_metal.md

Lines changed: 20 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,26 @@ rendered properly in your Markdown viewer.
1717
# Using TEI locally with Metal
1818

1919
You can install `text-embeddings-inference` locally to run it on your own Mac with Metal support.
20-
Here are the step-by-step instructions for installation:
20+
21+
## Homebrew (Apple Silicon)
22+
23+
On Apple Silicon (M1/M2/M3/M4), you can install a prebuilt binary via Homebrew:
24+
25+
```shell
26+
brew install text-embeddings-inference
27+
```
28+
29+
Then launch Text Embeddings Inference:
30+
31+
```shell
32+
model=Qwen/Qwen3-Embedding-0.6B
33+
34+
text-embeddings-router --model-id $model --port 8080
35+
```
36+
37+
## Build from source
38+
39+
Alternatively, you can build from source. Here are the step-by-step instructions:
2140

2241
## Step 1: Install Rust
2342

0 commit comments

Comments
 (0)