File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -40,6 +40,7 @@ length of 512 tokens:
4040 - [ Distributed Tracing] ( #distributed-tracing )
4141 - [ gRPC] ( #grpc )
4242- [ Local Install] ( #local-install )
43+ - [ Apple Silicon (Homebrew)] ( #apple-silicon-homebrew )
4344- [ Docker Build] ( #docker-build )
4445 - [ Apple M1/M2 Arm] ( #apple-m1m2-arm64-architectures )
4546- [ Examples] ( #examples )
@@ -492,6 +493,22 @@ grpcurl -d '{"inputs": "What is Deep Learning"}' -plaintext 0.0.0.0:8080 tei.v1.
492493
493494## Local install
494495
496+ ### Apple Silicon (Homebrew)
497+
498+ On Apple Silicon (M1/M2/M3/M4), you can install a prebuilt binary via Homebrew:
499+
500+ ``` shell
501+ brew install text-embeddings-inference
502+ ```
503+
504+ Then launch Text Embeddings Inference with Metal acceleration:
505+
506+ ``` shell
507+ model=Qwen/Qwen3-Embedding-0.6B
508+
509+ text-embeddings-router --model-id $model --port 8080
510+ ```
511+
495512### CPU
496513
497514You can also opt to install ` text-embeddings-inference ` locally.
Original file line number Diff line number Diff line change @@ -17,7 +17,26 @@ rendered properly in your Markdown viewer.
1717# Using TEI locally with Metal
1818
1919You can install ` text-embeddings-inference ` locally to run it on your own Mac with Metal support.
20- Here are the step-by-step instructions for installation:
20+
21+ ## Homebrew (Apple Silicon)
22+
23+ On Apple Silicon (M1/M2/M3/M4), you can install a prebuilt binary via Homebrew:
24+
25+ ``` shell
26+ brew install text-embeddings-inference
27+ ```
28+
29+ Then launch Text Embeddings Inference:
30+
31+ ``` shell
32+ model=Qwen/Qwen3-Embedding-0.6B
33+
34+ text-embeddings-router --model-id $model --port 8080
35+ ```
36+
37+ ## Build from source
38+
39+ Alternatively, you can build from source. Here are the step-by-step instructions:
2140
2241## Step 1: Install Rust
2342
You can’t perform that action at this time.
0 commit comments