Skip to content

Commit 9ae0233

Browse files
committed
docs: document S3-compatible object stores for the model repository
Signed-off-by: Gonzalo Peña-Castellanos <goanpeca@gmail.com>
1 parent 2d64d2d commit 9ae0233

1 file changed

Lines changed: 33 additions & 0 deletions

File tree

docs/user_guide/model_repository.md

Lines changed: 33 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -167,6 +167,39 @@ export TRITON_AWS_MOUNT_DIRECTORY=/path/to/your/local/directory
167167

168168
**Make sure, that `TRITON_AWS_MOUNT_DIRECTORY` exists on your local machine and it is empty.**
169169

170+
##### S3-compatible object stores
171+
172+
The S3 backend also works with S3-compatible object stores such as Backblaze B2, Cloudflare R2, and MinIO. The repository path uses the private-instance form described above, with the provider's endpoint as the host, and the credentials and region are passed through the same environment variables as Amazon S3.
173+
174+
```bash
175+
$ tritonserver --model-repository=s3://https://s3.us-west-004.backblazeb2.com:443/bucket/path/to/model/repository ...
176+
```
177+
178+
Replace `s3.us-west-004.backblazeb2.com` with the endpoint for your provider and region.
179+
180+
```bash
181+
$ export AWS_ACCESS_KEY_ID="<access_key_id>"
182+
$ export AWS_SECRET_ACCESS_KEY="<secret_access_key>"
183+
$ export AWS_DEFAULT_REGION="us-west-004"
184+
$ tritonserver --model-repository=s3://https://s3.us-west-004.backblazeb2.com:443/my-bucket/models ...
185+
```
186+
187+
The credential file described [above](#cloud-storage-with-credential-file-beta) can also be used for an S3-compatible endpoint by adding an `s3://` entry keyed by the full bucket path.
188+
189+
```json
190+
{
191+
"s3": {
192+
"s3://https://s3.us-west-004.backblazeb2.com:443/my-bucket": {
193+
"secret_key": "<secret_access_key>",
194+
"key_id": "<access_key_id>",
195+
"region": "us-west-004",
196+
"session_token": "",
197+
"profile": ""
198+
}
199+
}
200+
}
201+
```
202+
170203
#### Azure Storage
171204

172205
For a model repository residing in Azure Storage, the repository path must be prefixed with as://.

0 commit comments

Comments
 (0)