Skip to content
Open
Changes from 2 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 33 additions & 0 deletions docs/user_guide/model_repository.md
Original file line number Diff line number Diff line change
Expand Up @@ -167,6 +167,39 @@ export TRITON_AWS_MOUNT_DIRECTORY=/path/to/your/local/directory

**Make sure, that `TRITON_AWS_MOUNT_DIRECTORY` exists on your local machine and it is empty.**

#### S3-compatible object stores
Comment thread
goanpeca marked this conversation as resolved.
Outdated

The S3 backend also works with S3-compatible object stores such as Backblaze B2, Cloudflare R2, and MinIO. The repository path uses the private-instance form described above, with the provider's endpoint as the host, and the credentials and region are passed through the same environment variables as Amazon S3.

```bash
$ tritonserver --model-repository=s3://https://s3.us-west-004.backblazeb2.com:443/bucket/path/to/model/repository ...
Comment thread
goanpeca marked this conversation as resolved.
Outdated
```

Replace `s3.us-west-004.backblazeb2.com` with the endpoint for your provider and region.

```bash
$ export AWS_ACCESS_KEY_ID="<access_key_id>"
$ export AWS_SECRET_ACCESS_KEY="<secret_access_key>"
$ export AWS_DEFAULT_REGION="us-west-004"
$ tritonserver --model-repository=s3://https://s3.us-west-004.backblazeb2.com:443/my-bucket/models ...
Comment thread
goanpeca marked this conversation as resolved.
Outdated
```

The credential file described [above](#cloud-storage-with-credential-file-beta) can also be used for an S3-compatible endpoint by adding an `s3://` entry keyed by the full bucket path.
Comment thread
goanpeca marked this conversation as resolved.
Outdated

```json
{
"s3": {
"s3://https://s3.us-west-004.backblazeb2.com:443/my-bucket": {
"secret_key": "<secret_access_key>",
"key_id": "<access_key_id>",
"region": "us-west-004",
"session_token": "",
"profile": ""
}
}
}
```

#### Azure Storage

For a model repository residing in Azure Storage, the repository path must be prefixed with as://.
Expand Down