Skip to content

Commit dcc7480

Browse files
mobtownlabsclaude
andcommitted
docs: document multi-provider LLM support via litellm
README and quickstart now show that the system works with any litellm-compatible LLM provider (OpenAI, Azure, Bedrock, Cohere, Ollama, Vertex AI, etc.), not just Anthropic. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
1 parent 926a772 commit dcc7480

3 files changed

Lines changed: 22 additions & 5 deletions

File tree

.beads/PROGRESS.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -42,4 +42,4 @@
4242
| \[ ] | buyer-j95 | 3G: Infrastructure-as-Code Deployment (CloudFormation/Terraform) | P3 || |
4343

4444
---
45-
*Last updated: 2026-03-10 21:44 UTC — auto-generated by beads*
45+
*Last updated: 2026-03-10 22:00 UTC — auto-generated by beads*

README.md

Lines changed: 11 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -137,7 +137,15 @@ cp .env.example .env
137137
Key settings:
138138

139139
```bash
140-
ANTHROPIC_API_KEY=sk-ant-api03-xxxxx # Required
140+
# LLM — set the API key for your chosen provider
141+
ANTHROPIC_API_KEY=sk-ant-api03-xxxxx # For Anthropic (default)
142+
# OPENAI_API_KEY=sk-xxxxx # For OpenAI / Azure
143+
# COHERE_API_KEY=xxxxx # For Cohere
144+
145+
# LLM model (uses litellm provider/model format — any provider works)
146+
DEFAULT_LLM_MODEL=anthropic/claude-sonnet-4-5-20250929
147+
# DEFAULT_LLM_MODEL=openai/gpt-4o # OpenAI example
148+
# DEFAULT_LLM_MODEL=ollama/llama3 # Local Ollama example
141149

142150
# Seller connection
143151
SELLER_BASE_URL=http://localhost:8001 # Seller agent URL
@@ -146,6 +154,8 @@ SELLER_BASE_URL=http://localhost:8001 # Seller agent URL
146154
DATABASE_URL=sqlite:///./ad_buyer.db
147155
```
148156

157+
> **LLM Provider Flexibility:** The agent uses [litellm](https://docs.litellm.ai/) under the hood, supporting 100+ LLM providers (OpenAI, Azure, Cohere, Ollama, Vertex AI, Bedrock, etc.). Set `DEFAULT_LLM_MODEL` and `MANAGER_LLM_MODEL` using `provider/model-name` format and provide the matching API key. See the [Quickstart Guide](https://iabtechlab.github.io/buyer-agent/getting-started/quickstart/) for details.
158+
149159
[Full Configuration](https://iabtechlab.github.io/buyer-agent/getting-started/quickstart/)
150160

151161
### Run

docs/getting-started/quickstart.md

Lines changed: 10 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -27,8 +27,10 @@ pip install -e .
2727
Create a `.env` file in the project root:
2828

2929
```dotenv
30-
# LLM
31-
ANTHROPIC_API_KEY=sk-ant-...
30+
# LLM — set the API key for your chosen provider
31+
ANTHROPIC_API_KEY=sk-ant-... # For Anthropic (default)
32+
# OPENAI_API_KEY=sk-xxxxx # For OpenAI / Azure
33+
# COHERE_API_KEY=xxxxx # For Cohere
3234
3335
# Inbound API key for this service (leave empty to disable auth in dev)
3436
API_KEY=
@@ -41,9 +43,11 @@ OPENDIRECT_API_KEY= # API key for seller (optional)
4143
# Multi-seller mode (comma-separated URLs)
4244
SELLER_ENDPOINTS=
4345
44-
# LLM model overrides (defaults shown)
46+
# LLM model overrides — uses litellm provider/model format (any provider works)
4547
DEFAULT_LLM_MODEL=anthropic/claude-sonnet-4-5-20250929
4648
MANAGER_LLM_MODEL=anthropic/claude-opus-4-20250514
49+
# DEFAULT_LLM_MODEL=openai/gpt-4o # OpenAI example
50+
# DEFAULT_LLM_MODEL=ollama/llama3 # Local Ollama example
4751
4852
# Environment
4953
ENVIRONMENT=development
@@ -52,6 +56,9 @@ LOG_LEVEL=INFO
5256

5357
All settings are loaded from environment variables or the `.env` file via `pydantic-settings`.
5458

59+
!!! info "LLM Provider Flexibility"
60+
The buyer agent uses [litellm](https://docs.litellm.ai/) under the hood, supporting **100+ LLM providers** — OpenAI, Azure, Cohere, Ollama, Vertex AI, Bedrock, and more. Set `DEFAULT_LLM_MODEL` and `MANAGER_LLM_MODEL` using `provider/model-name` format and provide the matching API key environment variable. Agent prompts are tuned for Claude but work with any capable model. See the [litellm provider docs](https://docs.litellm.ai/docs/providers) for the full list.
61+
5562
## Run the Server
5663

5764
```bash

0 commit comments

Comments
 (0)