Skip to content

providers.md

Latest commit

 

History

History
115 lines (85 loc) · 2.31 KB

providers.md

File metadata and controls

115 lines (85 loc) · 2.31 KB
Raw

AI Providers

cooklang-import supports multiple AI providers for recipe conversion.

OpenAI

  • Models: gpt-4.1-mini (default), gpt-4.1-nano (fastest), gpt-4o-mini, gpt-4o
  • Environment Variable: OPENAI_API_KEY
[providers.openai]
enabled = true
model = "gpt-4.1-mini"
temperature = 0.7
max_tokens = 2000

Anthropic Claude

  • Models: claude-sonnet-4.5, claude-haiku-4.5 (fastest), claude-opus-4.1
  • Environment Variable: ANTHROPIC_API_KEY
[providers.anthropic]
enabled = true
model = "claude-sonnet-4.5"
temperature = 0.7
max_tokens = 4000

Google Gemini

  • Models: gemini-2.5-flash (latest), gemini-2.0-flash-lite
  • Environment Variable: GOOGLE_API_KEY
[providers.google]
enabled = true
model = "gemini-2.5-flash"
temperature = 0.7
max_tokens = 2000

Azure OpenAI

  • Models: Your deployed models (e.g., gpt-4, gpt-35-turbo)
  • Environment Variable: AZURE_OPENAI_API_KEY
  • Required Config: endpoint, deployment_name, api_version
[providers.azure_openai]
enabled = true
endpoint = "https://your-resource.openai.azure.com"
deployment_name = "your-deployment"
api_version = "2024-02-15-preview"

Ollama (Local)

Run AI models locally without API keys.

  • Models: llama3, llama2, codellama, mixtral, and more
  • Requirements: Ollama installed locally
  • Base URL: http://localhost:11434 (default)

Setup

# Install Ollama
curl -fsSL https://ollama.ai/install.sh | sh

# Pull a model
ollama pull llama3

Configuration

[providers.ollama]
enabled = true
model = "llama3"
base_url = "http://localhost:11434"

Provider Fallback

Enable automatic failover between providers:

[fallback]
enabled = true
order = ["openai", "anthropic", "google"]
retry_attempts = 3
retry_delay_ms = 1000

When enabled:

  1. Tries the primary provider with exponential backoff retries
  2. On failure, switches to the next provider in the list
  3. Continues until success or all providers exhausted

Environment Variable Format

For nested configuration, use double underscores:

export COOKLANG__PROVIDERS__OPENAI__MODEL="gpt-4.1-mini"
export COOKLANG__FALLBACK__ENABLED=true

Configuration Priority

  1. Environment variables (highest)
  2. config.toml file
  3. Default values (lowest)