Skip to content

Commit 2de1099

Browse files
authored
Merge pull request #36 from tryrobbo/patch-1
Add Groq example to inference providers
2 parents 6cdbe0b + 5ffa949 commit 2de1099

1 file changed

Lines changed: 20 additions & 0 deletions

File tree

docs/inference_providers.md

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -108,6 +108,26 @@ Then run the optimization:
108108
llama-prompt-ops migrate --api-key-env TOGETHER_API_KEY
109109
```
110110

111+
### 5. Groq
112+
113+
114+
```yaml
115+
model:
116+
task_model: groq/meta-llama/llama-4-maverick-17b-128e-instruct
117+
proposer_model: groq/meta-llama/llama-4-maverick-17b-128e-instruct
118+
api_base: https://api.groq.com/openai/v1
119+
```
120+
121+
```bash
122+
export GROQ_API_KEY=your_api_key_here
123+
```
124+
125+
Then run the optimization:
126+
127+
```bash
128+
llama-prompt-ops migrate --api-key-env GROQ_API_KEY
129+
```
130+
111131
## Advanced Configuration
112132

113133
### Using Different Models for Task and Proposer

0 commit comments

Comments
 (0)