There was an error while loading. Please reload this page.
2 parents 6cdbe0b + 5ffa949 commit 2de1099Copy full SHA for 2de1099
1 file changed
docs/inference_providers.md
@@ -108,6 +108,26 @@ Then run the optimization:
108
llama-prompt-ops migrate --api-key-env TOGETHER_API_KEY
109
```
110
111
+### 5. Groq
112
+
113
114
+```yaml
115
+model:
116
+ task_model: groq/meta-llama/llama-4-maverick-17b-128e-instruct
117
+ proposer_model: groq/meta-llama/llama-4-maverick-17b-128e-instruct
118
+ api_base: https://api.groq.com/openai/v1
119
+```
120
121
+```bash
122
+export GROQ_API_KEY=your_api_key_here
123
124
125
+Then run the optimization:
126
127
128
+llama-prompt-ops migrate --api-key-env GROQ_API_KEY
129
130
131
## Advanced Configuration
132
133
### Using Different Models for Task and Proposer
0 commit comments