Skip to content

adding-openAI-like-providers.md

Latest commit

 

History

History
24 lines (15 loc) · 959 Bytes

adding-openAI-like-providers.md

File metadata and controls

24 lines (15 loc) · 959 Bytes

Adding openAI like provider

What is an openAI like provider

It is an api that is like the openAI one. They are used as llm providers.

Adding providers - docker and local deployment - file method

  1. Set up the app as you normally would
  2. Open openai-compatible.config.ts in an IDE
  3. Uncomment the example and remove the word example
  4. Modify the api url and other data to match your provider - to add more just copy and paste it and edit it, also add your secret key
  5. Run pnpm openai-compatiable:parse to update env when you change schema

Adding providers - vercel or anywhere else - ui based method

  1. Go to this website and set up your models and providers
  2. Press generate JSON and copy it
  3. Put in this into your env as the OPENAI_COMPATIBLE_DATA variable

Editing

Copy the contents of the env into the import section at the top, then regenerate and update your env