Skip to main content
For model services accessed via the OpenAI-compatible protocol, such as:
  • Third-party API proxies: call multiple models through a unified API base
  • Local models: models deployed locally with tools like Ollama, vLLM
  • Private deployments: model services deployed inside an enterprise

Web Console

Recommended. On the “Models” page of the Web console, click “Add Provider” and pick “Custom”, then fill in the name, API Base and API Key. Multiple custom providers can be added; after adding one, select it together with a model in the “Main Model” card to enable it. Default endpoints of common local deployment tools:

Configuration File

You can also edit config.json directly: define multiple providers in the custom_providers list and set bot_type to "custom:<id>" to activate one of them:
The legacy single-provider configuration (bot_type set to "custom" with custom_api_key / custom_api_base) remains fully compatible and keeps working without any changes.