diff --git a/docs/features/ai-knowledge/models.md b/docs/features/ai-knowledge/models.md index bdee42d3..86fcf30b 100644 --- a/docs/features/ai-knowledge/models.md +++ b/docs/features/ai-knowledge/models.md @@ -143,6 +143,19 @@ To streamline the management of large model collections, the Admin Panel include These tools are specifically designed to help administrators quickly manage external providers (like OpenAI or Anthropic) that expose a high volume of models, allowing for instant site-wide configuration changes. +### Global Model Defaults + +Administrators can set **global default metadata and parameters** that apply as a baseline to all models. This eliminates the need to manually configure capabilities and inference settings for every model individually. + +- **Default Model Metadata** (`DEFAULT_MODEL_METADATA`): Sets baseline capabilities (vision, web search, code interpreter, etc.) and other model metadata for all models. For capabilities, defaults and per-model values are merged — per-model overrides always win on conflicts. For other metadata fields, the global default is only applied when a model has no value set. +- **Default Model Params** (`DEFAULT_MODEL_PARAMS`): Sets baseline inference parameters (temperature, top_p, max_tokens, seed, etc.) for all models. Per-model parameter overrides always take precedence. + +These settings are accessible via **Admin Settings → Models** and are persisted via `PersistentConfig`. See [`DEFAULT_MODEL_METADATA`](/reference/env-configuration#default_model_metadata) and [`DEFAULT_MODEL_PARAMS`](/reference/env-configuration#default_model_params) for details. + +:::tip +Global defaults are ideal for enforcing organizational policies — for example, disabling code interpreter by default across all models, or setting a consistent temperature for all models. +::: + ## Model Switching in Chat Open WebUI allows for dynamic model switching and parallel inference within a chat session. diff --git a/docs/reference/env-configuration.mdx b/docs/reference/env-configuration.mdx index 08f9812d..f8700ab4 100644 --- a/docs/reference/env-configuration.mdx +++ b/docs/reference/env-configuration.mdx @@ -185,6 +185,20 @@ is also being used and set to `True`. **Never disable this if OAUTH/SSO is not b - Example: `gpt-4,claude-3-opus,llama-3-70b` - Persistence: This environment variable is a `PersistentConfig` variable. +#### `DEFAULT_MODEL_METADATA` + +- Type: `dict` (JSON object) +- Default: `{}` +- Description: Sets global default metadata (capabilities and other model info) for all models. These defaults act as a baseline — per-model overrides always take precedence. For capabilities, the defaults and per-model values are merged (per-model wins on conflicts). For other metadata fields, the default is only applied if the model has no value set. Configurable via **Admin Settings → Models**. +- Persistence: This environment variable is a `PersistentConfig` variable. Stored at config key `models.default_metadata`. + +#### `DEFAULT_MODEL_PARAMS` + +- Type: `dict` (JSON object) +- Default: `{}` +- Description: Sets global default parameters (temperature, top_p, max_tokens, seed, etc.) for all models. These defaults are applied as a baseline at chat completion time — per-model parameter overrides always take precedence. Configurable via **Admin Settings → Models**. +- Persistence: This environment variable is a `PersistentConfig` variable. Stored at config key `models.default_params`. + #### `DEFAULT_USER_ROLE` - Type: `str`