This commit is contained in:
DrMelone
2025-12-30 15:01:32 +01:00
parent 689a25dc1f
commit e0b71f1dbf
2 changed files with 7 additions and 1 deletions

View File

@@ -71,7 +71,9 @@ Once Open WebUI is running:
* *Set*: Acts as an **Allowlist**. Only the specific model IDs you enter here will be visible to users. Use this to hide older or expensive models.
:::tip OpenRouter Recommendation
When using **OpenRouter**, we **highly recommend** using this allowlist (adding specific Model IDs). OpenRouter exposes thousands of models, which can clutter your model selector and slow down the admin panel if not filtered.
When using **OpenRouter**, we **highly recommend**:
1. **Use an allowlist** (add specific Model IDs). OpenRouter exposes thousands of models, which can clutter your model selector and slow down the admin panel if not filtered.
2. **Enable Model Caching** (`Settings > Connections > Cache Base Model List` or `ENABLE_BASE_MODELS_CACHE=True`). Without caching, page loads can take 10-15+ seconds on first visit due to querying a large number of models. See the [Performance Guide](/tutorials/tips/performance) for more details.
:::
* **Prefix ID**:

View File

@@ -47,6 +47,10 @@ Configure these settings to reduce latency and external API usage.
#### Model Caching
Drastically reduces startup time and API calls to external providers.
:::warning Important for OpenRouter and Multi-Model Providers
If you are using **OpenRouter** or any provider with hundreds/thousands of models, enabling model caching is **highly recommended**. Without caching, initial page loads can take **10-15+ seconds** as the application queries all available models. Enabling the cache reduces this to near-instant.
:::
- **Admin Panel**: `Settings > Connections > Cache Base Model List`
- **Env Var**: `ENABLE_BASE_MODELS_CACHE=True`
* *Note*: Caches the list of models in memory. Only refreshes on App Restart or when clicking **Save** in Connections settings.