mirror of
https://github.com/open-webui/docs.git
synced 2026-01-04 10:46:26 +07:00
OR
This commit is contained in:
@@ -71,7 +71,9 @@ Once Open WebUI is running:
|
||||
* *Set*: Acts as an **Allowlist**. Only the specific model IDs you enter here will be visible to users. Use this to hide older or expensive models.
|
||||
|
||||
:::tip OpenRouter Recommendation
|
||||
When using **OpenRouter**, we **highly recommend** using this allowlist (adding specific Model IDs). OpenRouter exposes thousands of models, which can clutter your model selector and slow down the admin panel if not filtered.
|
||||
When using **OpenRouter**, we **highly recommend**:
|
||||
1. **Use an allowlist** (add specific Model IDs). OpenRouter exposes thousands of models, which can clutter your model selector and slow down the admin panel if not filtered.
|
||||
2. **Enable Model Caching** (`Settings > Connections > Cache Base Model List` or `ENABLE_BASE_MODELS_CACHE=True`). Without caching, page loads can take 10-15+ seconds on first visit due to querying a large number of models. See the [Performance Guide](/tutorials/tips/performance) for more details.
|
||||
:::
|
||||
|
||||
* **Prefix ID**:
|
||||
|
||||
@@ -47,6 +47,10 @@ Configure these settings to reduce latency and external API usage.
|
||||
#### Model Caching
|
||||
Drastically reduces startup time and API calls to external providers.
|
||||
|
||||
:::warning Important for OpenRouter and Multi-Model Providers
|
||||
If you are using **OpenRouter** or any provider with hundreds/thousands of models, enabling model caching is **highly recommended**. Without caching, initial page loads can take **10-15+ seconds** as the application queries all available models. Enabling the cache reduces this to near-instant.
|
||||
:::
|
||||
|
||||
- **Admin Panel**: `Settings > Connections > Cache Base Model List`
|
||||
- **Env Var**: `ENABLE_BASE_MODELS_CACHE=True`
|
||||
* *Note*: Caches the list of models in memory. Only refreshes on App Restart or when clicking **Save** in Connections settings.
|
||||
|
||||
Reference in New Issue
Block a user