mirror of
https://github.com/docker/docs.git
synced 2026-03-27 06:18:55 +07:00
3
assets/icons/models.svg
Normal file
3
assets/icons/models.svg
Normal file
@@ -0,0 +1,3 @@
|
||||
<svg width="24" height="24" viewBox="0 0 24 24" fill="none" xmlns="http://www.w3.org/2000/svg">
|
||||
<path d="M12.3789 1.38416L12.5771 1.41443L12.6992 1.4447C12.9805 1.52555 13.2292 1.67314 13.4209 1.77966L20.6152 5.77673C20.8173 5.88899 21.0876 6.02945 21.3135 6.23767L21.4072 6.33142L21.541 6.49255C21.6242 6.6047 21.6952 6.72575 21.7529 6.85291L21.8301 7.04919L21.8662 7.17615C21.9179 7.38938 21.9281 7.60588 21.9297 7.79626V16.1166C21.9278 16.3451 21.9137 16.6114 21.8301 16.8646C21.742 17.1311 21.5974 17.376 21.4072 17.5824C21.1664 17.8436 20.8461 18.0078 20.6152 18.1361L13.4209 22.1332C13.2019 22.2549 12.9087 22.4302 12.5771 22.4984C12.3151 22.5523 12.0443 22.5523 11.7822 22.4984C11.4507 22.4302 11.1575 22.2549 10.9385 22.1332L3.74414 18.1361C3.51314 18.0078 3.19206 17.8438 2.95117 17.5824C2.76113 17.3761 2.61736 17.1309 2.5293 16.8646C2.44572 16.6115 2.43154 16.345 2.42969 16.1166V7.79626C2.43155 7.5679 2.44578 7.30219 2.5293 7.04919L2.60547 6.85291C2.69195 6.66223 2.80873 6.48608 2.95117 6.33142L3.04492 6.23767C3.27093 6.02909 3.54188 5.8891 3.74414 5.77673L10.9385 1.77966C11.1575 1.65796 11.4507 1.48266 11.7822 1.41443L11.9805 1.38416C12.1128 1.37073 12.2465 1.37073 12.3789 1.38416ZM11.9102 3.52869L4.71582 7.52478C4.56631 7.60784 4.48715 7.65162 4.43262 7.68591C4.42916 7.75018 4.42969 7.84066 4.42969 8.01111V15.9017C4.42969 16.0712 4.42922 16.1617 4.43262 16.226C4.48715 16.2603 4.56602 16.3048 4.71582 16.3881L11.9102 20.3851C12.0498 20.4627 12.1244 20.503 12.1787 20.5297C12.2332 20.503 12.3081 20.4635 12.4492 20.3851L19.6436 16.3881C19.7924 16.3053 19.8703 16.2602 19.9248 16.226C19.9282 16.1617 19.9297 16.0713 19.9297 15.9017V8.01111C19.9297 7.84058 19.9283 7.75018 19.9248 7.68591C19.8703 7.65175 19.7918 7.60713 19.6436 7.52478L12.4492 3.52869C12.3077 3.45007 12.2332 3.40889 12.1787 3.3822C12.1243 3.40891 12.0506 3.45068 11.9102 3.52869ZM12.0898 6.46912C12.4686 6.46912 12.8159 6.6831 12.9854 7.02185L13.7852 8.62048C14.0726 9.19534 14.1606 9.36327 14.2686 9.5033C14.3763 9.64312 14.5018 9.76853 14.6416 9.87634C14.7816 9.98425 14.9496 10.0733 15.5244 10.3607L17.123 11.1595C17.4617 11.3289 17.6757 11.6755 17.6758 12.0541C17.6758 12.4328 17.4617 12.7792 17.123 12.9486L15.5244 13.7484C14.95 14.0356 14.7816 14.124 14.6416 14.2318C14.5018 14.3396 14.3763 14.4651 14.2686 14.6049C14.1606 14.7449 14.0724 14.9131 13.7852 15.4877L12.9854 17.0863C12.816 17.425 12.4695 17.6389 12.0908 17.639H12.0898C11.9007 17.6389 11.7195 17.5853 11.5645 17.4896C11.5236 17.4644 11.4851 17.4356 11.4482 17.4047C11.3449 17.3182 11.2577 17.2111 11.1953 17.0863L10.3965 15.4877C10.2527 15.2001 10.1586 15.0145 10.0869 14.8832C10.0153 14.7519 9.96606 14.6748 9.91211 14.6049C9.80434 14.4652 9.67881 14.3395 9.53906 14.2318C9.39914 14.1241 9.2304 14.0355 8.65625 13.7484L7.05762 12.9486C6.97289 12.9062 6.89582 12.8527 6.82812 12.7904C6.76049 12.7282 6.7022 12.657 6.6543 12.5795C6.55871 12.4245 6.50488 12.2432 6.50488 12.0541C6.50489 12.0066 6.5081 11.9596 6.51465 11.9135C6.54733 11.6836 6.65918 11.4732 6.82812 11.3177C6.89582 11.2554 6.9729 11.202 7.05762 11.1595L8.65625 10.3607C9.0871 10.1453 9.28956 10.0414 9.42285 9.9574C9.46737 9.92934 9.50401 9.90334 9.53906 9.87634C9.67886 9.76856 9.80432 9.64308 9.91211 9.5033C9.96608 9.43328 10.0153 9.35629 10.0869 9.22498C10.1586 9.09367 10.2527 8.90803 10.3965 8.62048L11.1953 7.02185L11.2666 6.90076C11.359 6.76687 11.4818 6.65875 11.623 6.58435C11.6583 6.56574 11.6951 6.54984 11.7324 6.53552C11.8073 6.50689 11.8859 6.48698 11.9668 6.47693C12.0073 6.47189 12.0484 6.46915 12.0898 6.46912Z" fill="currentColor"/>
|
||||
</svg>
|
||||
|
After Width: | Height: | Size: 3.5 KiB |
@@ -36,7 +36,7 @@ params:
|
||||
description: Manage and secure your AI tools with a single gateway.
|
||||
icon: /icons/toolkit.svg
|
||||
link: /ai/mcp-gateway/
|
||||
|
||||
|
||||
ai:
|
||||
- title: Ask Gordon
|
||||
description: Streamline your workflow and get the most out of the Docker ecosystem with your personal AI assistant.
|
||||
@@ -44,7 +44,7 @@ params:
|
||||
link: /ai/gordon/
|
||||
- title: Docker Model Runner
|
||||
description: View and manage your local models.
|
||||
icon: view_in_ar
|
||||
icon: /icons/models.svg
|
||||
link: /ai/model-runner/
|
||||
- title: MCP Catalog and Toolkit
|
||||
description: Augment your AI workflow with MCP servers.
|
||||
@@ -126,7 +126,7 @@ Open source development and containerization technologies.
|
||||
|
||||
## AI
|
||||
|
||||
All the Docker AI tools in one easy-to-access location.
|
||||
All the Docker AI tools in one easy-to-access location.
|
||||
|
||||
{{< grid items=ai >}}
|
||||
|
||||
@@ -145,6 +145,6 @@ subscription management.
|
||||
|
||||
## Enterprise
|
||||
|
||||
Targeted at IT administrators with help on deploying Docker Desktop at scale with configuration guidance on security related features.
|
||||
Targeted at IT administrators with help on deploying Docker Desktop at scale with configuration guidance on security related features.
|
||||
|
||||
{{< grid items=enterprise >}}
|
||||
@@ -144,7 +144,7 @@ To call the `chat/completions` OpenAI endpoint from the host via TCP:
|
||||
If you are running on Windows, also enable GPU-backed inference.
|
||||
See [Enable Docker Model Runner](get-started.md#enable-docker-model-runner-in-docker-desktop).
|
||||
|
||||
2. Interact with it as documented in the previous section using `localhost` and the correct port.
|
||||
1. Interact with it as documented in the previous section using `localhost` and the correct port.
|
||||
|
||||
```bash
|
||||
#!/bin/sh
|
||||
|
||||
@@ -30,7 +30,7 @@ with your local models in the **Models** tab in the Docker Desktop Dashboard.
|
||||
> For Docker Desktop versions 4.41 and earlier, this setting was under the
|
||||
> **Experimental features** tab on the **Features in development** page.
|
||||
|
||||
### Enable Docker Model Runner in Docker Engine
|
||||
### Enable DMR in Docker Engine
|
||||
|
||||
1. Ensure you have installed [Docker Engine](/engine/install/).
|
||||
1. Docker Model Runner is available as a package. To install it, run:
|
||||
@@ -38,7 +38,7 @@ with your local models in the **Models** tab in the Docker Desktop Dashboard.
|
||||
{{< tabs >}}
|
||||
{{< tab name="Ubuntu/Debian">}}
|
||||
|
||||
```console
|
||||
```bash
|
||||
$ sudo apt-get update
|
||||
$ sudo apt-get install docker-model-plugin
|
||||
```
|
||||
@@ -46,7 +46,7 @@ with your local models in the **Models** tab in the Docker Desktop Dashboard.
|
||||
{{< /tab >}}
|
||||
{{< tab name="RPM-base distributions">}}
|
||||
|
||||
```console
|
||||
```bash
|
||||
$ sudo dnf update
|
||||
$ sudo dnf install docker-model-plugin
|
||||
```
|
||||
@@ -56,7 +56,7 @@ with your local models in the **Models** tab in the Docker Desktop Dashboard.
|
||||
|
||||
1. Test the installation:
|
||||
|
||||
```console
|
||||
```bash
|
||||
$ docker model version
|
||||
$ docker model run ai/smollm2
|
||||
```
|
||||
@@ -64,13 +64,13 @@ with your local models in the **Models** tab in the Docker Desktop Dashboard.
|
||||
> [!NOTE]
|
||||
> TCP support is enabled by default for Docker Engine on port `12434`.
|
||||
|
||||
### Update Docker Model Runner in Docker Engine
|
||||
### Update DMR in Docker Engine
|
||||
|
||||
To update Docker Model Runner in Docker Engine, uninstall it with
|
||||
[`docker model uninstall-runner`](/reference/cli/docker/model/uninstall-runner/)
|
||||
then reinstall it:
|
||||
|
||||
```console
|
||||
```bash
|
||||
docker model uninstall-runner --images && docker model install-runner
|
||||
```
|
||||
|
||||
@@ -133,8 +133,9 @@ Use the [`docker model run` command](/reference/cli/docker/model/run/).
|
||||
|
||||
## Configure a model
|
||||
|
||||
You can configure a model, such as the its maximum token limit and more,
|
||||
use Docker Compose. See [Models and Compose - Model configuration options](../compose/models-and-compose.md#model-configuration-options).
|
||||
You can configure a model, such as its maximum token limit and more,
|
||||
use Docker Compose.
|
||||
See [Models and Compose - Model configuration options](../compose/models-and-compose.md#model-configuration-options).
|
||||
|
||||
## Publish a model
|
||||
|
||||
@@ -146,7 +147,7 @@ use Docker Compose. See [Models and Compose - Model configuration options](../co
|
||||
You can tag existing models with a new name and publish them under a different
|
||||
namespace and repository:
|
||||
|
||||
```console
|
||||
```bash
|
||||
# Tag a pulled model under a new name
|
||||
$ docker model tag ai/smollm2 myorg/smollm2
|
||||
|
||||
@@ -161,7 +162,7 @@ documentation.
|
||||
You can also package a model file in GGUF format as an OCI Artifact and publish
|
||||
it to Docker Hub.
|
||||
|
||||
```console
|
||||
```bash
|
||||
# Download a model file in GGUF format, for example from HuggingFace
|
||||
$ curl -L -o model.gguf https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF/resolve/main/mistral-7b-v0.1.Q4_K_M.gguf
|
||||
|
||||
@@ -209,7 +210,7 @@ In Docker Desktop, to inspect the requests and responses for each model:
|
||||
- The prompt/request
|
||||
- The context usage
|
||||
- The time it took for the response to be generated.
|
||||
2. Select one of the requests to display further details:
|
||||
1. Select one of the requests to display further details:
|
||||
- In the **Overview** tab, view the token usage, response metadata and generation speed, and the actual prompt and response.
|
||||
- In the **Request** and **Response** tabs, view the full JSON payload of the request and the response.
|
||||
|
||||
@@ -220,4 +221,4 @@ In Docker Desktop, to inspect the requests and responses for each model:
|
||||
|
||||
- [Interact with your model programmatically](./api-reference.md)
|
||||
- [Models and Compose](../compose/models-and-compose.md)
|
||||
- [Docker Model Runner cli reference documentation](/reference/cli/docker/model)
|
||||
- [Docker Model Runner CLI reference documentation](/reference/cli/docker/model)
|
||||
Reference in New Issue
Block a user