Skip to content

Commit fd4cabf

Browse files
committed
edits
1 parent 8847d4a commit fd4cabf

File tree

2 files changed

+13
-19
lines changed

2 files changed

+13
-19
lines changed

content/manuals/compose/how-tos/model-runner.md

Lines changed: 12 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
---
2-
title: Use Docker Model
2+
title: Use Docker Model Runner
33
description: Learn how to integrate Docker Model Runner with Docker Compose to build AI-powered applications
44
keywords: compose, docker compose, model runner, ai, llm, artificial intelligence, machine learning
55
weight: 111
@@ -13,18 +13,14 @@ params:
1313
{{< summary-bar feature_name="Compose model runner" >}}
1414

1515
Docker Model Runner can be integrated with Docker Compose to run AI models as part of your multi-container applications.
16-
This allows you to define and run AI-powered applications alongside your other services.
16+
This lets you define and run AI-powered applications alongside your other services.
1717

1818
## Prerequisites
1919

2020
- Docker Compose v2.35 or later
2121
- Docker Desktop 4.41 or later
22-
- Docker Model Runner enabled in Docker Desktop
23-
- Apple Silicon Mac (currently Model Runner is only available for Mac with Apple Silicon)
24-
25-
## Enabling Docker Model Runner
26-
27-
Before you can use Docker Model Runner with Compose, you need to enable it in Docker Desktop, as described in the [Docker Model Runner documentation](/desktop/features/model-runner/).
22+
- Docker Desktop for Mac with Apple Silicon or Docker Desktop for Windows with NVIDIA GPU
23+
- [Docker Model Runner enabled in Docker Desktop](/manuals/desktop/features/model-runner.md#enable-docker-model-runner)
2824

2925
## Provider services
3026

@@ -46,27 +42,25 @@ services:
4642
model: ai/smollm2
4743
```
4844
49-
You should notice the dedicated `provider` attribute in the `ai-runner` service.
50-
This attribute specifies that the service is a model provider and let you define options such as the name of the model to be used.
45+
Notice the dedicated `provider` attribute in the `ai-runner` service.
46+
This attribute specifies that the service is a model provider and lets you define options such as the name of the model to be used.
5147

5248
There is also a `depends_on` attribute in the `chat` service.
5349
This attribute specifies that the `chat` service depends on the `ai-runner` service.
5450
This means that the `ai-runner` service will be started before the `chat` service to allow injection of model information to the `chat` service.
5551

5652
## How it works
5753

58-
During the `docker compose up` process, Docker Model Runner will automatically pull and run the specified model.
59-
It will also send to Compose the model tag name and the URL to access the model runner.
54+
During the `docker compose up` process, Docker Model Runner automatically pulls and runs the specified model.
55+
It also sends Compose the model tag name and the URL to access the model runner.
6056

61-
Those information will be then pass to services which declare a dependency on the model provider.
62-
In the example above, the `chat` service will receive 2 env variables prefixed by the service name:
57+
This information is then passed to services which declare a dependency on the model provider.
58+
In the example above, the `chat` service receives 2 environment variables prefixed by the service name:
6359
- `AI-RUNNER_URL` with the URL to access the model runner
6460
- `AI-RUNNER_MODEL` with the model name which could be passed with the URL to request the model.
6561

66-
This allows the `chat` service to interact with the model and use it for its own purposes.
67-
62+
This lets the `chat` service to interact with the model and use it for its own purposes.
6863

6964
## Reference
7065

71-
- [Docker Model Runner documentation](/desktop/features/model-runner/)
72-
66+
- [Docker Model Runner documentation](/manuals/desktop/features/model-runner.md)

data/summary.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -106,7 +106,7 @@ Compose mac address:
106106
Compose menu:
107107
requires: Docker Compose [2.26.0](/manuals/compose/releases/release-notes.md#2260) and later
108108
Compose model runner:
109-
requires: Docker Compose [2.35.0](/manuals/compose/releases/release-notes.md#2300) and later
109+
requires: Docker Compose [2.35.0](/manuals/compose/releases/release-notes.md#2300) and later, and Docker Desktop 4.41 and later
110110
Compose OCI artifact:
111111
requires: Docker Compose [2.34.0](/manuals/compose/releases/release-notes.md#2340) and later
112112
Compose replace file:

0 commit comments

Comments
 (0)