Skip to content

model runner: update docs #25377

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
mickael-docker wants to merge 2 commits into
base: main
Choose a base branch
from
+17 −0
Open

model runner: update docs #25377

Changes from 1 commit
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
acd9c51
model runner: update docs
mickael-docker Jun 17, 2026
a2a50e7
fix: address review feedback
mickael-docker Jun 17, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
21 changes: 21 additions & 0 deletions content/manuals/ai/model-runner/_index.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -120,6 +120,27 @@ See [Configuration options](configuration.md) for details on context size and ot
> [Docker Compose](/manuals/ai/compose/models-and-compose.md) support Docker
> Model Runner.

## Security and isolation

Depending on the inference engine and model format, loading a model can run
code from the model's files. Pull and run only models you trust, from sources
you trust, the same way you would any other software you run.
Comment thread
mickael-docker marked this conversation as resolved.
Outdated

Docker Model Runner isolates inference engines from your host:

- On Linux, Docker Model Runner and its inference engines, such as Diffusers,
run inside a container, which provides the isolation boundary.
- On macOS and Windows, the engines don't run inside a container, so Docker
Model Runner runs them in a sandboxed environment instead.
Comment thread
mickael-docker marked this conversation as resolved.
Outdated

> [!WARNING]
>
> The Model Runner API is not authenticated. Any client that can reach it,
> including other containers on the same Docker network, can pull, load, and
> run models, and send inference requests. Only enable host-side or TCP access
Comment thread
mickael-docker marked this conversation as resolved.
Outdated
> when you control the clients, and don't expose the Model Runner endpoint to
> untrusted containers or networks.

## Known issues

### `docker model` is not recognised
Expand Down