docker model
| Description | Docker Model Runner |
|---|
Description
Use Docker Model Runner to run and interact with AI models directly from the command line. For more information, see the documentation
Subcommands
| Command | Description |
|---|---|
docker model bench
| Benchmark a model's performance at different concurrency levels |
docker model inspect
| Display detailed information on one model |
docker model install-runner
| Install Docker Model Runner (Docker Engine only) |
docker model list
| List the models pulled to your local environment |
docker model logs
| Fetch the Docker Model Runner logs |
docker model package
| Package a GGUF file, Safetensors directory, or existing model into a Docker model OCI artifact. |
docker model pull
| Pull a model from Docker Hub or HuggingFace to your local environment |
docker model purge
| Remove all models |
docker model push
| Push a model to Docker Hub |
docker model reinstall-runner
| Reinstall Docker Model Runner (Docker Engine only) |
docker model restart-runner
| Restart Docker Model Runner (Docker Engine only) |
docker model rm
| Remove local models downloaded from Docker Hub |
docker model run
| Run a model and interact with it using a submitted prompt or chat mode |
docker model start-runner
| Start Docker Model Runner (Docker Engine only) |
docker model status
| Check if the Docker Model Runner is running |
docker model stop-runner
| Stop Docker Model Runner (Docker Engine only) |
docker model tag
| Tag a model |
docker model uninstall-runner
| Uninstall Docker Model Runner (Docker Engine only) |
docker model version
| Show the Docker Model Runner version |