docker model package
| Description | Package a GGUF file, Safetensors directory, or existing model into a Docker model OCI artifact. |
|---|---|
| Usage | docker model package (--gguf <path> | --safetensors-dir <path> | --from <model>) [--license <path>...] [--context-size <tokens>] [--push] MODEL |
Description
Package a GGUF file, Safetensors directory, or existing model into a Docker model OCI artifact, with optional licenses. The package is sent to the model-runner, unless --push is specified. When packaging a sharded GGUF model, --gguf should point to the first shard. All shard files should be siblings and should include the index in the file name (e.g. model-00001-of-00015.gguf). When packaging a Safetensors model, --safetensors-dir should point to a directory containing .safetensors files and config files (*.json, merges.txt). All files will be auto-discovered and config files will be packaged into a tar archive. When packaging from an existing model using --from, you can modify properties like context size to create a variant of the original model.
Options
| Option | Default | Description |
|---|---|---|
--chat-template
|
absolute path to chat template file (must be Jinja format) | |
--context-size
|
context size in tokens | |
--dir-tar
|
relative path to directory to package as tar (can be specified multiple times) |
|
--from
|
reference to an existing model to repackage | |
--gguf
|
absolute path to gguf file | |
-l, --license
|
absolute path to a license file | |
--push
|
push to registry (if not set, the model is loaded into the Model Runner content store) |
|
--safetensors-dir
|
absolute path to directory containing safetensors files and config |