Skip to content

CHANGELOG.md

Latest commit

 

History

History
891 lines (702 loc) · 40.3 KB

CHANGELOG.md

File metadata and controls

891 lines (702 loc) · 40.3 KB
Raw

NVIDIA Container Toolkit Changelog

v1.20.0

  • Add enable-cuda-compat hook to management CDI specs
  • Add update-application-profile CDI hook for EGL/Vulkan use case
  • Use xz compression when building rpm packages
  • fix: populate runtime_type field in containerd runtime config if not present

v1.20.0-rc.1

  • Validate imex channels for CDI/JIT-CDI mode
  • [wsl2] discover all .so, .bin, and .dll files at nvidia driver store path
  • [nri plugin] move cdi inject info log to debug level
  • [CDI Hooks] add ability to specify OCI hook type
  • [cudacompat] use Masterminds/semver for parsing/comparing versions
  • Expand cudacompat hook to always inspect libcuda.so ELF header if available
  • Add libnvidia-nvvm70.so library to CDI spec
  • fix: prevent config option from reverting modified configurations
  • [nri-plugin] support injection of management CDI devices in multiple namespaces
  • docker.mk: Add Podman support and fix volume/artifact handling
  • Only generate update-ldcache hook if libraries are discovered
  • Mount nvidia.icd file needed by OpenCL
  • Update SECURITY.md
  • Allow multiple driver library paths
  • import text/template instead of html/template
  • feat: drop nvidia-cdi-hook shell shim
  • Fix nvidia-cdi-refresh systemd packaging
  • Add ability to disable CDI hooks in jit-cdi mode
  • [nri] only restrict management CDI devices to the toolkit namespace

Changes in the Toolkit Container

  • Ship static busybox shell in container-toolkit image

Changes in libnvidia-container

  • refactor: Use version script instead of linker script for library symbols

v1.19.0

  • Promote v1.19.0-rc.7 to v1.19.0

v1.19.0-rc.7

  • fix: Reuse instantiated editsFactory in CDI
  • fix: Don't use driver version in ELF header for compat check
  • Use jit-cdi modifier for gated modifiers
  • refactor: Use automatic CDI modifier for CSV
  • fix: Use driver.Root instead of config option in modifier Factory
  • test: Improve csv modifier tests
  • test: Add IsOverrideApplied function to devices package
  • chore: Run goimports on mocks
  • fix: Ensure that CUDA Compat Container path is set by default
  • chore: Update isIntegratedGPU for readability
  • chore: Rename isIntegratedGPUID function to isOrinGPUID
  • fix: Use correct version when updating versions.mk

v1.19.0-rc.6

  • Use host CUDA version for all CSV compat checks

v1.19.0-rc.5

  • Remove dlopen locator added in v1.19.0-rc.4

Changes in the Toolkit Container

  • build(deps): Bump nvidia/distroless/go to v4.0.2-dev in /deployments/container

v1.19.0-rc.4

  • Add a Dlopen-based library locator
  • Add support for injecting additional GIDs
  • Add support for CUDA forward compat on Orin systems

v1.19.0-rc.3

  • Remove restart logic from nvidia-cdi-refresh.service.
  • fix: Set device node GID in CDI specs
  • fix: Log actual CDI spec version
  • Make internal/system packages public
  • Move config to api
  • Make internal lookup package exportable
  • fix: Allow config options to be set to default values
  • test: Add failing test for setting debug log
  • test: Adjust e2e test for Docker 29.2.0

Changes in the Toolkit Container

  • build(deps): Bump nvidia/distroless/go to v4.0.1-dev in /deployments/container
  • Replace repackaging using fpm with rpmrebuild

Changes in libnvidia-container

  • Add libnvidia-tileiras.so to the list of compute libs

v1.19.0-rc.2

  • fix: Ensure that iGPU device nodes includes /dev/nvidia2
  • restrict NRI injection of CDI devices to pods in the toolkit's namespace
  • test: Add test for CSV-based device spec generation
  • fix: Add docker swarm support to jit-cdi mode
  • feat: Check ELF note for CUDA compat
  • Refactor enable-cuda-compat hook
  • fix: Allow nvidia-cdi-refresh.service to be restarted
  • fix: permissions sync
  • fix(discover): remove ro mount option from IPC sockets
  • Simplify logger.Interface
  • Add --no-runtime-config option to toolkit installer
  • Add interface for runtime configuration to installer
  • implement NRI plugin server to inject management CDI devices
  • Generate none device spec
  • fix: Fix arguments when creating DRM device symlinks
  • fix: Skip device node injection if NVIDIA_VISIBLE_DEVICES=none
  • test: Add failing test for NVIDIA_VISIBLE_DEVICES=none
  • Fix library paths in Apline containers
  • fix: Use pure CSV mode when a single device is found
  • fix: Don't filter device nodes when disable-multiple-csv-devices is enabled
  • trim extraneous whitespaces when parsing comma-separated config sources
  • fix: Return error on JIT CDI spec generation failure

Changes in the Toolkit Container

  • Bump nvidia/distroless/go in /deployments/container
  • Bump nvidia/distroless/go in /deployments/container

Changes in libnvidia-container

  • Add tooling to auto-bump golang version
  • Allow GOLANG_VERSION to be overridden

v1.19.0-rc.1

  • Add enable-cuda-compat on Tegra-based systems
  • Add --cuda-compat-container-root
  • Add --device-id flag to nvidia-ctk cdi generate command
  • Handle multiple GPUs in CDI spec generation from CSV
  • Fix trigger of CDI refresh service
  • Add --no-all-device option to nvidia-ctk cd generate
  • Default to strict decoding of OCI runtime spec
  • Load minimal spec to extract container root
  • Allow update-ldcache to work when pivot-root is not supported
  • Extract device information from host path if possible
  • Fix update of ldcache for non-matching host and container distros
  • Use enable-cuda-compat hook when ldcache does not exist
  • ldconfig: Create ld.so.conf file if missing
  • ldconfig: Determine container "debian-ness" after root pivot
  • Add missing return in getSystemSearchPaths for debian like containers
  • Use requested devices for CSV CDI spec generation
  • Also consider libnvidia-ml.so for extracting driver version
  • Switch to go 1.25 os.Root
  • Filter already tracked directories from ldcache update
  • Correct typo in nvsandboxutils feature flag
  • Allow nvcdi FeatureFlags to be configured for jit-cdi mode
  • Fix duplicate specs for jit-cdi mode
  • Fix trigger of CDI refresh service
  • Update rpm package to have 256bit digests
  • Fix generate tests when cdi hook exists in path
  • Fix containerd drop-in config path
  • Redirect log message to stderr in nvidia runtime wrapper script
  • chore: fix issues raised by govet and gocritic
  • Fix handling of existing imports in containerd
  • Don't read cdi generate mode from runtime mode
  • Fix bug in create-dev-char-symlinks command
  • Fix typo in nvidia-container-runtime's README

Changes in the Toolkit Container

  • Update rpm package to have 256bit digests
  • Bump nvidia/distroless/go in /deployments/container
  • Bump nvidia/distroless/go in /deployments/container

v1.18.0

  • Fix bug in device selection in jit-cdi mode
  • Make list of explicit driver libraries opt-in

Changes in the Toolkit Container

  • Invoke the actual default low-level runtime in the nvidia-ctk wrapper script
  • Remove default_runtime from cri-o config on cleanup
  • Do not remove cri-o drop-in file on shutdown.

v1.18.0-rc.6

  • Remove ppc64le artifacts from build
  • Add support for building artifacts with custom GOPROXY
  • Always update the ldcache in the container.

Changes in the Toolkit Container

  • Bump nvidia/distroless/go to v3.1.13-dev in /deployments/container
  • Allow config sources to be specified for containerd and crio
  • Allow file for config source to be specified explicitly

Changes in libnvidia-container

  • Add clock_gettime to the set of allowed syscalls under seccomp.

v1.18.0-rc.5

  • Fix handling of unrecognised hooks
  • Disable generation of coherent CDI specs by default
  • Update go-nvlib to restrict nvidia.com/gpu.coherent devices to devices with an ATS addressing mode.
  • Deprecate the hook config mode for cri-o

Changes in the Toolkit Container

  • Deprecate the hook config mode for cri-o
  • Add CRI plugin config from source containerd config to drop-in file
  • Add support for drop-in config files in a container

v1.18.0-rc.4

  • Add drop-in file support for containerd and crio
  • Add support for IMEX_CHANNELS to jit-cdi mode
  • Refactor IMEX channel requests from image
  • Remove redundant CDI annotations
  • support running and degraded systemd state during install
  • Don't inject enable-cuda-compat hook in CSV mode
  • Cleanup default runtime in runtime config when setAsDefault=false

Changes in the Toolkit Container

  • Bump nvidia/distroless/go to v3.1.12-dev in /deployments/container

v1.18.0-rc.3

  • Generate separate specs for coherent and noncoherent devices
  • Disable chmod hook by default
  • Add support for gated modifications jit-cdi mode
  • Add support for nvswitch mode to nvcdi API
  • Add support for gdrcopy mode to nvcdi API
  • Consolidate CDI spec generation of gated modes
  • Add missing imex mode to Valid modes
  • Add explicitLibs list to libs discovery
  • Consolidate logic to determine driver version
  • Fix: Enable local YUM repo by default in CentOS8 and Fedora35 entrypoints

Changes in the Toolkit Container

  • Bump nvidia/distroless/go to v3.1.11-dev in /deployments/container

v1.18.0-rc.2

  • Ensure that .so symlinks are created for driver libraries in the container
  • Load settings from config.toml file during CDI generation
  • Use securejoin to resolve /proc
  • Refactor nvml CDI spec generation for consistency
  • Simplify nvcdi interface
  • Add SpecGenerator interface
  • Ensure that modified params file mount does not leak to host
  • Add test for leaking mounts with shared mount propagation

Changes in the Toolkit Container

  • Bump nvidia/distroless/go to v3.1.10-dev in /deployments/container
  • Bump nvidia/cuda to 12.9.1-base-ubi9 in /deployments/container

v1.18.0-rc.1

  • Add create-soname-symlinks hook
  • Require matching version of libnvidia-container-tools
  • Add envvar for libcuda.so parent dir to CDI spec
  • Add EnvVar to Discover interface
  • Resolve to legacy by default in nvidia-container-runtime-hook
  • Default to jit-cdi mode in the nvidia runtime
  • Use functional options to construct runtime mode resolver
  • Add NVIDIA_CTK_CONFIG_FILE_PATH envvar
  • Switch to cuda ubi9 base image
  • Use single version tag for image
  • BUGFIX: modifier: respect GPU volume-mount device requests
  • Ensure consistent sorting of annotation devices
  • Extract deb and rpm packages to single image
  • Remove docker-run as default runtime candidate
  • Return annotation devices from VisibleDevices
  • Make CDI device requests consistent with other methods
  • Construct container info once
  • Add logic to extract annotation device requests to image type
  • Add IsPrivileged function to CUDA container type
  • Add device IDs to nvcdi.GetSpec API
  • Refactor extracting requested devices from the container image
  • Add EnvVars option for all nvidia-ctk cdi commands
  • Add nvidia-cdi-refresh service
  • Add discovery of arch-specific vulkan ICD
  • Add disabled-device-node-modification hook to CDI spec
  • Add a hook to disable device node creation in a container
  • Remove redundant deduplication of search paths for WSL
  • Added ability to disable specific (or all) CDI hooks
  • Consolidate HookName functionality on internal/discover pkg
  • Add envvar to control debug logging in CDI hooks
  • Add FeatureFlags to the nvcdi API
  • Reenable nvsandboxutils for driver discovery
  • Edit discover.mounts to have a deterministic output
  • Refactor the way we create CDI Hooks
  • Issue warning on unsupported CDI hook
  • Run update-ldcache in isolated namespaces
  • Add cuda-compat-mode config option
  • Fix mode detection on Thor-based systems
  • Add rprivate to CDI mount options
  • Skip nil discoverers in merge
  • bump runc go dep to v1.3.0
  • Fix resolution of libs in LDCache on ARM
  • Updated .release:staging to stage images in nvstaging
  • Refactor toolkit installer
  • Allow container runtime executable path to be specified
  • Add support for building ubuntu22.04 on arm64
  • Fix race condition in mounts cache
  • Add support for building ubuntu22.04 on amd64
  • Fix update-ldcache arguments
  • Remove positional arguments from nvidia-ctk-installer
  • Remove deprecated --runtime-args from nvidia-ctk-installer
  • Add version info to nvidia-ctk-installer
  • Update nvidia-ctk-installer app name to match binary name
  • Allow nvidia-ctk config --set to accept comma-separated lists
  • Disable enable-cuda-compat hook for management containers
  • Allow enable-cuda-compat hook to be disabled in CDI spec generation
  • Add disable-cuda-compat-lib-hook feature flag
  • Add basic integration tests for forward compat
  • Ensure that mode hook is executed last
  • Add enable-cuda-compat hook to CDI spec generation
  • Add ldconfig hook in legacy mode
  • Add enable-cuda-compat hook if required
  • Add enable-cuda-compat hook to allow compat libs to be discovered
  • Use libcontainer execseal to run ldconfig
  • Add ignore-imex-channel-requests feature flag
  • Disable nvsandboxutils in nvcdi API
  • Allow cdi mode to work with --gpus flag
  • Add E2E GitHub Action for Container Toolkit
  • Add remote-test option for E2E
  • Enable CDI in runtime if CDI_ENABLED is set
  • Fix overwriting docker feature flags
  • Add option in toolkit container to enable CDI in runtime
  • Remove Set from engine config API
  • Add EnableCDI() method to engine.Interface
  • Add IMEX binaries to CDI discovery
  • Rename test folder to tests
  • Add allow-cuda-compat-libs-from-container feature flag
  • Disable mounting of compat libs from container
  • Skip graphics modifier in CSV mode
  • Move nvidia-toolkit to nvidia-ctk-installer
  • Automated regression testing for the NVIDIA Container Toolkit
  • Add support for containerd version 3 config
  • Remove watch option from create-dev-char-symlinks
  • Add string TOML source
  • Improve the implementation for UseLegacyConfig
  • Properly pass configSearchPaths to a Driver constructor
  • Fix create-device-node test when devices exist
  • Add imex mode to CDI spec generation
  • Only allow host-relative LDConfig paths
  • Fix NVIDIA_IMEX_CHANNELS handling on legacy images
  • Fix bug in default config file path
  • Fix fsnotify.Remove logic function.
  • Force symlink creation in create-symlink hook

Changes in the Toolkit Container

  • Create /work/nvidia-toolkit symlink
  • Use Apache license for images
  • Switch to golang distroless image
  • Switch to cuda ubi9 base image
  • Use single version tag for image
  • Extract deb and rpm packages to single image
  • Bump nvidia/cuda in /deployments/container
  • Bump nvidia/cuda in /deployments/container
  • Add E2E GitHub Action for Container Toolkit
  • Bump nvidia/cuda in /deployments/container
  • Move nvidia-toolkit to nvidia-ctk-installer
  • Add support for containerd version 3 config
  • Improve the implementation for UseLegacyConfig
  • Bump nvidia/cuda in /deployments/container
  • Add imex mode to CDI spec generation
  • Only allow host-relative LDConfig paths
  • Fallback to file for runtime config

Changes in libnvidia-container

  • Fix pointer accessing local variable out of scope
  • Require version match between libnvidia-container-tools and libnvidia-container1
  • Add libnvidia-gpucomp.so to the list of compute libs
  • Use VERSION_ prefix for version parts in makefiles
  • Add additional logging
  • Do not discard container flags when --cuda-compat-mode is not specified
  • Remove unneeded --no-cntlibs argument from list command
  • Add cuda-compat-mode flag to configure command
  • Skip files when user has insufficient permissions
  • Fix building with Go 1.24
  • Add no-cntlibs CLI option to nvidia-container-cli
  • Fix always using fallback
  • Add fallback for systems without memfd_create()
  • Create virtual copy of host ldconfig binary before calling fexecve()
  • Fix some typos in text.

v1.17.0

  • Promote v1.17.0-rc.2 to v1.17.0
  • Fix bug when using just-in-time CDI spec generation
  • Check for valid paths in create-symlinks hook

v1.17.0-rc.2

  • Fix bug in locating libcuda.so from ldcache
  • Fix bug in sorting of symlink chain
  • Remove unsupported print-ldcache command
  • Remove csv-filename support from create-symlinks

Changes in the Toolkit Container

  • Fallback to crio-status if crio status does not work when configuring the crio runtime

v1.17.0-rc.1

  • Allow IMEX channels to be requested as volume mounts
  • Fix typo in error message
  • Add disable-imex-channel-creation feature flag
  • Add -z,lazy to LDFLAGS
  • Add imex channels to management CDI spec
  • Add support to fetch current container runtime config from the command line.
  • Add creation of select driver symlinks to CDI spec generation.
  • Remove support for config overrides when configuring runtimes.
  • Skip explicit creation of libnvidia-allocator.so.1 symlink
  • Add vdpau as as a driver library search path.
  • Add support for using libnvsandboxutils to generate CDI specifications.

Changes in the Toolkit Container

  • Allow opt-in features to be selected when deploying the toolkit-container.
  • Bump CUDA base image version to 12.6.2
  • Remove support for config overrides when configuring runtimes.

Changes in libnvidia-container

  • Add no-create-imex-channels command line option.

v1.16.2

  • Exclude libnvidia-allocator from graphics mounts. This fixes a bug that leaks mounts when a container is started with bi-directional mount propagation.
  • Use empty string for default runtime-config-override. This removes a redundant warning for runtimes (e.g. Docker) where this is not applicable.

Changes in the Toolkit Container

  • Bump CUDA base image version to 12.6.0

Changes in libnvidia-container

  • Add no-gsp-firmware command line option
  • Add no-fabricmanager command line option
  • Add no-persistenced command line option
  • Skip directories and symlinks when mounting libraries.

v1.16.1

  • Fix bug with processing errors during CDI spec generation for MIG devices

v1.16.0

  • Promote v1.16.0-rc.2 to v1.16.0

Changes in the Toolkit Container

  • Bump CUDA base image version to 12.5.1

v1.16.0-rc.2

  • Use relative path to locate driver libraries
  • Add RelativeToRoot function to Driver
  • Inject additional libraries for full X11 functionality
  • Extract options from default runtime if runc does not exist
  • Avoid using map pointers as maps are always passed by reference
  • Reduce logging for the NVIDIA Container runtime
  • Fix bug in argument parsing for logger creation

v1.16.0-rc.1

  • Support vulkan ICD files directly in a driver root. This allows for the discovery of vulkan files in GKE driver installations.

  • Increase priority of ld.so.conf.d config file injected into container. This ensures that injected libraries are preferred over libraries present in the container.

  • Set default CDI spec permissions to 644. This fixes permission issues when using the nvidia-ctk cdi transform functions.

  • Add dev-root option to nvidia-ctk system create-device-nodes command.

  • Fix location of libnvidia-ml.so.1 when a non-standard driver root is used. This enabled CDI spec generation when using the driver container on a host.

  • Recalculate minimum required CDI spec version on save.

  • Move nvidia-ctk hook commands to a separate nvidia-cdi-hook binary. The same subcommands are supported.

  • Use : as an nvidia-ctk config --set list separator. This fixes a bug when trying to set config options that are lists.

  • [toolkit-container] Bump CUDA base image version to 12.5.0

  • [toolkit-container] Allow the path to toolkit.pid to be specified directly.

  • [toolkit-container] Remove provenance information from image manifests.

  • [toolkit-container] Add dev-root option when configuring the toolkit. This adds support for GKE driver installations.

v1.15.0

  • Remove nvidia-container-runtime and nvidia-docker2 packages.

  • Use XDG_DATA_DIRS environment variable when locating config files such as graphics config files.

  • Add support for v0.7.0 Container Device Interface (CDI) specification.

  • Add --config-search-path option to nvidia-ctk cdi generate command. These paths are used when locating driver files such as graphics config files.

  • Use D3DKMTEnumAdapters3 to enumerate adpaters on WSL2 if available.

  • Add support for v1.2.0 OCI Runtime specification.

  • Explicitly set NVIDIA_VISIBLE_DEVICES=void in generated CDI specifications. This prevents the NVIDIA Container Runtime from making additional modifications.

  • [libnvidia-container] Use D3DKMTEnumAdapters3 to enumerate adpaters on WSL2 if available.

  • [toolkit-container] Bump CUDA base image version to 12.4.1

v1.15.0-rc.4

  • Add a --spec-dir option to the nvidia-ctk cdi generate command. This allows specs outside of /etc/cdi and /var/run/cdi to be processed.

  • Add support for extracting device major number from /proc/devices if nvidia is used as a device name over nvidia-frontend.

  • Allow multiple device naming strategies for nvidia-ctk cdi generate command. This allows a single CDI spec to be generated that includes GPUs by index and UUID.

  • Set the default --device-name-strategy for the nvidia-ctk cdi generate command to [index, uuid].

  • Remove libnvidia-container0 jetpack dependency included for legacy Tegra-based systems.

  • Add NVIDIA_VISIBLE_DEVICES=void to generated CDI specifications.

  • [toolkit-container] Remove centos7 image. The ubi8 image can be used on all RPM-based platforms.

  • [toolkit-container] Bump CUDA base image version to 12.3.2

v1.15.0-rc.3

  • Fix bug in nvidia-ctk hook update-ldcache where default --ldconfig-path value was not applied.

v1.15.0-rc.2

  • Extend the runtime.nvidia.com/gpu CDI kind to support full-GPUs and MIG devices specified by index or UUID.

  • Fix bug when specifying --dev-root for Tegra-based systems.

  • Log explicitly requested runtime mode.

  • Remove package dependency on libseccomp.

  • Added detection of libnvdxgdmal.so.1 on WSL2

  • Use devRoot to resolve MIG device nodes.

  • Fix bug in determining default nvidia-container-runtime.user config value on SUSE-based systems.

  • Add crun to the list of configured low-level runtimes.

  • Added support for --ldconfig-path to nvidia-ctk cdi generate command.

  • Fix nvidia-ctk runtime configure --cdi.enabled for Docker.

  • Add discovery of the GDRCopy device (gdrdrv) if the NVIDIA_GDRCOPY environment variable of the container is set to enabled

  • [toolkit-container] Bump CUDA base image version to 12.3.1.

v1.15.0-rc.1

  • Skip update of ldcache in containers without ldconfig. The .so.SONAME symlinks are still created.

  • Normalize ldconfig path on use. This automatically adjust the ldconfig setting applied to ldconfig.real on systems where this exists.

  • Include nvidia/nvoptix.bin in list of graphics mounts.

  • Include vulkan/icd.d/nvidia_layers.json in list of graphics mounts.

  • Add support for --library-search-paths to nvidia-ctk cdi generate command.

  • Add support for injecting /dev/nvidia-nvswitch* devices if the NVIDIA_NVSWITCH=enabled envvar is specified.

  • Added support for nvidia-ctk runtime configure --enable-cdi for the docker runtime. Note that this requires Docker >= 25.

  • Fixed bug in nvidia-ctk config command when using --set. The types of applied config options are now applied correctly.

  • Add --relative-to option to nvidia-ctk transform root command. This controls whether the root transformation is applied to host or container paths.

  • Added automatic CDI spec generation when the runtime.nvidia.com/gpu=all device is requested by a container.

  • [libnvidia-container] Fix device permission check when using cgroupv2 (fixes #227)

v1.14.3

  • [toolkit-container] Bump CUDA base image version to 12.2.2.

v1.14.2

  • Fix bug on Tegra-based systems where symlinks were not created in containers.
  • Add --csv.ignore-pattern command line option to nvidia-ctk cdi generate command.

v1.14.1

  • Fixed bug where contents of /etc/nvidia-container-runtime/config.toml is ignored by the NVIDIA Container Runtime Hook.

  • [libnvidia-container] Use libelf.so on RPM-based systems due to removed mageia repositories hosting pmake and bmake.

v1.14.0

  • Promote v1.14.0-rc.3 to v1.14.0

v1.14.0-rc.3

  • Added support for generating OCI hook JSON file to nvidia-ctk runtime configure command.

  • Remove installation of OCI hook JSON from RPM package.

  • Refactored config for nvidia-container-runtime-hook.

  • Added a nvidia-ctk config command which supports setting config options using a --set flag.

  • Added --library-search-path option to nvidia-ctk cdi generate command in csv mode. This allows folders where libraries are located to be specified explicitly.

  • Updated go-nvlib to support devices which are not present in the PCI device database. This allows the creation of dev/char symlinks on systems with such devices installed.

  • Added UsesNVGPUModule info function for more robust platform detection. This is required on Tegra-based systems where libnvidia-ml.so is also supported.

  • [toolkit-container] Set NVIDIA_VISIBLE_DEVICES=void to prevent injection of NVIDIA devices and drivers into the NVIDIA Container Toolkit container.

v1.14.0-rc.2

  • Fix bug causing incorrect nvidia-smi symlink to be created on WSL2 systems with multiple driver roots.

  • Remove dependency on coreutils when installing package on RPM-based systems.

  • Create output folders if required when running nvidia-ctk runtime configure

  • Generate default config as post-install step.

  • Added support for detecting GSP firmware at custom paths when generating CDI specifications.

  • Added logic to skip the extraction of image requirements if NVIDIA_DISABLE_REQUIRES is set to true.

  • [libnvidia-container] Include Shared Compiler Library (libnvidia-gpucomp.so) in the list of compute libaries.

  • [toolkit-container] Ensure that common envvars have higher priority when configuring the container engines.

  • [toolkit-container] Bump CUDA base image version to 12.2.0.

  • [toolkit-container] Remove installation of nvidia-experimental runtime. This is superceded by the NVIDIA Container Runtime in CDI mode.

v1.14.0-rc.1

  • Add support for updating containerd configs to the nvidia-ctk runtime configure command.

  • Create file in etc/ld.so.conf.d with permissions 644 to support non-root containers.

  • Generate CDI specification files with 644 permissions to allow rootless applications (e.g. podman)

  • Add nvidia-ctk cdi list command to show the known CDI devices.

  • Add support for generating merged devices (e.g. all device) to the nvcdi API.

  • Use . pattern to locate libcuda.so when generating a CDI specification to support platforms where a patch version is not specified.

  • Update go-nvlib to skip devices that are not MIG capable when generating CDI specifications.

  • Add nvidia-container-runtime-hook.path config option to specify NVIDIA Container Runtime Hook path explicitly.

  • Fix bug in creation of /dev/char symlinks by failing operation if kernel modules are not loaded.

  • Add option to load kernel modules when creating device nodes

  • Add option to create device nodes when creating /dev/char symlinks

  • [libnvidia-container] Support OpenSSL 3 with the Encrypt/Decrypt library

  • [toolkit-container] Allow same envars for all runtime configs

v1.13.1

  • Update update-ldcache hook to only update ldcache if it exists.
  • Update update-ldcache hook to create /etc/ld.so.conf.d folder if it doesn't exist.
  • Fix failure when libcuda cannot be located during XOrg library discovery.
  • Fix CDI spec generation on systems that use /etc/alternatives (e.g. Debian)

v1.13.0

  • Promote 1.13.0-rc.3 to 1.13.0

v1.13.0-rc.3

  • Only initialize NVML for modes that require it when runing nvidia-ctk cdi generate.

  • Prefer /run over /var/run when locating nvidia-persistenced and nvidia-fabricmanager sockets.

  • Fix the generation of CDI specifications for management containers when the driver libraries are not in the LDCache.

  • Add transformers to deduplicate and simplify CDI specifications.

  • Generate a simplified CDI specification by default. This means that entities in the common edits in a spec are not included in device definitions.

  • Also return an error from the nvcdi.New constructor instead of panicing.

  • Detect XOrg libraries for injection and CDI spec generation.

  • Add nvidia-ctk system create-device-nodes command to create control devices.

  • Add nvidia-ctk cdi transform command to apply transforms to CDI specifications.

  • Add --vendor and --class options to nvidia-ctk cdi generate

  • [libnvidia-container] Fix segmentation fault when RPC initialization fails.

  • [libnvidia-container] Build centos variants of the NVIDIA Container Library with static libtirpc v1.3.2.

  • [libnvidia-container] Remove make targets for fedora35 as the centos8 packages are compatible.

  • [toolkit-container] Add nvidia-container-runtime.modes.cdi.annotation-prefixes config option that allows the CDI annotation prefixes that are read to be overridden.

  • [toolkit-container] Create device nodes when generating CDI specification for management containers.

  • [toolkit-container] Add nvidia-container-runtime.runtimes config option to set the low-level runtime for the NVIDIA Container Runtime

v1.13.0-rc.2

  • Don't fail chmod hook if paths are not injected
  • Only create by-path symlinks if CDI devices are actually requested.
  • Fix possible blank nvidia-ctk path in generated CDI specifications
  • Fix error in postun scriplet on RPM-based systems
  • Only check NVIDIA_VISIBLE_DEVICES for environment variables if no annotations are specified.
  • Add cdi.default-kind config option for constructing fully-qualified CDI device names in CDI mode
  • Add support for accept-nvidia-visible-devices-envvar-unprivileged config setting in CDI mode
  • Add nvidia-container-runtime-hook.skip-mode-detection config option to bypass mode detection. This allows legacy and cdi mode, for example, to be used at the same time.
  • Add support for generating CDI specifications for GDS and MOFED devices
  • Ensure CDI specification is validated on save when generating a spec
  • Rename --discovery-mode argument to --mode for nvidia-ctk cdi generate
  • [libnvidia-container] Fix segfault on WSL2 systems
  • [toolkit-container] Add --cdi-enabled flag to toolkit config
  • [toolkit-container] Install nvidia-ctk from toolkit container
  • [toolkit-container] Use installed nvidia-ctk path in NVIDIA Container Toolkit config
  • [toolkit-container] Bump CUDA base images to 12.1.0
  • [toolkit-container] Set nvidia-ctk path in the
  • [toolkit-container] Add cdi.k8s.io/* to set of allowed annotations in containerd config
  • [toolkit-container] Generate CDI specification for use in management containers
  • [toolkit-container] Install experimental runtime as nvidia-container-runtime.experimental instead of nvidia-container-runtime-experimental
  • [toolkit-container] Install and configure mode-specific runtimes for cdi and legacy modes

v1.13.0-rc.1

  • Include MIG-enabled devices as GPUs when generating CDI specification
  • Fix missing NVML symbols when running nvidia-ctk on some platforms [#49]
  • Add CDI spec generation for WSL2-based systems to nvidia-ctk cdi generate command
  • Add auto mode to nvidia-ctk cdi generate command to automatically detect a WSL2-based system over a standard NVML-based system.
  • Add mode-specific (.cdi and .legacy) NVIDIA Container Runtime binaries for use in the GPU Operator
  • Discover all gsb*.bin GSP firmware files when generating CDI specification.
  • Align .deb and .rpm release candidate package versions
  • Remove fedora35 packaging targets
  • [libnvidia-container] Include all gsp*.bin firmware files if present
  • [libnvidia-container] Align .deb and .rpm release candidate package versions
  • [libnvidia-container] Remove fedora35 packaging targets
  • [toolkit-container] Install nvidia-container-toolkit-operator-extensions package for mode-specific executables.
  • [toolkit-container] Allow nvidia-container-runtime.mode to be set when configuring the NVIDIA Container Toolkit

v1.12.0

  • Promote v1.12.0-rc.5 to v1.12.0
  • Rename nvidia cdi generate --root flag to --driver-root to better indicate intent
  • [libnvidia-container] Add nvcubins.bin to DriverStore components under WSL2
  • [toolkit-container] Bump CUDA base images to 12.0.1

v1.12.0-rc.5

  • Fix bug here the nvidia-ctk path was not properly resolved. This causes failures to run containers when the runtime is configured in csv mode or if the NVIDIA_DRIVER_CAPABILITIES includes graphics or display (e.g. all).

v1.12.0-rc.4

  • Generate a minimum CDI spec version for improved compatibility.
  • Add --device-name-strategy options to the nvidia-ctk cdi generate command that can be used to control how device names are constructed.
  • Set default for CDI device name generation to index to generate device names such as nvidia.com/gpu=0 or nvidia.com/gpu=1:0 by default.

v1.12.0-rc.3

  • Don't fail if by-path symlinks for DRM devices do not exist
  • Replace the --json flag with a --format [json|yaml] flag for the nvidia-ctk cdi generate command
  • Ensure that the CDI output folder is created if required
  • When generating a CDI specification use a blank host path for devices to ensure compatibility with the v0.4.0 CDI specification
  • Add injection of Wayland JSON files
  • Add GSP firmware paths to generated CDI specification
  • Add --root flag to nvidia-ctk cdi generate command

v1.12.0-rc.2

  • Inject Direct Rendering Manager (DRM) devices into a container using the NVIDIA Container Runtime
  • Improve logging of errors from the NVIDIA Container Runtime
  • Improve CDI specification generation to support rootless podman
  • Use nvidia-ctk cdi generate to generate CDI specifications instead of nvidia-ctk info generate-cdi
  • [libnvidia-container] Skip creation of existing files when these are already mounted

v1.12.0-rc.1

  • Add support for multiple Docker Swarm resources
  • Improve injection of Vulkan configurations and libraries
  • Add nvidia-ctk info generate-cdi command to generated CDI specification for available devices
  • [libnvidia-container] Include NVVM compiler library in compute libs

v1.11.0

  • Promote v1.11.0-rc.3 to v1.11.0

v1.11.0-rc.3

  • Build fedora35 packages
  • Introduce an nvidia-container-toolkit-base package for better dependency management
  • Fix removal of nvidia-container-runtime-hook on RPM-based systems
  • Inject platform files into container on Tegra-based systems
  • [toolkit container] Update CUDA base images to 11.7.1
  • [libnvidia-container] Preload libgcc_s.so.1 on arm64 systems

v1.11.0-rc.2

  • Allow accept-nvidia-visible-devices-* config options to be set by toolkit container
  • [libnvidia-container] Fix bug where LDCache was not updated when the --no-pivot-root option was specified

v1.11.0-rc.1

  • Add discovery of GPUDirect Storage (nvidia-fs*) devices if the NVIDIA_GDS environment variable of the container is set to enabled
  • Add discovery of MOFED Infiniband devices if the NVIDIA_MOFED environment variable of the container is set to enabled
  • Fix bug in CSV mode where libraries listed as sym entries in mount specification are not added to the LDCache.
  • Rename nvidia-container-toolkit executable to nvidia-container-runtime-hook and create nvidia-container-toolkit as a symlink to nvidia-container-runtime-hook instead.
  • Add nvidia-ctk runtime configure command to configure the Docker config file (e.g. /etc/docker/daemon.json) for use with the NVIDIA Container Runtime.

v1.10.0

  • Promote v1.10.0-rc.3 to v1.10.0

v1.10.0-rc.3

  • Use default config instead of raising an error if config file cannot be found
  • Ignore NVIDIA_REQUIRE_JETPACK* environment variables for requirement checks
  • Fix bug in detection of Tegra systems where /sys/devices/soc0/family is ignored
  • Fix bug where links to devices were detected as devices
  • [libnvida-container] Fix bug introduced when adding libcudadebugger.so to list of libraries

v1.10.0-rc.2

  • Add support for NVIDIA_REQUIRE_* checks for cuda version and arch to csv mode
  • Switch to debug logging to reduce log verbosity
  • Support logging to logs requested in command line
  • Fix bug when launching containers with relative root path (e.g. using containerd)
  • Allow low-level runtime path to be set explicitly as nvidia-container-runtime.runtimes option
  • Fix failure to locate low-level runtime if PATH envvar is unset
  • Replace experimental option for NVIDIA Container Runtime with nvidia-container-runtime.mode = csv option
  • Use csv as default mode on Tegra systems without NVML
  • Add --version flag to all CLIs
  • [libnvidia-container] Bump libtirpc to 1.3.2
  • [libnvidia-container] Fix bug when running host ldconfig using glibc compiled with a non-standard prefix
  • [libnvidia-container] Add libcudadebugger.so to list of compute libraries

v1.10.0-rc.1

  • Include nvidia-ctk CLI in installed binaries
  • Add experimental option to NVIDIA Container Runtime

v1.9.0

  • [libnvidia-container] Add additional check for Tegra in /sys/.../family file in CLI
  • [libnvidia-container] Update jetpack-specific CLI option to only load Base CSV files by default
  • [libnvidia-container] Fix bug (from 1.8.0) when mounting GSP firmware into containers without /lib to /usr/lib symlinks
  • [libnvidia-container] Update nvml.h to CUDA 11.6.1 nvML_DEV 11.6.55
  • [libnvidia-container] Update switch statement to include new brands from latest nvml.h
  • [libnvidia-container] Process all --require flags on Jetson platforms
  • [libnvidia-container] Fix long-standing issue with running ldconfig on Debian systems

v1.8.1

  • [libnvidia-container] Fix bug in determining cgroup root when running in nested containers
  • [libnvidia-container] Fix permission issue when determining cgroup version

v1.8.0

  • Promote 1.8.0-rc.2-1 to 1.8.0

v1.8.0-rc.2

  • Remove support for building amazonlinux1 packages

v1.8.0-rc.1

  • [libnvidia-container] Add support for cgroupv2
  • Release toolkit-container images from nvidia-container-toolkit repository

v1.7.0

  • Promote 1.7.0-rc.1-1 to 1.7.0
  • Bump Golang version to 1.16.4

v1.7.0-rc.1

  • Specify containerd runtime type as string in config tools to remove dependency on containerd package
  • Add supported-driver-capabilities config option to allow for a subset of all driver capabilities to be specified

v1.6.0

  • Promote 1.6.0-rc.3-1 to 1.6.0
  • Fix unnecessary logging to stderr instead of configured nvidia-container-runtime log file

v1.6.0-rc.3

  • Add supported-driver-capabilities config option to the nvidia-container-toolkit
  • Move OCI and command line checks for runtime to internal oci package

v1.6.0-rc.2

  • Use relative path to OCI specification file (config.json) if bundle path is not specified as an argument to the nvidia-container-runtime

v1.6.0-rc.1

  • Add AARCH64 package for Amazon Linux 2
  • Include nvidia-container-runtime into nvidia-container-toolkit package

v1.5.1

  • Fix bug where Docker Swarm device selection is ignored if NVIDIA_VISIBLE_DEVICES is also set
  • Improve unit testing by using require package and adding coverage reports
  • Remove unneeded go dependencies by running go mod tidy
  • Move contents of pkg directory to cmd for CLI tools
  • Ensure make binary target explicitly sets GOOS

v1.5.0

  • Add dependence on libnvidia-container-tools >= 1.4.0
  • Add golang check targets to Makefile
  • Add Jenkinsfile definition for build targets
  • Move docker.mk to docker folder

v1.4.2

  • Add dependence on libnvidia-container-tools >= 1.3.3

v1.4.1

  • Ignore NVIDIA_VISIBLE_DEVICES for containers with insufficent privileges
  • Add dependence on libnvidia-container-tools >= 1.3.2

v1.4.0

  • Add 'compute' capability to list of defaults
  • Add dependence on libnvidia-container-tools >= 1.3.1

v1.3.0

  • Promote 1.3.0-rc.2-1 to 1.3.0
  • Add dependence on libnvidia-container-tools >= 1.3.0

v1.3.0-rc.2

  • 2c180947 Add more tests for new semantics with device list from volume mounts
  • 7c003857 Refactor accepting device lists from volume mounts as a boolean

v1.3.0-rc.1

  • b50d86c1 Update build system to accept a TAG variable for things like rc.x
  • fe65573b Add common CI tests for things like golint, gofmt, unit tests, etc.
  • da6fbb34 Revert "Add ability to merge envars of the form NVIDIA_VISIBLE_DEVICES_*"
  • a7fb3330 Flip build-all targets to run automatically on merge requests
  • 8b248b66 Rename github.com/NVIDIA/container-toolkit to nvidia-container-toolkit
  • da36874e Add new config options to pull device list from mounted files instead of ENVVAR

v1.2.1

  • 4e6e0ed4 Add 'ngx' to list ofall driver capabilities
  • 2f4af743 List config.toml as a config file in the RPM SPEC

v1.2.0

  • 8e0aab46 Fix repo listed in changelog for debian distributions
  • 320bb6e4 Update dependence on libnvidia-container to 1.2.0
  • 6cfc8097 Update package license to match source license
  • e7dc3cbb Fix debian copyright file
  • d3aee3e0 Add the 'ngx' driver capability

v1.1.2

  • c32237f3 Add support for parsing Linux Capabilities for older OCI specs

v1.1.1

  • d202aded Update dependence to libnvidia-container 1.1.1

v1.1.0

  • 4e4de762 Update build system to support multi-arch builds
  • fcc1d116 Add support for MIG (Multi-Instance GPUs)
  • d4ff0416 Add ability to merge envars of the form NVIDIA_VISIBLE_DEVICES_*
  • 60f165ad Add no-pivot option to toolkit

v1.0.5

  • Initial release. Replaces older package nvidia-container-runtime-hook. (Closes: #XXXXXX)