Hey All,
We're relatively new to Triton and we've been trying to import a couple local models, but when we run the import command (below), we keep getting errors stating the path isn't found. Curious if anyone else as seen this, or know if the syntax we used is wrong.
triton -v import --repo /software/model_repository/ -m gpt-oss-120b --source local:/software/model_repository/gpt-oss-120b/ triton - ERROR - Local file path 'local:/software/model_repository/gpt-oss-120b' provided by --source does not exist
We've tried various flavors with the source flag, including local:modelname local://pathtomodel and even "local:/pathtomodel" none of which seems to help.
We're running triton in the nvidia provided Docker containers.
Hey All,
We're relatively new to Triton and we've been trying to import a couple local models, but when we run the import command (below), we keep getting errors stating the path isn't found. Curious if anyone else as seen this, or know if the syntax we used is wrong.
triton -v import --repo /software/model_repository/ -m gpt-oss-120b --source local:/software/model_repository/gpt-oss-120b/ triton - ERROR - Local file path 'local:/software/model_repository/gpt-oss-120b' provided by --source does not existWe've tried various flavors with the source flag, including local:modelname local://pathtomodel and even "local:/pathtomodel" none of which seems to help.
We're running triton in the nvidia provided Docker containers.