Skip to content

Commit 5e885a1

Browse files
authored
fix: re-enable Torch-TensorRT model generation for SM 12.1
Removes a temporary skip in qa/common/gen_qa_model_repository that previously prevented Torch-TensorRT QA model generation on devices with compute capability 12.1 (NVIDIA GB10 / DGX Spark). The skip was added when TensorRT lacked the required convolution kernels for SM 12.1; that gap has been resolved in TensorRT 10.16.1.11 (current pytorch:26.05), so torchtrt_model_store builds end-to-end on GB10 hardware. Also bumps the copyright year on the modified file to 2026.
1 parent ab68625 commit 5e885a1

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

qa/common/gen_qa_model_repository

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
#!/bin/bash
2-
# Copyright 2018-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
2+
# Copyright 2018-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
33
#
44
# Redistribution and use in source and binary forms, with or without
55
# modification, are permitted provided that the following conditions
@@ -284,7 +284,7 @@ chmod -R 777 $TRITON_MDLS_QA_VARIABLE_SEQUENCE_IMPLICIT_MODEL
284284
python3 $TRITON_MDLS_SRC_DIR/gen_qa_dyna_sequence_models.py --libtorch --models_dir=$TRITON_MDLS_QA_DYNA_SEQUENCE_MODEL
285285
chmod -R 777 $TRITON_MDLS_QA_DYNA_SEQUENCE_MODEL
286286
if [ -z "$MODEL_TYPE" ] || [ "$MODEL_TYPE" != "igpu" ]; then
287-
nvidia-smi --query-gpu=compute_cap | grep -qz 12.1 && echo -e '${COLOR_WARNING}[WARNING]${COLOR_RESET} Skipping model generation for Torch TensorRT${COLOR_RESET}' || python3 $TRITON_MDLS_SRC_DIR/gen_qa_torchtrt_models.py --models_dir=$TRITON_MDLS_QA_TORCHTRT_MODEL
287+
python3 $TRITON_MDLS_SRC_DIR/gen_qa_torchtrt_models.py --models_dir=$TRITON_MDLS_QA_TORCHTRT_MODEL
288288
chmod -R 777 $TRITON_MDLS_QA_TORCHTRT_MODEL
289289
fi
290290
python3 $TRITON_MDLS_SRC_DIR/gen_qa_ragged_models.py --libtorch --models_dir=$TRITON_MDLS_QA_RAGGED_MODEL

0 commit comments

Comments
 (0)