Append the output of grad_transform_on_trace to computation_traces - #2392
Merged
Merged
Lit OSS [bot] / all-tests.yaml / Lit Job (pytorchlightning/lightning-thunder:ubuntu24.04-cuda12.6.3-cudnn-fe1.10.0-py3.10-pt_2.8.0-dev, ops, L4)
succeeded
Sep 2, 2025 in 36m 19s
Job finished
Job ci-run_Lightning-AI-lightning-thunder-4e44a46-event-ce730a40-all-tests.yaml_/Lit_Job(pytorchlightning/lightning-thunder:ubuntu24.04-cuda12.6.3-cudnn-fe1.10.0-py3.10-pt_2.8.0-dev,_ops,_L4) finished as Completed with exit code 0.
Details
nvidia:
Tue Sep 2 15:55:13 2025
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 550.163.01 Driver Version: 550.163.01 CUDA Version: 12.6 |
|-----------------------------------------+------------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA L4 Off | 00000000:00:04.0 Off | 0 |
| N/A 38C P8 11W / 72W | 1MiB / 23034MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
+-----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| No running processes found |
+-----------------------------------------------------------------------------------------+
Python 3.10.18
pip 25.2 from /usr/local/lib/python3.10/dist-packages/pip (python 3.10)
Package Version
------------------------ ------------------
absl-py 2.3.1
accelerate 1.10.1
aiohappyeyeballs 2.6.1
aiohttp 3.12.15
aiosignal 1.4.0
apex 0.1
asv 0.6.4
asv_runner 0.2.1
asvdb 0.4.2
async-timeout 5.0.1
attrs 25.3.0
bitsandbytes 0.47.0
blinker 1.7.0
boto3 1.40.21
botocore 1.40.21
build 1.3.0
certifi 2025.8.3
charset-normalizer 3.4.3
coverage 7.9.2
cryptography 41.0.7
dbus-python 1.3.2
diffusers 0.34.0
distlib 0.4.0
distro 1.9.0
docstring_parser 0.17.0
einops 0.8.1
exceptiongroup 1.3.0
execnet 2.1.1
expecttest 0.3.0
fdm 0.5.0
filelock 3.13.1
frozenlist 1.7.0
fsspec 2024.6.1
graphviz 0.21
hf-xet 1.1.9
httplib2 0.20.4
huggingface-hub 0.34.4
hypothesis 6.136.9
idna 3.10
importlib_metadata 8.7.0
importlib_resources 6.5.2
iniconfig 2.1.0
Jinja2 3.1.4
jmespath 1.0.1
json5 0.12.1
jsonargparse 4.32.1
launchpadlib 1.11.0
lazr.restfulclient 0.14.6
lazr.uri 1.0.6
lightning 2.4.0
lightning-utilities 0.15.2
litgpt 0.5.0
MarkupSafe 2.1.5
mpmath 1.3.0
multidict 6.6.4
networkx 3.3
numpy 1.26.4
nvfuser_cu126_torch28 0.2.31.dev20250901
nvidia-cublas-cu12 12.6.4.1
nvidia-cuda-cupti-cu12 12.6.80
nvidia-cuda-nvrtc-cu12 12.6.77
nvidia-cuda-runtime-cu12 12.6.77
nvidia-cudnn-cu12 9.10.2.21
nvidia-cudnn-frontend 1.10.0
nvidia-cufft-cu12 11.3.0.4
nvidia-cufile-cu12 1.11.1.6
nvidia-curand-cu12 10.3.7.77
nvidia-cusolver-cu12 11.7.1.2
nvidia-cusparse-cu12 12.5.4.2
nvidia-cusparselt-cu12 0.7.1
nvidia-nccl-cu12 2.27.3
nvidia-nvjitlink-cu12 12.6.85
nvidia-nvtx-cu12 12.6.77
oauthlib 3.2.2
packaging 24.2
pandas 2.3.2
pillow 11.3.0
pip 25.2
platformdirs 4.4.0
pluggy 1.6.0
propcache 0.3.2
psutil 7.0.0
py-cpuinfo 9.0.0
PyGObject 3.48.2
PyJWT 2.7.0
Pympler 1.1
pyparsing 3.1.1
pyproject_hooks 1.2.0
pytest 8.3.5
pytest-benchmark 5.1.0
pytest-cov 6.2.1
pytest-random-order 1.2.0
pytest-timeout 2.4.0
pytest-timestamper 0.0.10
pytest-xdist 3.8.0
python-apt 2.7.7+ubuntu5
python-dateutil 2.9.0.post0
pytorch-lightning 2.5.4
pytz 2025.2
PyYAML 6.0.2
regex 2025.9.1
requests 2.32.5
s3transfer 0.13.1
safetensors 0.6.2
setuptools 80.9.0
six 1.16.0
sortedcontainers 2.4.0
sympy 1.13.3
tabulate 0.9.0
tokenizers 0.21.4
tomli 2.2.1
torch 2.8.0+cu126
torchmetrics 1.8.1
tqdm 4.67.1
transformers 4.52.4
triton 3.4.0
typeshed_client 2.8.2
typing_extensions 4.15.0
tzdata 2025.2
urllib3 2.5.0
virtualenv 20.34.0
wadllib 1.3.6
wheel 0.45.1
xlsxwriter 3.2.5
yarl 1.20.1
zipp 3.23.0
+ bash scripts/remove-torch-lines.sh requirements/base.txt
+ cat requirements/base.txt
looseversion ==1.3.0
lightning-utilities >0.7.0
numpy
networkx >=3.3
optree >=0.12.1
opt_einsum >=3.3.0
# todo: teporarl pin for `NameError: name '_C' is not defined`
mpmath <1.4.0
# Support for 3.12
dill >=0.3.8
+ pip install -U -r requirements/base.txt -r requirements/test.txt
Ignoring bitsandbytes: markers '"arm" in platform_machine or "aarch" in platform_machine' don't match your environment
Collecting asvdb@ git+https://github.com/rapidsai/asvdb.git (from -r requirements/test.txt (line 26))
Cloning https://github.com/rapidsai/asvdb.git to /tmp/pip-install-zc41q563/asvdb_2b5b0c0d265344dc9a82fa2aee5194c3
Running command git clone --filter=blob:none --quiet https://github.com/rapidsai/asvdb.git /tmp/pip-install-zc41q563/asvdb_2b5b0c0d265344dc9a82fa2aee5194c3
Resolved https://github.com/rapidsai/asvdb.git to commit fd1616a47f9b37bdce4c9c61a5bdd9310daccb72
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting looseversion==1.3.0 (from -r requirements/base.txt (line 1))
Downloading looseversion-1.3.0-py2.py3-none-any.whl.metadata (4.6 kB)
Requirement already satisfied: lightning-utilities>0.7.0 in /usr/local/lib/python3.10/dist-packages (from -r requirements/base.txt (line 2)) (0.15.2)
Requirement already satisfied: numpy in /usr/local/lib/python3.10/dist-packages (from -r requirements/base.txt (line 3)) (1.26.4)
Collecting numpy (from -r requirements/base.txt (line 3))
Using cached numpy-2.2.6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (62 kB)
Requirement already satisfied: networkx>=3.3 in /usr/local/lib/python3.10/dist-packages (from -r requirements/base.txt (line 4)) (3.3)
Collecting networkx>=3.3 (from -r requirements/base.txt (line 4))
Downloading networkx-3.4.2-py3-none-any.whl.metadata (6.3 kB)
Collecting optree>=0.12.1 (from -r requirements/base.txt (line 5))
Downloading optree-0.17.0-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (33 kB)
Collecting opt_einsum>=3.3.0 (from -r requirements/base.txt (line 6))
Downloading opt_einsum-3.4.0-py3-none-any.whl.metadata (6.3 kB)
Requirement already satisfied: mpmath<1.4.0 in /usr/local/lib/python3.10/dist-packages (from -r requirements/base.txt (line 8)) (1.3.0)
Collecting dill>=0.3.8 (from -r requirements/base.txt (line 10))
Downloading dill-0.4.0-py3-none-any.whl.metadata (10 kB)
Requirement already satisfied: coverage~=7.9.1 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 1)) (7.9.2)
Requirement already satisfied: pytest==8.3.5 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 2)) (8.3.5)
Requirement already satisfied: pytest-benchmark==5.1.0 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 3)) (5.1.0)
Requirement already satisfied: pytest-timeout==2.4.0 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 4)) (2.4.0)
Requirement already satisfied: pytest-cov==6.2.1 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 5)) (6.2.1)
Requirement already satisfied: pytest-xdist==3.8.0 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 6)) (3.8.0)
Requirement already satisfied: pytest-random-order==1.2.0 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 7)) (1.2.0)
Requirement already satisfied: pytest-timestamper==0.0.10 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 8)) (0.0.10)
Requirement already satisfied: graphviz==0.21 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 9)) (0.21)
Requirement already satisfied: fdm==0.5.0 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 10)) (0.5.0)
Requirement already satisfied: expecttest==0.3.0 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 11)) (0.3.0)
Requirement already satisfied: hypothesis~=6.136.6 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 12)) (6.136.9)
Requirement already satisfied: einops in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 14)) (0.8.1)
Requirement already satisfied: litgpt==0.5.0 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 15)) (0.5.0)
Requirement already satisfied: absl-py in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 16)) (2.3.1)
Requirement already satisfied: pandas in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 17)) (2.3.2)
Requirement already satisfied: xlsxwriter in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 18)) (3.2.5)
Requirement already satisfied: jsonargparse in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 19)) (4.32.1)
Collecting jsonargparse (from -r requirements/test.txt (line 19))
Using cached jsonargparse-4.40.2-py3-none-any.whl.metadata (13 kB)
Requirement already satisfied: bitsandbytes==0.47.0 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 20)) (0.47.0)
Requirement already satisfied: transformers==4.52.4 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 22)) (4.52.4)
Requirement already satisfied: diffusers==0.34.0 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 23)) (0.34.0)
Requirement already satisfied: accelerate in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 24)) (1.10.1)
Requirement already satisfied: asv>=0.6.4 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 27)) (0.6.4)
Requirement already satisfied: botocore in /usr/local/lib/python3.10/dist-packages (from asvdb@ git+https://github.com/rapidsai/asvdb.git->-r requirements/test.txt (line 26)) (1.40.21)
Requirement already satisfied: boto3 in /usr/local/lib/python3.10/dist-packages (from asvdb@ git+https://github.com/rapidsai/asvdb.git->-r requirements/test.txt (line 26)) (1.40.21)
Requirement already satisfied: exceptiongroup>=1.0.0rc8 in /usr/local/lib/python3.10/dist-packages (from pytest==8.3.5->-r requirements/test.txt (line 2)) (1.3.0)
Requirement already satisfied: iniconfig in /usr/local/lib/python3.10/dist-packages (from pytest==8.3.5->-r requirements/test.txt (line 2)) (2.1.0)
Requirement already satisfied: packaging in /usr/local/lib/python3.10/dist-packages (from pytest==8.3.5->-r requirements/test.txt (line 2)) (24.2)
Requirement already satisfied: pluggy<2,>=1.5 in /usr/local/lib/python3.10/dist-packages (from pytest==8.3.5->-r requirements/test.txt (line 2)) (1.6.0)
Requirement already satisfied: tomli>=1 in /usr/local/lib/python3.10/dist-packages (from pytest==8.3.5->-r requirements/test.txt (line 2)) (2.2.1)
Requirement already satisfied: py-cpuinfo in /usr/local/lib/python3.10/dist-packages (from pytest-benchmark==5.1.0->-r requirements/test.txt (line 3)) (9.0.0)
Requirement already satisfied: execnet>=2.1 in /usr/local/lib/python3.10/dist-packages (from pytest-xdist==3.8.0->-r requirements/test.txt (line 6)) (2.1.1)
Requirement already satisfied: sympy in /usr/local/lib/python3.10/dist-packages (from fdm==0.5.0->-r requirements/test.txt (line 10)) (1.13.3)
Requirement already satisfied: torch>=2.2.0 in /usr/local/lib/python3.10/dist-packages (from litgpt==0.5.0->-r requirements/test.txt (line 15)) (2.8.0+cu126)
Requirement already satisfied: lightning==2.4.0 in /usr/local/lib/python3.10/dist-packages (from litgpt==0.5.0->-r requirements/test.txt (line 15)) (2.4.0)
Requirement already satisfied: huggingface-hub>=0.23.5 in /usr/local/lib/python3.10/dist-packages (from litgpt==0.5.0->-r requirements/test.txt (line 15)) (0.34.4)
Requirement already satisfied: safetensors>=0.4.3 in /usr/local/lib/python3.10/dist-packages (from litgpt==0.5.0->-r requirements/test.txt (line 15)) (0.6.2)
Requirement already satisfied: tokenizers>=0.15.2 in /usr/local/lib/python3.10/dist-packages (from litgpt==0.5.0->-r requirements/test.txt (line 15)) (0.21.4)
Requirement already satisfied: tqdm>=4.66.0 in /usr/local/lib/python3.10/dist-packages (from litgpt==0.5.0->-r requirements/test.txt (line 15)) (4.67.1)
Requirement already satisfied: filelock in /usr/local/lib/python3.10/dist-packages (from transformers==4.52.4->-r requirements/test.txt (line 22)) (3.13.1)
Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.10/dist-packages (from transformers==4.52.4->-r requirements/test.txt (line 22)) (6.0.2)
Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.10/dist-packages (from transformers==4.52.4->-r requirements/test.txt (line 22)) (2025.9.1)
Requirement already satisfied: requests in /usr/local/lib/python3.10/dist-packages (from transformers==4.52.4->-r requirements/test.txt (line 22)) (2.32.5)
Requirement already satisfied: importlib_metadata in /usr/local/lib/python3.10/dist-packages (from diffusers==0.34.0->-r requirements/test.txt (line 23)) (8.7.0)
Requirement already satisfied: Pillow in /usr/local/lib/python3.10/dist-packages (from diffusers==0.34.0->-r requirements/test.txt (line 23)) (11.3.0)
Requirement already satisfied: fsspec<2026.0,>=2022.5.0 in /usr/local/lib/python3.10/dist-packages (from fsspec[http]<2026.0,>=2022.5.0->lightning==2.4.0->litgpt==0.5.0->-r requirements/test.txt (line
↪ 15)) (2024.6.1)
Requirement already satisfied: torchmetrics<3.0,>=0.7.0 in /usr/local/lib/python3.10/dist-packages (from lightning==2.4.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (1.8.1)
Requirement already satisfied: typing-extensions<6.0,>=4.4.0 in /usr/local/lib/python3.10/dist-packages (from lightning==2.4.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (4.15.0)
Requirement already satisfied: pytorch-lightning in /usr/local/lib/python3.10/dist-packages (from lightning==2.4.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (2.5.4)
Requirement already satisfied: setuptools in /usr/local/lib/python3.10/dist-packages (from lightning-utilities>0.7.0->-r requirements/base.txt (line 2)) (80.9.0)
Requirement already satisfied: attrs>=22.2.0 in /usr/local/lib/python3.10/dist-packages (from hypothesis~=6.136.6->-r requirements/test.txt (line 12)) (25.3.0)
Requirement already satisfied: sortedcontainers<3.0.0,>=2.1.0 in /usr/local/lib/python3.10/dist-packages (from hypothesis~=6.136.6->-r requirements/test.txt (line 12)) (2.4.0)
Requirement already satisfied: aiohttp!=4.0.0a0,!=4.0.0a1 in /usr/local/lib/python3.10/dist-packages (from fsspec[http]<2026.0,>=2022.5.0->lightning==2.4.0->litgpt==0.5.0->-r requirements/test.txt
↪ (line 15)) (3.12.15)
Requirement already satisfied: hf-xet<2.0.0,>=1.1.3 in /usr/local/lib/python3.10/dist-packages (from huggingface-hub>=0.23.5->litgpt==0.5.0->-r requirements/test.txt (line 15)) (1.1.9)
Requirement already satisfied: docstring-parser>=0.15 in /usr/local/lib/python3.10/dist-packages (from jsonargparse[signatures]<=4.32.1,>=4.30.1->litgpt==0.5.0->-r requirements/test.txt (line 15))
↪ (0.17.0)
Requirement already satisfied: typeshed-client>=2.1.0 in /usr/local/lib/python3.10/dist-packages (from jsonargparse[signatures]<=4.32.1,>=4.30.1->litgpt==0.5.0->-r requirements/test.txt (line 15))
↪ (2.8.2)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.10/dist-packages (from torch>=2.2.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (3.1.4)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.6.77 in /usr/local/lib/python3.10/dist-packages (from torch>=2.2.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (12.6.77)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.6.77 in /usr/local/lib/python3.10/dist-packages (from torch>=2.2.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (12.6.77)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.6.80 in /usr/local/lib/python3.10/dist-packages (from torch>=2.2.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (12.6.80)
Requirement already satisfied: nvidia-cudnn-cu12==9.10.2.21 in /usr/local/lib/python3.10/dist-packages (from torch>=2.2.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (9.10.2.21)
Requirement already satisfied: nvidia-cublas-cu12==12.6.4.1 in /usr/local/lib/python3.10/dist-packages (from torch>=2.2.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (12.6.4.1)
Requirement already satisfied: nvidia-cufft-cu12==11.3.0.4 in /usr/local/lib/python3.10/dist-packages (from torch>=2.2.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (11.3.0.4)
Requirement already satisfied: nvidia-curand-cu12==10.3.7.77 in /usr/local/lib/python3.10/dist-packages (from torch>=2.2.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (10.3.7.77)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.1.2 in /usr/local/lib/python3.10/dist-packages (from torch>=2.2.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (11.7.1.2)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.4.2 in /usr/local/lib/python3.10/dist-packages (from torch>=2.2.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (12.5.4.2)
Requirement already satisfied: nvidia-cusparselt-cu12==0.7.1 in /usr/local/lib/python3.10/dist-packages (from torch>=2.2.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (0.7.1)
Requirement already satisfied: nvidia-nccl-cu12==2.27.3 in /usr/local/lib/python3.10/dist-packages (from torch>=2.2.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (2.27.3)
Requirement already satisfied: nvidia-nvtx-cu12==12.6.77 in /usr/local/lib/python3.10/dist-packages (from torch>=2.2.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (12.6.77)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.6.85 in /usr/local/lib/python3.10/dist-packages (from torch>=2.2.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (12.6.85)
Requirement already satisfied: nvidia-cufile-cu12==1.11.1.6 in /usr/local/lib/python3.10/dist-packages (from torch>=2.2.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (1.11.1.6)
Requirement already satisfied: triton==3.4.0 in /usr/local/lib/python3.10/dist-packages (from torch>=2.2.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (3.4.0)
Requirement already satisfied: python-dateutil>=2.8.2 in /usr/local/lib/python3.10/dist-packages (from pandas->-r requirements/test.txt (line 17)) (2.9.0.post0)
Requirement already satisfied: pytz>=2020.1 in /usr/local/lib/python3.10/dist-packages (from pandas->-r requirements/test.txt (line 17)) (2025.2)
Requirement already satisfied: tzdata>=2022.7 in /usr/local/lib/python3.10/dist-packages (from pandas->-r requirements/test.txt (line 17)) (2025.2)
Requirement already satisfied: psutil in /usr/local/lib/python3.10/dist-packages (from accelerate->-r requirements/test.txt (line 24)) (7.0.0)
Requirement already satisfied: asv-runner>=v0.2.1 in /usr/local/lib/python3.10/dist-packages (from asv>=0.6.4->-r requirements/test.txt (line 27)) (0.2.1)
Requirement already satisfied: json5 in /usr/local/lib/python3.10/dist-packages (from asv>=0.6.4->-r requirements/test.txt (line 27)) (0.12.1)
Requirement already satisfied: build in /usr/local/lib/python3.10/dist-packages (from asv>=0.6.4->-r requirements/test.txt (line 27)) (1.3.0)
Requirement already satisfied: tabulate in /usr/local/lib/python3.10/dist-packages (from asv>=0.6.4->-r requirements/test.txt (line 27)) (0.9.0)
Requirement already satisfied: virtualenv in /usr/local/lib/python3.10/dist-packages (from asv>=0.6.4->-r requirements/test.txt (line 27)) (20.34.0)
Requirement already satisfied: pympler in /usr/local/lib/python3.10/dist-packages (from asv>=0.6.4->-r requirements/test.txt (line 27)) (1.1)
Requirement already satisfied: aiohappyeyeballs>=2.5.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<2026.0,>=2022.5.0->lightning==2.4.0->litgpt==0.5.0->-r
↪ requirements/test.txt (line 15)) (2.6.1)
Requirement already satisfied: aiosignal>=1.4.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<2026.0,>=2022.5.0->lightning==2.4.0->litgpt==0.5.0->-r
↪ requirements/test.txt (line 15)) (1.4.0)
Requirement already satisfied: async-timeout<6.0,>=4.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<2026.0,>=2022.5.0->lightning==2.4.0->litgpt==0.5.0->-r
↪ requirements/test.txt (line 15)) (5.0.1)
Requirement already satisfied: frozenlist>=1.1.1 in /usr/local/lib/python3.10/dist-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<2026.0,>=2022.5.0->lightning==2.4.0->litgpt==0.5.0->-r
↪ requirements/test.txt (line 15)) (1.7.0)
Requirement already satisfied: multidict<7.0,>=4.5 in /usr/local/lib/python3.10/dist-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<2026.0,>=2022.5.0->lightning==2.4.0->litgpt==0.5.0->-r
↪ requirements/test.txt (line 15)) (6.6.4)
Requirement already satisfied: propcache>=0.2.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<2026.0,>=2022.5.0->lightning==2.4.0->litgpt==0.5.0->-r
↪ requirements/test.txt (line 15)) (0.3.2)
Requirement already satisfied: yarl<2.0,>=1.17.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<2026.0,>=2022.5.0->lightning==2.4.0->litgpt==0.5.0->-r
↪ requirements/test.txt (line 15)) (1.20.1)
Requirement already satisfied: idna>=2.0 in /usr/local/lib/python3.10/dist-packages (from
↪ yarl<2.0,>=1.17.0->aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<2026.0,>=2022.5.0->lightning==2.4.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (3.10)
Requirement already satisfied: six>=1.5 in /usr/lib/python3/dist-packages (from python-dateutil>=2.8.2->pandas->-r requirements/test.txt (line 17)) (1.16.0)
Requirement already satisfied: importlib_resources>=1.4.0 in /usr/local/lib/python3.10/dist-packages (from typeshed-client>=2.1.0->jsonargparse[signatures]<=4.32.1,>=4.30.1->litgpt==0.5.0->-r
↪ requirements/test.txt (line 15)) (6.5.2)
Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /usr/local/lib/python3.10/dist-packages (from boto3->asvdb@ git+https://github.com/rapidsai/asvdb.git->-r requirements/test.txt (line 26))
↪ (1.0.1)
Requirement already satisfied: s3transfer<0.14.0,>=0.13.0 in /usr/local/lib/python3.10/dist-packages (from boto3->asvdb@ git+https://github.com/rapidsai/asvdb.git->-r requirements/test.txt (line 26))
↪ (0.13.1)
Requirement already satisfied: urllib3!=2.2.0,<3,>=1.25.4 in /usr/local/lib/python3.10/dist-packages (from botocore->asvdb@ git+https://github.com/rapidsai/asvdb.git->-r requirements/test.txt (line
↪ 26)) (2.5.0)
Requirement already satisfied: pyproject_hooks in /usr/local/lib/python3.10/dist-packages (from build->asv>=0.6.4->-r requirements/test.txt (line 27)) (1.2.0)
Requirement already satisfied: zipp>=3.20 in /usr/local/lib/python3.10/dist-packages (from importlib_metadata->diffusers==0.34.0->-r requirements/test.txt (line 23)) (3.23.0)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.10/dist-packages (from jinja2->torch>=2.2.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (2.1.5)
Requirement already satisfied: charset_normalizer<4,>=2 in /usr/local/lib/python3.10/dist-packages (from requests->transformers==4.52.4->-r requirements/test.txt (line 22)) (3.4.3)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests->transformers==4.52.4->-r requirements/test.txt (line 22)) (2025.8.3)
Requirement already satisfied: distlib<1,>=0.3.7 in /usr/local/lib/python3.10/dist-packages (from virtualenv->asv>=0.6.4->-r requirements/test.txt (line 27)) (0.4.0)
Requirement already satisfied: platformdirs<5,>=3.9.1 in /usr/local/lib/python3.10/dist-packages (from virtualenv->asv>=0.6.4->-r requirements/test.txt (line 27)) (4.4.0)
Downloading looseversion-1.3.0-py2.py3-none-any.whl (8.2 kB)
Downloading networkx-3.4.2-py3-none-any.whl (1.7 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.7/1.7 MB 43.0 MB/s 0:00:00
Downloading optree-0.17.0-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (387 kB)
Downloading opt_einsum-3.4.0-py3-none-any.whl (71 kB)
Downloading dill-0.4.0-py3-none-any.whl (119 kB)
Installing collected packages: looseversion, optree, opt_einsum, networkx, dill
Attempting uninstall: networkx
Found existing installation: networkx 3.3
Uninstalling networkx-3.3:
Successfully uninstalled networkx-3.3
Successfully installed dill-0.4.0 looseversion-1.3.0 networkx-3.4.2 opt_einsum-3.4.0 optree-0.17.0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a
↪ virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
+ curl -Os https://uploader.codecov.io/latest/linux/codecov
+ chmod +x codecov
+ python setup.py develop
running develop
/usr/local/lib/python3.10/dist-packages/setuptools/_distutils/cmd.py:90: DevelopDeprecationWarning: develop command is deprecated.
!!
********************************************************************************
Please avoid running ``setup.py`` and ``develop``.
Instead, use standards-based tools like pip or uv.
By 2025-Oct-31, you need to update your project and remove deprecated calls
or your builds will no longer be supported.
See https://github.com/pypa/setuptools/issues/917 for details.
********************************************************************************
!!
self.initialize_options()
Obtaining file:///workspace
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Checking if build backend supports build_editable: started
Checking if build backend supports build_editable: finished with status 'done'
Getting requirements to build editable: started
Getting requirements to build editable: finished with status 'done'
Preparing editable metadata (pyproject.toml): started
Preparing editable metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: looseversion==1.3.0 in /usr/local/lib/python3.10/dist-packages (from lightning-thunder==0.2.5.dev0) (1.3.0)
Requirement already satisfied: lightning-utilities>0.7.0 in /usr/local/lib/python3.10/dist-packages (from lightning-thunder==0.2.5.dev0) (0.15.2)
Requirement already satisfied: numpy in /usr/local/lib/python3.10/dist-packages (from lightning-thunder==0.2.5.dev0) (1.26.4)
Requirement already satisfied: networkx>=3.3 in /usr/local/lib/python3.10/dist-packages (from lightning-thunder==0.2.5.dev0) (3.4.2)
Requirement already satisfied: optree>=0.12.1 in /usr/local/lib/python3.10/dist-packages (from lightning-thunder==0.2.5.dev0) (0.17.0)
Requirement already satisfied: opt_einsum>=3.3.0 in /usr/local/lib/python3.10/dist-packages (from lightning-thunder==0.2.5.dev0) (3.4.0)
Requirement already satisfied: mpmath<1.4.0 in /usr/local/lib/python3.10/dist-packages (from lightning-thunder==0.2.5.dev0) (1.3.0)
Requirement already satisfied: dill>=0.3.8 in /usr/local/lib/python3.10/dist-packages (from lightning-thunder==0.2.5.dev0) (0.4.0)
Requirement already satisfied: packaging>=17.1 in /usr/local/lib/python3.10/dist-packages (from lightning-utilities>0.7.0->lightning-thunder==0.2.5.dev0) (24.2)
Requirement already satisfied: setuptools in /usr/local/lib/python3.10/dist-packages (from lightning-utilities>0.7.0->lightning-thunder==0.2.5.dev0) (80.9.0)
Requirement already satisfied: typing_extensions in /usr/local/lib/python3.10/dist-packages (from lightning-utilities>0.7.0->lightning-thunder==0.2.5.dev0) (4.15.0)
Building wheels for collected packages: lightning-thunder
Building editable for lightning-thunder (pyproject.toml): started
Building editable for lightning-thunder (pyproject.toml): finished with status 'done'
Created wheel for lightning-thunder: filename=lightning_thunder-0.2.5.dev0-0.editable-py3-none-any.whl size=11449 sha256=bcb9404d7a3dcbeefc8953f6e065fd31e32f57f2e45098bcac598405a875792c
Stored in directory: /tmp/pip-ephem-wheel-cache-hsx_0ct1/wheels/80/75/f6/d63789e3414f7f88206102fa596a8ddafc889f48984e8712b3
Successfully built lightning-thunder
Installing collected packages: lightning-thunder
Successfully installed lightning-thunder-0.2.5.dev0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a
↪ virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
+ bash scripts/sanity-check.sh
+ pip list
Package Version Editable project location
------------------------ ------------------ -------------------------
absl-py 2.3.1
accelerate 1.10.1
aiohappyeyeballs 2.6.1
aiohttp 3.12.15
aiosignal 1.4.0
apex 0.1
asv 0.6.4
asv_runner 0.2.1
asvdb 0.4.2
async-timeout 5.0.1
attrs 25.3.0
bitsandbytes 0.47.0
blinker 1.7.0
boto3 1.40.21
botocore 1.40.21
build 1.3.0
certifi 2025.8.3
charset-normalizer 3.4.3
coverage 7.9.2
cryptography 41.0.7
dbus-python 1.3.2
diffusers 0.34.0
dill 0.4.0
distlib 0.4.0
distro 1.9.0
docstring_parser 0.17.0
einops 0.8.1
exceptiongroup 1.3.0
execnet 2.1.1
expecttest 0.3.0
fdm 0.5.0
filelock 3.13.1
frozenlist 1.7.0
fsspec 2024.6.1
graphviz 0.21
hf-xet 1.1.9
httplib2 0.20.4
huggingface-hub 0.34.4
hypothesis 6.136.9
idna 3.10
importlib_metadata 8.7.0
importlib_resources 6.5.2
iniconfig 2.1.0
Jinja2 3.1.4
jmespath 1.0.1
json5 0.12.1
jsonargparse 4.32.1
launchpadlib 1.11.0
lazr.restfulclient 0.14.6
lazr.uri 1.0.6
lightning 2.4.0
lightning-thunder 0.2.5.dev0 /workspace
lightning-utilities 0.15.2
litgpt 0.5.0
looseversion 1.3.0
MarkupSafe 2.1.5
mpmath 1.3.0
multidict 6.6.4
networkx 3.4.2
numpy 1.26.4
nvfuser_cu126_torch28 0.2.31.dev20250901
nvidia-cublas-cu12 12.6.4.1
nvidia-cuda-cupti-cu12 12.6.80
nvidia-cuda-nvrtc-cu12 12.6.77
nvidia-cuda-runtime-cu12 12.6.77
nvidia-cudnn-cu12 9.10.2.21
nvidia-cudnn-frontend 1.10.0
nvidia-cufft-cu12 11.3.0.4
nvidia-cufile-cu12 1.11.1.6
nvidia-curand-cu12 10.3.7.77
nvidia-cusolver-cu12 11.7.1.2
nvidia-cusparse-cu12 12.5.4.2
nvidia-cusparselt-cu12 0.7.1
nvidia-nccl-cu12 2.27.3
nvidia-nvjitlink-cu12 12.6.85
nvidia-nvtx-cu12 12.6.77
oauthlib 3.2.2
opt_einsum 3.4.0
optree 0.17.0
packaging 24.2
pandas 2.3.2
pillow 11.3.0
pip 25.2
platformdirs 4.4.0
pluggy 1.6.0
propcache 0.3.2
psutil 7.0.0
py-cpuinfo 9.0.0
PyGObject 3.48.2
PyJWT 2.7.0
Pympler 1.1
pyparsing 3.1.1
pyproject_hooks 1.2.0
pytest 8.3.5
pytest-benchmark 5.1.0
pytest-cov 6.2.1
pytest-random-order 1.2.0
pytest-timeout 2.4.0
pytest-timestamper 0.0.10
pytest-xdist 3.8.0
python-apt 2.7.7+ubuntu5
python-dateutil 2.9.0.post0
pytorch-lightning 2.5.4
pytz 2025.2
PyYAML 6.0.2
regex 2025.9.1
requests 2.32.5
s3transfer 0.13.1
safetensors 0.6.2
setuptools 80.9.0
six 1.16.0
sortedcontainers 2.4.0
sympy 1.13.3
tabulate 0.9.0
tokenizers 0.21.4
tomli 2.2.1
torch 2.8.0+cu126
torchmetrics 1.8.1
tqdm 4.67.1
transformers 4.52.4
triton 3.4.0
typeshed_client 2.8.2
typing_extensions 4.15.0
tzdata 2025.2
urllib3 2.5.0
virtualenv 20.34.0
wadllib 1.3.6
wheel 0.45.1
xlsxwriter 3.2.5
yarl 1.20.1
zipp 3.23.0
+ python -c 'import torch ; assert torch.cuda.is_available(), '\''missing GPU support!'\'''
+ python -c 'import torch ; v = torch.__version__ ; assert str(v).startswith('\''2'\''), v'
+ python -c 'from thunder.executors import nvfuser_available ; assert nvfuser_available(), '\''nvFuser is missing!'\'''
/usr/local/lib/python3.10/dist-packages/nvfuser_direct/__init__.py:11: UserWarning: Be careful! You've imported nvfuser_direct when the nvfuser module is already imported.
warnings.warn(
/workspace/thunder/executors/transformer_engine_v2ex.py:25: UserWarning: transformer_engine module not found!
warnings.warn("transformer_engine module not found!")
+ python -c 'from thunder.executors.triton_utils import triton_version ; assert triton_version() is not None, '\''triton is missing!'\'''
/usr/local/lib/python3.10/dist-packages/nvfuser_direct/__init__.py:11: UserWarning: Be careful! You've imported nvfuser_direct when the nvfuser module is already imported.
warnings.warn(
/workspace/thunder/executors/transformer_engine_v2ex.py:25: UserWarning: transformer_engine module not found!
warnings.warn("transformer_engine module not found!")
+ '[' ops == main ']'
+ '[' ops == ops ']'
+ coverage run --source thunder -m pytest thunder/tests/test_ops.py -m 'not standalone' -v --datefmt=%Y%m%d-%H:%M:%S.%f --random-order-seed=42 --durations=250 --timeout=240 --numprocesses=9
/usr/local/lib/python3.10/dist-packages/pytest_benchmark/logger.py:39: PytestBenchmarkWarning: Benchmarks are automatically disabled because xdist plugin is active.Benchmarks cannot be performed
↪ reliably in a parallelized environment.
warner(PytestBenchmarkWarning(text))
============================= test session starts ==============================
platform linux -- Python 3.10.18, pytest-8.3.5, pluggy-1.6.0 -- /usr/bin/python3.10
cachedir: .pytest_cache
Using --random-order-bucket=module
Using --random-order-seed=42
hypothesis profile 'ci' -> database=None, deadline=None, print_blob=True, derandomize=True, suppress_health_check=(HealthCheck.too_slow,)
benchmark: 5.1.0 (defaults: timer=torch.utils.benchmark.utils.timer.timer disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=True warmup_iterations=100000)
rootdir: /workspace
configfile: pyproject.toml
plugins: timeout-2.4.0, timestamper-0.0.10, random-order-1.2.0, hypothesis-6.136.9, xdist-3.8.0, cov-6.2.1, benchmark-5.1.0
timeout: 240.0s
timeout method: signal
timeout func_only: False
created: 9/9 workers
9 workers [4820 items]
scheduling tests via LoadScheduling
[20250902-15:55:58.358370] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_nvfuser_cuda_thunder::dtypes::bool8
[gw0] [ 0%] SKIPPED [20250902-15:55:58.358370] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_nvfuser_cuda_thunder::dtypes::bool8
[20250902-15:55:58.360562] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_torch_cuda_thunder::dtypes::bool8
[20250902-15:55:58.360901] thunder/tests/test_ops.py::test_core_vs_torch_consistency_stack_wrapper_torch_cuda_thunder::dtypes::complex128
[gw7] [ 0%] SKIPPED [20250902-15:55:58.360901] thunder/tests/test_ops.py::test_core_vs_torch_consistency_stack_wrapper_torch_cuda_thunder::dtypes::complex128
[20250902-15:55:58.361830] thunder/tests/test_ops.py::test_core_vs_torch_consistency_add_nvfuser_cuda_thunder::dtypes::float32
[20250902-15:55:58.362266] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ndtri_torch_cuda_thunder::dtypes::uint8
[20250902-15:55:58.362612] thunder/tests/test_ops.py::test_errors_t_nvfuser_cuda_thunder::dtypes::complex128
[20250902-15:55:58.362992] thunder/tests/test_ops.py::test_core_vs_torch_consistency_cosh_torch_cuda_thunder::dtypes::int64
[20250902-15:55:58.363360] thunder/tests/test_ops.py::test_core_vs_torch_consistency_randint_nvfuser_cuda_thunder::dtypes::bfloat16
[20250902-15:55:58.363790] thunder/tests/test_ops.py::test_core_vs_torch_consistency_squeeze_torch_nvfuser_cuda_thunder::dtypes::int64
[gw0] [ 0%] SKIPPED [20250902-15:55:58.360562] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_torch_cuda_thunder::dtypes::bool8
[20250902-15:55:58.366741] thunder/tests/test_ops.py::test_core_vs_torch_consistency_square_torch_cuda_thunder::dtypes::bool8
[20250902-15:55:58.367048] thunder/tests/test_ops.py::test_core_vs_torch_consistency_rrelu_torch_cuda_thunder::dtypes::complex32
[gw1] [ 0%] SKIPPED [20250902-15:55:58.367048] thunder/tests/test_ops.py::test_core_vs_torch_consistency_rrelu_torch_cuda_thunder::dtypes::complex32
[20250902-15:55:58.368368] thunder/tests/test_ops.py::test_core_vs_torch_consistency_full_nvfuser_cuda_thunder::dtypes::int64
[20250902-15:55:58.370349] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_torch_cuda_thunder::dtypes::bfloat16
[gw0] [ 0%] SKIPPED [20250902-15:55:58.370349] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_torch_cuda_thunder::dtypes::bfloat16
[20250902-15:55:58.373482] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_nvfuser_cuda_thunder::dtypes::int64
[gw0] [ 0%] SKIPPED [20250902-15:55:58.373482] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_nvfuser_cuda_thunder::dtypes::int64
[20250902-15:55:58.381002] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_nvfuser_cuda_thunder::dtypes::float32
[gw0] [ 0%] SKIPPED [20250902-15:55:58.381002] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_nvfuser_cuda_thunder::dtypes::float32
[20250902-15:55:58.389190] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_nvfuser_cuda_thunder::dtypes::int32
[gw0] [ 0%] SKIPPED [20250902-15:55:58.389190] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_nvfuser_cuda_thunder::dtypes::int32
[20250902-15:55:58.394462] thunder/tests/test_ops.py::test_double_setitem
[gw2] [ 0%] PASSED [20250902-15:55:58.362612] thunder/tests/test_ops.py::test_errors_t_nvfuser_cuda_thunder::dtypes::complex128
[20250902-15:55:58.474665] thunder/tests/test_ops.py::test_errors_topk_nvfuser_cuda_thunder::dtypes::int64
[gw2] [ 0%] PASSED [20250902-15:55:58.474665] thunder/tests/test_ops.py::test_errors_topk_nvfuser_cuda_thunder::dtypes::int64
[20250902-15:55:58.834011] thunder/tests/test_ops.py::test_errors_unflatten_torch_cuda_thunder::dtypes::complex128
[gw0] [ 0%] PASSED [20250902-15:55:58.394462] thunder/tests/test_ops.py::test_double_setitem
[20250902-15:55:58.956254] thunder/tests/test_ops.py::test_multi_dot_optimization
[gw2] [ 0%] PASSED [20250902-15:55:58.834011] thunder/tests/test_ops.py::test_errors_unflatten_torch_cuda_thunder::dtypes::complex128
[20250902-15:55:59.086349] thunder/tests/test_ops.py::test_core_vs_torch_consistency_logical_xor_nvfuser_cuda_thunder::dtypes::float64
[gw4] [ 0%] PASSED [20250902-15:55:58.363790] thunder/tests/test_ops.py::test_core_vs_torch_consistency_squeeze_torch_nvfuser_cuda_thunder::dtypes::int64
[20250902-15:55:59.251410] thunder/tests/test_ops.py::test_core_vs_torch_consistency_size_torch_cuda_thunder::dtypes::bfloat16
[gw0] [ 0%] PASSED [20250902-15:55:58.956254] thunder/tests/test_ops.py::test_multi_dot_optimization
[20250902-15:55:59.394079] thunder/tests/test_ops.py::test_ltorch_maximum_result_dtype_for_scalar_tensors
[gw0] [ 0%] PASSED [20250902-15:55:59.394079] thunder/tests/test_ops.py::test_ltorch_maximum_result_dtype_for_scalar_tensors
[20250902-15:55:59.484312] thunder/tests/test_ops.py::test_setitem[False]
[gw0] [ 0%] PASSED [20250902-15:55:59.484312] thunder/tests/test_ops.py::test_setitem[False]
[20250902-15:55:59.991956] thunder/tests/test_ops.py::test_ltorch_cumsum_result_dtype_for_int_input
[gw5] [ 0%] PASSED [20250902-15:55:58.366741] thunder/tests/test_ops.py::test_core_vs_torch_consistency_square_torch_cuda_thunder::dtypes::bool8
[20250902-15:56:00.051148] thunder/tests/test_ops.py::test_core_vs_torch_consistency_exp2_torch_cuda_thunder::dtypes::float32
[gw3] [ 0%] PASSED [20250902-15:55:58.362992] thunder/tests/test_ops.py::test_core_vs_torch_consistency_cosh_torch_cuda_thunder::dtypes::int64
[20250902-15:56:00.078387] thunder/tests/test_ops.py::test_errors_unflatten_torch_cuda_thunder::dtypes::int8
[gw0] [ 0%] PASSED [20250902-15:55:59.991956] thunder/tests/test_ops.py::test_ltorch_cumsum_result_dtype_for_int_input
[20250902-15:56:00.083836] thunder/tests/test_ops.py::test_notimplemented_interpolate_modes
[gw1] [ 0%] PASSED [20250902-15:55:58.368368] thunder/tests/test_ops.py::test_core_vs_torch_consistency_full_nvfuser_cuda_thunder::dtypes::int64
[gw4] [ 0%] PASSED [20250902-15:55:59.251410] thunder/tests/test_ops.py::test_core_vs_torch_consistency_size_torch_cuda_thunder::dtypes::bfloat16
[20250902-15:56:00.216700] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ge_torch_cuda_thunder::dtypes::int64
[20250902-15:56:00.220165] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sin_nvfuser_cuda_thunder::dtypes::complex128
[gw1] [ 0%] SKIPPED [20250902-15:56:00.220165] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sin_nvfuser_cuda_thunder::dtypes::complex128
[20250902-15:56:00.223835] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sinh_nvfuser_cuda_thunder::dtypes::float32
[gw3] [ 0%] PASSED [20250902-15:56:00.078387] thunder/tests/test_ops.py::test_errors_unflatten_torch_cuda_thunder::dtypes::int8
[20250902-15:56:00.309288] thunder/tests/test_ops.py::test_core_vs_torch_consistency_bitwise_left_shift_nvfuser_cuda_thunder::dtypes::int32
[gw0] [ 0%] PASSED [20250902-15:56:00.083836] thunder/tests/test_ops.py::test_notimplemented_interpolate_modes
[20250902-15:56:00.460687] thunder/tests/test_ops.py::test_notimplemented_interpolate_recompute_scale
[gw0] [ 0%] PASSED [20250902-15:56:00.460687] thunder/tests/test_ops.py::test_notimplemented_interpolate_recompute_scale
[20250902-15:56:00.557012] thunder/tests/test_ops.py::test_interpolate_nearest_vs_nearest_exact
[gw6] [ 0%] PASSED [20250902-15:55:58.361830] thunder/tests/test_ops.py::test_core_vs_torch_consistency_add_nvfuser_cuda_thunder::dtypes::float32
[20250902-15:56:00.616433] thunder/tests/test_ops.py::test_core_vs_torch_consistency_std_torch_cuda_thunder::dtypes::float64
[gw4] [ 0%] PASSED [20250902-15:56:00.216700] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ge_torch_cuda_thunder::dtypes::int64
[20250902-15:56:00.689553] thunder/tests/test_ops.py::test_core_vs_torch_consistency_scatter_nvfuser_cuda_thunder::dtypes::int32
[gw0] [ 0%] PASSED [20250902-15:56:00.557012] thunder/tests/test_ops.py::test_interpolate_nearest_vs_nearest_exact
[20250902-15:56:00.988569] thunder/tests/test_ops.py::test_notimplemented_interpolate_align
[gw0] [ 0%] PASSED [20250902-15:56:00.988569] thunder/tests/test_ops.py::test_notimplemented_interpolate_align
[20250902-15:56:01.085950] thunder/tests/test_ops.py::test_exponential
[gw2] [ 0%] PASSED [20250902-15:55:59.086349] thunder/tests/test_ops.py::test_core_vs_torch_consistency_logical_xor_nvfuser_cuda_thunder::dtypes::float64
[20250902-15:56:01.227196] thunder/tests/test_ops.py::test_errors_convolution_torch_cuda_thunder::dtypes::bfloat16
[gw7] [ 0%] PASSED [20250902-15:55:58.363360] thunder/tests/test_ops.py::test_core_vs_torch_consistency_randint_nvfuser_cuda_thunder::dtypes::bfloat16
[20250902-15:56:01.263362] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ndtri_nvfuser_cuda_thunder::dtypes::bool8
[gw0] [ 0%] PASSED [20250902-15:56:01.085950] thunder/tests/test_ops.py::test_exponential
[20250902-15:56:01.485277] thunder/tests/test_ops.py::test_max_with_int
[gw6] [ 0%] PASSED [20250902-15:56:00.616433] thunder/tests/test_ops.py::test_core_vs_torch_consistency_std_torch_cuda_thunder::dtypes::float64
[20250902-15:56:01.592205] thunder/tests/test_ops.py::test_core_vs_torch_consistency_le_nvfuser_cuda_thunder::dtypes::float64
[gw0] [ 0%] PASSED [20250902-15:56:01.485277] thunder/tests/test_ops.py::test_max_with_int
[20250902-15:56:01.655309] thunder/tests/test_ops.py::test_softmax_stacklevel
[gw0] [ 0%] PASSED [20250902-15:56:01.655309] thunder/tests/test_ops.py::test_softmax_stacklevel
[20250902-15:56:01.856041] thunder/tests/test_ops.py::test_setitem[True]
[gw3] [ 0%] PASSED [20250902-15:56:00.309288] thunder/tests/test_ops.py::test_core_vs_torch_consistency_bitwise_left_shift_nvfuser_cuda_thunder::dtypes::int32
[20250902-15:56:02.405647] thunder/tests/test_ops.py::test_core_vs_torch_consistency_max_pool1d_nvfuser_cuda_thunder::dtypes::float16
[gw5] [ 0%] PASSED [20250902-15:56:00.051148] thunder/tests/test_ops.py::test_core_vs_torch_consistency_exp2_torch_cuda_thunder::dtypes::float32
[20250902-15:56:02.620582] thunder/tests/test_ops.py::test_core_vs_torch_consistency_matmul_torch_cuda_thunder::dtypes::float16
[gw0] [ 0%] PASSED [20250902-15:56:01.856041] thunder/tests/test_ops.py::test_setitem[True]
[20250902-15:56:02.831513] thunder/tests/test_ops.py::test_notimplemented_interpolate_antialias
[gw0] [ 0%] PASSED [20250902-15:56:02.831513] thunder/tests/test_ops.py::test_notimplemented_interpolate_antialias
[20250902-15:56:02.945054] thunder/tests/test_ops.py::test_core_vs_torch_consistency_tensor_torch_cuda_thunder::dtypes::bool8
[gw3] [ 0%] PASSED [20250902-15:56:02.405647] thunder/tests/test_ops.py::test_core_vs_torch_consistency_max_pool1d_nvfuser_cuda_thunder::dtypes::float16
[20250902-15:56:03.404090] thunder/tests/test_ops.py::test_errors_rand_torch_cuda_thunder::dtypes::complex64
[gw3] [ 0%] PASSED [20250902-15:56:03.404090] thunder/tests/test_ops.py::test_errors_rand_torch_cuda_thunder::dtypes::complex64
[20250902-15:56:03.778703] thunder/tests/test_ops.py::test_core_vs_torch_consistency_prelu_nvfuser_cuda_thunder::dtypes::bfloat16
[gw6] [ 0%] PASSED [20250902-15:56:01.592205] thunder/tests/test_ops.py::test_core_vs_torch_consistency_le_nvfuser_cuda_thunder::dtypes::float64
[20250902-15:56:03.826573] thunder/tests/test_ops.py::test_core_vs_torch_consistency_full_torch_cuda_thunder::dtypes::float64
[gw5] [ 0%] PASSED [20250902-15:56:02.620582] thunder/tests/test_ops.py::test_core_vs_torch_consistency_matmul_torch_cuda_thunder::dtypes::float16
[20250902-15:56:03.869446] thunder/tests/test_ops.py::test_core_vs_torch_consistency_t_torch_cuda_thunder::dtypes::uint8
[gw5] [ 0%] PASSED [20250902-15:56:03.869446] thunder/tests/test_ops.py::test_core_vs_torch_consistency_t_torch_cuda_thunder::dtypes::uint8
[20250902-15:56:04.164560] thunder/tests/test_ops.py::test_core_vs_torch_consistency_zeta_torch_cuda_thunder::dtypes::complex32
[gw5] [ 0%] SKIPPED [20250902-15:56:04.164560] thunder/tests/test_ops.py::test_core_vs_torch_consistency_zeta_torch_cuda_thunder::dtypes::complex32
[20250902-15:56:04.172012] thunder/tests/test_ops.py::test_errors_permute_torch_cuda_thunder::dtypes::uint8
[gw5] [ 0%] PASSED [20250902-15:56:04.172012] thunder/tests/test_ops.py::test_errors_permute_torch_cuda_thunder::dtypes::uint8
[20250902-15:56:04.224806] thunder/tests/test_ops.py::test_core_vs_torch_consistency_tanhshrink_torch_cuda_thunder::dtypes::complex64
[gw5] [ 0%] SKIPPED [20250902-15:56:04.224806] thunder/tests/test_ops.py::test_core_vs_torch_consistency_tanhshrink_torch_cuda_thunder::dtypes::complex64
[20250902-15:56:04.236871] thunder/tests/test_ops.py::test_core_vs_torch_consistency_lgamma_nvfuser_cuda_thunder::dtypes::complex128
[gw5] [ 0%] SKIPPED [20250902-15:56:04.236871] thunder/tests/test_ops.py::test_core_vs_torch_consistency_lgamma_nvfuser_cuda_thunder::dtypes::complex128
[20250902-15:56:04.243132] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ceil_torch_cuda_thunder::dtypes::int8
[gw6] [ 1%] PASSED [20250902-15:56:03.826573] thunder/tests/test_ops.py::test_core_vs_torch_consistency_full_torch_cuda_thunder::dtypes::float64
[20250902-15:56:04.587483] thunder/tests/test_ops.py::test_core_vs_torch_consistency_randint_torch_cuda_thunder::dtypes::float16
[gw8] [ 1%] PASSED [20250902-15:55:58.362266] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ndtri_torch_cuda_thunder::dtypes::uint8
[20250902-15:56:04.991668] thunder/tests/test_ops.py::test_core_vs_torch_consistency_frexp_torch_cuda_thunder::dtypes::bfloat16
[gw5] [ 1%] PASSED [20250902-15:56:04.243132] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ceil_torch_cuda_thunder::dtypes::int8
[20250902-15:56:05.402966] thunder/tests/test_ops.py::test_core_vs_torch_consistency_take_along_axis_torch_cuda_thunder::dtypes::complex32
[gw5] [ 1%] SKIPPED [20250902-15:56:05.402966] thunder/tests/test_ops.py::test_core_vs_torch_consistency_take_along_axis_torch_cuda_thunder::dtypes::complex32
[20250902-15:56:05.403473] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sign_torch_cuda_thunder::dtypes::complex128
[gw5] [ 1%] SKIPPED [20250902-15:56:05.403473] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sign_torch_cuda_thunder::dtypes::complex128
[20250902-15:56:05.406759] thunder/tests/test_ops.py::test_core_vs_torch_consistency_fmod_nvfuser_cuda_thunder::dtypes::complex128
[gw5] [ 1%] SKIPPED [20250902-15:56:05.406759] thunder/tests/test_ops.py::test_core_vs_torch_consistency_fmod_nvfuser_cuda_thunder::dtypes::complex128
[20250902-15:56:05.411665] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sin_torch_cuda_thunder::dtypes::int64
[gw0] [ 1%] PASSED [20250902-15:56:02.945054] thunder/tests/test_ops.py::test_core_vs_torch_consistency_tensor_torch_cuda_thunder::dtypes::bool8
[20250902-15:56:05.529284] thunder/tests/test_ops.py::test_core_vs_torch_consistency_cuda_nvfuser_cuda_thunder::dtypes::bfloat16
[gw0] [ 1%] PASSED [20250902-15:56:05.529284] thunder/tests/test_ops.py::test_core_vs_torch_consistency_cuda_nvfuser_cuda_thunder::dtypes::bfloat16
[20250902-15:56:05.711390] thunder/tests/test_ops.py::test_core_vs_torch_consistency_log1p_nvfuser_cuda_thunder::dtypes::int32
[gw8] [ 1%] PASSED [20250902-15:56:04.991668] thunder/tests/test_ops.py::test_core_vs_torch_consistency_frexp_torch_cuda_thunder::dtypes::bfloat16
[20250902-15:56:05.971199] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sigmoid_nvfuser_cuda_thunder::dtypes::complex64
[gw8] [ 1%] SKIPPED [20250902-15:56:05.971199] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sigmoid_nvfuser_cuda_thunder::dtypes::complex64
[20250902-15:56:05.977100] thunder/tests/test_ops.py::test_errors_matrix_transpose_nvfuser_cuda_thunder::dtypes::complex128
[gw8] [ 1%] PASSED [20250902-15:56:05.977100] thunder/tests/test_ops.py::test_errors_matrix_transpose_nvfuser_cuda_thunder::dtypes::complex128
[20250902-15:56:06.028006] thunder/tests/test_ops.py::test_errors_flip_torch_cuda_thunder::dtypes::complex128
[gw1] [ 1%] PASSED [20250902-15:56:00.223835] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sinh_nvfuser_cuda_thunder::dtypes::float32
[gw6] [ 1%] PASSED [20250902-15:56:04.587483] thunder/tests/test_ops.py::test_core_vs_torch_consistency_randint_torch_cuda_thunder::dtypes::float16
[gw8] [ 1%] PASSED [20250902-15:56:06.028006] thunder/tests/test_ops.py::test_errors_flip_torch_cuda_thunder::dtypes::complex128
[20250902-15:56:06.322975] thunder/tests/test_ops.py::test_core_vs_torch_consistency_triu_nvfuser_cuda_thunder::dtypes::float64
[20250902-15:56:06.326912] thunder/tests/test_ops.py::test_core_vs_torch_consistency_polygamma_nvfuser_cuda_thunder::dtypes::complex64
[gw6] [ 1%] SKIPPED [20250902-15:56:06.326912] thunder/tests/test_ops.py::test_core_vs_torch_consistency_polygamma_nvfuser_cuda_thunder::dtypes::complex64
[20250902-15:56:06.333388] thunder/tests/test_ops.py::test_core_vs_torch_consistency_flip_torch_cuda_thunder::dtypes::int8
[20250902-15:56:06.345496] thunder/tests/test_ops.py::test_core_vs_torch_consistency_rsqrt_nvfuser_cuda_thunder::dtypes::bfloat16
[gw4] [ 1%] PASSED [20250902-15:56:00.689553] thunder/tests/test_ops.py::test_core_vs_torch_consistency_scatter_nvfuser_cuda_thunder::dtypes::int32
[20250902-15:56:06.419753] thunder/tests/test_ops.py::test_errors_all_tensor_torch_cuda_thunder::dtypes::float16
[gw4] [ 1%] PASSED [20250902-15:56:06.419753] thunder/tests/test_ops.py::test_errors_all_tensor_torch_cuda_thunder::dtypes::float16
[20250902-15:56:06.467137] thunder/tests/test_ops.py::test_core_vs_torch_consistency_div_torch_cuda_thunder::dtypes::int8
[gw5] [ 1%] PASSED [20250902-15:56:05.411665] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sin_torch_cuda_thunder::dtypes::int64
[20250902-15:56:06.798450] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ldexp_torch_cuda_thunder::dtypes::int8
[gw5] [ 1%] PASSED [20250902-15:56:06.798450] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ldexp_torch_cuda_thunder::dtypes::int8
[20250902-15:56:06.946645] thunder/tests/test_ops.py::test_core_vs_torch_consistency_layer_norm_nvfuser_cuda_thunder::dtypes::bfloat16
[gw3] [ 1%] PASSED [20250902-15:56:03.778703] thunder/tests/test_ops.py::test_core_vs_torch_consistency_prelu_nvfuser_cuda_thunder::dtypes::bfloat16
[20250902-15:56:07.887476] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ldexp_torch_cuda_thunder::dtypes::complex64
[gw3] [ 1%] SKIPPED [20250902-15:56:07.887476] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ldexp_torch_cuda_thunder::dtypes::complex64
[20250902-15:56:07.892528] thunder/tests/test_ops.py::test_core_vs_torch_consistency_argmax_torch_cuda_thunder::dtypes::int16
[gw2] [ 1%] PASSED [20250902-15:56:01.227196] thunder/tests/test_ops.py::test_errors_convolution_torch_cuda_thunder::dtypes::bfloat16
[20250902-15:56:09.499916] thunder/tests/test_ops.py::test_core_vs_torch_consistency_mul_torch_cuda_thunder::dtypes::bool8
[gw8] [ 1%] PASSED [20250902-15:56:06.322975] thunder/tests/test_ops.py::test_core_vs_torch_consistency_triu_nvfuser_cuda_thunder::dtypes::float64
[20250902-15:56:09.868611] thunder/tests/test_ops.py::test_core_vs_torch_consistency_linear_nvfuser_cuda_thunder::dtypes::float16
[gw2] [ 1%] PASSED [20250902-15:56:09.499916] thunder/tests/test_ops.py::test_core_vs_torch_consistency_mul_torch_cuda_thunder::dtypes::bool8
[20250902-15:56:09.952153] thunder/tests/test_ops.py::test_core_vs_torch_consistency_view_torch_cuda_thunder::dtypes::complex32
[gw2] [ 1%] SKIPPED [20250902-15:56:09.952153] thunder/tests/test_ops.py::test_core_vs_torch_consistency_view_torch_cuda_thunder::dtypes::complex32
[20250902-15:56:09.952755] thunder/tests/test_ops.py::test_errors_ldexp_torch_cuda_thunder::dtypes::float16
[gw2] [ 1%] PASSED [20250902-15:56:09.952755] thunder/tests/test_ops.py::test_errors_ldexp_torch_cuda_thunder::dtypes::float16
[20250902-15:56:10.008752] thunder/tests/test_ops.py::test_core_vs_torch_consistency_cat_wrapper_torch_cuda_thunder::dtypes::float64
[gw3] [ 1%] PASSED [20250902-15:56:07.892528] thunder/tests/test_ops.py::test_core_vs_torch_consistency_argmax_torch_cuda_thunder::dtypes::int16
[20250902-15:56:10.080707] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sqrt_torch_cuda_thunder::dtypes::uint8
[gw5] [ 1%] PASSED [20250902-15:56:06.946645] thunder/tests/test_ops.py::test_core_vs_torch_consistency_layer_norm_nvfuser_cuda_thunder::dtypes::bfloat16
[gw4] [ 1%] PASSED [20250902-15:56:06.467137] thunder/tests/test_ops.py::test_core_vs_torch_consistency_div_torch_cuda_thunder::dtypes::int8
[20250902-15:56:10.382061] thunder/tests/test_ops.py::test_errors_broadcast_in_dim_torch_cuda_thunder::dtypes::bfloat16
[20250902-15:56:10.416592] thunder/tests/test_ops.py::test_core_vs_torch_consistency_signbit_torch_cuda_thunder::dtypes::float16
[gw8] [ 1%] PASSED [20250902-15:56:09.868611] thunder/tests/test_ops.py::test_core_vs_torch_consistency_linear_nvfuser_cuda_thunder::dtypes::float16
[20250902-15:56:10.612618] thunder/tests/test_ops.py::test_core_vs_torch_consistency_rsqrt_torch_cuda_thunder::dtypes::bfloat16
[gw5] [ 1%] XPASS [20250902-15:56:10.382061] thunder/tests/test_ops.py::test_errors_broadcast_in_dim_torch_cuda_thunder::dtypes::bfloat16
[20250902-15:56:10.765037] thunder/tests/test_ops.py::test_core_vs_torch_consistency_zeta_nvfuser_cuda_thunder::dtypes::float16
[gw2] [ 1%] PASSED [20250902-15:56:10.008752] thunder/tests/test_ops.py::test_core_vs_torch_consistency_cat_wrapper_torch_cuda_thunder::dtypes::float64
[20250902-15:56:11.523300] thunder/tests/test_ops.py::test_core_vs_torch_consistency_repeat_interleave_torch_cuda_thunder::dtypes::int8
[gw3] [ 1%] PASSED [20250902-15:56:10.080707] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sqrt_torch_cuda_thunder::dtypes::uint8
[20250902-15:56:11.688186] thunder/tests/test_ops.py::test_errors_cat_wrapper_nvfuser_cuda_thunder::dtypes::int32
[gw4] [ 1%] PASSED [20250902-15:56:10.416592] thunder/tests/test_ops.py::test_core_vs_torch_consistency_signbit_torch_cuda_thunder::dtypes::float16
[20250902-15:56:11.770149] thunder/tests/test_ops.py::test_core_vs_torch_consistency_elu_torch_cuda_thunder::dtypes::float32
[gw0] [ 1%] PASSED [20250902-15:56:05.711390] thunder/tests/test_ops.py::test_core_vs_torch_consistency_log1p_nvfuser_cuda_thunder::dtypes::int32
[20250902-15:56:11.874250] thunder/tests/test_ops.py::test_core_vs_torch_consistency_triu_torch_cuda_thunder::dtypes::bfloat16
[gw2] [ 1%] PASSED [20250902-15:56:11.523300] thunder/tests/test_ops.py::test_core_vs_torch_consistency_repeat_interleave_torch_cuda_thunder::dtypes::int8
[20250902-15:56:11.963638] thunder/tests/test_ops.py::test_core_vs_torch_consistency_zeta_torch_cuda_thunder::dtypes::float64
[gw8] [ 1%] PASSED [20250902-15:56:10.612618] thunder/tests/test_ops.py::test_core_vs_torch_consistency_rsqrt_torch_cuda_thunder::dtypes::bfloat16
[20250902-15:56:12.064706] thunder/tests/test_ops.py::test_core_vs_torch_consistency_atanh_torch_cuda_thunder::dtypes::float32
[gw7] [ 1%] PASSED [20250902-15:56:01.263362] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ndtri_nvfuser_cuda_thunder::dtypes::bool8
[20250902-15:56:12.111176] thunder/tests/test_ops.py::test_errors_broadcast_in_dim_torch_cuda_thunder::dtypes::complex32
[gw0] [ 1%] PASSED [20250902-15:56:11.874250] thunder/tests/test_ops.py::test_core_vs_torch_consistency_triu_torch_cuda_thunder::dtypes::bfloat16
[gw3] [ 1%] PASSED [20250902-15:56:11.688186] thunder/tests/test_ops.py::test_errors_cat_wrapper_nvfuser_cuda_thunder::dtypes::int32
[20250902-15:56:12.384315] thunder/tests/test_ops.py::test_core_vs_torch_consistency_real_torch_cuda_thunder::dtypes::float64
[20250902-15:56:12.385935] thunder/tests/test_ops.py::test_core_vs_torch_consistency_torch_empty_like_and_zero_torch_cuda_thunder::dtypes::complex32
[gw3] [ 1%] SKIPPED [20250902-15:56:12.385935] thunder/tests/test_ops.py::test_core_vs_torch_consistency_torch_empty_like_and_zero_torch_cuda_thunder::dtypes::complex32
[20250902-15:56:12.393813] thunder/tests/test_ops.py::test_core_vs_torch_consistency_scaled_dot_product_attention_torch_cuda_thunder::dtypes::float32
[gw7] [ 1%] XPASS [20250902-15:56:12.111176] thunder/tests/test_ops.py::test_errors_broadcast_in_dim_torch_cuda_thunder::dtypes::complex32
[20250902-15:56:12.455183] thunder/tests/test_ops.py::test_core_vs_torch_consistency_square_nvfuser_cuda_thunder::dtypes::bfloat16
[gw1] [ 1%] PASSED [20250902-15:56:06.345496] thunder/tests/test_ops.py::test_core_vs_torch_consistency_rsqrt_nvfuser_cuda_thunder::dtypes::bfloat16
[20250902-15:56:12.563457] thunder/tests/test_ops.py::test_core_vs_torch_consistency_atan2_nvfuser_cuda_thunder::dtypes::float16
[gw8] [ 1%] PASSED [20250902-15:56:12.064706] thunder/tests/test_ops.py::test_core_vs_torch_consistency_atanh_torch_cuda_thunder::dtypes::float32
[20250902-15:56:13.405679] thunder/tests/test_ops.py::test_core_vs_torch_consistency_tensor_split_nvfuser_cuda_thunder::dtypes::bfloat16
[gw0] [ 1%] PASSED [20250902-15:56:12.384315] thunder/tests/test_ops.py::test_core_vs_torch_consistency_real_torch_cuda_thunder::dtypes::float64
[20250902-15:56:14.003930] thunder/tests/test_ops.py::test_core_vs_torch_consistency_addcdiv_torch_cuda_thunder::dtypes::bool8
[gw0] [ 1%] XFAIL [20250902-15:56:14.003930] thunder/tests/test_ops.py::test_core_vs_torch_consistency_addcdiv_torch_cuda_thunder::dtypes::bool8
[20250902-15:56:14.201087] thunder/tests/test_ops.py::test_errors_t_torch_cuda_thunder::dtypes::complex64
[gw0] [ 1%] PASSED [20250902-15:56:14.201087] thunder/tests/test_ops.py::test_errors_t_torch_cuda_thunder::dtypes::complex64
[20250902-15:56:14.341727] thunder/tests/test_ops.py::test_core_vs_torch_consistency_fmod_torch_cuda_thunder::dtypes::complex32
[gw0] [ 1%] SKIPPED [20250902-15:56:14.341727] thunder/tests/test_ops.py::test_core_vs_torch_consistency_fmod_torch_cuda_thunder::dtypes::complex32
…(truncated)
Loading