Skip to content

ThunderFX: Modify GraphModule in-place - #2399

Merged
shino16 merged 8 commits into
Lightning-AI:mainfrom
shino16:do-not-return-deepcopy-of-GraphModule
Aug 28, 2025
Merged

shino16 merged 8 commits into
Lightning-AI:mainfrom
shino16:do-not-return-deepcopy-of-GraphModule

Merge branch 'main' into do-not-return-deepcopy-of-GraphModule

6555495
Select commit
Loading
Failed to load commit list.
Lit OSS [bot] / tests.yaml / Lit Job (pytorchlightning/lightning-thunder:ubuntu24.04-cuda12.6.3-cudnn-fe1.10.0-py3.10-pt_main-dev, ops, L4) failed Aug 28, 2025 in 40m 31s

Job finished

Job 'ci-run_Lightning-AI-lightning-thunder-6555495-event-564c6b30-tests.yaml_/Lit_Job(pytorchlightning/lightning-thunder:ubuntu24.04-cuda12.6.3-cudnn-fe1.10.0-py3.10-pt_main-dev,_ops,_L4)' finished as Completed with exit code 1.

Details

nvidia:
Thu Aug 28 13:17:06 2025
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 550.163.01             Driver Version: 550.163.01     CUDA Version: 12.6     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA L4                      Off |   00000000:00:04.0 Off |                    0 |
| N/A   46C    P8             13W /   72W |       1MiB /  23034MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI        PID   Type   Process name                              GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|  No running processes found                                                             |
+-----------------------------------------------------------------------------------------+
Python 3.10.18
pip 25.2 from /usr/local/lib/python3.10/dist-packages/pip (python 3.10)
Package               Version
--------------------- ------------------
absl-py               2.3.1
accelerate            1.10.1
aiohappyeyeballs      2.6.1
aiohttp               3.12.15
aiosignal             1.4.0
apex                  0.1
asv                   0.6.4
asv_runner            0.2.1
asvdb                 0.4.2
async-timeout         5.0.1
attrs                 25.3.0
bitsandbytes          0.46.1
blinker               1.7.0
boto3                 1.40.18
botocore              1.40.18
build                 1.3.0
certifi               2025.8.3
charset-normalizer    3.4.3
cmake                 3.31.6
coverage              7.9.2
cryptography          41.0.7
dbus-python           1.3.2
diffusers             0.34.0
distlib               0.4.0
distro                1.9.0
docstring_parser      0.17.0
einops                0.8.1
exceptiongroup        1.3.0
execnet               2.1.1
expecttest            0.3.0
fdm                   0.5.0
filelock              3.19.1
frozenlist            1.7.0
fsspec                2025.7.0
graphviz              0.21
hf-xet                1.1.8
httplib2              0.20.4
huggingface-hub       0.34.4
hypothesis            6.136.9
idna                  3.10
importlib_metadata    8.7.0
importlib_resources   6.5.2
iniconfig             2.1.0
Jinja2                3.1.6
jmespath              1.0.1
json5                 0.12.1
jsonargparse          4.32.1
launchpadlib          1.11.0
lazr.restfulclient    0.14.6
lazr.uri              1.0.6
lightning             2.4.0
lightning-utilities   0.15.2
lintrunner            0.12.7
litgpt                0.5.0
MarkupSafe            3.0.2
mpmath                1.3.0
multidict             6.6.4
networkx              3.4.2
ninja                 1.13.0
numpy                 1.26.4
nvfuser               0.2.30+git6d4256e
nvidia-cudnn-frontend 1.10.0
oauthlib              3.2.2
optree                0.17.0
packaging             24.2
pandas                2.3.2
pillow                11.3.0
pip                   25.2
platformdirs          4.4.0
pluggy                1.6.0
propcache             0.3.2
psutil                7.0.0
py-cpuinfo            9.0.0
pybind11              3.0.1
pybind11-global       3.0.1
PyGObject             3.48.2
PyJWT                 2.7.0
Pympler               1.1
pyparsing             3.1.1
pyproject_hooks       1.2.0
pytest                8.3.5
pytest-benchmark      5.1.0
pytest-cov            6.2.1
pytest-random-order   1.2.0
pytest-timeout        2.4.0
pytest-timestamper    0.0.10
pytest-xdist          3.7.0
python-apt            2.7.7+ubuntu5
python-dateutil       2.9.0.post0
pytorch-lightning     2.5.3
pytorch-triton        3.4.0+gitf7888497
pytz                  2025.2
PyYAML                6.0.2
regex                 2025.7.34
requests              2.32.5
s3transfer            0.13.1
safetensors           0.6.2
setuptools            79.0.1
six                   1.16.0
sortedcontainers      2.4.0
sympy                 1.14.0
tabulate              0.9.0
tokenizers            0.21.4
tomli                 2.2.1
torch                 2.9.0a0+git3d40642
torchmetrics          1.8.1
tqdm                  4.67.1
transformers          4.52.4
typeshed_client       2.8.2
typing_extensions     4.15.0
tzdata                2025.2
urllib3               2.5.0
uv                    0.8.13
virtualenv            20.34.0
wadllib               1.3.6
wheel                 0.45.1
xlsxwriter            3.2.5
yarl                  1.20.1
zipp                  3.23.0
+ bash scripts/remove-torch-lines.sh requirements/base.txt
+ cat requirements/base.txt
looseversion ==1.3.0
lightning-utilities >0.7.0
numpy
networkx >=3.3
optree >=0.12.1
opt_einsum >=3.3.0
# todo: teporarl pin for `NameError: name '_C' is not defined`
mpmath <1.4.0
# Support for 3.12
dill >=0.3.8
+ pip install -U -r requirements/base.txt -r requirements/test.txt
Ignoring bitsandbytes: markers '"arm" in platform_machine or "aarch" in platform_machine' don't match your environment
Collecting asvdb@ git+https://github.com/rapidsai/asvdb.git (from -r requirements/test.txt (line 26))
  Cloning https://github.com/rapidsai/asvdb.git to /tmp/pip-install-7b576psv/asvdb_3d171dd8dd4e42dbae433f8e38029ce8
  Running command git clone --filter=blob:none --quiet https://github.com/rapidsai/asvdb.git /tmp/pip-install-7b576psv/asvdb_3d171dd8dd4e42dbae433f8e38029ce8
  Resolved https://github.com/rapidsai/asvdb.git to commit fd1616a47f9b37bdce4c9c61a5bdd9310daccb72
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting looseversion==1.3.0 (from -r requirements/base.txt (line 1))
  Downloading looseversion-1.3.0-py2.py3-none-any.whl.metadata (4.6 kB)
Requirement already satisfied: lightning-utilities>0.7.0 in /usr/local/lib/python3.10/dist-packages (from -r requirements/base.txt (line 2)) (0.15.2)
Requirement already satisfied: numpy in /usr/local/lib/python3.10/dist-packages (from -r requirements/base.txt (line 3)) (1.26.4)
Collecting numpy (from -r requirements/base.txt (line 3))
  Using cached numpy-2.2.6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (62 kB)
Requirement already satisfied: networkx>=3.3 in /usr/local/lib/python3.10/dist-packages (from -r requirements/base.txt (line 4)) (3.4.2)
Requirement already satisfied: optree>=0.12.1 in /usr/local/lib/python3.10/dist-packages (from -r requirements/base.txt (line 5)) (0.17.0)
Collecting opt_einsum>=3.3.0 (from -r requirements/base.txt (line 6))
  Downloading opt_einsum-3.4.0-py3-none-any.whl.metadata (6.3 kB)
Requirement already satisfied: mpmath<1.4.0 in /usr/local/lib/python3.10/dist-packages (from -r requirements/base.txt (line 8)) (1.3.0)
Collecting dill>=0.3.8 (from -r requirements/base.txt (line 10))
  Downloading dill-0.4.0-py3-none-any.whl.metadata (10 kB)
Requirement already satisfied: coverage~=7.9.1 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 1)) (7.9.2)
Requirement already satisfied: pytest==8.3.5 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 2)) (8.3.5)
Requirement already satisfied: pytest-benchmark==5.1.0 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 3)) (5.1.0)
Requirement already satisfied: pytest-timeout==2.4.0 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 4)) (2.4.0)
Requirement already satisfied: pytest-cov==6.2.1 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 5)) (6.2.1)
Requirement already satisfied: pytest-xdist==3.7.0 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 6)) (3.7.0)
Requirement already satisfied: pytest-random-order==1.2.0 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 7)) (1.2.0)
Requirement already satisfied: pytest-timestamper==0.0.10 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 8)) (0.0.10)
Requirement already satisfied: graphviz==0.21 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 9)) (0.21)
Requirement already satisfied: fdm==0.5.0 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 10)) (0.5.0)
Requirement already satisfied: expecttest==0.3.0 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 11)) (0.3.0)
Requirement already satisfied: hypothesis~=6.136.6 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 12)) (6.136.9)
Requirement already satisfied: einops in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 14)) (0.8.1)
Requirement already satisfied: litgpt==0.5.0 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 15)) (0.5.0)
Requirement already satisfied: absl-py in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 16)) (2.3.1)
Requirement already satisfied: pandas in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 17)) (2.3.2)
Requirement already satisfied: xlsxwriter in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 18)) (3.2.5)
Requirement already satisfied: jsonargparse in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 19)) (4.32.1)
Collecting jsonargparse (from -r requirements/test.txt (line 19))
  Using cached jsonargparse-4.40.2-py3-none-any.whl.metadata (13 kB)
Requirement already satisfied: bitsandbytes==0.46.1 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 20)) (0.46.1)
Requirement already satisfied: transformers==4.52.4 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 22)) (4.52.4)
Requirement already satisfied: diffusers==0.34.0 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 23)) (0.34.0)
Requirement already satisfied: accelerate in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 24)) (1.10.1)
Requirement already satisfied: asv>=0.6.4 in /usr/local/lib/python3.10/dist-packages (from -r requirements/test.txt (line 27)) (0.6.4)
Requirement already satisfied: botocore in /usr/local/lib/python3.10/dist-packages (from asvdb@ git+https://github.com/rapidsai/asvdb.git->-r requirements/test.txt (line 26)) (1.40.18)
Requirement already satisfied: boto3 in /usr/local/lib/python3.10/dist-packages (from asvdb@ git+https://github.com/rapidsai/asvdb.git->-r requirements/test.txt (line 26)) (1.40.18)
Requirement already satisfied: exceptiongroup>=1.0.0rc8 in /usr/local/lib/python3.10/dist-packages (from pytest==8.3.5->-r requirements/test.txt (line 2)) (1.3.0)
Requirement already satisfied: iniconfig in /usr/local/lib/python3.10/dist-packages (from pytest==8.3.5->-r requirements/test.txt (line 2)) (2.1.0)
Requirement already satisfied: packaging in /usr/local/lib/python3.10/dist-packages (from pytest==8.3.5->-r requirements/test.txt (line 2)) (24.2)
Requirement already satisfied: pluggy<2,>=1.5 in /usr/local/lib/python3.10/dist-packages (from pytest==8.3.5->-r requirements/test.txt (line 2)) (1.6.0)
Requirement already satisfied: tomli>=1 in /usr/local/lib/python3.10/dist-packages (from pytest==8.3.5->-r requirements/test.txt (line 2)) (2.2.1)
Requirement already satisfied: py-cpuinfo in /usr/local/lib/python3.10/dist-packages (from pytest-benchmark==5.1.0->-r requirements/test.txt (line 3)) (9.0.0)
Requirement already satisfied: execnet>=2.1 in /usr/local/lib/python3.10/dist-packages (from pytest-xdist==3.7.0->-r requirements/test.txt (line 6)) (2.1.1)
Requirement already satisfied: sympy in /usr/local/lib/python3.10/dist-packages (from fdm==0.5.0->-r requirements/test.txt (line 10)) (1.14.0)
Requirement already satisfied: torch>=2.2.0 in /usr/local/lib/python3.10/dist-packages (from litgpt==0.5.0->-r requirements/test.txt (line 15)) (2.9.0a0+git3d40642)
Requirement already satisfied: lightning==2.4.0 in /usr/local/lib/python3.10/dist-packages (from litgpt==0.5.0->-r requirements/test.txt (line 15)) (2.4.0)
Requirement already satisfied: huggingface-hub>=0.23.5 in /usr/local/lib/python3.10/dist-packages (from litgpt==0.5.0->-r requirements/test.txt (line 15)) (0.34.4)
Requirement already satisfied: safetensors>=0.4.3 in /usr/local/lib/python3.10/dist-packages (from litgpt==0.5.0->-r requirements/test.txt (line 15)) (0.6.2)
Requirement already satisfied: tokenizers>=0.15.2 in /usr/local/lib/python3.10/dist-packages (from litgpt==0.5.0->-r requirements/test.txt (line 15)) (0.21.4)
Requirement already satisfied: tqdm>=4.66.0 in /usr/local/lib/python3.10/dist-packages (from litgpt==0.5.0->-r requirements/test.txt (line 15)) (4.67.1)
Requirement already satisfied: filelock in /usr/local/lib/python3.10/dist-packages (from transformers==4.52.4->-r requirements/test.txt (line 22)) (3.19.1)
Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.10/dist-packages (from transformers==4.52.4->-r requirements/test.txt (line 22)) (6.0.2)
Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.10/dist-packages (from transformers==4.52.4->-r requirements/test.txt (line 22)) (2025.7.34)
Requirement already satisfied: requests in /usr/local/lib/python3.10/dist-packages (from transformers==4.52.4->-r requirements/test.txt (line 22)) (2.32.5)
Requirement already satisfied: importlib_metadata in /usr/local/lib/python3.10/dist-packages (from diffusers==0.34.0->-r requirements/test.txt (line 23)) (8.7.0)
Requirement already satisfied: Pillow in /usr/local/lib/python3.10/dist-packages (from diffusers==0.34.0->-r requirements/test.txt (line 23)) (11.3.0)
Requirement already satisfied: fsspec<2026.0,>=2022.5.0 in /usr/local/lib/python3.10/dist-packages (from fsspec[http]<2026.0,>=2022.5.0->lightning==2.4.0->litgpt==0.5.0->-r requirements/test.txt (line
↪ 15)) (2025.7.0)
Requirement already satisfied: torchmetrics<3.0,>=0.7.0 in /usr/local/lib/python3.10/dist-packages (from lightning==2.4.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (1.8.1)
Requirement already satisfied: typing-extensions<6.0,>=4.4.0 in /usr/local/lib/python3.10/dist-packages (from lightning==2.4.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (4.15.0)
Requirement already satisfied: pytorch-lightning in /usr/local/lib/python3.10/dist-packages (from lightning==2.4.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (2.5.3)
Requirement already satisfied: setuptools in /usr/local/lib/python3.10/dist-packages (from lightning-utilities>0.7.0->-r requirements/base.txt (line 2)) (79.0.1)
Requirement already satisfied: attrs>=22.2.0 in /usr/local/lib/python3.10/dist-packages (from hypothesis~=6.136.6->-r requirements/test.txt (line 12)) (25.3.0)
Requirement already satisfied: sortedcontainers<3.0.0,>=2.1.0 in /usr/local/lib/python3.10/dist-packages (from hypothesis~=6.136.6->-r requirements/test.txt (line 12)) (2.4.0)
Requirement already satisfied: aiohttp!=4.0.0a0,!=4.0.0a1 in /usr/local/lib/python3.10/dist-packages (from fsspec[http]<2026.0,>=2022.5.0->lightning==2.4.0->litgpt==0.5.0->-r requirements/test.txt
↪ (line 15)) (3.12.15)
Requirement already satisfied: hf-xet<2.0.0,>=1.1.3 in /usr/local/lib/python3.10/dist-packages (from huggingface-hub>=0.23.5->litgpt==0.5.0->-r requirements/test.txt (line 15)) (1.1.8)
Requirement already satisfied: docstring-parser>=0.15 in /usr/local/lib/python3.10/dist-packages (from jsonargparse[signatures]<=4.32.1,>=4.30.1->litgpt==0.5.0->-r requirements/test.txt (line 15))
↪ (0.17.0)
Requirement already satisfied: typeshed-client>=2.1.0 in /usr/local/lib/python3.10/dist-packages (from jsonargparse[signatures]<=4.32.1,>=4.30.1->litgpt==0.5.0->-r requirements/test.txt (line 15))
↪ (2.8.2)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.10/dist-packages (from torch>=2.2.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (3.1.6)
Requirement already satisfied: python-dateutil>=2.8.2 in /usr/local/lib/python3.10/dist-packages (from pandas->-r requirements/test.txt (line 17)) (2.9.0.post0)
Requirement already satisfied: pytz>=2020.1 in /usr/local/lib/python3.10/dist-packages (from pandas->-r requirements/test.txt (line 17)) (2025.2)
Requirement already satisfied: tzdata>=2022.7 in /usr/local/lib/python3.10/dist-packages (from pandas->-r requirements/test.txt (line 17)) (2025.2)
Requirement already satisfied: psutil in /usr/local/lib/python3.10/dist-packages (from accelerate->-r requirements/test.txt (line 24)) (7.0.0)
Requirement already satisfied: asv-runner>=v0.2.1 in /usr/local/lib/python3.10/dist-packages (from asv>=0.6.4->-r requirements/test.txt (line 27)) (0.2.1)
Requirement already satisfied: json5 in /usr/local/lib/python3.10/dist-packages (from asv>=0.6.4->-r requirements/test.txt (line 27)) (0.12.1)
Requirement already satisfied: build in /usr/local/lib/python3.10/dist-packages (from asv>=0.6.4->-r requirements/test.txt (line 27)) (1.3.0)
Requirement already satisfied: tabulate in /usr/local/lib/python3.10/dist-packages (from asv>=0.6.4->-r requirements/test.txt (line 27)) (0.9.0)
Requirement already satisfied: virtualenv in /usr/local/lib/python3.10/dist-packages (from asv>=0.6.4->-r requirements/test.txt (line 27)) (20.34.0)
Requirement already satisfied: pympler in /usr/local/lib/python3.10/dist-packages (from asv>=0.6.4->-r requirements/test.txt (line 27)) (1.1)
Requirement already satisfied: aiohappyeyeballs>=2.5.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<2026.0,>=2022.5.0->lightning==2.4.0->litgpt==0.5.0->-r
↪ requirements/test.txt (line 15)) (2.6.1)
Requirement already satisfied: aiosignal>=1.4.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<2026.0,>=2022.5.0->lightning==2.4.0->litgpt==0.5.0->-r
↪ requirements/test.txt (line 15)) (1.4.0)
Requirement already satisfied: async-timeout<6.0,>=4.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<2026.0,>=2022.5.0->lightning==2.4.0->litgpt==0.5.0->-r
↪ requirements/test.txt (line 15)) (5.0.1)
Requirement already satisfied: frozenlist>=1.1.1 in /usr/local/lib/python3.10/dist-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<2026.0,>=2022.5.0->lightning==2.4.0->litgpt==0.5.0->-r
↪ requirements/test.txt (line 15)) (1.7.0)
Requirement already satisfied: multidict<7.0,>=4.5 in /usr/local/lib/python3.10/dist-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<2026.0,>=2022.5.0->lightning==2.4.0->litgpt==0.5.0->-r
↪ requirements/test.txt (line 15)) (6.6.4)
Requirement already satisfied: propcache>=0.2.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<2026.0,>=2022.5.0->lightning==2.4.0->litgpt==0.5.0->-r
↪ requirements/test.txt (line 15)) (0.3.2)
Requirement already satisfied: yarl<2.0,>=1.17.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<2026.0,>=2022.5.0->lightning==2.4.0->litgpt==0.5.0->-r
↪ requirements/test.txt (line 15)) (1.20.1)
Requirement already satisfied: idna>=2.0 in /usr/local/lib/python3.10/dist-packages (from
↪ yarl<2.0,>=1.17.0->aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<2026.0,>=2022.5.0->lightning==2.4.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (3.10)
Requirement already satisfied: six>=1.5 in /usr/lib/python3/dist-packages (from python-dateutil>=2.8.2->pandas->-r requirements/test.txt (line 17)) (1.16.0)
Requirement already satisfied: importlib_resources>=1.4.0 in /usr/local/lib/python3.10/dist-packages (from typeshed-client>=2.1.0->jsonargparse[signatures]<=4.32.1,>=4.30.1->litgpt==0.5.0->-r
↪ requirements/test.txt (line 15)) (6.5.2)
Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /usr/local/lib/python3.10/dist-packages (from boto3->asvdb@ git+https://github.com/rapidsai/asvdb.git->-r requirements/test.txt (line 26))
↪ (1.0.1)
Requirement already satisfied: s3transfer<0.14.0,>=0.13.0 in /usr/local/lib/python3.10/dist-packages (from boto3->asvdb@ git+https://github.com/rapidsai/asvdb.git->-r requirements/test.txt (line 26))
↪ (0.13.1)
Requirement already satisfied: urllib3!=2.2.0,<3,>=1.25.4 in /usr/local/lib/python3.10/dist-packages (from botocore->asvdb@ git+https://github.com/rapidsai/asvdb.git->-r requirements/test.txt (line
↪ 26)) (2.5.0)
Requirement already satisfied: pyproject_hooks in /usr/local/lib/python3.10/dist-packages (from build->asv>=0.6.4->-r requirements/test.txt (line 27)) (1.2.0)
Requirement already satisfied: zipp>=3.20 in /usr/local/lib/python3.10/dist-packages (from importlib_metadata->diffusers==0.34.0->-r requirements/test.txt (line 23)) (3.23.0)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.10/dist-packages (from jinja2->torch>=2.2.0->litgpt==0.5.0->-r requirements/test.txt (line 15)) (3.0.2)
Requirement already satisfied: charset_normalizer<4,>=2 in /usr/local/lib/python3.10/dist-packages (from requests->transformers==4.52.4->-r requirements/test.txt (line 22)) (3.4.3)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests->transformers==4.52.4->-r requirements/test.txt (line 22)) (2025.8.3)
Requirement already satisfied: distlib<1,>=0.3.7 in /usr/local/lib/python3.10/dist-packages (from virtualenv->asv>=0.6.4->-r requirements/test.txt (line 27)) (0.4.0)
Requirement already satisfied: platformdirs<5,>=3.9.1 in /usr/local/lib/python3.10/dist-packages (from virtualenv->asv>=0.6.4->-r requirements/test.txt (line 27)) (4.4.0)
Downloading looseversion-1.3.0-py2.py3-none-any.whl (8.2 kB)
Downloading opt_einsum-3.4.0-py3-none-any.whl (71 kB)
Downloading dill-0.4.0-py3-none-any.whl (119 kB)
Installing collected packages: looseversion, opt_einsum, dill

Successfully installed dill-0.4.0 looseversion-1.3.0 opt_einsum-3.4.0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a
↪ virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
+ curl -Os https://uploader.codecov.io/latest/linux/codecov
+ chmod +x codecov
+ python setup.py develop
running develop
/usr/local/lib/python3.10/dist-packages/setuptools/command/develop.py:41: EasyInstallDeprecationWarning: easy_install command is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` and ``easy_install``.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://github.com/pypa/setuptools/issues/917 for details.
        ********************************************************************************

!!
  easy_install.initialize_options(self)
/usr/local/lib/python3.10/dist-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` directly.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
        ********************************************************************************

!!
  self.initialize_options()
running egg_info
creating lightning_thunder.egg-info
writing lightning_thunder.egg-info/PKG-INFO
writing dependency_links to lightning_thunder.egg-info/dependency_links.txt
writing requirements to lightning_thunder.egg-info/requires.txt
writing top-level names to lightning_thunder.egg-info/top_level.txt
writing manifest file 'lightning_thunder.egg-info/SOURCES.txt'
reading manifest file 'lightning_thunder.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no previously-included files matching '*.py[cod]' found under directory '__pycache__'
warning: no previously-included files matching '*.orig' found under directory '__pycache__'
warning: no files found matching '*.md' under directory 'pl_sandbox'
warning: no previously-included files found matching '*.svg'
warning: no previously-included files found matching '*.yml'
warning: no previously-included files found matching '*.yaml'
warning: no previously-included files matching '*' found under directory 'site'
warning: no previously-included files found matching 'thunder/tests'
warning: no previously-included files matching '*' found under directory 'docs'
warning: no previously-included files found matching 'docs'
warning: no previously-included files found matching 'Makefile'
no previously-included directories found matching '.git'
no previously-included directories found matching '.github'
no previously-included directories found matching 'notebook*'
no previously-included directories found matching 'temp*'
no previously-included directories found matching 'test*'
no previously-included directories found matching 'benchmark*'
no previously-included directories found matching 'examples*'
adding license file 'LICENSE'
writing manifest file 'lightning_thunder.egg-info/SOURCES.txt'
running build_ext
Creating /usr/local/lib/python3.10/dist-packages/lightning-thunder.egg-link (link to .)
Adding lightning-thunder 0.2.5.dev0 to easy-install.pth file

Installed /workspace
Processing dependencies for lightning-thunder==0.2.5.dev0
Searching for dill==0.4.0
Best match: dill 0.4.0
Adding dill 0.4.0 to easy-install.pth file

Using /usr/local/lib/python3.10/dist-packages
Searching for mpmath==1.3.0
Best match: mpmath 1.3.0
Adding mpmath 1.3.0 to easy-install.pth file

Using /usr/local/lib/python3.10/dist-packages
Searching for opt-einsum==3.4.0
Best match: opt-einsum 3.4.0
Adding opt-einsum 3.4.0 to easy-install.pth file

Using /usr/local/lib/python3.10/dist-packages
Searching for optree==0.17.0
Best match: optree 0.17.0
Adding optree 0.17.0 to easy-install.pth file

Using /usr/local/lib/python3.10/dist-packages
Searching for networkx==3.4.2
Best match: networkx 3.4.2
Adding networkx 3.4.2 to easy-install.pth file

Using /usr/local/lib/python3.10/dist-packages
Searching for numpy==1.26.4
Best match: numpy 1.26.4
Adding numpy 1.26.4 to easy-install.pth file
Installing f2py script to /usr/local/bin

Using /usr/local/lib/python3.10/dist-packages
Searching for lightning-utilities==0.15.2
Best match: lightning-utilities 0.15.2
Adding lightning-utilities 0.15.2 to easy-install.pth file

Using /usr/local/lib/python3.10/dist-packages
Searching for looseversion==1.3.0
Best match: looseversion 1.3.0
Adding looseversion 1.3.0 to easy-install.pth file

Using /usr/local/lib/python3.10/dist-packages
Searching for typing-extensions==4.15.0
Best match: typing-extensions 4.15.0
Adding typing-extensions 4.15.0 to easy-install.pth file

Using /usr/local/lib/python3.10/dist-packages
Searching for setuptools==79.0.1
Best match: setuptools 79.0.1
Adding setuptools 79.0.1 to easy-install.pth file

Using /usr/local/lib/python3.10/dist-packages
Searching for packaging==24.2
Best match: packaging 24.2
Adding packaging 24.2 to easy-install.pth file

Using /usr/local/lib/python3.10/dist-packages/setuptools/_vendor
Finished processing dependencies for lightning-thunder==0.2.5.dev0
+ bash scripts/sanity-check.sh
+ pip list
Package               Version            Editable project location
--------------------- ------------------ -------------------------
absl-py               2.3.1
accelerate            1.10.1
aiohappyeyeballs      2.6.1
aiohttp               3.12.15
aiosignal             1.4.0
apex                  0.1
asv                   0.6.4
asv_runner            0.2.1
asvdb                 0.4.2
async-timeout         5.0.1
attrs                 25.3.0
autocommand           2.2.2
backports.tarfile     1.2.0
bitsandbytes          0.46.1
blinker               1.7.0
boto3                 1.40.18
botocore              1.40.18
build                 1.3.0
certifi               2025.8.3
charset-normalizer    3.4.3
cmake                 3.31.6
coverage              7.9.2
cryptography          41.0.7
dbus-python           1.3.2
diffusers             0.34.0
dill                  0.4.0
distlib               0.4.0
distro                1.9.0
docstring_parser      0.17.0
einops                0.8.1
exceptiongroup        1.3.0
execnet               2.1.1
expecttest            0.3.0
fdm                   0.5.0
filelock              3.19.1
frozenlist            1.7.0
fsspec                2025.7.0
graphviz              0.21
hf-xet                1.1.8
httplib2              0.20.4
huggingface-hub       0.34.4
hypothesis            6.136.9
idna                  3.10
importlib_metadata    8.7.0
importlib_resources   6.5.2
inflect               7.3.1
iniconfig             2.1.0
jaraco.collections    5.1.0
jaraco.context        5.3.0
jaraco.functools      4.0.1
jaraco.text           3.12.1
Jinja2                3.1.6
jmespath              1.0.1
json5                 0.12.1
jsonargparse          4.32.1
launchpadlib          1.11.0
lazr.restfulclient    0.14.6
lazr.uri              1.0.6
lightning             2.4.0
lightning-thunder     0.2.5.dev0         /workspace
lightning-utilities   0.15.2
lintrunner            0.12.7
litgpt                0.5.0
looseversion          1.3.0
MarkupSafe            3.0.2
more-itertools        10.3.0
mpmath                1.3.0
multidict             6.6.4
networkx              3.4.2
ninja                 1.13.0
numpy                 1.26.4
nvfuser               0.2.30+git6d4256e
nvidia-cudnn-frontend 1.10.0
oauthlib              3.2.2
opt_einsum            3.4.0
optree                0.17.0
packaging             24.2
pandas                2.3.2
pillow                11.3.0
pip                   25.2
platformdirs          4.4.0
pluggy                1.6.0
propcache             0.3.2
psutil                7.0.0
py-cpuinfo            9.0.0
pybind11              3.0.1
pybind11-global       3.0.1
PyGObject             3.48.2
PyJWT                 2.7.0
Pympler               1.1
pyparsing             3.1.1
pyproject_hooks       1.2.0
pytest                8.3.5
pytest-benchmark      5.1.0
pytest-cov            6.2.1
pytest-random-order   1.2.0
pytest-timeout        2.4.0
pytest-timestamper    0.0.10
pytest-xdist          3.7.0
python-apt            2.7.7+ubuntu5
python-dateutil       2.9.0.post0
pytorch-lightning     2.5.3
pytorch-triton        3.4.0+gitf7888497
pytz                  2025.2
PyYAML                6.0.2
regex                 2025.7.34
requests              2.32.5
s3transfer            0.13.1
safetensors           0.6.2
setuptools            79.0.1
six                   1.16.0
sortedcontainers      2.4.0
sympy                 1.14.0
tabulate              0.9.0
tokenizers            0.21.4
tomli                 2.2.1
torch                 2.9.0a0+git3d40642
torchmetrics          1.8.1
tqdm                  4.67.1
transformers          4.52.4
typeguard             4.3.0
typeshed_client       2.8.2
typing_extensions     4.15.0
tzdata                2025.2
urllib3               2.5.0
uv                    0.8.13
virtualenv            20.34.0
wadllib               1.3.6
wheel                 0.45.1
xlsxwriter            3.2.5
yarl                  1.20.1
zipp                  3.23.0
+ python -c 'import torch ; assert torch.cuda.is_available(), '\''missing GPU support!'\'''
+ python -c 'import torch ; v = torch.__version__ ; assert str(v).startswith('\''2'\''), v'
+ python -c 'from thunder.executors import nvfuser_available ; assert nvfuser_available(), '\''nvFuser is missing!'\'''
/usr/local/lib/python3.10/dist-packages/torch/cuda/__init__.py:283: UserWarning:
    Found GPU0 NVIDIA L4 which is of cuda capability 8.9.
    Minimum and Maximum cuda capability supported by this version of PyTorch is
    (8.0) - (8.0)

  warnings.warn(
/usr/local/lib/python3.10/dist-packages/torch/cuda/__init__.py:304: UserWarning:
    Please install PyTorch with a following CUDA
    configurations:  12.6 12.8 12.9 following instructions at
    https://pytorch.org/get-started/locally/

  warnings.warn(matched_cuda_warn.format(matched_arches))
/usr/local/lib/python3.10/dist-packages/nvfuser_direct/__init__.py:11: UserWarning: Be careful! You've imported nvfuser_direct when the nvfuser module is already imported.
  warnings.warn(
/workspace/thunder/executors/transformer_engine_v2ex.py:25: UserWarning: transformer_engine module not found!
  warnings.warn("transformer_engine module not found!")
+ python -c 'from thunder.executors.triton_utils import triton_version ; assert triton_version() is not None, '\''triton is missing!'\'''
/usr/local/lib/python3.10/dist-packages/torch/cuda/__init__.py:283: UserWarning:
    Found GPU0 NVIDIA L4 which is of cuda capability 8.9.
    Minimum and Maximum cuda capability supported by this version of PyTorch is
    (8.0) - (8.0)

  warnings.warn(
/usr/local/lib/python3.10/dist-packages/torch/cuda/__init__.py:304: UserWarning:
    Please install PyTorch with a following CUDA
    configurations:  12.6 12.8 12.9 following instructions at
    https://pytorch.org/get-started/locally/

  warnings.warn(matched_cuda_warn.format(matched_arches))
/usr/local/lib/python3.10/dist-packages/nvfuser_direct/__init__.py:11: UserWarning: Be careful! You've imported nvfuser_direct when the nvfuser module is already imported.
  warnings.warn(
/workspace/thunder/executors/transformer_engine_v2ex.py:25: UserWarning: transformer_engine module not found!
  warnings.warn("transformer_engine module not found!")
+ '[' ops == main ']'
+ '[' ops == ops ']'
+ coverage run --source thunder -m pytest thunder/tests/test_ops.py -m 'not standalone' -v --datefmt=%Y%m%d-%H:%M:%S.%f --random-order-seed=42 --durations=250 --timeout=240 --numprocesses=9
/usr/local/lib/python3.10/dist-packages/pytest_benchmark/logger.py:39: PytestBenchmarkWarning: Benchmarks are automatically disabled because xdist plugin is active.Benchmarks cannot be performed
↪ reliably in a parallelized environment.
  warner(PytestBenchmarkWarning(text))
============================= test session starts ==============================
platform linux -- Python 3.10.18, pytest-8.3.5, pluggy-1.6.0 -- /usr/bin/python3.10
cachedir: .pytest_cache
Using --random-order-bucket=module
Using --random-order-seed=42

hypothesis profile 'ci' -> database=None, deadline=None, print_blob=True, derandomize=True, suppress_health_check=(HealthCheck.too_slow,)
benchmark: 5.1.0 (defaults: timer=torch.utils.benchmark.utils.timer.timer disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=True warmup_iterations=100000)
rootdir: /workspace
configfile: pyproject.toml
plugins: timestamper-0.0.10, random-order-1.2.0, hypothesis-6.136.9, timeout-2.4.0, cov-6.2.1, benchmark-5.1.0, xdist-3.7.0, typeguard-4.3.0
timeout: 240.0s
timeout method: signal
timeout func_only: False
created: 9/9 workers
9 workers [4820 items]

scheduling tests via LoadScheduling

[20250828-13:17:46.751721] thunder/tests/test_ops.py::test_core_vs_torch_consistency_squeeze_torch_nvfuser_cuda_thunder::dtypes::int64
[20250828-13:17:46.752451] thunder/tests/test_ops.py::test_core_vs_torch_consistency_add_nvfuser_cuda_thunder::dtypes::float32
[20250828-13:17:46.753671] thunder/tests/test_ops.py::test_core_vs_torch_consistency_stack_wrapper_torch_cuda_thunder::dtypes::complex128
[20250828-13:17:46.754080] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_nvfuser_cuda_thunder::dtypes::bool8
[gw4] [  0%] SKIPPED [20250828-13:17:46.754080] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_nvfuser_cuda_thunder::dtypes::bool8
[20250828-13:17:46.756005] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_torch_cuda_thunder::dtypes::bool8
[gw4] [  0%] SKIPPED [20250828-13:17:46.756005] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_torch_cuda_thunder::dtypes::bool8
[20250828-13:17:46.758342] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_torch_cuda_thunder::dtypes::bfloat16
[20250828-13:17:46.758748] thunder/tests/test_ops.py::test_errors_t_nvfuser_cuda_thunder::dtypes::complex128
[gw2] [  0%] SKIPPED [20250828-13:17:46.753671] thunder/tests/test_ops.py::test_core_vs_torch_consistency_stack_wrapper_torch_cuda_thunder::dtypes::complex128
[20250828-13:17:46.759794] thunder/tests/test_ops.py::test_core_vs_torch_consistency_randint_nvfuser_cuda_thunder::dtypes::bfloat16
[20250828-13:17:46.763040] thunder/tests/test_ops.py::test_core_vs_torch_consistency_cosh_torch_cuda_thunder::dtypes::int64
[gw4] [  0%] SKIPPED [20250828-13:17:46.758342] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_torch_cuda_thunder::dtypes::bfloat16
[20250828-13:17:46.764103] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_nvfuser_cuda_thunder::dtypes::int64
[gw4] [  0%] SKIPPED [20250828-13:17:46.764103] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_nvfuser_cuda_thunder::dtypes::int64
[20250828-13:17:46.764969] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_nvfuser_cuda_thunder::dtypes::float32
[gw4] [  0%] SKIPPED [20250828-13:17:46.764969] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_nvfuser_cuda_thunder::dtypes::float32
[20250828-13:17:46.765864] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_nvfuser_cuda_thunder::dtypes::int32
[20250828-13:17:46.766463] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ndtri_torch_cuda_thunder::dtypes::uint8
[gw4] [  0%] SKIPPED [20250828-13:17:46.765864] thunder/tests/test_ops.py::test_core_vs_torch_consistency_floor_divide_nvfuser_cuda_thunder::dtypes::int32
[20250828-13:17:46.767378] thunder/tests/test_ops.py::test_double_setitem
[20250828-13:17:46.768857] thunder/tests/test_ops.py::test_core_vs_torch_consistency_rrelu_torch_cuda_thunder::dtypes::complex32
[20250828-13:17:46.769079] thunder/tests/test_ops.py::test_core_vs_torch_consistency_square_torch_cuda_thunder::dtypes::bool8
[gw5] [  0%] SKIPPED [20250828-13:17:46.768857] thunder/tests/test_ops.py::test_core_vs_torch_consistency_rrelu_torch_cuda_thunder::dtypes::complex32
[20250828-13:17:46.770100] thunder/tests/test_ops.py::test_core_vs_torch_consistency_full_nvfuser_cuda_thunder::dtypes::int64
[gw7] [  0%] PASSED [20250828-13:17:46.758748] thunder/tests/test_ops.py::test_errors_t_nvfuser_cuda_thunder::dtypes::complex128
[20250828-13:17:46.874473] thunder/tests/test_ops.py::test_errors_topk_nvfuser_cuda_thunder::dtypes::int64
[gw7] [  0%] PASSED [20250828-13:17:46.874473] thunder/tests/test_ops.py::test_errors_topk_nvfuser_cuda_thunder::dtypes::int64
[20250828-13:17:47.319279] thunder/tests/test_ops.py::test_errors_unflatten_torch_cuda_thunder::dtypes::complex128
[gw4] [  0%] PASSED [20250828-13:17:46.767378] thunder/tests/test_ops.py::test_double_setitem
[20250828-13:17:47.657146] thunder/tests/test_ops.py::test_multi_dot_optimization
[gw7] [  0%] PASSED [20250828-13:17:47.319279] thunder/tests/test_ops.py::test_errors_unflatten_torch_cuda_thunder::dtypes::complex128
[20250828-13:17:47.705335] thunder/tests/test_ops.py::test_core_vs_torch_consistency_logical_xor_nvfuser_cuda_thunder::dtypes::float64
[gw4] [  0%] PASSED [20250828-13:17:47.657146] thunder/tests/test_ops.py::test_multi_dot_optimization
[20250828-13:17:48.199878] thunder/tests/test_ops.py::test_ltorch_maximum_result_dtype_for_scalar_tensors
[gw4] [  0%] PASSED [20250828-13:17:48.199878] thunder/tests/test_ops.py::test_ltorch_maximum_result_dtype_for_scalar_tensors
[20250828-13:17:48.370063] thunder/tests/test_ops.py::test_setitem[False]
[gw1] [  0%] PASSED [20250828-13:17:46.751721] thunder/tests/test_ops.py::test_core_vs_torch_consistency_squeeze_torch_nvfuser_cuda_thunder::dtypes::int64
[20250828-13:17:48.666235] thunder/tests/test_ops.py::test_core_vs_torch_consistency_size_torch_cuda_thunder::dtypes::bfloat16
[gw0] [  0%] PASSED [20250828-13:17:46.763040] thunder/tests/test_ops.py::test_core_vs_torch_consistency_cosh_torch_cuda_thunder::dtypes::int64
[gw4] [  0%] PASSED [20250828-13:17:48.370063] thunder/tests/test_ops.py::test_setitem[False]
[20250828-13:17:49.177675] thunder/tests/test_ops.py::test_ltorch_cumsum_result_dtype_for_int_input
[20250828-13:17:49.203008] thunder/tests/test_ops.py::test_errors_unflatten_torch_cuda_thunder::dtypes::int8
[gw5] [  0%] PASSED [20250828-13:17:46.770100] thunder/tests/test_ops.py::test_core_vs_torch_consistency_full_nvfuser_cuda_thunder::dtypes::int64
[20250828-13:17:49.290446] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sin_nvfuser_cuda_thunder::dtypes::complex128
[gw5] [  0%] SKIPPED [20250828-13:17:49.290446] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sin_nvfuser_cuda_thunder::dtypes::complex128
[20250828-13:17:49.292437] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sinh_nvfuser_cuda_thunder::dtypes::float32
[gw4] [  0%] PASSED [20250828-13:17:49.177675] thunder/tests/test_ops.py::test_ltorch_cumsum_result_dtype_for_int_input
[20250828-13:17:49.338026] thunder/tests/test_ops.py::test_notimplemented_interpolate_modes
[gw0] [  0%] PASSED [20250828-13:17:49.203008] thunder/tests/test_ops.py::test_errors_unflatten_torch_cuda_thunder::dtypes::int8
[20250828-13:17:49.481673] thunder/tests/test_ops.py::test_core_vs_torch_consistency_bitwise_left_shift_nvfuser_cuda_thunder::dtypes::int32
[gw6] [  0%] PASSED [20250828-13:17:46.769079] thunder/tests/test_ops.py::test_core_vs_torch_consistency_square_torch_cuda_thunder::dtypes::bool8
[20250828-13:17:49.695033] thunder/tests/test_ops.py::test_core_vs_torch_consistency_exp2_torch_cuda_thunder::dtypes::float32
[gw8] [  0%] PASSED [20250828-13:17:46.752451] thunder/tests/test_ops.py::test_core_vs_torch_consistency_add_nvfuser_cuda_thunder::dtypes::float32
[20250828-13:17:49.865894] thunder/tests/test_ops.py::test_core_vs_torch_consistency_std_torch_cuda_thunder::dtypes::float64
[gw1] [  0%] PASSED [20250828-13:17:48.666235] thunder/tests/test_ops.py::test_core_vs_torch_consistency_size_torch_cuda_thunder::dtypes::bfloat16
[20250828-13:17:49.920389] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ge_torch_cuda_thunder::dtypes::int64
[gw4] [  0%] PASSED [20250828-13:17:49.338026] thunder/tests/test_ops.py::test_notimplemented_interpolate_modes
[20250828-13:17:49.956365] thunder/tests/test_ops.py::test_notimplemented_interpolate_recompute_scale
[gw4] [  0%] PASSED [20250828-13:17:49.956365] thunder/tests/test_ops.py::test_notimplemented_interpolate_recompute_scale
[20250828-13:17:50.120472] thunder/tests/test_ops.py::test_interpolate_nearest_vs_nearest_exact
[gw1] [  0%] PASSED [20250828-13:17:49.920389] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ge_torch_cuda_thunder::dtypes::int64
[20250828-13:17:50.411141] thunder/tests/test_ops.py::test_core_vs_torch_consistency_scatter_nvfuser_cuda_thunder::dtypes::int32
[gw4] [  0%] PASSED [20250828-13:17:50.120472] thunder/tests/test_ops.py::test_interpolate_nearest_vs_nearest_exact
[20250828-13:17:50.641349] thunder/tests/test_ops.py::test_notimplemented_interpolate_align
[gw4] [  0%] PASSED [20250828-13:17:50.641349] thunder/tests/test_ops.py::test_notimplemented_interpolate_align
[20250828-13:17:50.742971] thunder/tests/test_ops.py::test_exponential
[gw8] [  0%] PASSED [20250828-13:17:49.865894] thunder/tests/test_ops.py::test_core_vs_torch_consistency_std_torch_cuda_thunder::dtypes::float64
[20250828-13:17:50.755641] thunder/tests/test_ops.py::test_core_vs_torch_consistency_le_nvfuser_cuda_thunder::dtypes::float64
[gw2] [  0%] PASSED [20250828-13:17:46.759794] thunder/tests/test_ops.py::test_core_vs_torch_consistency_randint_nvfuser_cuda_thunder::dtypes::bfloat16
[gw7] [  0%] PASSED [20250828-13:17:47.705335] thunder/tests/test_ops.py::test_core_vs_torch_consistency_logical_xor_nvfuser_cuda_thunder::dtypes::float64
[20250828-13:17:50.970138] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ndtri_nvfuser_cuda_thunder::dtypes::bool8
[20250828-13:17:50.981315] thunder/tests/test_ops.py::test_errors_convolution_torch_cuda_thunder::dtypes::bfloat16
[gw4] [  0%] PASSED [20250828-13:17:50.742971] thunder/tests/test_ops.py::test_exponential
[20250828-13:17:51.438477] thunder/tests/test_ops.py::test_max_with_int
[gw4] [  0%] PASSED [20250828-13:17:51.438477] thunder/tests/test_ops.py::test_max_with_int
[20250828-13:17:51.614694] thunder/tests/test_ops.py::test_softmax_stacklevel
[gw4] [  0%] PASSED [20250828-13:17:51.614694] thunder/tests/test_ops.py::test_softmax_stacklevel
[20250828-13:17:51.798511] thunder/tests/test_ops.py::test_setitem[True]
[gw0] [  0%] PASSED [20250828-13:17:49.481673] thunder/tests/test_ops.py::test_core_vs_torch_consistency_bitwise_left_shift_nvfuser_cuda_thunder::dtypes::int32
[20250828-13:17:52.267642] thunder/tests/test_ops.py::test_core_vs_torch_consistency_max_pool1d_nvfuser_cuda_thunder::dtypes::float16
[gw6] [  0%] PASSED [20250828-13:17:49.695033] thunder/tests/test_ops.py::test_core_vs_torch_consistency_exp2_torch_cuda_thunder::dtypes::float32
[20250828-13:17:52.558633] thunder/tests/test_ops.py::test_core_vs_torch_consistency_matmul_torch_cuda_thunder::dtypes::float16
[gw8] [  0%] PASSED [20250828-13:17:50.755641] thunder/tests/test_ops.py::test_core_vs_torch_consistency_le_nvfuser_cuda_thunder::dtypes::float64
[20250828-13:17:52.796208] thunder/tests/test_ops.py::test_core_vs_torch_consistency_full_torch_cuda_thunder::dtypes::float64
[gw4] [  0%] PASSED [20250828-13:17:51.798511] thunder/tests/test_ops.py::test_setitem[True]
[20250828-13:17:52.979223] thunder/tests/test_ops.py::test_notimplemented_interpolate_antialias
[gw0] [  0%] PASSED [20250828-13:17:52.267642] thunder/tests/test_ops.py::test_core_vs_torch_consistency_max_pool1d_nvfuser_cuda_thunder::dtypes::float16
[20250828-13:17:53.091144] thunder/tests/test_ops.py::test_errors_rand_torch_cuda_thunder::dtypes::complex64
[gw4] [  0%] PASSED [20250828-13:17:52.979223] thunder/tests/test_ops.py::test_notimplemented_interpolate_antialias
[20250828-13:17:53.101359] thunder/tests/test_ops.py::test_core_vs_torch_consistency_tensor_torch_cuda_thunder::dtypes::bool8
[gw0] [  0%] PASSED [20250828-13:17:53.091144] thunder/tests/test_ops.py::test_errors_rand_torch_cuda_thunder::dtypes::complex64
[20250828-13:17:53.400836] thunder/tests/test_ops.py::test_core_vs_torch_consistency_prelu_nvfuser_cuda_thunder::dtypes::bfloat16
[gw8] [  0%] PASSED [20250828-13:17:52.796208] thunder/tests/test_ops.py::test_core_vs_torch_consistency_full_torch_cuda_thunder::dtypes::float64
[20250828-13:17:53.592195] thunder/tests/test_ops.py::test_core_vs_torch_consistency_randint_torch_cuda_thunder::dtypes::float16
[gw6] [  0%] PASSED [20250828-13:17:52.558633] thunder/tests/test_ops.py::test_core_vs_torch_consistency_matmul_torch_cuda_thunder::dtypes::float16
[20250828-13:17:53.836384] thunder/tests/test_ops.py::test_core_vs_torch_consistency_t_torch_cuda_thunder::dtypes::uint8
[gw6] [  0%] PASSED [20250828-13:17:53.836384] thunder/tests/test_ops.py::test_core_vs_torch_consistency_t_torch_cuda_thunder::dtypes::uint8
[20250828-13:17:54.205207] thunder/tests/test_ops.py::test_core_vs_torch_consistency_zeta_torch_cuda_thunder::dtypes::complex32
[gw6] [  0%] SKIPPED [20250828-13:17:54.205207] thunder/tests/test_ops.py::test_core_vs_torch_consistency_zeta_torch_cuda_thunder::dtypes::complex32
[20250828-13:17:54.217934] thunder/tests/test_ops.py::test_errors_permute_torch_cuda_thunder::dtypes::uint8
[gw6] [  0%] PASSED [20250828-13:17:54.217934] thunder/tests/test_ops.py::test_errors_permute_torch_cuda_thunder::dtypes::uint8
[20250828-13:17:54.300933] thunder/tests/test_ops.py::test_core_vs_torch_consistency_tanhshrink_torch_cuda_thunder::dtypes::complex64
[gw6] [  0%] SKIPPED [20250828-13:17:54.300933] thunder/tests/test_ops.py::test_core_vs_torch_consistency_tanhshrink_torch_cuda_thunder::dtypes::complex64
[20250828-13:17:54.303117] thunder/tests/test_ops.py::test_core_vs_torch_consistency_lgamma_nvfuser_cuda_thunder::dtypes::complex128
[gw6] [  1%] SKIPPED [20250828-13:17:54.303117] thunder/tests/test_ops.py::test_core_vs_torch_consistency_lgamma_nvfuser_cuda_thunder::dtypes::complex128
[20250828-13:17:54.308437] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ceil_torch_cuda_thunder::dtypes::int8
[gw3] [  1%] PASSED [20250828-13:17:46.766463] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ndtri_torch_cuda_thunder::dtypes::uint8
[20250828-13:17:54.979806] thunder/tests/test_ops.py::test_core_vs_torch_consistency_frexp_torch_cuda_thunder::dtypes::bfloat16
[gw8] [  1%] PASSED [20250828-13:17:53.592195] thunder/tests/test_ops.py::test_core_vs_torch_consistency_randint_torch_cuda_thunder::dtypes::float16
[20250828-13:17:55.418923] thunder/tests/test_ops.py::test_core_vs_torch_consistency_polygamma_nvfuser_cuda_thunder::dtypes::complex64
[gw8] [  1%] SKIPPED [20250828-13:17:55.418923] thunder/tests/test_ops.py::test_core_vs_torch_consistency_polygamma_nvfuser_cuda_thunder::dtypes::complex64
[20250828-13:17:55.427328] thunder/tests/test_ops.py::test_core_vs_torch_consistency_flip_torch_cuda_thunder::dtypes::int8
[gw6] [  1%] PASSED [20250828-13:17:54.308437] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ceil_torch_cuda_thunder::dtypes::int8
[20250828-13:17:55.762532] thunder/tests/test_ops.py::test_core_vs_torch_consistency_take_along_axis_torch_cuda_thunder::dtypes::complex32
[gw6] [  1%] SKIPPED [20250828-13:17:55.762532] thunder/tests/test_ops.py::test_core_vs_torch_consistency_take_along_axis_torch_cuda_thunder::dtypes::complex32
[20250828-13:17:55.765256] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sign_torch_cuda_thunder::dtypes::complex128
[gw6] [  1%] SKIPPED [20250828-13:17:55.765256] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sign_torch_cuda_thunder::dtypes::complex128
[20250828-13:17:55.766866] thunder/tests/test_ops.py::test_core_vs_torch_consistency_fmod_nvfuser_cuda_thunder::dtypes::complex128
[gw6] [  1%] SKIPPED [20250828-13:17:55.766866] thunder/tests/test_ops.py::test_core_vs_torch_consistency_fmod_nvfuser_cuda_thunder::dtypes::complex128
[20250828-13:17:55.771553] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sin_torch_cuda_thunder::dtypes::int64
[gw4] [  1%] PASSED [20250828-13:17:53.101359] thunder/tests/test_ops.py::test_core_vs_torch_consistency_tensor_torch_cuda_thunder::dtypes::bool8
[20250828-13:17:55.832327] thunder/tests/test_ops.py::test_core_vs_torch_consistency_cuda_nvfuser_cuda_thunder::dtypes::bfloat16
[gw4] [  1%] PASSED [20250828-13:17:55.832327] thunder/tests/test_ops.py::test_core_vs_torch_consistency_cuda_nvfuser_cuda_thunder::dtypes::bfloat16
[20250828-13:17:55.977173] thunder/tests/test_ops.py::test_core_vs_torch_consistency_log1p_nvfuser_cuda_thunder::dtypes::int32
[gw3] [  1%] PASSED [20250828-13:17:54.979806] thunder/tests/test_ops.py::test_core_vs_torch_consistency_frexp_torch_cuda_thunder::dtypes::bfloat16
[20250828-13:17:56.121004] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sigmoid_nvfuser_cuda_thunder::dtypes::complex64
[gw3] [  1%] SKIPPED [20250828-13:17:56.121004] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sigmoid_nvfuser_cuda_thunder::dtypes::complex64
[20250828-13:17:56.121573] thunder/tests/test_ops.py::test_errors_matrix_transpose_nvfuser_cuda_thunder::dtypes::complex128
[gw3] [  1%] PASSED [20250828-13:17:56.121573] thunder/tests/test_ops.py::test_errors_matrix_transpose_nvfuser_cuda_thunder::dtypes::complex128
[20250828-13:17:56.182563] thunder/tests/test_ops.py::test_errors_flip_torch_cuda_thunder::dtypes::complex128
[gw3] [  1%] PASSED [20250828-13:17:56.182563] thunder/tests/test_ops.py::test_errors_flip_torch_cuda_thunder::dtypes::complex128
[20250828-13:17:56.599455] thunder/tests/test_ops.py::test_core_vs_torch_consistency_triu_nvfuser_cuda_thunder::dtypes::float64
[gw5] [  1%] PASSED [20250828-13:17:49.292437] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sinh_nvfuser_cuda_thunder::dtypes::float32
[20250828-13:17:57.053777] thunder/tests/test_ops.py::test_core_vs_torch_consistency_rsqrt_nvfuser_cuda_thunder::dtypes::bfloat16
[gw1] [  1%] PASSED [20250828-13:17:50.411141] thunder/tests/test_ops.py::test_core_vs_torch_consistency_scatter_nvfuser_cuda_thunder::dtypes::int32
[20250828-13:17:57.302692] thunder/tests/test_ops.py::test_errors_all_tensor_torch_cuda_thunder::dtypes::float16
[gw1] [  1%] PASSED [20250828-13:17:57.302692] thunder/tests/test_ops.py::test_errors_all_tensor_torch_cuda_thunder::dtypes::float16
[20250828-13:17:57.394743] thunder/tests/test_ops.py::test_core_vs_torch_consistency_div_torch_cuda_thunder::dtypes::int8
[gw6] [  1%] PASSED [20250828-13:17:55.771553] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sin_torch_cuda_thunder::dtypes::int64
[20250828-13:17:57.709705] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ldexp_torch_cuda_thunder::dtypes::int8
[gw6] [  1%] PASSED [20250828-13:17:57.709705] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ldexp_torch_cuda_thunder::dtypes::int8
[20250828-13:17:57.981654] thunder/tests/test_ops.py::test_core_vs_torch_consistency_layer_norm_nvfuser_cuda_thunder::dtypes::bfloat16
[gw0] [  1%] PASSED [20250828-13:17:53.400836] thunder/tests/test_ops.py::test_core_vs_torch_consistency_prelu_nvfuser_cuda_thunder::dtypes::bfloat16
[20250828-13:17:58.195518] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ldexp_torch_cuda_thunder::dtypes::complex64
[gw0] [  1%] SKIPPED [20250828-13:17:58.195518] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ldexp_torch_cuda_thunder::dtypes::complex64
[20250828-13:17:58.204275] thunder/tests/test_ops.py::test_core_vs_torch_consistency_argmax_torch_cuda_thunder::dtypes::int16
[gw7] [  1%] PASSED [20250828-13:17:50.981315] thunder/tests/test_ops.py::test_errors_convolution_torch_cuda_thunder::dtypes::bfloat16
[20250828-13:18:00.105254] thunder/tests/test_ops.py::test_core_vs_torch_consistency_mul_torch_cuda_thunder::dtypes::bool8
[gw3] [  1%] PASSED [20250828-13:17:56.599455] thunder/tests/test_ops.py::test_core_vs_torch_consistency_triu_nvfuser_cuda_thunder::dtypes::float64
[gw7] [  1%] PASSED [20250828-13:18:00.105254] thunder/tests/test_ops.py::test_core_vs_torch_consistency_mul_torch_cuda_thunder::dtypes::bool8
[20250828-13:18:00.681977] thunder/tests/test_ops.py::test_core_vs_torch_consistency_linear_nvfuser_cuda_thunder::dtypes::float16
[20250828-13:18:00.688273] thunder/tests/test_ops.py::test_core_vs_torch_consistency_view_torch_cuda_thunder::dtypes::complex32
[gw7] [  1%] SKIPPED [20250828-13:18:00.688273] thunder/tests/test_ops.py::test_core_vs_torch_consistency_view_torch_cuda_thunder::dtypes::complex32
[20250828-13:18:00.695752] thunder/tests/test_ops.py::test_errors_ldexp_torch_cuda_thunder::dtypes::float16
[gw7] [  1%] PASSED [20250828-13:18:00.695752] thunder/tests/test_ops.py::test_errors_ldexp_torch_cuda_thunder::dtypes::float16
[20250828-13:18:00.741408] thunder/tests/test_ops.py::test_core_vs_torch_consistency_cat_wrapper_torch_cuda_thunder::dtypes::float64
[gw0] [  1%] PASSED [20250828-13:17:58.204275] thunder/tests/test_ops.py::test_core_vs_torch_consistency_argmax_torch_cuda_thunder::dtypes::int16
[20250828-13:18:00.949718] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sqrt_torch_cuda_thunder::dtypes::uint8
[gw3] [  1%] PASSED [20250828-13:18:00.681977] thunder/tests/test_ops.py::test_core_vs_torch_consistency_linear_nvfuser_cuda_thunder::dtypes::float16
[20250828-13:18:01.414794] thunder/tests/test_ops.py::test_core_vs_torch_consistency_rsqrt_torch_cuda_thunder::dtypes::bfloat16
[gw1] [  1%] PASSED [20250828-13:17:57.394743] thunder/tests/test_ops.py::test_core_vs_torch_consistency_div_torch_cuda_thunder::dtypes::int8
[20250828-13:18:01.852219] thunder/tests/test_ops.py::test_core_vs_torch_consistency_signbit_torch_cuda_thunder::dtypes::float16
[gw6] [  1%] PASSED [20250828-13:17:57.981654] thunder/tests/test_ops.py::test_core_vs_torch_consistency_layer_norm_nvfuser_cuda_thunder::dtypes::bfloat16
[20250828-13:18:02.402454] thunder/tests/test_ops.py::test_errors_broadcast_in_dim_torch_cuda_thunder::dtypes::bfloat16
[gw2] [  1%] PASSED [20250828-13:17:50.970138] thunder/tests/test_ops.py::test_core_vs_torch_consistency_ndtri_nvfuser_cuda_thunder::dtypes::bool8
[20250828-13:18:02.535257] thunder/tests/test_ops.py::test_errors_broadcast_in_dim_torch_cuda_thunder::dtypes::complex32
[gw7] [  1%] PASSED [20250828-13:18:00.741408] thunder/tests/test_ops.py::test_core_vs_torch_consistency_cat_wrapper_torch_cuda_thunder::dtypes::float64
[20250828-13:18:02.580077] thunder/tests/test_ops.py::test_core_vs_torch_consistency_repeat_interleave_torch_cuda_thunder::dtypes::int8
[gw6] [  1%] XPASS [20250828-13:18:02.402454] thunder/tests/test_ops.py::test_errors_broadcast_in_dim_torch_cuda_thunder::dtypes::bfloat16
[20250828-13:18:02.678387] thunder/tests/test_ops.py::test_core_vs_torch_consistency_zeta_nvfuser_cuda_thunder::dtypes::float16
[gw0] [  1%] PASSED [20250828-13:18:00.949718] thunder/tests/test_ops.py::test_core_vs_torch_consistency_sqrt_torch_cuda_thunder::dtypes::uint8
[20250828-13:18:02.710857] thunder/tests/test_ops.py::test_errors_cat_wrapper_nvfuser_cuda_thunder::dtypes::int32
[gw2] [  1%] XPASS [20250828-13:18:02.535257] thunder/tests/test_ops.py::test_errors_broadcast_in_dim_torch_cuda_thunder::dtypes::complex32
[20250828-13:18:02.924343] thunder/tests/test_ops.py::test_core_vs_torch_consistency_square_nvfuser_cuda_thunder::dtypes::bfloat16
[gw7] [  1%] PASSED [20250828-13:18:02.580077] thunder/tests/test_ops.py::test_core_vs_torch_consistency_repeat_interleave_torch_cuda_thunder::dtypes::int8
[20250828-13:18:03.099273] thunder/tests/test_ops.py::test_core_vs_torch_consistency_zeta_torch_cuda_thunder::dtypes::float64
[gw4] [  1%] PASSED [20250828-13:17:55.977173] thunder/tests/test_ops.py::test_core_vs_torch_consistency_log1p_nvfuser_cuda_thunder::dtypes::int32
[20250828-13:18:03.156869] thunder/tests/test_ops.py::test_core_vs_torch_consistency_triu_torch_cuda_thunder::dtypes::bfloat16
[gw3] [  1%] PASSED [20250828-13:18:01.414794] thunder/tests/test_ops.py::test_core_vs_torch_consistency_rsqrt_torch_cuda_thunder::dtypes::bfloat16
[20250828-13:18:03.277129] thunder/tests/test_ops.py::test_core_vs_torch_consistency_atanh_torch_cuda_thunder::dtypes::float32
[gw0] [  1%] PASSED [20250828-13:18:02.710857] thunder/tests/test_ops.py::test_errors_cat_wrapper_nvfuser_cuda_thunder::dtypes::int32
[20250828-13:18:03.598301] thunder/tests/test_ops.py::test_core_vs_torch_consistency_torch_empty_like_and_zero_torch_cuda_thunder::dtypes::complex32
[gw0] [  1%] SKIPPED [20250828-13:18:03.598301] thunder/tests/test_ops.py::test_core_vs_torch_consistency_torch_empty_like_and_zero_torch_cuda_thunder::dtypes::complex32
[20250828-13:18:03.606331] thunder/tests/test_ops.py::test_core_vs_torch_consistency_scaled_dot_product_attention_torch_cuda_thunder::dtypes::float32
[gw1] [  1%] PASSED [20250828-13:18:01.852219] thunder/tests/test_ops.py::test_core_vs_torch_consistency_signbit_torch_cuda_thunder::dtypes::float16
[20250828-13:18:03.716438] thunder/tests/test_ops.py::test_core_vs_torch_consistency_elu_torch_cuda_thunder::dtypes::float32
[gw4] [  1%] PASSED [20250828-13:18:03.156869] thunder/tests/test_ops.py::test_core_vs_torch_consistency_triu_torch_cuda_thunder::dtypes::bfloat16
[20250828-13:18:04.074928] thunder/tests/test_ops.py::test_core_vs_torch_consistency_real_torch_cuda_thunder::dtypes::float64
[gw5] [  1%] PASSED [20250828-13:17:57.053777] thunder/tests/test_ops.py::test_core_vs_torch_consistency_rsqrt_nvfuser_cuda_thunder::dtypes::bfloat16
[20250828-13:18:04.421039] thunder/tests/test_ops.py::test_core_vs_torch_consistency_atan2_nvfuser_cuda_thunder::dtypes::float16
[gw3] [  1%] PASSED [20250828-13:18:03.277129] thunder/tests/test_ops.py::test_core_vs_torch_consistency_atanh_torch_cuda_thunder::dtypes::float32
[20250828-13:18:04.925098] thunder/tests/test_ops.py::test_core_vs_torch_consistency_tensor_split_nvfuser_cuda_thunder::dtypes::bfloat16
[gw4] [  1%] PASSED [20250828-13:18:04.074928] thunder/tests/test_ops.py::test_core_vs_torch_consistency_real_torch_cuda_thunder::dtypes::float64
[20250828-13:18:05.895518] thunder/tests/test_ops.py::test_core_vs_torch_consistency_addcdiv_torch_cuda_thunder::dtypes::bool8
[gw4] [  1%] XFAIL [20250828-13:18:05.895518] thunder/tests/test_ops.py::test_core_vs_torch_consistency_addcdiv_torch_cuda_thunder::dtypes::bool8
[20250828-13:18:06.126242] thunder/tests/test_ops.py::test_errors_t_torch_cuda_thunder::dtypes::complex64
[gw4] [  1%] PASSED [20250828-13:18:06.126242] thunder/tests/test_ops.py::test_errors_t_torch_cuda_thunder::dtypes::complex64
[20250828-13:18:06.226699] thunder/tests/test_ops.py::test_core_vs_torch_consistency_fmod_torch_cuda_thunder::dtypes::complex32
[gw4] [  1%] SKIPPED [20250828-13:18:06.226699] thunder/tests/test_ops.py::test_core_vs_torch_consistency_fmod_torch_cuda_thunder::dtypes::complex32
[20250828-13:18:06.240736] thunder/tests/test_ops.py::test_errors_interpolate_torch_cuda_thunder::dtypes::float64
[gw5] [  2%] PASSED [20250828-13:18:04.421039] thunder/tests/test_ops.py::test_core_vs_torch_consistency_atan2_nvfuser_cuda_thunder::dtypes::float16
[20250828-13:18:06.507199] thunder/tests/test_ops.py::test_core_vs_torch_consistency_atan_torch_cuda_thunder::dtypes::bfloat16
[gw3] [  2%] PASSED [20250828-13:18:04.925098] thunder/tests/test_ops.py::test_core_vs_torch_consistency_tensor_split_nvfuser_cuda_thunder::dtypes::bfloat16
[20250828-13:18:06.647222] thunder/tests/test_ops.py::test_core_vs_torch_consistency_flatten_torch_cuda_thunder::dtypes::bool8
[gw8] [  2%] PASSED [20250828-13:17:55.427328] thunder/tests/test_ops.py::test_core_vs_torch_consistency_flip_torch_cuda_thunder::dtypes::int8
[gw0] [  2%] PASSED [20250828-13:18:03.606331] thunder/tests/test_ops.py::test_core_vs_torch_consistency_scaled_dot_product_attention_torch_cuda_thunder::dtypes::float32
[20250828-13:18:07.046140] thunder/tests/test_ops.py::test_core_vs_torch_consistency_torch_transpose_torch_cuda_thunder::dtypes::int8
[gw3] [  2%] PASSED [20250828-13:18:06.647222] thunder/tests/test_ops.py::test_core_vs_torch_consistency_flatten_torch_cuda_thunder::dtypes::bool8
[20250828-13:18:07.111283] thunder/tests/test_ops.py::test_core_vs_torch_consistency_outer_nvfuser_cuda_thunder::dtypes::complex128
[gw3] [  2%] SKIPPED [20250828-13:18:07.111283] thunder/tests/test_ops.py::test_core_vs_torch_consistency_outer_nvfuser_cuda_thunder::dtypes::complex128
[20250828-13:18:07.114364] thunder/tests/test_ops.py::test_errors_ldexp_nvfuser_cuda_thunder::dtypes::float32
[gw3] [  2%] PASSED [20250828-13:18:07.114364] thunder/tests/test_ops.py::test_errors_ldexp_nvfuser_cuda_thunder::dtypes::float32
[20250828-13:18:07.164153] thunder/tests/test_ops.py::test_core_vs_torch_consistency_type_as_torch_cuda_thunder::dtypes::uint8
[20250828-13:18:07.167023] thunder/tests/test_ops.py::test_errors_broadcast_in_dim_torch_cuda_thunder::dtypes::float16
[gw8] [  2%] XPASS [20250828-13:18:07.167023] thunder/tests/test_ops.py::test_errors_broadcast_in_dim_torch_cuda_thunder::dtypes::float16
[20250828-13:18:07.576856] thunder/tests/test_ops.py::test_core_vs_torch_consistency_t_nvfuser_cuda_thunder::dtypes::complex128
[gw8] [  2%] SKIPPED [20250828-13:18:07.576856] thunder/tests/test_ops.py::test_core_vs_torch_consistency_t_nvfuser_cuda_thunder::dtypes::complex128
[20250828-13:18:07.589380] thunder/tests/test_ops.py::test_core_vs_torch_consistency_amin_torch_cuda_thunder::dtypes::uint8
[gw0] [  2%] PASSED [20250828-13:18:07.046140] thunder/tests/test_ops.py::test_core_vs_torch_consistency_torch_transpose_torch_cuda_thunder::dtypes::int8
[20250828-13:18:07.622674] thunder/tests/test_ops.py::test_errors_bernoulli_nvfuser_cuda_thunder::dtypes::float16
[gw6] [  2%] XFAIL [20250828-13:18:02.678387] thunder/tests/test_ops.py::test_core_vs_torch_consistency_zeta_nvfuser_cuda_thunder::dtypes::float16
[20250828-13:18:07.654463] thunder/tests/test_ops.py::test_errors_convolution_torch_cuda_thunder::dtypes::float32
[gw0] [  2%] PASSED [20250828-13:18:07.622674] thunder/tests/test_ops.py::test_errors_bernoulli_nvfuser_cuda_thunder::dtypes::float16
[20250828-13:18:07.903225] thunder/tests/test_ops.py::test_errors_conv2d_torch_cuda_thunder::dtypes::complex64
[gw8] [  2%] PASSED [20250828-13:18:07.589380] thunder/tests/test_ops.py::test_core_vs_torch_consistency_amin_torch_cuda_thunder::dtypes::uint8
…(truncated)