Move pull.yml to linux_job_v3 - #22247
Conversation
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/22247
Note: Links to docs will display an error until the docs builds have been completed. ❌ 1 New Failure, 2 Unrelated Failures, 1 Unclassified FailureAs of commit 01e69e9 with merge base f665a3b ( NEW FAILURE - The following job has failed:
UNCLASSIFIED FAILURE - DrCI could not classify the following job because the workflow did not run on the merge base. The failure may be pre-existing on trunk or introduced by this PR:
FLAKY - The following job failed but was likely due to flakiness present on trunk:
BROKEN TRUNK - The following job failed but was present on the merge base:👉 Rebase onto the `viable/strict` branch to avoid these failures
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
9605234 to
920dfbe
Compare
920dfbe to
bd18ec6
Compare
bd18ec6 to
8830186
Compare
8830186 to
03079a2
Compare
03079a2 to
0ce31ae
Compare
45 call sites, all mechanical: the v2 -> v3 rename, EC2 runner labels swapped for their OSDC equivalents, and the ECR image spelled out against the hash _docker-image.yml resolves. Authored with Claude Code.
fb43bb2 to
878e10a
Compare
|
Last commit temporarily points pull.yml's 45 The job to watch is Worth knowing what this run can and cannot prove: this PR triggers a |
`auto` and `logical` both resolve through psutil.cpu_count(), which reports the machine's cores and ignores the container's CPU limit. On an 8 vCPU OSDC pod that meant 64 workers in test-arm-backend-no-driver, which exhausted the memory limit and got the container OOMKilled, and enough workers in unittest-nxp-neutron to starve the aot_neutron_compile tests past their 300 second subprocess timeout. pytest-parallelism.sh exports PYTEST_XDIST_AUTO_NUM_WORKERS, which xdist checks ahead of psutil, from nproc. nproc honours the pod's cpuset, which is what pytorch relies on for OMP_NUM_THREADS on the same fleet (.ci/pytorch/test.sh, USE_ARC block). Off OSDC it is the machine count, so this is a no-op there. Sourced from the four scripts that let xdist size itself. The variable governs `-n logical` as well, despite its name. Authored with Claude Code.
Exercises the HF cache mode fix on test-models-linux, which is one of the jobs failing on the read-only mount. Revert to @main before landing. Authored with Claude Code.
|
Pushed the
Verified the variable governs Re-grepped for both spellings across From the previous run on this branch, the two job families that were failing are green: |
Third of six splitting up #22107. Stacked on #22246.
45 call sites in one file, all mechanical: the v2 -> v3 rename, EC2 runner labels swapped for their OSDC equivalents,
use-custom-docker-registrydropped since v3 ignores it, and the ECR image spelled out against the hash_docker-image.ymlresolves.linux.2xlarge,linux.2xlarge.memorymt-l-x86iavx512-8-64linux.4xlarge.memorymt-l-x86iavx512-16-128linux.24xlargemt-l-x86iavx512-94-192linux.24xlarge.memorymt-l-x86iavx512-94-768linux.arm64.2xlargemt-l-arm64g4-16-62linux.g5.4xlarge.nvidia.gpumt-l-x86aavx2-29-113-a10gAuthored with Claude Code.
cc @digantdesai @freddan80 @per @zingo @oscarandersson8218 @mansnils @Sebastian-Larsson @robell @rascani