Move transformer base definition to extension/llm

[jackzhxng]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/11917

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• VolumeLimitExceeded Issue for linux.2xlarge and linux.4xlarge

❌ 47 New Failures

As of commit f65b648 with merge base 77a7ace ():

NEW FAILURES - The following jobs have failed:

• pull / android / build-llm-demo / linux-job (gh)
  RuntimeError: Command docker exec -t 267518960e58e9f690552a1c9297be8b6abc3fb685532dbc47b9f9a25b888d9b /exec failed with exit code 1
• pull / test-eval_llama-mmlu-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 539afc1137ae57138b56d82a8ad5b0867feebb8b59e55a54702f524f743c1e50 /exec failed with exit code 1
• pull / test-eval_llama-wikitext-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 12953d925ce15044d3c0f2804c36d88d63891220e7394d9c880294cc1b861aa0 /exec failed with exit code 1
• pull / test-llama_runner_eager-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 63ae5b8ecfdd9afd5c9cd8482d266b43b55cc65b04561afcc2b32b5b89d15205 /exec failed with exit code 1
• pull / test-llama-runner-linux (bf16, custom, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t 10c08f8582e1d6e360be22a927ae11dc7632575734b0b0e01035f5c58de1b34a /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t 41e56dc70ea42451a8f63a3ef4aa557705aa862a9c208a21a97279a06cea8619 /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.arm64.2xlarge, executorch-ubuntu-22.04-gc... / linux-job (gh)
  RuntimeError: Command docker exec -t fe71560b6f30d2329234e71eae0b247d0f106ba31a88c7fe07562c935adc654c /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04... / linux-job (gh)
  RuntimeError: Command docker exec -t 011b8413dc2bacca50d2aeaae46e6c2b7e37a02f2d2078ac0c10c3ef9bf1126a /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu... / linux-job (gh)
  RuntimeError: Command docker exec -t 6c3dd2129f3eb576846018dac83779d285a9b8f75b41cfc40e6cc13d14a5d3ad /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t f4a288813d0adb545f3af321667fbfca3d70c4e35ba98f661eed717917104afa /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu-22.04-... / linux-job (gh)
  RuntimeError: Command docker exec -t df400d8c0df5db4bc24bc498b4817ef664fc591fda20429536746ade0dacb3e5 /exec failed with exit code 1
• pull / test-llama-runner-qnn-linux (fp32, qnn_16a16w, qnn) / linux-job (gh)
  RuntimeError: Command docker exec -t b8b9ce82bc4c5d89f83a807175f755afb55d873207e802d6453f37dbaa47695b /exec failed with exit code 1
• pull / test-llama-runner-qnn-linux (fp32, qnn_8a8w, qnn) / linux-job (gh)
  RuntimeError: Command docker exec -t b5d5bb38f2101eb873b70c45713e429c51bc8a969157ccd39c8e91cd5d8f1a70 /exec failed with exit code 1
• pull / test-llava-runner-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 9ee2a0eed6162e860df87bf2362f72215351185ae298bf0a77536fa67116fa31 /exec failed with exit code 1
• pull / test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t d3ea6980c9df43513f84704d4d84f38a996465686be14eb5b42df2086ababe09 /exec failed with exit code 1
• pull / test-static-llama-qnn-linux / linux-job (gh)
  RuntimeError: Command docker exec -t c88c75ef9c48663fb451619191fc7332e8f1658f607f5a50c5278179afd1aeb7 /exec failed with exit code 1
• pull / unittest / linux / linux-job (gh)
  backends/xnnpack/test/ops/test_gelu.py::TestGelu::test_fp16_gelu
• pull / unittest / macos / macos-job (gh)
  examples/models/llama/config/test_llm_config.py::TestValidConstruction::test_valid_llm_config
• pull / unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job (gh)
  RuntimeError: Command docker exec -t 2838f0a026d16713bee68482a16b64fa602dfcd50d4ae1188460d388a1cd27ea /exec failed with exit code 2
• pull / unittest-editable / linux / linux-job (gh)
  examples/models/llama/config/test_llm_config.py::TestValidConstruction::test_valid_llm_config
• pull / unittest-editable / macos / macos-job (gh)
  backends/xnnpack/test/ops/test_exp.py::TestExp::test_fp16_exp
• trunk / test-arm-backend (test_pytest_models_ethosu_fvp) / linux-job (gh)
  RuntimeError: Command docker exec -t 08d5fff8def9aa3975e0960f78a2243f3f76f605c8d738d2a793e6dc91c02a4b /exec failed with exit code 2
• trunk / test-huggingface-transformers (allenai/OLMo-1B-hf) / linux-job (gh)
  RuntimeError: Command docker exec -t e7751f92e57f0002631dba81d4858e95ab1c320268a85128e3ecf00765caf226 /exec failed with exit code 1
• trunk / test-huggingface-transformers (google/gemma-3-1b-it) / linux-job (gh)
  RuntimeError: Command docker exec -t 1ec13caa9a95c6848c27f373d86df49dd31067c6ac810f5ee319771e400b6b72 /exec failed with exit code 1
• trunk / test-huggingface-transformers (HuggingFaceTB/SmolLM2-135M) / linux-job (gh)
  RuntimeError: Command docker exec -t 58d5c363ca0c41d161b2fc12cc29b300481e2b32e5bd5caeee0c27c0fac7fc81 /exec failed with exit code 1
• trunk / test-huggingface-transformers (meta-llama/Llama-3.2-1B) / linux-job (gh)
  RuntimeError: Command docker exec -t b201b04d405e18708481a2cf0faa3c7478d8733399936997fc7673c4a26d9ccc /exec failed with exit code 1
• trunk / test-huggingface-transformers (Qwen/Qwen3-0.6B) / linux-job (gh)
  RuntimeError: Command docker exec -t 59668a94f2127edd14df379bafa937cc5b36593b51a26c8f70c5984f1b2f6277 /exec failed with exit code 1
• trunk / test-llama-runner-linux (bf16, custom, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / linux-job (gh)
  RuntimeError: Command docker exec -t b87e548d85ce439188f4f582b4bf5547690c65edaf8f27cf7146e7d092d61132 /exec failed with exit code 1
• trunk / test-llama-runner-linux (bf16, portable, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t 4e19e18650726e36b2b91eb8a3d53467a49a37d2b5dd1b00c61a1ffabe800aea /exec failed with exit code 1
• trunk / test-llama-runner-linux (bf16, portable, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / linux-job (gh)
  RuntimeError: Command docker exec -t 5d6ca385a103f543488d13e2380ac9ee9e6a530b40eec93627f88de257084747 /exec failed with exit code 1
• trunk / test-llama-runner-linux (fp32, portable, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t 4ce0ccd4e7fe7fbfd9dfd1eb67cce91f9a747467033d9e68fd5d9da10113f4de /exec failed with exit code 1
• trunk / test-llama-runner-linux (fp32, portable, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / linux-job (gh)
  RuntimeError: Command docker exec -t e6277942667675fce5517173b224c220fff56ae3a81308d112cdd947662fa5cb /exec failed with exit code 1
• trunk / test-llama-runner-linux (fp32, xnnpack+custom, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t 1678724bd1abe7d6512bdd533c991d51244ad7b5e5ae7b944266cb735cbf1e28 /exec failed with exit code 1
• trunk / test-llama-runner-linux (fp32, xnnpack+custom, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job (gh)
  RuntimeError: Command docker exec -t a4a5c01de34786de41309840f40c1ce105cf560ac92a82286a0802e4c9c8d42c /exec failed with exit code 1
• trunk / test-llama-runner-mac (fp32, coreml) / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• trunk / test-llama-runner-mac (fp32, mps) / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• trunk / test-llama-runner-mac (fp32, xnnpack+custom+quantize_kv) / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• trunk / test-llama-runner-qnn-linux (fp32, qnn_16a16w, qnn) / linux-job (gh)
  RuntimeError: Command docker exec -t 3c5713cfc3f973388dcfad8d3e256448676e2b739b5eae5f838dbcc57745e099 /exec failed with exit code 1
• trunk / test-llama-runner-qnn-linux (fp32, qnn_8a8w, qnn) / linux-job (gh)
  RuntimeError: Command docker exec -t 3ae9be73e71a00d5c48f0dbc56ea7a0d6570288e5e1de32ede0d2d31dfc4e3ca /exec failed with exit code 1
• trunk / test-llama-torchao-lowbit / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• trunk / test-models-linux-aarch64 (phi_4_mini, portable, linux.arm64.m7g.4xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t e3b8bdd04e35a476dfcd9e30c1dbb896900076548feb8068aa82327838cf2c9f /exec failed with exit code 1
• trunk / test-models-linux-aarch64 (qwen2_5, portable, linux.arm64.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 39bdbff07de23fe7af59b7f374a7db1d655e48680dc8384b6b74e34933f35740 /exec failed with exit code 1
• trunk / test-models-macos (llama, portable) / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• trunk / test-models-macos (llama2, xnnpack-quantization-delegation) / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• trunk / test-static-llama-ane / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• trunk / unittest-release / linux / linux-job (gh)
  examples/models/llama/config/test_llm_config.py::TestValidConstruction::test_valid_llm_config
• trunk / unittest-release / macos / macos-job (gh)
  examples/models/llama/config/test_llm_config.py::TestValidConstruction::test_valid_llm_config

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[digantdesai]

Is it mainly mechanical move? I see bunch of CI failures, also added trunk tag to make sure we don't regress silently on other jobs.

[digantdesai]

can we use git mv to preserve the history better? I saw the import error message update, perhaps that's why you didn't do it?

[jackzhxng]

I'll try, I just forgot to do git mv this time

[mergennachin]

let's not make the extension/llm/modeling/text_decoder/decoder_model.py move. There are too many examples and meta specific stuff there... let's keep it in examples

[mergennachin]

Why did you not move llama_transformer.py to extension inside?

[github-actions]

Looks like this PR hasn't been updated in a while so we're going to go ahead and mark this as Stale.
Feel free to remove the Stale label if you feel this was a mistake.
If you are unable to remove the Stale label please contact a maintainer in order to do so.
If you want the bot to never mark this PR stale again, add the no-stale label.
Stale pull requests will automatically be closed after 30 days of inactivity.