Revert "Revert "Qualcomm AI Engine Direct - CI for Non-LLM GA model" …

[winskuo-quic]

…(#12166)"

This reverts commit 9554826.

Summary

[PLEASE REMOVE] See CONTRIBUTING.md's Pull Requests for ExecuTorch PR guidelines.

[PLEASE REMOVE] If this PR closes an issue, please add a Fixes #<issue-id> line.

[PLEASE REMOVE] If this PR introduces a fix or feature that should be the upcoming release notes, please add a "Release notes: " label. For a list of available release notes labels, check out CONTRIBUTING.md's Pull Requests.

Test plan

[PLEASE REMOVE] How did you test this PR? Please write down any manual commands you used and note down tests that you have written if applicable.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/12536

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure, 1 Unrelated Failure

As of commit dffd733 with merge base 0c8879e ():

NEW FAILURE - The following job has failed:

• trunk / test-models-linux-aarch64 (resnet18, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t b7397d0f77a13edc4e599f030ae4643a9284b0b34ade08c5baa8e0a5ab884130 /exec failed with exit code 1

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• trunk / test-models-macos-coreml (emformer_transcribe) / macos-job (gh) (trunk failure)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

[winskuo-quic]

Hi @cccclai,
Sorry for the late reland on: #12166
I have been working on finding the root cause of timeout for certain models in this PR: #12191.
With the same config, it took only 1 minute to lower the model on my workstation. That is why I think higher timeout won't help resolving the issue.
In this PR with newest mainline, the CI seems to be working fine again.
However, I still couldn't find the reason that is causing the previous hang.
By any chance, can you see additional logs causing the hang on your side for this PR? #12191
I think if the root cause can be found, we can better prevent timeout from happening again in the future.
The model that is hanging previously was deit and dit.

[cccclai]

After discussion offline, we will remove the timeout model and only enable the pass models for now

[cccclai]

Thanks