Skip to content

Arm backend: Rename test_arm_baremetal.sh to test_arm_backend.sh #19665

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
zingo merged 5 commits into from
May 19, 2026
Merged

Arm backend: Rename test_arm_baremetal.sh to test_arm_backend.sh #19665

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
348d08e
Arm backend: Rename test_arm_baremetal.sh to test_arm_backend.sh
zingo May 18, 2026
939977b
Potential fix for pull request finding
zingo May 19, 2026
5f404bd
Potential fix for pull request finding
zingo May 19, 2026
238b34e
Potential fix for pull request finding
zingo May 19, 2026
68abe96
Potential fix for pull request finding
zingo May 19, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 7 additions & 7 deletions .github/workflows/pull.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -717,10 +717,10 @@ jobs:
strategy:
matrix:
include:
- test_arm_baremetal: test_pytest_ops_no_target
- test_arm_baremetal: test_pytest_ops_tosa
- test_arm_baremetal: test_pytest_models_tosa
- test_arm_baremetal: test_run_tosa
- test_arm_backend: test_pytest_ops_no_target
- test_arm_backend: test_pytest_ops_tosa
- test_arm_backend: test_pytest_models_tosa
- test_arm_backend: test_run_tosa
fail-fast: false
with:
runner: linux.2xlarge
Expand All @@ -738,10 +738,10 @@ jobs:

.ci/scripts/setup-arm-baremetal-tools.sh --disable-ethos-u-deps

ARM_TEST=${{ matrix.test_arm_baremetal }}
ARM_TEST=${{ matrix.test_arm_backend }}

# Test test_arm_baremetal.sh with test
backends/arm/test/test_arm_baremetal.sh "${ARM_TEST}"
# Test test_arm_backend.sh with test
backends/arm/test/test_arm_backend.sh "${ARM_TEST}"

test-llama-runner-qnn-linux:
name: test-llama-runner-qnn-linux
Expand Down
28 changes: 14 additions & 14 deletions .github/workflows/trunk.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -349,14 +349,14 @@ jobs:
strategy:
matrix:
include:
- test_arm_baremetal: test_pytest_ops_ethos_u55
- test_arm_baremetal: test_pytest_models_ethos_u55
- test_arm_baremetal: test_run_ethos_u55
- test_arm_baremetal: test_pytest_ops_ethos_u85
- test_arm_baremetal: test_pytest_models_ethos_u85
- test_arm_baremetal: test_run_ethos_u85
- test_arm_baremetal: test_smaller_stories_llama
- test_arm_baremetal: test_memory_allocation
- test_arm_backend: test_pytest_ops_ethos_u55
- test_arm_backend: test_pytest_models_ethos_u55
- test_arm_backend: test_run_ethos_u55
- test_arm_backend: test_pytest_ops_ethos_u85
- test_arm_backend: test_pytest_models_ethos_u85
- test_arm_backend: test_run_ethos_u85
- test_arm_backend: test_smaller_stories_llama
- test_arm_backend: test_memory_allocation
fail-fast: false
with:
runner: linux.2xlarge.memory
Expand All @@ -378,15 +378,15 @@ jobs:
# Hopefully this is high enough for this setup.
sudo sysctl fs.inotify.max_user_watches=1048576 # 1024 * 1024

ARM_TEST=${{ matrix.test_arm_baremetal }}
ARM_TEST=${{ matrix.test_arm_backend }}

# Output test report on pytest runs so that github can surface failing tests.
if [[ -n "${RUNNER_TEST_RESULTS_DIR:-}" ]]; then
export PYTEST_ADDOPTS="--junit-xml=${RUNNER_TEST_RESULTS_DIR}/${ARM_TEST}.xml ${PYTEST_ADDOPTS:-}"
fi

# Test test_arm_baremetal.sh with test
backends/arm/test/test_arm_baremetal.sh "${ARM_TEST}"
# Test test_arm_backend.sh with test
backends/arm/test/test_arm_backend.sh "${ARM_TEST}"

test-arm-backend-vkml:
name: test-arm-backend-vkml
Expand All @@ -397,7 +397,7 @@ jobs:
strategy:
matrix:
include:
- test_arm_baremetal: test_pytest_ops_vkml
- test_arm_backend: test_pytest_ops_vkml
fail-fast: false
with:
runner: linux.2xlarge.memory
Expand All @@ -418,14 +418,14 @@ jobs:
# Hopefully this is high enough for this setup.
sudo sysctl fs.inotify.max_user_watches=1048576 # 1024 * 1024

ARM_TEST=${{ matrix.test_arm_baremetal }}
ARM_TEST=${{ matrix.test_arm_backend }}

# Output test report on pytest runs so that github can surface failing tests.
if [[ -n "${RUNNER_TEST_RESULTS_DIR:-}" ]]; then
export PYTEST_ADDOPTS="--junit-xml=${RUNNER_TEST_RESULTS_DIR}/${ARM_TEST}.xml ${PYTEST_ADDOPTS:-}"
fi

backends/arm/test/test_arm_baremetal.sh "${ARM_TEST}"
backends/arm/test/test_arm_backend.sh "${ARM_TEST}"

test-arm-ootb-linux:
name: test-arm-ootb-linux
Expand Down
42 changes: 21 additions & 21 deletions backends/arm/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -186,34 +186,34 @@ ssh -p 2222 root@127.0.0.1 -t "/tmp/executor_runner -model_path /tmp/add_arm_del

There are two approaches for running the tests for the Arm backend. This section will explain these two approaches:

### Using test_arm_baremetal.sh
### Using test_arm_backend.sh

The backend provides a script `backends/arm/test/test_arm_baremetal.sh`, which is used in the `trunk` CI workflow.
The backend provides a script `backends/arm/test/test_arm_backend.sh`, which is used in the `trunk` CI workflow.
This approach is useful for checking your change against this workflow on your own machine.
These scripts also install the necessary dependencies to run the tests.
Comment thread
zingo marked this conversation as resolved.
Comment thread
zingo marked this conversation as resolved.
Below is an overview of some of the testing options this script provides:

| Command | Description |
| ---------------------------------------------------- | ------------------------------------------------------------ |
| `test_arm_baremetal.sh test_pytest_ops_no_target` | Runs operator unit tests for non-target specific use-cases. |
| `test_arm_baremetal.sh test_pytest_models_no_target` | Runs model unit tests for non-target specific use-cases. |
| `test_arm_baremetal.sh test_pytest_ops_tosa` | Runs operator unit tests for TOSA specific use-cases. |
| `test_arm_baremetal.sh test_pytest_models_tosa` | Runs model unit tests for TOSA specific use-cases. |
| `test_arm_baremetal.sh test_run_tosa` | Runs end-to-end unit tests for TOSA specific use-cases. |
| `test_arm_baremetal.sh test_pytest_ops_ethos_u55` | Runs operator unit tests for Ethos-U55 specific use-cases. |
| `test_arm_baremetal.sh test_pytest_models_ethos_u55` | Runs model unit tests for Ethos-U55 specific use-cases. |
| `test_arm_baremetal.sh test_run_ethos_u55` | Runs end-to-end unit tests for Ethos-U55 specific use-cases. |
| `test_arm_baremetal.sh test_pytest_ops_ethos_u85` | Runs operator unit tests for Ethos-U85 specific use-cases. |
| `test_arm_baremetal.sh test_pytest_models_ethos_u85` | Runs model unit tests for Ethos-U85 specific use-cases. |
| `test_arm_baremetal.sh test_run_ethos_u85` | Runs end-to-end unit tests for Ethos-U85 specific use-cases. |
| `test_arm_baremetal.sh test_pytest_ops_vkml` | Runs operator unit tests for VGF specific use-cases. |
| `test_arm_baremetal.sh test_pytest_models_vkml` | Runs model unit tests for VGF specific use-cases. |
| `test_arm_baremetal.sh test_run_vkml` | Runs end-to-end unit tests for VGF specific use-cases. |
| `test_arm_baremetal.sh test_model_smollm2-135M` | Runs some models with Corstone FVP. |
| `test_arm_baremetal.sh test_smaller_stories_llama` | Runs E2E model tests on Corstone FVP. |
| `test_arm_baremetal.sh test_memory_allocation` | Runs memory allocation tests for Ethos-U specific targets |

For more information, please refer to the `backends/arm/test/test_arm_baremetal.sh` script.
| `test_arm_backend.sh test_pytest_ops_no_target` | Runs operator unit tests for non-target specific use-cases. |
| `test_arm_backend.sh test_pytest_models_no_target` | Runs model unit tests for non-target specific use-cases. |
| `test_arm_backend.sh test_pytest_ops_tosa` | Runs operator unit tests for TOSA specific use-cases. |
| `test_arm_backend.sh test_pytest_models_tosa` | Runs model unit tests for TOSA specific use-cases. |
| `test_arm_backend.sh test_run_tosa` | Runs end-to-end unit tests for TOSA specific use-cases. |
| `test_arm_backend.sh test_pytest_ops_ethos_u55` | Runs operator unit tests for Ethos-U55 specific use-cases. |
| `test_arm_backend.sh test_pytest_models_ethos_u55` | Runs model unit tests for Ethos-U55 specific use-cases. |
| `test_arm_backend.sh test_run_ethos_u55` | Runs end-to-end unit tests for Ethos-U55 specific use-cases. |
| `test_arm_backend.sh test_pytest_ops_ethos_u85` | Runs operator unit tests for Ethos-U85 specific use-cases. |
| `test_arm_backend.sh test_pytest_models_ethos_u85` | Runs model unit tests for Ethos-U85 specific use-cases. |
| `test_arm_backend.sh test_run_ethos_u85` | Runs end-to-end unit tests for Ethos-U85 specific use-cases. |
| `test_arm_backend.sh test_pytest_ops_vkml` | Runs operator unit tests for VGF specific use-cases. |
| `test_arm_backend.sh test_pytest_models_vkml` | Runs model unit tests for VGF specific use-cases. |
| `test_arm_backend.sh test_run_vkml` | Runs end-to-end unit tests for VGF specific use-cases. |
| `test_arm_backend.sh test_model_smollm2_135M` | Runs some models with Corstone FVP. |
| `test_arm_backend.sh test_smaller_stories_llama` | Runs E2E model tests on Corstone FVP. |
| `test_arm_backend.sh test_memory_allocation` | Runs memory allocation tests for Ethos-U specific targets |

Comment thread
zingo marked this conversation as resolved.
For more information, please refer to the `backends/arm/test/test_arm_backend.sh` script.

### Using pytest

Expand Down
Loading
Loading