d-flex flex-column width-full">

Intorduce TextLLMRunner. (#12055)

0624c5c

Select commit

Loading

Failed to load commit list.

Uh oh!

There was an error while loading. Please reload this page.

Sign in for the full log view

Check Labels on: pull_request_target

Check labels

Facebook GitHub Tools

Facebook CLA Check

Meta Import Checks

Meta Internal-Only Changes Check

Apple on: pull_request

set-version

build-demo-ios

build-benchmark-app

build-frameworks-ios / macos-job

upload-demo-ios

upload-frameworks-ios

test-demo-ios

Build documentation on: pull_request

build (buck2) / Build doc

upload-gh-pages

Build Presets on: pull_request

apple (macos) / build

apple (ios) / build

apple (ios-simulator) / build

apple (pybind) / build

apple (llm) / build

linux (linux, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build

linux (linux, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build

linux (pybind, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build

linux (pybind, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build

linux (llm, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build

linux (llm, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build

windows (pybind) / build

Lint on: pull_request

lintrunner / linux-job

link-check / lint-urls / linux-job

link-check / lint-xrefs / linux-job

android-java-format / linux-job

Build Linux Wheels on: pull_request

generate-matrix / generate

pytorch/executorch / build-manywheel-py3_10-cpu

pytorch/executorch / upload / upload-manywheel-py3_10-cpu

Build macOS Wheels on: pull_request 5

generate-matrix / generate

pytorch/executorch / build-wheel-py3_10-cpu

pytorch/executorch / upload / upload-wheel-py3_10-cpu

pull on: pull_request 4

test-setup-linux-gcc / linux-job

test-models-linux-basic (mv3, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-models-linux-basic (mv3, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job

test-models-linux-basic (mv3, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job

test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job

test-models-linux-basic (mv3, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job

test-models-linux-basic (vit, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-models-linux-basic (vit, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job

test-models-linux-basic (vit, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job

test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job

test-models-linux-basic (vit, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job

test-models-linux (linear, portable, linux.2xlarge) / linux-job

test-models-linux (linear, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (add, portable, linux.2xlarge) / linux-job

test-models-linux (add, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (add_mul, portable, linux.2xlarge) / linux-job

test-models-linux (add_mul, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (ic3, portable, linux.2xlarge) / linux-job

test-models-linux (ic3, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (mv2, portable, linux.2xlarge) / linux-job

test-models-linux (mv2, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (resnet18, portable, linux.2xlarge) / linux-job

test-models-linux (resnet18, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (resnet50, portable, linux.2xlarge) / linux-job

test-models-linux (resnet50, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (mobilebert, portable, linux.2xlarge) / linux-job

test-models-linux (mobilebert, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (emformer_transcribe, portable, linux.2xlarge) / linux-job

test-models-linux (emformer_transcribe, xnnpack-quantization-delegation, linux.2xlarge) / linux-job

test-models-linux (ic4, portable, linux.4xlarge.memory) / linux-job

test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job

test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job

test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job

test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job

test-models-linux (llama3_2_vision_encoder, portable, linux.4xlarge.memory) / linux-job

test-models-linux (w2l, portable, linux.4xlarge.memory) / linux-job

test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.arm64.2xlarge, executorch-ubuntu-22.04-gc... / linux-job

test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04... / linux-job

test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu... / linux-job

test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu-22.04-... / linux-job

test-llama-runner-linux (bf16, custom, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-llama-runner-linux-android / linux-job

test-custom-ops-linux / linux-job

test-selective-build-linux / linux-job

test-llava-runner-linux / linux-job

test-moshi-linux / linux-job

test-quantized-aot-lib-linux / linux-job

test-binary-size-linux-gcc / linux-job

test-binary-size-linux / linux-job

android / build-llm-demo / linux-job

android / run-emulator

unittest / linux / linux-job

unittest / macos / macos-job

unittest-editable / linux / linux-job

unittest-editable / macos / macos-job

unittest-buck / linux / linux-job

unittest-buck / macos / macos-job

unittest-arm-backend-with-no-fvp (test_pytest_ops) / linux-job

unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job

test-llama-runner-qnn-linux (fp32, qnn_16a16w, qnn) / linux-job

test-llama-runner-qnn-linux (fp32, qnn_8a8w, qnn) / linux-job

test-static-llama-qnn-linux / linux-job

test-qnn-models-linux / linux-job

test-phi-3-mini-runner-linux / linux-job

test-eval_llama-wikitext-linux / linux-job

test-eval_llama-mmlu-linux / linux-job

test-llama_runner_eager-linux / linux-job

test-mediatek-models-linux / linux-job

test-openvino-linux / linux-job

Apple on: push 3

set-version

build-demo-ios / macos-job

build-benchmark-app / macos-job

build-frameworks-ios / macos-job

upload-demo-ios

upload-frameworks-ios

test-demo-ios / mobile-job (ios)

trunk on: push 23

test-models-macos (emformer_join, xnnpack-quantization-delegation) / macos-job

test-models-macos (ic4, xnnpack-quantization-delegation) / macos-job

test-models-macos (llama2, xnnpack-quantization-delegation) / macos-job

test-models-macos (mobilebert, xnnpack-quantization-delegation) / macos-job

test-models-macos (mv3, xnnpack-quantization-delegation) / macos-job

test-models-macos (resnet50, xnnpack-quantization-delegation) / macos-job

test-models-macos (vit, xnnpack-quantization-delegation) / macos-job

test-models-macos (w2l, xnnpack-quantization-delegation) / macos-job

test-models-macos (efficient_sam, portable) / macos-job

test-models-macos (llama, portable) / macos-job

test-models-macos (llama3_2_vision_encoder, portable) / macos-job

test-models-macos (mv3, portable) / macos-job

test-models-linux-aarch64 (linear, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (linear, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (add, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (add, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (add_mul, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (add_mul, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (ic3, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (ic3, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (ic4, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (ic4, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (mv2, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (mv2, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (mv3, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (mv3, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (resnet18, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (resnet18, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (resnet50, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (resnet50, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (vit, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (vit, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (w2l, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (w2l, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (mobilebert, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (mobilebert, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (emformer_join, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (emformer_join, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (emformer_transcribe, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (emformer_transcribe, xnnpack-quantization-delegation, linux.arm64.2xla... / linux-job

test-models-linux-aarch64 (lstm, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (mul, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (softmax, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (phi_4_mini, portable, linux.arm64.m7g.4xlarge) / linux-job

test-models-linux-aarch64 (qwen2_5, portable, linux.arm64.2xlarge) / linux-job

test-models-linux-aarch64 (llama3_2_vision_encoder, portable, linux.arm64.2xlarge) / linux-job

test-custom-ops-macos (cmake) / macos-job

test-selective-build-macos (cmake) / macos-job

test-demo-backend-delegation (buck2) / linux-job

test-demo-backend-delegation (cmake) / linux-job

test-arm-backend (test_pytest_ops_ethosu_fvp) / linux-job

test-arm-backend (test_pytest_models_ethosu_fvp) / linux-job

test-arm-backend (test_run_ethosu_fvp) / linux-job

test-arm-backend (test_models_tosa) / linux-job

test-arm-backend (test_models_ethos-u55) / linux-job

test-arm-backend (test_models_ethos-u85) / linux-job

test-arm-cortex-m-size-test / linux-job

test-coreml-delegate / macos-job

test-static-llama-ane / macos-job

test-llama-torchao-lowbit / macos-job

test-llama-runner-linux (fp32, portable, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-llama-runner-linux (fp32, portable, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / linux-job

test-llama-runner-linux (fp32, xnnpack+custom, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-llama-runner-linux (fp32, xnnpack+custom, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job

test-llama-runner-linux (bf16, portable, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job

test-llama-runner-linux (bf16, portable, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / linux-job

test-llama-runner-linux (bf16, custom, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / linux-job

test-llama-runner-mac (fp32, mps) / macos-job

test-llama-runner-mac (fp32, coreml) / macos-job

test-llama-runner-mac (fp32, xnnpack+custom+quantize_kv) / macos-job

test-qnn-model (fp32, dl3) / linux-job

test-qnn-model (fp32, mv3) / linux-job

test-qnn-model (fp32, mv2) / linux-job

test-qnn-model (fp32, ic4) / linux-job

test-qnn-model (fp32, ic3) / linux-job

test-qnn-model (fp32, vit) / linux-job

test-qnn-model (fp32, mb) / linux-job

test-qnn-model (fp32, w2l) / linux-job

test-qnn-optimum-model (fp32, albert) / linux-job

test-qnn-optimum-model (fp32, bert) / linux-job

test-qnn-optimum-model (fp32, distilbert) / linux-job

test-apple-model / macos-job

test-huggingface-transformers (google/gemma-3-1b-it) / linux-job

test-huggingface-transformers (Qwen/Qwen3-0.6B) / linux-job

test-huggingface-transformers (HuggingFaceTB/SmolLM2-135M) / linux-job

test-huggingface-transformers (meta-llama/Llama-3.2-1B) / linux-job

test-huggingface-transformers (allenai/OLMo-1B-hf) / linux-job

test-llama-runner-qnn-linux (fp32, qnn_16a16w, qnn) / linux-job

test-llama-runner-qnn-linux (fp32, qnn_8a8w, qnn) / linux-job

unittest-release / linux / linux-job

unittest-release / macos / macos-job

unittest-nxp-neutron / linux-job

PyTorch Bot

Dr.CI

The logs for this run have expired and are no longer available.

Loading

Re-running jobs...