[Executorch][LLM] Use caching allocator for runner #15710

kimishpatel · 2025-11-10T17:18:21Z

Stack from ghstack (oldest at bottom):

We observed that on iOS it improves perf by 6% because SDPA op does temp allocations.

No significant difference on android though.

Differential Revision: D86120038

We observed that on iOS it improves perf by 6% because SDPA op does temp allocations. No significant difference on android though. Differential Revision: [D86120038](https://our.internmc.facebook.com/intern/diff/D86120038/) [ghstack-poisoned]

pytorch-bot · 2025-11-10T17:18:24Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/15710

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 127 New Failures, 1 Unrelated Failure

As of commit c826be1 with merge base aba44fd ():

NEW FAILURES - The following jobs have failed:

Build documentation / build (buck2) / Build doc (gh)
RuntimeError: Command docker exec -t 346dc76f46d3e1c6a7b0c00890bebc7e252abf4fb432be2126e711ede94fcdd8 /exec failed with exit code 1
Build Presets / apple (ios-simulator) / build (gh)
The process '/opt/homebrew/bin/git' failed with exit code 128
Build Presets / apple (ios) / build (gh)
RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1
Build Presets / apple (llm) / build (gh)
The process '/opt/homebrew/bin/git' failed with exit code 128
Build Presets / apple (macos) / build (gh)
The process '/opt/homebrew/bin/git' failed with exit code 128
Build Presets / apple (profiling) / build (gh)
The process '/opt/homebrew/bin/git' failed with exit code 128
Build Presets / apple (pybind) / build (gh)
The process '/opt/homebrew/bin/git' failed with exit code 128
Build Presets / linux (linux, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build (gh)
RuntimeError: Command docker exec -t ba28b7be06e1f253943b96d83236604073d9468352c7a85d8742acc0ffb07b69 /exec failed with exit code 1
Build Presets / linux (linux, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build (gh)
RuntimeError: Command docker exec -t c72bbc7a8cdd5768cee8a9614abc90a0cb6ca33bab31e9c180e67c958f8c86fa /exec failed with exit code 1
Build Presets / linux (llm, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build (gh)
RuntimeError: Command docker exec -t c0305247096ae2967e68b9602e8bac866762f7ef0f779f885591fe1c4b11b5b7 /exec failed with exit code 1
Build Presets / linux (llm, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build (gh)
Build Presets / linux (pybind, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build (gh)
Build Presets / linux (pybind, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build (gh)
Build Presets / windows (pybind) / build (gh)
The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 128
Build Presets / windows (windows) / build (gh)
The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 128
Build Windows Wheels / pytorch/executorch / build-wheel-py3_10-cpu (gh)
The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 128
Build Windows Wheels / pytorch/executorch / upload / upload-wheel-py3_10-cpu (gh)
Unable to download artifact(s): Artifact not found for name: pytorch_executorch__3.10_cpu_x64
Lint / lintrunner / linux-job (gh)
>>> Lint for CMakeLists.txt:
periodic / test-models-linux (buck2, mv3, portable, linux.2xlarge, 90) / linux-job (gh)
RuntimeError: Command docker exec -t 1b7d8698f29da3c07b763727569ddee2824cb89318b4fb99802bb738fd6c0c90 /exec failed with exit code 1
periodic / test-models-linux (buck2, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
RuntimeError: Command docker exec -t 45a8b24798a241466ffcb6e09fe90f3b28095ada0f3033cb0506905e47a1cd82 /exec failed with exit code 1
periodic / test-models-linux (cmake, mv3, portable, linux.2xlarge, 90) / linux-job (gh)
RuntimeError: Command docker exec -t ce4401a68c9d82d2e0e64c40c54cba9ba37634f2c46f881a2b1cedc00e13ca16 /exec failed with exit code 1
periodic / test-models-linux (cmake, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
RuntimeError: Command docker exec -t 878d02ce9b02a23626464132bcbfc65c988f79be8de1e042df2dee0e211f33d5 /exec failed with exit code 1
periodic / test-models-linux (cmake, vit, portable, linux.2xlarge, 90) / linux-job (gh)
RuntimeError: Command docker exec -t 3d373266d989a6d6f8d472896e28f6070f177031acb3a1e0265517b40195301a /exec failed with exit code 1
periodic / test-models-linux (cmake, vit, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
RuntimeError: Command docker exec -t e3a443d1b081d38391e0cef913246c8be30b1a8864c7093915550ecd187f169e /exec failed with exit code 1
pull / android / build-llm-demo / linux-job (gh)
RuntimeError: Command docker exec -t d3360e179cc7c4c91590849f20c4ce3f7325d288a581e440c4d8c3ff79fe957e /exec failed with exit code 1
pull / test-build-wasm-linux / linux-job (gh)
RuntimeError: Command docker exec -t 74f1c5e298142f080e097994991db4d1752051986136c856e0ada6b4d8d346a0 /exec failed with exit code 1
pull / test-custom-ops-linux / linux-job (gh)
RuntimeError: Command docker exec -t 3cb4cf85eaf3e4b754b2ed80e269cf7068415af341cf1e0c0cdb13db15604492 /exec failed with exit code 1
pull / test-eval_llama-wikitext-linux / linux-job (gh)
RuntimeError: Command docker exec -t ecfa4f80b99e4a9ac3121f8c5a7a55590eef5458791357beb2e93adc723ac546 /exec failed with exit code 1
pull / test-llama_runner_eager-linux / linux-job (gh)
RuntimeError: Command docker exec -t 68512fe65e8f30e11bf690b795baa20d469e7e44e8983542dab4943f5450f99c /exec failed with exit code 1
pull / test-llama-lora-linux / linux-job (gh)
RuntimeError: Command docker exec -t 807086945e12a77e099b29d49628ecc6ed7a2887829ec8a28030f1d62bd9edb0 /exec failed with exit code 1
pull / test-llama-runner-linux (bf16, custom, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t f3346cbbc98458a3a2c6a27a099926bfcc10f315ca2612f00542c470fcd5a97a /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t 27360af380a872af6bc72a885d54da0e4f0a601436c9d42abbd9be7349cb7e6b /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.arm64.2xlarge, executorch-ubuntu-22.04-gc... / linux-job (gh)
RuntimeError: Command docker exec -t ea768abe3bec85e748aa9d68306a3ec5a79800d55a86a92009583d1a84b4a13b /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04... / linux-job (gh)
RuntimeError: Command docker exec -t 4f2055c6946256c7292f5097c8d46c610c95827edaafa0a7cce0bfee6461390c /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu... / linux-job (gh)
RuntimeError: Command docker exec -t b528417b1db1ba7cdcd7e3978ca3f897e88e34827193ea0412e9fbf02e00b986 /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t d311f3bbc5b67f37d265d51c0dbf5cf260f1139f226098e836ceb0eddd325379 /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu-22.04-... / linux-job (gh)
RuntimeError: Command docker exec -t 813ce1680ca2cd4cc81a199345eba767b16f3c0ba28833e7882c01659eb2e41d /exec failed with exit code 1
pull / test-llama-runner-linux-android / linux-job (gh)
RuntimeError: Command docker exec -t eb8a7381f767fe084b44a63a31911fe043425be60a574967832906d8c9e902b0 /exec failed with exit code 1
pull / test-llama-runner-qnn-linux (fp32, qnn_16a16w, qnn) / linux-job (gh)
RuntimeError: Command docker exec -t a0a7b4ea8dedcb1f04d4fbb0fde01ea3e3ec4c9ad59ac69221ecfbe294e4ba40 /exec failed with exit code 1
pull / test-llama-runner-qnn-linux (fp32, qnn_8a8w, qnn) / linux-job (gh)
RuntimeError: Command docker exec -t 5d9e21442f7ede369495c15b27bdef689fdc41350e0b46d3281e4e99c208440b /exec failed with exit code 1
pull / test-mediatek-models-linux / linux-job (gh)
RuntimeError: Command docker exec -t c2b804a5a78d85a66f3138b7803be7880f9a274f6a6b0a7e1e96fa909dcb0550 /exec failed with exit code 1
pull / test-models-linux (add_mul, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t af8c68ffdd12f69e9ba8e50e8c582b2da58975f9252f5c2a12280a178ebd349d /exec failed with exit code 1
pull / test-models-linux (add_mul, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t e6c97f806b1e8d12101609ec6ebf178dbece69526a1a96c3b717b9a9cb7c73b9 /exec failed with exit code 1
pull / test-models-linux (add, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t bc4ba0ff3360e813989c0ce5258133cf1df44f8e75082423d5443f6977e76fee /exec failed with exit code 1
pull / test-models-linux (add, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t e9c67923adf1b4776c2b93dbe6233f9d28cb4e2995c815fdd64354d23dd0c889 /exec failed with exit code 1
pull / test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t e504bcd923478fafd504b571a0f7241c0e68bc043073bc46a4a5e7a8554e2b08 /exec failed with exit code 1
pull / test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t 5fe5829970fe1b8b8a9ae60a72666304443a3127e112bbd812f54f9b3036f24c /exec failed with exit code 1
pull / test-models-linux (emformer_transcribe, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t c22d2fa54f5c9e3c2297d7dd714f2b15d3c83f9a2186c36e092897e7007eed1d /exec failed with exit code 1
pull / test-models-linux (emformer_transcribe, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t e66d2ac05005e32ccc1cec3ab368caf00f5a63ffd3b778f1c22d8e0fd992e8ad /exec failed with exit code 1
pull / test-models-linux (ic3, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 71a11c3c21c813eaef46e9fb9e82b914ce7ac2463abeabdc1832f96e6cbfc723 /exec failed with exit code 1
pull / test-models-linux (ic3, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t b99683709d817f316ccaf25e97f43a67c10aca0325daf275351fb61222343a44 /exec failed with exit code 1
pull / test-models-linux (ic4, portable, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t 029bee2f8fe8c8a191e7fdc9a8c16d3ec02e9b8095e3d334ead0a7b26d793b7c /exec failed with exit code 1
pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t 464932532cb0e084d95648f586ecf29ad5b3d9294e2a2e1b7f8e057da49a0096 /exec failed with exit code 1
pull / test-models-linux (linear, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t dfdf97dbc55caf056013ba298e2dce42bba112639023e14428354b973815e1aa /exec failed with exit code 1
pull / test-models-linux (linear, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 275fbfc252de5ee56c63c2cf3596cccde0f983ea6a6b0d327f3ff376c6fdebf5 /exec failed with exit code 1
pull / test-models-linux (llama3_2_vision_encoder, portable, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t 52b637a8f6e8ecacd7223557d281bd0e027b5ff249dc68c3cd66eac25648ac21 /exec failed with exit code 1
pull / test-models-linux (mobilebert, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 50d0151129d4246d941481a2884090071b54c66f6259973b19af146731d1d307 /exec failed with exit code 1
pull / test-models-linux (mobilebert, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t e42b82220c30ca70b5dd114aeb34340eae007af2e933ff75276e4ad906b81f69 /exec failed with exit code 1
pull / test-models-linux (mv2, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t f1317fca6a76b225716453c62d1b3cfb1a35d9aa718530637415b620e5c7459a /exec failed with exit code 1
pull / test-models-linux (mv2, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t cfc072e0ec13964f259120b190444112566b4193ca90f6be02e99dd5bf186381 /exec failed with exit code 1
pull / test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t 99dd8cb426f6c649d740bf77a02cb24f32ded41fc70e6717bfe8dc6dc43c2d7f /exec failed with exit code 1
pull / test-models-linux (resnet18, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 5ad9fddfea0a84a5b075c2acc246a6d3d294ef947817d477cd0836730a982b31 /exec failed with exit code 1
pull / test-models-linux (resnet18, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t da4389cad497458986c4a84ce4e62e79fdf65edc38da608b7748124f9a2fba7e /exec failed with exit code 1
pull / test-models-linux (resnet50, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 8221708a23ac057cdd1479f65848ea8f0d31012b1bf56714c88469ee9cd9b384 /exec failed with exit code 1
pull / test-models-linux (resnet50, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t e4478dd429d588fd1192a91496107b0133802e7c696965be31f35eb9d0f46865 /exec failed with exit code 1
pull / test-models-linux (w2l, portable, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t ce53b7cc3b56cd27b28bd54a65bef8f26ad0e4bff493aaf48ee9d459318f71ec /exec failed with exit code 1
pull / test-models-linux-basic (mv3, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t 6d3eeaa5f002bcc1f6aaa3da5bbee0a56a5efc23e5784f7b6f197c1f06c81e0d /exec failed with exit code 1
pull / test-models-linux-basic (mv3, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t 38e5f2234f429e25e7733dcd3456264714e340c4c5d1b4c9f08fe57002505930 /exec failed with exit code 1
pull / test-models-linux-basic (mv3, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job (gh)
RuntimeError: Command docker exec -t 6418cc01342be704cc0d96938c3f012d93e339a68779cc2ad6a0e5591b593b76 /exec failed with exit code 1
pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
RuntimeError: Command docker exec -t c5904ae9a416fc7cd8c876552e5d5933e00879b516018a14eaecbf72906a0bad /exec failed with exit code 1
pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
RuntimeError: Command docker exec -t 6938bd86f5a0b640228988c1d07effc3986808d16bbadea35d27aba0b7a95ba7 /exec failed with exit code 1
pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
RuntimeError: Command docker exec -t 5840619193f57b8d0d4dcae652d918c3fb6b0b8b569ffa01436a7fd4281194fd /exec failed with exit code 1
pull / test-models-linux-basic (vit, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t b621c4bf60807c4308cfdc38e8b55ff423717fd3bae1ec290192bd663789b7d7 /exec failed with exit code 1
pull / test-models-linux-basic (vit, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t 1432f95f94da033cbf4306d10a18c5812124f0078bef9cab010ee192334231e4 /exec failed with exit code 1
pull / test-models-linux-basic (vit, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job (gh)
RuntimeError: Command docker exec -t 1f42ebd3a23d25dff7d6ec25ec6e2f8482cb41921b022540237b9c28fd22b989 /exec failed with exit code 1
pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
RuntimeError: Command docker exec -t 5b6cfe114bb7978fb77bc1295e118669aeffbd13c5a239ad99affcd47fd4ec0e /exec failed with exit code 1
pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
RuntimeError: Command docker exec -t 623da0924e17c05014528109a6ccae17c47f0250ec4aab35352aca20fe920325 /exec failed with exit code 1
pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
RuntimeError: Command docker exec -t d844a2173ad39126ffc6eeaeb01703290821c9e4b838f30ce54fe57178b2aba0 /exec failed with exit code 1
pull / test-moshi-linux / linux-job (gh)
RuntimeError: Command docker exec -t 48ae52f5cca59e3c6e706c04e68a241c3ba13687b6a7126d6e30d2adafa6a0a8 /exec failed with exit code 1
pull / test-multimodal-linux (gemma3-4b) / linux-job (gh)
RuntimeError: Command docker exec -t f41b06efd42b1463eb8d36a8620e4cc553e20fdca52a73a9046a74af5ff94241 /exec failed with exit code 1
pull / test-openvino-linux / linux-job (gh)
RuntimeError: Command docker exec -t 5a25ca498b2b1257e3debc77a9ec42b06016811ad3c56f66fa597ff96d8381da /exec failed with exit code 1
pull / test-phi-3-mini-runner-linux / linux-job (gh)
RuntimeError: Command docker exec -t 5d97cfe7a948bdfc73fc782374cc8d957d98146f23988948ee4ef36eff6bc424 /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.10) / linux-job (gh)
RuntimeError: Command docker exec -t 5047f00ecf3724f136b3eb871cf07ae0e1d29c839fd5ec5d88b2ddedacbfa425 /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.11) / linux-job (gh)
RuntimeError: Command docker exec -t 3e7ef8b52ee6960f2fbf1129d04c13408e3b323d86a3cebc8a986b17d4e1aed6 /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.12) / linux-job (gh)
RuntimeError: Command docker exec -t aefca060691a0f6c9cd814ac7bb9bf21a6874bdec89be0078f85a1581249571c /exec failed with exit code 1
pull / test-quantized-aot-lib-linux / linux-job (gh)
RuntimeError: Command docker exec -t a4f1b2a6b05881bc063a5b4b8a99d2f61f05759a289f5f0f55d76b44256ee790 /exec failed with exit code 1
pull / test-samsung-models-linux / linux-job (gh)
RuntimeError: Command docker exec -t 806ae8dfccb6ad048483b37381687bfd2db32ad05d431567367d10c10b1ed4e9 /exec failed with exit code 1
pull / test-selective-build-linux / linux-job (gh)
RuntimeError: Command docker exec -t 6828fa401f5d38d98568948628e844c6a1f378016d1e3928d8d6ea09d007affe /exec failed with exit code 1
pull / test-setup-linux-gcc / linux-job (gh)
RuntimeError: Command docker exec -t 673a6a7b5e9dbb70c99d3b5f673688086eeb57e55f80d885107af563727dd3da /exec failed with exit code 1
pull / test-static-llama-qnn-linux (stories_110m) / linux-job (gh)
RuntimeError: Command docker exec -t fd0b62bc24832c01a8686d12e9daff6659ba9bfd58fbc72dda3a6580e288b0b6 /exec failed with exit code 1
pull / test-static-llama-qnn-linux (stories_260k_bc) / linux-job (gh)
RuntimeError: Command docker exec -t 0bd0382873def4af329c72c3c93b9c1d9ea27e3987dadca5526a6c7500ee2d47 /exec failed with exit code 1
pull / test-vulkan-models-linux / linux-job (gh)
RuntimeError: Command docker exec -t 47390a0b34efcfa2c6c07149f25e1c07307b4e7909a679ee9ce0e4daf44fe243 /exec failed with exit code 1
pull / test-vulkan-operators-linux / linux-job (gh)
RuntimeError: Command docker exec -t 24017d99b5296ad7a8780b6bb43f6893eb242042082c30b169e4480d023f06f0 /exec failed with exit code 1
pull / unittest / macos / macos-job (gh)
RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
pull / unittest / windows / windows-job (gh)
The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 128
pull / unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job (gh)
RuntimeError: Command docker exec -t 2e3f2403d7e2d2d8050080973a92584cfe2c9b4a8c45c969a210ecc05ea2662f /exec failed with exit code 1
pull / unittest-arm-backend-with-no-fvp (test_pytest_ops) / linux-job (gh)
RuntimeError: Command docker exec -t 5660664f5cd2e0b60a36d2e5d230259903b66d1f86feecf94d77b133203d7d40 /exec failed with exit code 1
pull / unittest-buck / linux / linux-job (gh)
RuntimeError: Command docker exec -t 1959159a05dba195477c3d743244324d1de9633fe00f3fa9979a12b7bb004792 /exec failed with exit code 1
pull / unittest-buck / macos / macos-job (gh)
RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
pull / unittest-editable / linux / linux-job (gh)
RuntimeError: Command docker exec -t a3348077c96d30913f0d2afeaea2818d6439feb985bfdf9f8fd8e116cbcba1fe /exec failed with exit code 1
pull / unittest-editable / macos / macos-job (gh)
RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 128
pull / unittest-editable / windows / windows-job (gh)
The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 128
pull / unittest-nxp-neutron / linux-job (gh)
RuntimeError: Command docker exec -t 8f8ceea9c494cbff99ae8e7f54627946ace698b097e56bbb5e67ec34f0ad7378 /exec failed with exit code 1
pull / unittest-wasm-bindings (--enable-etdump) / linux-job (gh)
RuntimeError: Command docker exec -t 7ee2d150a5aaf98eafee7faeca5bc06d16a601802ffaac22219b3dadf4e5f139 /exec failed with exit code 1
pull / unittest-wasm-bindings / linux-job (gh)
RuntimeError: Command docker exec -t b242cc61f5264272a92a5f597211a4d06dc71d2baf9bef0a517b281983d1b936 /exec failed with exit code 1
Test CUDA Builds / check-all-cuda-builds (gh)
Process completed with exit code 1.
Test CUDA Builds / export-model-cuda-artifact (google, gemma-3-4b-it, non-quantized) / linux-job (gh)
RuntimeError: Command docker exec -t 2b7531c0d6250a0a6d04ef838ecbd3e084ed9a1bffc30215ce5e13cab1229b3d /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (google, gemma-3-4b-it, quantized-int4-tile-packed) / linux-job (gh)
RuntimeError: Command docker exec -t 321515e3b27793f38540bd4959e7e6fe7f8ccacb90991f56a52a82775ae543a4 /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (mistralai, Voxtral-Mini-3B-2507, non-quantized) / linux-job (gh)
RuntimeError: Command docker exec -t 7e82e8e454509466e58cc2f208c8ff6b6da90ac52e420df25ef45ea3085a341b /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (mistralai, Voxtral-Mini-3B-2507, quantized-int4-tile-packed) / linux-job (gh)
RuntimeError: Command docker exec -t ce4277242379b81905be51a01c7d74be1062cbe9002dc95dbd3322681c6aa795 /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (mistralai, Voxtral-Mini-3B-2507, quantized-int4-weight-only) / linux-job (gh)
RuntimeError: Command docker exec -t 7d74f541811faf42d9c25738790682b4a5dc853b07cfc379ac84ada4b749e4ea /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (openai, whisper-large-v3-turbo, non-quantized) / linux-job (gh)
RuntimeError: Command docker exec -t 36bef14ffe732433ae992e2dff95116358c46b888306298f3809995db09d5d2e /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (openai, whisper-large-v3-turbo, quantized-int4-tile-packed) / linux-job (gh)
RuntimeError: Command docker exec -t 5e556d0ba81c08a05a1c6663ddc966894fd58ea873f0aa34196d84d39f49830e /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (openai, whisper-large-v3-turbo, quantized-int4-weight-only) / linux-job (gh)
RuntimeError: Command docker exec -t b34974d1c5f0c7c0874ab8d78860ae4dc12b1657bfc5f0061c9ac75a63889a03 /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (openai, whisper-small, non-quantized) / linux-job (gh)
RuntimeError: Command docker exec -t 28debe87bc097a8522718e72dc4155e160b7e958ec078a4e794359ffa34097f8 /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (openai, whisper-small, quantized-int4-tile-packed) / linux-job (gh)
RuntimeError: Command docker exec -t efac2732fd915695e4e6d7c48d9d5b3f5fb1a8fc19385e76e341c8cf8a81db8d /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (openai, whisper-small, quantized-int4-weight-only) / linux-job (gh)
RuntimeError: Command docker exec -t 2f8def3336371110b52607eae34863d05c560ce6363402e642b24b969e711bc4 /exec failed with exit code 1
Test CUDA Builds / test-executorch-cuda-build-12.6 / linux-job (gh)
RuntimeError: Command docker exec -t 8319a3b461b997bad927d1dd9b82923cc7064fb50dcda98158b9ba46fea9bca2 /exec failed with exit code 1
Test CUDA Builds / test-executorch-cuda-build-12.8 / linux-job (gh)
RuntimeError: Command docker exec -t 2f47ac6c48ac94f6774f65602c85902618e915c497c37a49bc117bc3ee1bebf8 /exec failed with exit code 1
Test CUDA Builds / test-executorch-cuda-build-13.0 / linux-job (gh)
RuntimeError: Command docker exec -t 070fc6a28b51b683095a1f3405c68ae1a2078d76d629b4cc14f36e50e157b6fe /exec failed with exit code 1
Test CUDA Builds / test-models-cuda (add_mul) / linux-job (gh)
RuntimeError: Command docker exec -t 157a13b1e2a23717c30f6782aec2c462410806734c55fdff8b9b79b4a01d8eda /exec failed with exit code 1
Test CUDA Builds / test-models-cuda (add) / linux-job (gh)
RuntimeError: Command docker exec -t b7ca994d8677a843d0eb3824616c100192ead4ba4a123bee0b84ed38c9740f51 /exec failed with exit code 1
Test CUDA Builds / test-models-cuda (conv1d) / linux-job (gh)
RuntimeError: Command docker exec -t 2b0918b5187ce1379d9d4f6a3a33ee7e599a6c016e04805edeb3e21ea69ab753 /exec failed with exit code 1
Test CUDA Builds / test-models-cuda (linear) / linux-job (gh)
RuntimeError: Command docker exec -t 1328ceb9bca4a3ed25ec92d861e301538f794abbe9d089f2f7f4faee1739bc50 /exec failed with exit code 1
Test CUDA Builds / test-models-cuda (resnet18) / linux-job (gh)
RuntimeError: Command docker exec -t ddd472fb68b4ef992ce1f22057e6cd1a6b1ed087785a15786958b2617138b224 /exec failed with exit code 1
Test Metal Backend / export-voxtral-metal-artifact / macos-job (gh)
RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
Test Metal Backend / test-executorch-metal-build / macos-job (gh)
RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1

FLAKY - The following job failed but was likely due to flakiness present on trunk:

pull / unittest / linux / linux-job (gh) (matched linux rule in flaky-rules.json)
The process '/usr/bin/git' failed with exit code 128

This comment was automatically generated by Dr. CI and updates every 15 minutes.

We observed that on iOS it improves perf by 6% because SDPA op does temp allocations. No significant difference on android though. Differential Revision: [D86120038](https://our.internmc.facebook.com/intern/diff/D86120038/) ghstack-source-id: 322129671 Pull Request resolved: #15710

github-actions · 2025-11-10T17:18:54Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

JacobSzwejbka · 2025-11-10T17:39:47Z

extension/llm/runner/llm_runner_helper.cpp

-        model_path, data_files, Module::LoadMode::File);
+        model_path,
+        data_files,
+        Module::LoadMode::File,


we dont use mmap? @larryliu0820

kimishpatel requested review from jackzhxng, kirklandsign, larryliu0820 and mergennachin as code owners November 10, 2025 17:18

This was referenced Nov 10, 2025

[Executorch][llm] Fix flakyness of quantized sdpa test #15653

Open

[Executorch] parallelize op_choose_qparams #15607

Open

meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 10, 2025

JacobSzwejbka reviewed Nov 10, 2025

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[Executorch][LLM] Use caching allocator for runner #15710

[Executorch][LLM] Use caching allocator for runner #15710

kimishpatel commented Nov 10, 2025 •

edited

Loading

Uh oh!

pytorch-bot bot commented Nov 10, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Nov 10, 2025

Uh oh!

JacobSzwejbka Nov 10, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

[Executorch][LLM] Use caching allocator for runner #15710

Are you sure you want to change the base?

[Executorch][LLM] Use caching allocator for runner #15710

Conversation

kimishpatel commented Nov 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pytorch-bot bot commented Nov 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/15710

❌ 127 New Failures, 1 Unrelated Failure

Uh oh!

github-actions bot commented Nov 10, 2025

This PR needs a release notes: label

Uh oh!

JacobSzwejbka Nov 10, 2025

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

kimishpatel commented Nov 10, 2025 •

edited

Loading

pytorch-bot bot commented Nov 10, 2025 •

edited

Loading

This PR needs a `release notes:` label