You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Dependabot PR #205 bumps com.microsoft.onnxruntime:onnxruntime-android 1.22.0 → 1.28.0 in bench/android/wav2vec2/app/build.gradle. That app (BenchActivity.java:3-5,95) uses only the
stable Java bindings (OrtEnvironment, OrtSession, default empty SessionOptions) with abiFilters "arm64-v8a" — plain CPU EP, no NNAPI/XNNPACK configured.
Across the 1.23.0–1.28.0 release notes, ARM64 CPU inference got several KleidiAI kernel upgrades
that apply automatically with no app code changes:
1.23.0: enhanced SGEMM/IGEMM/dynamic-quantized-MatMul performance, esp. Conv2D on SME2 hardware
1.25.0: BF16 SME2 kernel integration, asymmetric 4-bit MatMulNBits on ARM64
1.28.0: new ARM64 2-bit weight CPU kernels
docs/android-asr-runtime-bench.md already has committed baseline numbers for this exact app on
onnxruntime-android 1.22.0. Since the model it loads (model_quantized.onnx, wav2vec2-base-960h) is
quantized, these are exactly the kernels that would benefit.
Rebuild bench/android/wav2vec2 and re-run the existing benchmark harness on the same
device/test set used for the baseline numbers already in docs/android-asr-runtime-bench.md.
Update docs/android-asr-runtime-bench.md with the new numbers, noting whether the KleidiAI
kernel upgrades above produced a measurable speedup (or regression) versus the 1.22.0 baseline.
This is a "capture the free win" task, not a new feature — the version bump alone may already
improve on-device latency for this benchmark without any code change.
Context
Dependabot PR #205 bumps
com.microsoft.onnxruntime:onnxruntime-android1.22.0 → 1.28.0 inbench/android/wav2vec2/app/build.gradle. That app (BenchActivity.java:3-5,95) uses only thestable Java bindings (
OrtEnvironment,OrtSession, default emptySessionOptions) withabiFilters "arm64-v8a"— plain CPU EP, no NNAPI/XNNPACK configured.Across the 1.23.0–1.28.0 release notes, ARM64 CPU inference got several KleidiAI kernel upgrades
that apply automatically with no app code changes:
docs/android-asr-runtime-bench.mdalready has committed baseline numbers for this exact app ononnxruntime-android 1.22.0. Since the model it loads (
model_quantized.onnx, wav2vec2-base-960h) isquantized, these are exactly the kernels that would benefit.
Ask
bench/android/wav2vec2and re-run the existing benchmark harness on the samedevice/test set used for the baseline numbers already in
docs/android-asr-runtime-bench.md.docs/android-asr-runtime-bench.mdwith the new numbers, noting whether the KleidiAIkernel upgrades above produced a measurable speedup (or regression) versus the 1.22.0 baseline.
This is a "capture the free win" task, not a new feature — the version bump alone may already
improve on-device latency for this benchmark without any code change.