Skip to content

ci(benchmarks): adapt to new benchmark paths - #2545

Merged
mkroening merged 1 commit into
mainfrom
hermit-rs-example-rename
Jul 26, 2026
Merged

ci(benchmarks): adapt to new benchmark paths#2545
mkroening merged 1 commit into
mainfrom
hermit-rs-example-rename

Conversation

@mkroening

@mkroening mkroening commented Jul 10, 2026

Copy link
Copy Markdown
Member

For details, see hermit-os/hermit-rs#1019.

@mkroening mkroening self-assigned this Jul 10, 2026

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark Results

Details
Benchmark Current: 4e68fb3 Previous: 2e23902 Performance Ratio
startup_benchmark Build Time 79.41 s 80.34 s 0.99
startup_benchmark File Size 0.79 MB 0.80 MB 0.99
Startup Time - 1 core 0.72 s (±0.02 s) 0.75 s (±0.02 s) 0.96
Startup Time - 2 cores 0.75 s (±0.02 s) 0.74 s (±0.02 s) 1.01
Startup Time - 4 cores 0.74 s (±0.02 s) 0.74 s (±0.02 s) 0.99
multithreaded_benchmark Build Time 81.66 s 82.11 s 0.99
multithreaded_benchmark File Size 0.90 MB 0.86 MB 1.05
Multithreaded Pi Efficiency - 2 Threads 87.36 % (±5.30 %) 85.89 % (±6.61 %) 1.02
Multithreaded Pi Efficiency - 4 Threads 43.02 % (±3.26 %) 43.43 % (±2.56 %) 0.99
Multithreaded Pi Efficiency - 8 Threads 25.37 % (±1.50 %) 25.76 % (±1.53 %) 0.99
micro_benchmarks Build Time 80.48 s 80.40 s 1.00
micro_benchmarks File Size 0.90 MB 0.86 MB 1.05
Scheduling time - 1 thread 63.87 ticks (±4.29 ticks) 62.65 ticks (±4.06 ticks) 1.02
Scheduling time - 2 threads 36.57 ticks (±5.64 ticks) 34.08 ticks (±4.10 ticks) 1.07
Micro - Time for syscall (getpid) 4.02 ticks (±0.70 ticks) 3.45 ticks (±0.58 ticks) 1.16
Memcpy speed - (built_in) block size 4096 84766.11 MByte/s (±58638.46 MByte/s) 82448.38 MByte/s (±56997.13 MByte/s) 1.03
Memcpy speed - (built_in) block size 1048576 30530.55 MByte/s (±24588.24 MByte/s) 30585.98 MByte/s (±24707.84 MByte/s) 1.00
Memcpy speed - (built_in) block size 16777216 27255.64 MByte/s (±22450.87 MByte/s) 26340.06 MByte/s (±21720.96 MByte/s) 1.03
Memset speed - (built_in) block size 4096 84795.41 MByte/s (±58659.63 MByte/s) 82292.76 MByte/s (±56891.50 MByte/s) 1.03
Memset speed - (built_in) block size 1048576 31291.09 MByte/s (±25034.27 MByte/s) 31323.85 MByte/s (±25145.86 MByte/s) 1.00
Memset speed - (built_in) block size 16777216 28014.47 MByte/s (±22923.00 MByte/s) 27104.68 MByte/s (±22209.94 MByte/s) 1.03
Memcpy speed - (rust) block size 4096 76471.41 MByte/s (±52987.44 MByte/s) 74097.96 MByte/s (±51811.44 MByte/s) 1.03
Memcpy speed - (rust) block size 1048576 30688.24 MByte/s (±24721.62 MByte/s) 30361.60 MByte/s (±24602.37 MByte/s) 1.01
Memcpy speed - (rust) block size 16777216 28282.61 MByte/s (±23276.63 MByte/s) 27625.34 MByte/s (±22806.88 MByte/s) 1.02
Memset speed - (rust) block size 4096 77185.49 MByte/s (±53445.74 MByte/s) 74373.47 MByte/s (±51976.48 MByte/s) 1.04
Memset speed - (rust) block size 1048576 31420.82 MByte/s (±25147.86 MByte/s) 31110.89 MByte/s (±25033.24 MByte/s) 1.01
Memset speed - (rust) block size 16777216 29054.41 MByte/s (±23744.28 MByte/s) 28386.93 MByte/s (±23265.03 MByte/s) 1.02
alloc_benchmarks Build Time 75.26 s 74.76 s 1.01
alloc_benchmarks File Size 0.87 MB 0.87 MB 1.00
Allocations - Allocation success 91.31 % 91.31 % 1
Allocations - Deallocation success 100.00 % 100.00 % 1
Allocations - Pre-fail Allocations 61.44 % 61.44 % 1
Allocations - Average Allocation time 3248.15 Ticks (±145.20 Ticks) 5860.58 Ticks (±98.43 Ticks) 0.55
Allocations - Average Allocation time (no fail) 4172.63 Ticks (±133.38 Ticks) 6554.81 Ticks (±92.86 Ticks) 0.64
Allocations - Average Deallocation time 871.06 Ticks (±107.24 Ticks) 1805.01 Ticks (±250.35 Ticks) 0.48
mutex_benchmark Build Time 75.40 s 79.82 s 0.94
mutex_benchmark File Size 0.90 MB 0.86 MB 1.05
Mutex Stress Test Average Time per Iteration - 1 Threads 11.84 ns (±0.42 ns) 12.10 ns (±0.41 ns) 0.98
Mutex Stress Test Average Time per Iteration - 2 Threads 38.36 ns (±1.83 ns) 40.26 ns (±1.68 ns) 0.95

This comment was automatically generated by workflow using github-action-benchmark.

@jounathaen

Copy link
Copy Markdown
Member

Looks to me as if this test was successful, right?

@mkroening
mkroening force-pushed the hermit-rs-example-rename branch from 828f6b9 to 4e68fb3 Compare July 26, 2026 08:53
@mkroening mkroening changed the title ci: test hermit-rs package renaming ci(benchmarks): adapt to new benchmark paths Jul 26, 2026
@mkroening
mkroening marked this pull request as ready for review July 26, 2026 08:53
@mkroening
mkroening enabled auto-merge July 26, 2026 09:14
@mkroening
mkroening added this pull request to the merge queue Jul 26, 2026
Merged via the queue into main with commit af88f18 Jul 26, 2026
33 of 40 checks passed
@mkroening
mkroening deleted the hermit-rs-example-rename branch July 26, 2026 10:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants