Skip to content

Reduce benchmark harness process churn in performance measurements #25

Description

@spMohanty

Benchmark measurement currently builds temporary scripts and launches subprocess/perf processes on a per-measurement basis. This adds significant harness overhead for large matrices.

Add batched/persistent execution support so multiple measurement cases can run inside fewer Python/perf processes while preserving existing interfaces and comparability.

Files

  • benchmarks/_perf.py

Acceptance Criteria

  • Reduce process launch overhead in suite-level runs.
  • Keep output semantics for existing benchmark reporting.
  • Improve total wall-time for large benchmark sets without changing measured operation definitions.

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:benchmarksBenchmark runner, measurement harness, and perf workflowsperformancePerformance optimization and runtime-sensitive improvementspriority:p1Ship in the current iteration

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions