Skip to content

build(bench): pin GDC identities and evidence contracts #960

Description

@DecisionNerd

Objective

Provide shared benchmark-owned manifests, dataset provenance, reference handling, and evidence schemas for independent GDC suites.

Requirements

  • Pin GDC/spec, generator, and driver versions or commits.
  • Verify checksums and record licenses/acquisition without committing bulk data.
  • Keep every suite independently selectable and reported.
  • Sanitize evidence and preserve reproducibility metadata.

Acceptance criteria

  • Validation rejects incomplete provenance.
  • Fixtures cover checksum mismatch, missing assets, reference mismatch, and drift.
  • Adapters share contracts without sharing workload semantics.

BDD completion scenario

Given a GDC profile
When inputs are acquired
Then every generator, driver, dataset, and reference has an immutable recorded identity.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    testingTest coverage and testing infrastructure

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions