Product·Compliance & Governance·Fairness & bias testing

Tested for disparate impact, on a schedule.

A synthetic bias probe varies demographic signals while holding qualifications constant, then measures selection rates across groups. It runs before and after deployment on a schedule, re-testing whenever the scoring configuration changes and at least once a year regardless. An adverse finding pauses Amp acting on its own scores for that job until an admin reviews it.

A run, in full

Selection rates, intersectionally. One cell fails, everything pauses.

Synthetic candidates: identical qualifications, varied demographic signals, run through the same production gate as real applicants. If any group is selected at less than 80% of the top group's rate, and the gap is statistically real, the run reads adverse. That cell shows at a glance, and the job goes on hold.

Compliance
Bias & Fairness
OverviewBias & FairnessPrivacy ConsoleSetup
Bias run #41 · Line Cook · Weekend CloseAdverse
MenWomenGroup A0.910.88Group B0.860.90Group C0.740.83
4/5ths rule · Fisher’s exact · Newcombe CI · Cohen’s h
Group C / Men: 0.74, below the 0.80 threshold, p < 0.05 · hold engaged on this job
The cadence

On a schedule, not on request.

Testing runs whether or not anyone asks: a baseline before deployment, on a schedule after that, immediately on any change to the scoring configuration, and a fresh-run floor of once a year. Admins set how much of the job list each scheduled run covers.

Bias & FairnessConfigure how Amp tests for adverse impact across demographic groups using the EEOC 4/5ths rule.
Test methodology
Each job test runs 710 synthetic reviews (≈25 min/job): a diverse mix of demographic variants, school backgrounds, cultural affiliations, and pronoun signals, each scored once through the production gate.
Automated monthly testingRotates through your active jobs: never-tested first, then longest ago, so every job gets covered over time.
Jobs to test

See Amp running.

A 30-minute walkthrough, keyed to one of your roles and one of your geographies.

See Amp running