Rolerise

Matching demo

Bias testing report

Updated August 2026

Scope of testing

We periodically re-score held-out synthetic and consented evaluation sets while holding job requirements constant. Tests look at score gaps across gender-coded names, ethnicity-proxy name lists, and university prestige signals that are not job-relevant.

Latest results (evaluation set)

On the current evaluation set, mean overall-fit difference between gender-coded name pairs was under 1.5 percentage points when experience and skills were identical. University-name ablation (replacing elite vs regional schools with a generic label) changed shortlist membership for fewer than 3% of otherwise identical profiles.

These figures describe the matching ranker on evaluation data. They are not a legal certification and do not replace customer-specific impact assessments.

What we do with findings

If a test exceeds internal thresholds, ranking features that encode protected or proxy attributes are disabled or reweighted before the next production rollout. Recruiter-facing explanations must cite job-relevant evidence (skills, tenure, domain), not demographic or school-prestige language.

Request the full packet

Customers under NDA can request the latest methodology appendix, slice tables, and change log from [email protected]. The public summary on this page is updated when a new evaluation cycle completes.