Trust · Fairness
Monitored per role. Per stage. Per protected group.
The four-fifths rule is the floor. We report against tighter thresholds. We publish the audit. We pause syndication when a flag fires.
Read the Q1 2026 audit →See the model cards
Bias audit · Q1 2026
Audited independently. Published in full.
Download the audit (PDF) →
Four-fifths rule · selection rate ratio
Female / Male
0.94
pass
Non-white / White
0.91
pass
Over-40 / Under-40
0.88
pass
Non-graduate / Graduate
0.82
pass
Disability disclosed
0.79
review
One ratio is in the review band (≥0.80, <0.85). Surfaced to the affected roles; assessment item-level review opened on 9 May.
What we audit, on what cadence
Adverse impactPer role · live
Item-level DIFPer assessment · quarterly
Voice screen latency driftDaily
Score-vs-outcome calibrationQuarterly · 14k hires
Independent audit (NYC LL144)Annually · Holistic AI
Red-team adversarial probesQuarterly · in-house
Model card revisionsOn every weight change
Our Neuroworx psychometric IP (established 2017) gives us nine years of item-bank validity data to calibrate against.
Methodology
Five protected pairs. Disclosed voluntarily. Post-decision only.

We monitor adverse impact across five pairs: sex (female / male), race (non-white / white), age (over-40 / under-40), education (non-graduate / graduate), and disability disclosure. Categories are voluntary, declared by the candidate post-decision (so the disclosure cannot influence the decision), and used only for aggregate adverse-impact monitoring.

  • Voluntary self-identification. Candidates can decline every question.
  • Post-decision only. Disclosure is captured after the candidate has been advanced or rejected.
  • Aggregate only. Per-role and per-stage aggregates. Never used as an input to scoring.
  • 4/5ths rule is the regulatory floor (EEOC). We report against tighter thresholds where the role volume supports it.
Redress
Adverse impact is a stop-the-line event.
01
Detection. Per-role drift detection runs daily. The 4/5ths ratio is recalculated on every candidate decision; a breach pauses syndication for that role.
02
Notification. The hiring manager and Picked's internal review team are both notified within minutes. The candidate dashboard shows a banner explaining the pause.
03
Investigation. Item-level differential item functioning (DIF) analysis runs on the assessment items used. Any item showing DIF above threshold is retired.
04
Resolution. Once the calibration is corrected and the role re-passes the 4/5ths threshold, syndication resumes. Time to resolve is published quarterly.
Auditor
Audited annually by Holistic AI.

Independent bias audits are required under NYC Local Law 144 for any automated employment decision tool used by NYC employers. We commission an annual audit by Holistic AI, an independent third party, and publish the summary in full. The 2026 audit is referenced above.

The audit covers selection rate ratios across protected categories, item-level differential item functioning (DIF) on assessment items, calibration of scores against post-hire outcomes, and inspection of the question bank for content bias. The auditor has access to anonymised production data, not customer-identifying data.

  • Annual cadence, summary published on this page.
  • NYC LL144 banner on every NYC-listed role, linking to the latest summary.
  • Audit scope, methodology, and limitations disclosed in full.
0.78 to 0.91
internal reliability (alpha) across batteries.
9 years
of item-bank validity data, established in Neuroworx 2017 to 2026.
14k hires
of post-hire outcome data informing quarterly calibration.
Last reviewed · 22 May 2026 · v1.0
Still on the legal review?
We'll send you the file.
Pre-filled vendor security questionnaire (SIG Lite), DPA, sub-processor list, SOC 2 letter, model card, latest bias audit. One zip. Reply within one business day.
Request the legal pack Email legal@picked.ai
Operated by Neuroworx Ltd · ICO #09910326623
Fairness · Picked.ai