Caesar AI Atlas
Recrutement / RH
2019-06-03Cas #6

Les outils d’IA de Workday auraient permis à des employeurs de discriminer des candidats issus de groupes protégés

Résumé de l'incident

Les systèmes de filtrage algorithmique de Workday ont été accusés, dans une action en justice, de permettre aux employeurs de discriminer les Afro-Américains, les personnes de plus de 40 ans et les personnes en situation de handicap.

Dossier de conformité

Gestion pratique des risques d'entreprise et réglementations

Impact commercial & risques PME

The massive class-action lawsuit filed against Workday—alleging that its automated AI recruiting software and screening filters systematically discriminated against Black, disabled, and over-40 applicants—exposes hiring firms to severe civil and financial liabilities. Organizations outsourcing their initial candidate review to Workday are legally responsible for discriminatory outcomes under federal and state civil rights laws (such as Title VII in the U.S.). The litigation resulted in extensive legal defense expenditures, mandatory compliance auditing, and severe damage to employer branding, causing top-tier talent to boycott the firm. Regulatory Impact Alignment: HR candidate evaluation, job-ad optimization, and screening algorithms are designated as High-Risk AI systems under EU AI Act Article 6 and Article 27. Compliance requires executing systematic Data Protection Impact Assessments (DPIAs), maintaining immutable server logs, and verifying that pre-employment tools adhere to EEOC Title VII guidelines on disparate selection rates to prevent automated racial, age, or gender discrimination.

Leçon de conformité clé

Out-of-the-box algorithmic candidate filters often inherit and amplify historic demographic biases present in training data. Recruitment firms cannot outsource legal liability to third-party software vendors. HR platforms must be continuously audited for disparate impact and monitored using strict demographic statistical constraints. Compliance Audit Standards: For detailed verification audits, this case maps directly under EU AI Act Article 6 (High-Risk Classification) & EEOC Title VII Alignment. Systems deploying similar AI features must maintain dynamic security logs and hold systematic compliance records.

Plan d'action étape par étape

  • 1Vendor Bias Audits: Require all third-party HR and resume-filtering vendors to provide biannual, independent bias audit certifications (such as NYC Local Law 144 compliance).
  • 2Demographic Selection Dashboards: Deploy an internal auditing dashboard to track selection ratios across age, gender, and racial groups, flagging any algorithmic discrepancies.
  • 3Human-in-the-Loop Override: Establish a mandatory human-in-the-loop review for any candidate flagged for rejection by automated filtering tools.
  • 4Automated Disparity Checks: Train compliance teams to run automated statistical disparity tests on all active screening algorithms to detect implicit bias.
  • 5Disparate Impact Audit: Conduct annual statistical audits using the 80% selection rule to verify zero demographic bias in automated filters.
  • 6Cryptographic Consent Logs: Enforce strict local database encryption and cryptographically sign candidate consent logs for biometric checks.
  • 7Conformance Trail Retention: Retain secure server-side event logs capturing all automated candidate classification logs for 5 years.

Commentaire d'expert en conformité

Professional compliance incident analysis

Outsourcing your candidate screening to a 'black-box' algorithm is a massive legal liability. Under federal labor laws, you are responsible for the discrimination your software commits. You must actively audit your AI hiring systems. Fairness is a regulatory necessity, not an optional feature.

Nuances du glossaire IA & terminologie

AI Compliance FAQ

Critical answers regarding AI compliance, auditing, and organizational risks

QWhat is the basis of the class-action lawsuit against Workday?

The lawsuit alleges that Workday's proprietary screening algorithms and automated filters systematically rejected qualified applicants who were Black, disabled, or over the age of 40, violating Title VII of the Civil Rights Act.

QAre employers legally responsible for bias in third-party HR tools?

Yes. Under federal civil rights frameworks, the employer is legally liable for disparate impact resulting from tools used in their recruitment process, regardless of whether the software was developed by a third-party vendor.

QWhat is NYC Local Law 144?

NYC Local Law 144 requires employers using automated employment decision tools (AEDT) to conduct independent annual bias audits and publish the results publicly.

Parties prenantes de l'incident

Déployeurs du système

Workday

Développeurs du système

Workday

Parties lésées

Derek MobleyCandidats En Situation De HandicapCandidats De Plus De 40 AnsCandidats Afro Americains

Sources auditables (2)

Dossiers similaires recommandés