Where AI Takes Over Compliance Is Where Contestability Goes To Die
Blog post description.
3/16/20261 min read


If there’s one place AI can quietly push institutions toward authoritarian behavior, it’s compliance enforcement.
Compliance language already leans that way:
“no choice”
“zero tolerance”
“don’t ask questions”
Now add automation.
And suddenly, decisions arrive faster, feel more objective, and become much harder to challenge.
That’s the danger.
The real test of AI governance is not whether a system can enforce rules at scale.
It’s whether people still have agency when the system gets it wrong.
The fix isn't less automation. It's architecture that keeps humans in the loop with real power.
So here’s a simple ANTI-AUTOPILOT PLAYBOOK.
1) Turn “no choice” into bounded choice
Every enforcement action should display, in plain language:
- what rule it’s based on
- what harm it’s trying to prevent
- where human discretion still exists
- how to appeal (who can pause/review it)
If discretion is truly zero, someone outside the chain of command should sign off.
2) Give employees a protected voice with real teeth
If people can’t safely challenge the system, that’s not oversight. That’s approval-by-default.
Employee representatives need real powers to:
- inspect thresholds
- review escalation rules
- pause automation (“circuit breaker”) when harms spike
3) Preserve human competence
Deskilling is guaranteed unless you proactively fight it, so:
- Run periodic manual drills
- Compare human-first vs. AI-first decisions.
- Rehearse failures: false positives, model drift, hidden biases
4) Train the skills that preserve agency
Two matter most:
- Judgment under value conflict (review real cases involving competing values)
- Craft / domain mastery (do enough real work to be able to spot nonsense)
The bottom line:
Automation can execute.
It cannot confer legitimacy.
The moment a system cannot be challenged, overridden, or corrected, it stops being compliance.
It’s AUTOMATED COERCION.
#AIGovernance #ResponsibleAI #FutureOfWork #Leadership #AIethics
Contact
bruno.gentil@sherpaconsultingasia.com
© 2026. All rights reserved.
