Remove Benchmarking Remove Handbook Remove Metrics Remove Speed
article thumbnail

What We Learned Auditing Sophisticated AI for Bias

O'Reilly

The internal control questionnaire in the Office of the Comptroller of the Currency’s MRM Handbook (starting pg. When that data is used to train an AI system, that system can replicate our bad behavior with speed and scale. Despite flaws, start with simple metrics and clear thresholds. More are published all the time.