Back to the index
08/ 55

SAFETY & SOCIETY

Bias.

Algorithmic bias · statistical bias

A systematic tendency in data or a system’s behavior that can skew results or produce unfair outcomes.

In plain words

In discussions of AI fairness, bias means systematic patterns that disadvantage people or misrepresent the world. The same word also has technical meanings, including an additive parameter in a model and assumptions built into a learning method.

A closer look

Bias can enter through who is represented in the data, how labels are assigned, which objective is optimized, or where a model is deployed. A dataset can be large and still omit important situations. A model can achieve high average accuracy while performing much worse for a smaller group.

Examining bias involves choosing relevant populations, comparing error patterns, and understanding the consequences of those errors. There is no single fairness score that resolves every case: different definitions can conflict, and the appropriate tradeoffs depend on the task and its social context.

In practice

AN EXAMPLE

A speech recognizer trained mostly on one accent may repeatedly mistranscribe another. Its overall accuracy can hide the problem unless performance is evaluated across different speakers.

A useful distinction

Removing sensitive attributes does not necessarily remove unfairness. Other features may act as proxies, and the labels or task design may already encode unequal treatment. Conversely, a neural-network “bias term” is not itself a claim about social prejudice.

Sources & further reading

Google — Machine Learning Crash Course: Fairness (opens in a new tab)