
How Big Data Increases Inequality and Threatens Democracy
Cathy O'Neil · 2016 · Technology
Original summary · AI-drafted, human-published · added by Library
Cathy O'Neil argues that many of the algorithms now used to sort, score, and judge people are not neutral tools but opaque, unaccountable systems that punish the poor and reward the already advantaged. Drawing on her own career as a Wall Street quant, she shows how models used in education, criminal justice, hiring, lending, and advertising can encode bias, scale it nationally, and hide it behind a false claim of mathematical objectivity.
Pick a finish date and Genius lays out the days — the plan shows today's target and keeps you honest.
Start a circle and share the code — everyone sees everyone's honest place in the book. Accountability, not leaderboards.
- A data scientist or engineer who builds scoring or ranking systems and wants to understand their social stakes - A policymaker or journalist trying to evaluate claims that an algorithm is 'fair' or 'objective' - A general reader affected by credit scores, hiring software, or predictive policing who wants to understand why
The 2008 financial crisis shows that mathematical models can cause catastrophic, society-wide harm while being treated as too complex and too authoritative to question.
A statistical model becomes destructive specifically when it combines opacity, massive scale, and a damaging feedback loop, not simply because it uses data.
The Washington D.C. teacher value-added scoring system punished good teachers with statistically meaningless numbers dressed up as objective measurement.
The U.S. News college rankings did not just measure quality, they redefined it, forcing schools to compete on metrics that often had little to do with education.
Companies used data-driven targeting to find and exploit the most anxious and financially desperate people, turning personal data into a tool for predatory marketing.
Predictive policing and recidivism scoring do not predict crime, they predict and then reinforce where police already look and whom the system already punishes.
Automated hiring tools filter out qualified candidates using hidden criteria that can amount to illegal discrimination without anyone intending it.
Workforce scheduling software optimizes for corporate efficiency at the direct expense of workers' health, income stability, and family life.
Modern credit and insurance scoring uses proxies correlated with race and class to recreate discriminatory pricing that fair-lending laws were designed to prevent.
Political campaigns' use of microtargeted data undermines the shared public information that democratic debate depends on.
Cathy O'Neil holds a PhD in mathematics from Harvard and worked as a quantitative analyst at the hedge fund D.E. Shaw before moving into data science and joining Occupy Wall Street. She writes the mathbabe blog and founded an algorithmic auditing company, giving her both technical fluency and firsthand experience of how financial models fail.