Investigation into the Minneapolis school district's use of Gaggle during the pandemic shows how moderators subject students to relentless digital surveillance
Mark Keierleber / The 74 :
Context & Ripple Effects
This investigation lands two years after reporting showed Gaggle was already monitoring some 5 million US students with AI triage plus human reviewers — the Minneapolis district's pandemic-era deployment made that machinery visible from the inside, through what moderators actually saw and flagged. It also arrives amid a wider lockdown surge in classroom monitoring: Bloomberg reported weeks later that GoGuardian's usage in US schools exploded during lockdowns, with critics linking such tools to added psychological strain on kids.
The arc since has run toward accountability rather than retreat: by early 2023, discrimination concerns pushed Gaggle to stop flagging LGBTQ keywords in assignments (a policy reversal it announced alongside parallel reporting), and a later AP investigation found the tool — then tracking roughly 6 million students — wasn't always secure and had no research behind its safety claims.
First-order effects
- Minneapolis school district officials face direct scrutiny over what students' private messages and documents were routed to outside moderators during remote learning, and on whose authority.
- Gaggle's human moderation layer — previously described only at scale across millions of students — is now documented case-by-case, exposing the company to questions about reviewer training and flagging criteria.
Second-order effects
- Competing vendors like GoGuardian, already criticized for lockdown-era growth and kids' psychological strain, inherit the same line of questioning about how much human review their products involve.
- District procurement teams weighing surveillance contracts gain a concrete investigative record to demand disclosure on flagging rules — a dynamic that foreshadowed Gaggle's later LGBTQ keyword reversal.
Third-order effects
- If the pattern holds, the student-monitoring market shifts from selling safety assurances to defending them, with buyers demanding evidence — a gap the AP later highlighted when it found no research showing Gaggle increases safety.
- Sustained investigations into keyword-based flagging push ed-tech monitoring toward regulated territory, where states and districts set limits on which communications get scanned and who reviews them.
The trend: Pandemic-era student surveillance software is moving from rapid adoption to an accountability phase, where districts, journalists, and eventually regulators test whether monitoring vendors' safety claims survive scrutiny.