Purpose
Translates the chapter’s analytical claims into regulatory-relevant risk categories, enabling direct mapping to systemic risk assessment, duty-of-care evaluation, and mitigation obligations.
Downstream intervention reduces instances but does not reconfigure the generative conditions of harm without changes to amplification and incentive structures.
Symbolic intervention loops: Reporting and moderation interfaces absorb user distress without altering amplification, replication, or monetization dynamics, allowing harm to persist at scale.
Procedural throughput optimization: Trust-and-safety systems optimize for volume processed rather than behavioral cessation, enabling continued circulation of harmful content despite high intervention activity.
Adaptive evasion feedback: Enforcement actions generate learnings that are fed back into cruelty networks, increasing resilience and sophistication.
9.2 Foreseeable Amplification Pathway
Downstream moderation: Intervention occurs after content has already achieved distributional impact, rendering mitigation temporally misaligned with harm generation.
Metric-driven amplification: Engagement-based ranking surfaces extreme content once it proves attention-efficient, irrespective of semantic harm.
Replication advantage: Disposable accounts and automated mirroring allow harmful material to outpace takedown capacity predictably.
9.3 Failure of Duty of Care
Asymmetric burden allocation: Systems impose response costs on harmed users and intermediaries while imposing minimal friction on producers and distributors of harm.
Opaque outcomes: Reporting processes lack transparent feedback and measurable efficacy, undermining user trust and informed consent.
Acknowledgment without prevention: Platforms recognize harm categories yet fail to deploy controls capable of preventing recurrence, constituting responsibility without agency.
9.4 Structural Selection Effect
Selection for evasion: Systems that penalize only detectable instances select for behaviors optimized to evade detection rather than cease.
Normalization via futility: Repeated non-resolution conditions users to disengage, reducing external corrective pressure and stabilizing harmful equilibria.
Institutional erosion: Persistent ineffectiveness degrades confidence in platform governance and broader institutional response, enabling long-term harm normalization.
Regulatory Implication:
The “useless machine” represents a systemic governance failure, not an operational shortfall. Effective mitigation requires upstream constraints on amplification, material costs for repeated circulation, and alignment of platform success metrics with demonstrable harm reduction, rather than increased procedural activity.
Information Failure Modes in Networked Violence
Elijah Morgan
© 2026 Elijah Morgan
This work is licensed under the Creative Commons Attribution 4.0 International License (CC BY 4.0).
License: https://creativecommons.org/licenses/by/4.0/
DOI: https://doi.org/10.5281/zenodo.19599231
Version 1.1
Published 2026-04-15