Case Studiesadvanced14 min · 8 steps
Content Moderation at Scale
Moderate 10M posts a day with a four-tier cascade — filters, classifiers, an LLM and humans — so each tier only sees what the cheaper one couldn't decide.
harm exposure2%
false positives15%
critical review240min
requestheavy workerrorresponsedatasignal
metrics are illustrativeProblemStep 1 of 8
50M users, 10M posts a day, 500 moderators
A social platform with 50M daily active users gets 10M posts per day. Today 500 human moderators take an average of 4 hours to review a post, 15% of removals are false positives, and 2% of harmful content reaches users.
Goals: harmful exposure < 0.1%, priority content reviewed in < 15 minutes, false positives < 5% — and scale without hiring moderators linearly. Severity sets the deadline:
| Category | Action | Latency |
|---|---|---|
| CSAM | Block + report | Immediate |
| Violence / gore | Block + review | < 1 min |
| Hate speech | Block + review | < 5 min |
| Harassment | Review + warn | < 15 min |
| Spam · misinfo · adult | Deprioritise · label · age-gate | < 1 hour |
Lesson 5 of 20 in Case Studies