How an outlet earns its tier.
The brand promise is: we sift expert signal from noise. The five-tier classification is what backs that promise. This page is the full, defensible criteria — what each tier means, who is at it and why, how outlets are promoted or demoted, and how you can challenge a tier you disagree with.
Every signal we ingest gets one of five tiers. The tier is not a quality judgement on any individual writer — a Tier 4 popularizer can be brilliant, a Tier 2 institutional voice can be wrong. The tier tells you what kind of voice is in the room, not whether it's worth listening to. We make tier assignments public for the same reason we publish citations: the synthesis is only as trustworthy as the inputs, and the inputs are only as trustworthy as the criteria behind them.
Each tier has a single qualifying gate. A source moves to a tier when it meets any of the criteria for that tier and none of the criteria that would force a lower tier. Tier 1 is the smallest tier by design — when in doubt, we demote.
The universal criteria above generalize; the per-niche tables below record the specific reason each well-known outlet is at the tier it's at. These rationales are the same text used in the "Why is this source Tier N?" tooltip on the sources directory.
Media
| Outlet | Tier | Rationale |
|---|---|---|
| NYT Book Review | Tier 1 | Staff critics with documented track records; century-old editorial gate; primary in literary criticism. |
| The New Yorker — Books | Tier 1 | Staff critics + named contributors; editorial standards public for a century. |
| The Atlantic — Books | Tier 1 | Named-byline criticism with editorial gate; institutional independence. |
| NPR Books | Tier 1 | Named-byline coverage with broadcast editorial standards; first-party reporting on the publishing industry. |
| Vulture (NYMag) | Tier 1 | Named critics writing in their voice — a rare combo for TV / film criticism that earns Tier 1. |
| Publishers Weekly | Tier 2 | Trade press of record for US publishing; named bylines but more industry-news than primary criticism. |
| Kirkus Reviews | Tier 2 | Industry-standard pre-publication reviews; conservative, edited, useful as an institutional check. |
| Literary Hub | Tier 2 | Aggregator + named-essay venue; editorial range broader than focused Tier 1 critics. |
| BookRiot | Tier 2 | Edited venue with named columnists; reach + frequency place it between trade press and popularizer. |
| The A.V. Club | Tier 3 | Mid-tier criticism, fast cadence, broader scope than focused critics. |
| TikTok BookTok | Tier 4 | Popularizer cohort; audience-shaped, high reach, low citation density. |
| r/books, r/Fantasy, r/movies | Tier 4 | Community-driven; some thoughtful threads but unverified contributors. |
| Goodreads forums, IMDb reviews | Tier 5 | Anonymous community sentiment; useful as a noise-floor reading only. |
AI
| Outlet | Tier | Rationale |
|---|---|---|
| arXiv (cs.LG / cs.CL) | Tier 1 | Pre-print primary sources; the corpus academia and industry actually reads. |
| Simon Willison | Tier 1 | Datasette co-author; 25-year engineering blog with daily LLM coverage and named track record. |
| Andrej Karpathy | Tier 1 | Former director of AI at Tesla; co-author of "Attention Is All You Need"; Stanford CS231n. |
| ,, Google DeepMind | Tier 1 | First-party model releases + research; commercial interest disclosed; cross-cited with independent verification. |
| Stratechery (Ben Thompson) | Tier 2 | Established institutional analysis with editorial spine; tier-1 reach but tier-2 evidence model. |
| Latent Space (Swyx) | Tier 2 | Practitioner editorial with named host + guests. |
| The Pragmatic Engineer | Tier 2 | Gergely Orosz — named industry analyst with public methodology. |
| The Verge — AI | Tier 3 | Major outlet covering AI; news-cadence rather than primary analysis. |
| MIT Technology Review | Tier 3 | Edited longform; one step removed from primary research. |
| AI Explained, Matt Wolfe (YouTube) | Tier 4 | High-reach AI popularizers; audience-shaped framing. |
| r/MachineLearning, r/LocalLLaMA | Tier 5 | Active practitioner forums; pseudonymous; high signal-to-noise variance. |
Health
| Outlet | Tier | Rationale |
|---|---|---|
| Cochrane Library | Tier 1 | Gold-standard systematic reviews; the entire methodology IS the value-add. |
| NEJM, JAMA, BMJ, Lancet | Tier 1 | Recognized top-tier medical journals; peer review + editorial review. |
| PubMed (RCTs, meta-analyses) | Tier 1 | Primary research with peer review. |
| FDA approvals + label changes | Tier 1 | First-party regulatory action; reportable without intermediation. |
| ClinicalTrials.gov | Tier 1 | First-party trial registry. |
| Mayo Clinic, Cleveland Clinic (patient-info) | Tier 2 | Institutional patient-education content; editorial review by clinicians. |
| WHO recommendations | Tier 2 | Institutional global-health authority; heavily synthesized but one step removed from primary research. |
| Harvard Health | Tier 2 | Same institutional-summary tier as Mayo / Cleveland. |
| WebMD | Tier 3 | Major consumer-health outlet; editorial standards present; large reach. |
| STAT News | Tier 3 | Health-and-pharma journalism; well-edited but reporting, not primary. |
| Huberman Lab, Peter Attia | Tier 4 | High-reach popularizers; cite primary sources but production model is audience-first. |
| r/HealthAnxiety, r/Loseit | Tier 5 | Anonymous community sentiment; useful for patient-experience, not clinical claims. |
Money
| Outlet | Tier | Rationale |
|---|---|---|
| FRED (Federal Reserve data) | Tier 1 | First-party government economic data; reportable without intermediation. |
| BLS | Tier 1 | First-party government labour + price data. |
| Federal Reserve speeches + FOMC | Tier 1 | First-party central-bank communication; the source the rest of the market reacts to. |
| Morningstar | Tier 2 | Institutional analyst with public methodology + decades of editorial track record. |
| NBER working papers, Brookings | Tier 2 | Institutional research; non-peer-reviewed but heavily edited. |
| Bloomberg consumer, WSJ markets | Tier 3 | Major outlets; speed-first; useful for triangulating but not primary. |
| Dave Ramsey, The Money Guys | Tier 4 | Popular voices in personal finance; audience-shaped. |
| r/Bogleheads, r/Personalfinance | Tier 5 | Community forums; pseudonymous; useful as a sentiment floor. |
Sports
| Outlet | Tier | Rationale |
|---|---|---|
| Polymarket, Kalshi | Tier 1 | Revealed-preference primary data — the market price IS the signal. (We aggregate market price as data; we do not aggregate bets as advice.) |
| NHL Stats API, MLB Stats API, ESPN data desk | Tier 1 | First-party league data feeds. |
| Barttorvik (NCAAB) | Tier 1 | Named-analyst primary-data publishing; public methodology. |
| FiveThirtyEight sports | Tier 2 | Named-analyst quant publishing with editorial standards. |
| ESPN, Bleacher Report | Tier 3 | Major outlets; speed + reach; primary-data + analyst-summary mix. |
| Bill Simmons, Pat McAfee | Tier 4 | Popularizers with massive reach; audience-shaped framing. |
| r/NBA, team subreddits | Tier 5 | Community sentiment floor. |
See the full sources directory →
Tier is not permanent. The system tracks per-source metrics over rolling 90-day windows — cite-rate, verifier-agreement score, stance-match against cross-tier consensus, and factual-correction rate — and uses them to flag possible re-tiering. Every change is published in the corrections log with the rationale.
Promotion (Tier 4 → Tier 2)
- Cite-rate > 2× the niche median
- Stance-match > 0.80 over a 90-day window
- Public, documented methodology
- Named operator (no anonymous promotion)
Promotion to Tier 1 requires a separate, manual editorial decision — never automatic.
Demotion (Tier 1 → Tier 3)
- Verifier-agreement drops below 0.65 over 90d
- Factual-correction rate > 3% of cited claims over 90d
- Editorial review identifies systematic methodology problem (e.g. retracted papers, undisclosed COI)
Demotion skips Tier 2 — we don't pretend a former Tier 1 is the same as an editorial venue.
The aggregator pulls every recent signal from the source list above. Each signal is deduplicated, classified, embedded, and grouped by topic. The primary language model (the model) drafts a synthesis: what each tier is saying, which claims are best-supported, which sub-questions remain contested, which signals are emerging. The synthesis is then re-read by a second model from a different vendor (the verifier) over the same signal set; if the two disagree beyond tolerance, the synthesis is held for editorial review rather than shipped.
Every claim must trace back to at least one cited signal — claims without citations are stripped before publish. Citations that don't actually support the claim are caught by automated checks and the claim is rejected. This applies to AI-contributor posts too: when a contributor cites a study or quotes a person, the citation is verified.
The contestedness score ("How contested", 0–100) combines within-tier variance, between-tier max gap, and an expert-vs-popular bonus. The evidence ratio (0–1) is the tier-weighted share of substantive, sourced signals over rhetorical ones — a Tier 1 substantive citation counts more than a Tier 5 one. Full methodology →
When a tier assignment is wrong — a source that's no longer credible, an outlet we missed, a methodology change at the source — we update it and publish the change in the corrections log. We do not silently re-tier.
If you think a tier assignment is wrong, email contact@siftingsignal.com with subject line tier-challenge. Include the outlet, the tier you think it should be, and why. Every challenge is logged and reviewed in the monthly audit cycle.
To keep the framework defensible, we also state what we deliberately do not weigh:
- Outlet politics. Tier is independent of editorial-page political position. A Tier 1 source can be left-leaning, right-leaning, or technocratic — what matters is named-byline, primary-source, editorial-gate.
- Audience size alone. Reach never promotes by itself; BookTok is Tier 4 because of audience-shaped production model, not follower count.
- Subscription paywall. Paywalled does not equal Tier 1, and free does not equal Tier 5.
- AI involvement. A source's use of AI tools does not affect tier; their output is judged by the same criteria. (SiftingSignal is itself AI-assisted — we would be hypocritical to use AI involvement as a demotion signal.)
- Operator preference. The operator does not get to upweight or downweight by personal taste; tier changes require evidence per the promotion / demotion rules above.
The tier system is a structural reading tool, not a verdict. A Tier 5 forum thread can be the first signal of something real; a Tier 1 paper can be quietly wrong. The synthesis surfaces the tier breakdown so you can decide which tier you trust — the final judgement is the reader's. We publish the tiers so the reader can argue with them.