Research Methodology
Our methodology is designed to be inspectable, repeatable, and resistant to the conflicts that distort most market research.
Four-Stage Research Process
01
Signal Capture
Identify market signals, public documentation, and practitioner evidence that reveal a research-worthy question.
02
Criteria Design
Define evaluation criteria and weights before any provider or subject is assessed. Criteria fixed before conclusions.
03
Evidence Assessment
Apply criteria consistently across sources. Every claim is classified as Verified Proof, Unverified Assertion, or Proof Gap.
04
Published Output
Release reports with research question, criteria, sources, limitations, disclosure, and an open correction pathway.
Coverage Gating Tests
We only cover a category when all four tests are met:
- Evidence asymmetry — claims differ meaningfully from observable reality.
- Accessible public sources — enough documentation exists to support independent verification.
- Bounded, answerable research question — the question can be answered with available evidence within a defined scope.
- Feasible evaluation framework — criteria can be applied consistently across subjects.
Evidence Classes & Weights
Every report documents which evidence classes were used. We do not treat all evidence as equal.
- Direct documentation — contracts, public pricing, terms of service, audit reports. Highest weight.
- Independent reviews — third-party audits, verified customer references, academic studies.
- Market signals — search demand, job postings, practitioner discussion, support volume proxies.
- Expert interviews — on-background conversations with practitioners, disclosed where possible.
- Regulatory filings — SEC disclosures, privacy filings, certifications.
- Demonstrations — hands-on product evaluation, screen recordings, reproducible tests.
- Editorial analysis — structured synthesis of the above, lowest standalone weight.
Eight Standard Criteria Dimensions
For category benchmarks, we score subjects across eight dimensions where applicable:
- Category fit
- Scope clarity
- Proof quality
- Pricing transparency
- Implementation model
- Support & accountability
- Trust signals
- Risk factors
Claim Classification
Every significant claim in our reports is labeled as one of three types:
- Verified Proof — supported by direct, inspectable evidence.
- Unverified Assertion — a claim made by a subject or third party that we could not independently confirm.
- Proof Gap — an important question for which no evidence was found.
Update & Review Cadence
Reports are reviewed at least annually or when material new evidence emerges. Corrections are published with a dated note and a clear description of what changed. Read our editorial policy →