Validation Lab
We benchmark synthetic research against real human studies.
Synthetic research is useful when it predicts what real humans actually say. Here we run the same study both ways and publish the comparison, including where synthetic falls short. No marketing math. No selective reporting.
Methodology
1. Run both studies
We run the same research question through Gather Synthetic (8 to 20 AI personas grounded in real Reddit discussions and public research) and through Gather's human research platform (real moderated interviews).2. Score correlation
We compare headline findings, top consensus themes, sentiment direction, and tension points. Correlation score reflects how often synthetic and human research reach the same conclusions.3. Publish honestly
We list specific agreements and disagreements. Where synthetic missed something the humans caught, we say so. Where synthetic caught a signal humans missed, we also say so.Published comparisons
First comparisons publishing soon.
We're running the first wave of dual studies now: synthetic on this platform alongside human-moderated interviews on gatherhq.com. Results land here as they complete.
When not to trust synthetic research
Synthetic research is a force multiplier, not a replacement. The grounding score on each report tells you how well our corpus matched the study. Some honest limits:
- Novel products with no public discussion yet. The corpus has nothing to learn from.
- Deeply lived experience: medical decisions, grief, trauma, niche cultural context.
- Anything where the answer depends on what a real customer paid, signed, or actually did, not what they would say.
- Regulatory or legal decisions where precision is non-negotiable.
For these, run a real study on gatherhq.com.