Questions to Ask a Researcher
Rigorous prompts to understand research design, limitations, practical implications, and how to read results without hype.
1What real-world problem does this research aim to inform?
Click to see why this works
What real-world problem does this research aim to inform?
Click to see why this works
Why this works
Anchors theory to practical impact and stakeholders.
2How was the study designed and why that method?
Click to see why this works
How was the study designed and why that method?
Click to see why this works
Why this works
Connects design choice to validity and constraints.
3What are the key assumptions—and how did you test them?
Click to see why this works
What are the key assumptions—and how did you test them?
Click to see why this works
Why this works
Surfaces hidden dependencies that can break findings.
4What sources of bias were most concerning?
Click to see why this works
What sources of bias were most concerning?
Click to see why this works
Why this works
Improves critical reading of sampling and measurement.
5How big are the effects—and are they practically meaningful?
Click to see why this works
How big are the effects—and are they practically meaningful?
Click to see why this works
Why this works
Distinguishes statistical from practical significance.
6What do the confidence intervals tell us?
Click to see why this works
What do the confidence intervals tell us?
Click to see why this works
Why this works
Encourages uncertainty-aware interpretation.
7How might results differ in other populations or contexts?
Click to see why this works
How might results differ in other populations or contexts?
Click to see why this works
Why this works
Tests generalizability and boundary conditions.
8What replication or follow-up work is most important?
Click to see why this works
What replication or follow-up work is most important?
Click to see why this works
Why this works
Promotes scientific humility and next steps.
9What’s the most honest critique of your own study?
Click to see why this works
What’s the most honest critique of your own study?
Click to see why this works
Why this works
Invites transparency and improves trust.
10How should practitioners apply (or not apply) these findings?
Click to see why this works
How should practitioners apply (or not apply) these findings?
Click to see why this works
Why this works
Translates research into action with guardrails.
11What data or code are available for review?
Click to see why this works
What data or code are available for review?
Click to see why this works
Why this works
Checks openness, reproducibility, and standards.
12How did you handle missing data and outliers?
Click to see why this works
How did you handle missing data and outliers?
Click to see why this works
Why this works
Clarifies data hygiene and robustness.
13Were there preregistered hypotheses or analysis plans?
Click to see why this works
Were there preregistered hypotheses or analysis plans?
Click to see why this works
Why this works
Reduces p-hacking and hindsight bias.
14Who funded the work—and any conflicts of interest?
Click to see why this works
Who funded the work—and any conflicts of interest?
Click to see why this works
Why this works
Adds context for potential incentives or pressure.
15Which figure or table should a busy reader focus on?
Click to see why this works
Which figure or table should a busy reader focus on?
Click to see why this works
Why this works
Directs attention to decision-relevant evidence.
16What’s the biggest way media might misinterpret this?
Click to see why this works
What’s the biggest way media might misinterpret this?
Click to see why this works
Why this works
Prepares for clear, responsible communication.
17What related work should I read next?
Click to see why this works
What related work should I read next?
Click to see why this works
Why this works
Builds a curated path through the literature.
18If a practitioner has one hour, what’s the best use of it?
Click to see why this works
If a practitioner has one hour, what’s the best use of it?
Click to see why this works
Why this works
Bridges research and practice efficiently.
19What would you change if you could rerun the study?
Click to see why this works
What would you change if you could rerun the study?
Click to see why this works
Why this works
Encourages iteration and better future designs.
20What open question are you most excited about now?
Click to see why this works
What open question are you most excited about now?
Click to see why this works
Why this works
Ends with curiosity and future direction.
Understanding Research Without Hype
Expert tips and techniques for getting the most out of these questions.
Ask About Limits and Use
Start With Design
Method and sampling shape everything downstream.
Quantify Uncertainty
Intervals tell you what’s known versus guessed.
Mind External Validity
Context determines whether results carry over.
Reading Checklist
Five Checks
Common Pitfalls
P-Value Worship
Look for effect sizes and intervals, not just p<0.05.
Overgeneralizing
Small or narrow samples rarely justify sweeping claims.