You do not need a science degree to judge a study. Learning how to tell if a study is trustworthy comes down to a fixed sequence of checks: who ran it, how they ran it, who paid, and whether anyone else has tried it since. Run those checks in order and most bad research falls apart on its own.
The order matters more than the depth. Start with the cheap, fast signals — authorship, publication, funding, date — because those disqualify a paper in about a minute. Only then read the methods and results, which take longer and rarely change a verdict you already suspected.
I keep a plain notebook page for every claim I run this on. It takes five minutes and it stops me from believing two different articles about the same finding because they were written by people with different incentives. Most of what follows is what goes in that page.
One thing to get out of the way first: credibility, reliability and validity are three different words people swap for each other. Credibility asks whether the people who did the work are qualified and free to say what they found. Reliability asks whether the method would produce the same answer if you repeated it. Validity asks whether the method measured what it claims to measure. A study can be reliable and still not be about the thing the headline says it is about.
Table of Contents
- What You Need Before You Start
- How to Tell If a Study Is Trustworthy: Step by Step
- 1. Identify the research question and the type of study
- 2. Check who conducted the study and their credentials
- 3. Look for a clear and appropriate study design
- 4. Examine the sample size and who was in it
- 5. Review the measures, variables and data collection
- 6. Compare the results with the size of the effect
- 7. Investigate funding, conflicts and selective reporting
- 8. Check whether independent research agrees and how to tell if a study replicates
- 9. Read the conclusion within the study’s limits
- Common Mistakes to Avoid
- Frequently Asked Questions
- How do I judge a news article that summarizes a study?
- Is one study enough to believe a health or nutrition claim?
- How many participants does a study need before I trust it?
- Does it matter which journal published the study?
- What do I do when studies on the same question disagree?
- Conclusion
What You Need Before You Start

Four things. Almost everyone who gets this wrong is missing one of them.
The paper itself, not the article about it. The abstract alone will not settle a question, but it is enough to decide whether the rest is worth reading. Abstract screening takes about two minutes.
The origin of the claim. Who is telling you this study exists? A university press release, a supplement company’s website, and a researcher who emailed you the paper have different reasons for being in your inbox. Work backwards from the headline until you reach a paper or confirm you cannot.
Plain definitions of the words being used. If you do not know what the study means by exposure, outcome, significant or risk, you cannot judge whether its conclusion follows. Look the terms up before you judge the argument, not after.
A place to record what you cannot tell. That column matters as much as the rest. A study that never says who funded it leaves you with a real gap, and pretending the gap is not there is how a half-answer turns into a full belief.
How to Tell If a Study Is Trustworthy: Step by Step
1. Identify the research question and the type of study
Read the abstract and ask what the paper is actually doing. Original research collects its own data. A commentary, editorial or perspective piece argues using someone else’s data, and carries none of the credibility. Literature reviews summarise existing work and can be very strong evidence, but only if the authors searched systematically rather than cherry-picking studies that agree with them.
Then place the study in its family. A randomized controlled trial assigns people to conditions by chance, which is why it sits near the top. A cohort study follows a group over time without assigning anything. A case-control study starts from outcomes and works backwards. A cross-sectional study takes a snapshot. Qualitative work studies experiences and meanings rather than measurement.
The question to ask: does this design actually answer the question the headline is asking? A snapshot study almost never establishes that one thing causes another, however large the difference it reports.
2. Check who conducted the study and their credentials
Every paper has named authors with institutional affiliations. Look for the institution, not just the job title. Is the researcher at a university, a national institute, a hospital or a company? Are they actually qualified in this field, or are they a generalist reporting on a specialist question?
Search the author’s name. You are looking for three things: a publication history in this field, a handful of other researchers citing their work, and no pattern of papers that only ever agree with one conclusion. Experienced researchers validating sources tend to start exactly here — at the author, their past publications and their citations — rather than at the journal logo.
Watch for the ghost signature. A respected name attached to a study they did not design or run is common in some fields, and it is a reason to slow down.
3. Look for a clear and appropriate study design
The design should match the claim. If the paper says a supplement improves sleep, and it followed 20 volunteers for one night without a comparison group, the design cannot support the conclusion regardless of how impressive the numbers look.
Look for a comparison group. Results compared to nothing tell you almost nothing, because some people improve anyway. Look for randomization, which spreads known and unknown confounds — age, health, motivation, income — across the groups instead of letting them bunch up in one.
Look for follow-up. A result that holds at two weeks and vanishes at six months is a different claim from one that holds at a year. Short follow-up is the most common quiet weakness in nutrition and psychology research.
4. Examine the sample size and who was in it
Two numbers matter more than any other in the paper: how many people were involved, and how many started. Studies that recruit 30 volunteers and publish about a common condition are describing a handful of individuals in a sentence.
Small samples produce unstable results. The same study repeated can point in a different direction, and the estimated effect swings around wildly. Large samples reduce this, but a large sample cannot rescue a badly chosen one.
Then check who was actually included and who was left out. Did participants come from one clinic, one city, one age band, one university, one income bracket? A study of college freshmen tells you very little about a policy intended for all teenagers. A healthy volunteer sample underrepresents exactly the people who get sickest, which quietly biases the result toward looking harmless.
5. Review the measures, variables and data collection
Check that researchers measured what they say they measured. Self-reported mood, self-reported diet and self-reported spending are all imperfect, and one survey question cannot carry a strong causal claim.
Look for words that do too much work. Healthy, quality, lifestyle and stress are usually defined somewhere in the methods section, and the definition sometimes does not match everyday usage. If a study reports an association between a factor and an outcome, ask whether anything else could explain it, and whether the researchers measured that something else.
Data collection should also be consistent. Were the same tools used for everyone? Were measurements taken at the same times? Were the researchers blind to who was in which group, so their expectations could not shape what they recorded?
6. Compare the results with the size of the effect
Statistical significance is a technical signal that a result is unlikely to have appeared by chance. It is not a measure of importance, and a study can be statistically significant and practically meaningless — a difference so small it changes nothing in real life.
Effect size is the measure of importance. It tells you how big the difference actually is. You do not need to do arithmetic on it. Look for plain descriptions alongside the number: how many more cases, how much better, how many people would need to change their behaviour for the result to matter.
Confidence intervals carry their own message. A wide one means the true result could be quite a bit larger or smaller than the headline figure. Headlines quote the middle of that range and drop the ends, which is why the same finding gets reported as 20 percent in one article and 8 percent in the next.
7. Investigate funding, conflicts and selective reporting
Find the funding statement, usually near the end. Not disclosed at all is itself a finding, and worth noting rather than forgiving.
Then ask what the funder would gain. A drug company funding a trial of its own drug has a conflict of interest whether or not anyone misbehaved. A supplement company paying for a study of its supplement has the same. Funding does not automatically invalidate results, and well-run industry trials are registered and published regardless of outcome. But it changes how much weight you give the finding, and it should be weighed alongside the design rather than separately.
Check for preregistration. A registered report states the method and the analysis plan before the data are collected, which makes it much harder to test dozens of outcomes, report the one that worked, and stay silent about the rest. Studies that change their measures after seeing results produce findings that will not repeat.
Finally, read the limitations section. Researchers who have tested their own work honestly say what it cannot show. A paper claiming no limitations is making a claim most experienced researchers would not make.
8. Check whether independent research agrees and how to tell if a study replicates
Most published findings do not survive an exact repetition cleanly. That is a known feature of the field, not evidence that every paper is false, and it is the strongest argument for treating any single study as a starting point rather than a conclusion.
Two free places to look for the wider picture: PubMed for health and biomedical literature, and Google Scholar across everything. If you find systematic reviews or meta-analyses that pool many studies on your question, weight those above any single paper. A systematic review follows a declared search and inclusion method, so it is less vulnerable to cherry-picking.
A replication is not the same as a repeat. Look for work in a different lab, by different researchers, with its own data, reaching the same conclusion. A comment or a citation is not a replication. Retraction Watch and a plain search of the title plus the word retracted will tell you whether the paper has since been pulled or flagged.
9. Read the conclusion within the study’s limits
Separate what the researchers found from what the paper claims. Finding a moderate association in a group of 400 adults is not the same as showing that changing behaviour will improve outcomes, and a well-written paper is careful about the difference even when a headline is not.
Run any headline through four words. Cause, cure, danger, guarantee. If any of those appear, check whether the design could actually support them. Observational work cannot establish cause. A single trial cannot establish cure. Relative risk rises sound alarming and often describe a small change in absolute numbers.
Take the conclusion and hold it next to the limitations. If they contradict, trust the limitations.
Common Mistakes to Avoid
Judging by the journal name alone. Familiar imprints are a reasonable starting filter, not a verdict. Check whether that specific paper was peer reviewed and look for retractions.
Treating peer review as a guarantee. Peer review filters out bad reasoning and obvious problems. It does not verify the raw data, and it does not detect every mismeasurement.
Being impressed by a large sample. A large sample of the wrong people is still the wrong people.
Reading only the abstract. Screening on the abstract is a fine way to decide what deserves a full read. It is a poor way to decide a claim is true.
Believing a press release. University press releases add significance and certainty the paper does not always carry. Read the abstract next to the headline and notice the gap.
Taking correlation as cause. Two things moving together can reflect a third factor nobody measured, and sometimes the direction runs the other way.
Assuming newer means better. Recent is not the same as replicated, and the most-quoted finding this month may be superseded in six months.
Dismissing a study because it disagrees with you. This is the most common error and the least visible. People accept studies that confirm what they already believe and discount careful work pointing the other way. The practical fix is to write down the strength of the evidence before you notice whether you like the conclusion.
Assuming credibility is a yes or no. Most research lands somewhere in the middle, and a careful answer is more useful than a verdict. Sometimes the honest read is that a study was done well and simply does not settle the question.
Frequently Asked Questions
How do I judge a news article that summarizes a study?
Read the abstract, then compare the headline to it word by word. Look for added certainty words, a single study presented as consensus, and relative risk presented as absolute. If the article does not name the journal or the researchers, keep looking until it does. News coverage is reporting about research, so it inherits the study’s limits and usually adds a few of its own.
Is one study enough to believe a health or nutrition claim?
No. One study is a starting point. For a personal decision, you want several independent studies, ideally pooled in a systematic review or meta-analysis, that reach the same conclusion, with the funding made visible. For anything involving diagnosis, dosage or treatment, take it to a doctor or pharmacist rather than a paper. General health reading is fine; treatment decisions belong with a clinician who knows your history.
How many participants does a study need before I trust it?
There is no magic number, and it depends on the design and what was being measured. As a rough guide for everyday reading: dozens of participants supports a cautious observation, a few hundred supports something more solid, and thousands is where population-level claims usually come from. What matters more than the total is whether the group resembles the people the conclusion is about, and whether the study followed them long enough to mean anything.
Does it matter which journal published the study?
It matters as a first filter, not a final answer. Reputable journals use peer review, have editorial boards, and publish corrections and retractions openly. But a strong journal will occasionally publish a weak paper, and the reputation does not travel to the individual study. Use the journal to rule things out, then still read the methods, funding statement and limitations yourself.
What do I do when studies on the same question disagree?
Disagreement is normal and often informative. Start by comparing the studies directly: who was included, how many people, how long they were followed, what was measured. Then look for a systematic review on that question, which is the tool researchers themselves use to reconcile conflicting findings. If the conflict persists, the fair conclusion is that the question is genuinely unsettled, not that the loudest headline wins.
Conclusion
Here is the ten-minute version. Read the abstract and the conclusion, and check whether the study is original research or an opinion about someone else’s. Look up the authors and where they work. Read the funding statement. Check the sample size and who was in it. Read the limitations. Then search the title for a retraction and look for a systematic review on the same question.
If a claim survives that and still matters to your life, you have something worth acting on. If it does not survive, you have saved yourself from a bad decision, and you can say why rather than shrugging.
And if you reach the end of a paper and genuinely cannot tell, that is a normal place to land. Ask someone who works in the field, write to the corresponding author with a specific question about the method, or take a specific question to a librarian or a clinician. Questions are the most ordinary way research gets improved.
Last thing: I am always up for hearing the studies you cannot work out. If something has been sitting on your screen for a week and you cannot tell whether to believe it, send it over. Between us we have a decent chance of working it out.


