Abbreviated version of the REAPPRAISED Checklist.
Checklist of questions:
Realistic Data
Is the data collection plausible?
Errors
Are calculations of proportions and percentages correct?
Are results internally consistent?
Are the results of statistical testing internally consistent and plausible?
Analysis
Are the study methods plausible?
Do the methods fit the question or claim?
‘P-hacking’: biased or selective analyses that promote fragile results
Legit Statistics
Are any data impossible or implausible?
Are any of the outcome data unexpected outliers?
Are there any discrepancies between reported data and (participant) inclusion criteria?
Legible Context
Is it clear in what context the data was collected?
Is the result framed in the context of the data, or a broader, global context?
Y – Why else would I doubt this?
Anything else that gives you an uneasy feeling about this study or article?