Evaluation Tool for Quantitative Research Studies

0. Author, title, source (publisher and place of publication), year

1. What are the aims of the study?
2. If the paper is part of a wider study, what are its aims?

3. What are the key findings of the study?

4. What are the strengths and weaknesses of the study and theory, policy and practice implications?

5. What type of study is this?
6. What was the intervention?
7. What was the comparison intervention?
8. Is there sufficient detail given of the nature of the intervention and the comparison intervention?
9. What is the relationship of the study to the area of the topic review?

10. Within what geographical and care setting was the study carried out?

11. What was the source population?
12. What were the inclusion criteria?
13. What were the exclusion criteria?
14. How was the sample selected?
15. If more than one group of subjects, how many groups were there, and how many people were in each group?
16. How were subjects allocated to the groups?
17. What was the size of the study sample, and of any separate groups?
18. Is the achieved sample size sufficient for the study aims and to warrant the conclusions drawn?
19. Is information provided on loss to follow up?
20. Is the sample appropriate to the aims of the study?
21. What are the key sample characteristics, in relation to the topic area being reviewed?

22. Was Ethical Committee approval obtained?
23. Was informed consent obtained from participants of the study?
24. Have ethical issues been adequately addressed?

25. If there was more than one group was analysed, were the groups comparable before the intervention? In what respects were they comparable and in what were they not?
26. How were important confounding variables controlled (e.g. matching, randomisation, in the analysis stage)?
27. Was this control adequate to justify the author's conclusions?
28. Were there other important confounding variables controlled for in the study design or analyses and what were they?
29. Did the authors take these into account in their interpretation of the findings?

30. What were the outcome criteria?
31. What outcome measures were used?
32. Are the measures appropriate, given the outcome criteria?
33. What other (e.g. process, cost) measures are used?
34. Are the measures well validated?
35. Are the measures of known responsive to change?
36. Whose perspective do the outcome measures address (professional, service, user, carer)?
37. Is there a sufficient breath of perspective?
38. Are the outcome criteria useful/appropriate within routine practice?
39. Are the outcome measures useful/appropriate within routine practice?

40. What was the length of follow-up, and at what time points was outcome measurement made?
41. Is this period of follow-up sufficient to see the desired effects?

42. To what setting are the study findings generalisable? (For example, is the setting typical or representative of care settings and in what respects?)
43. To what population are the study’s findings generalisable?
44. Is the conclusion justified given the conduct of the study (For example, sampling procedure; measures of outcome used and results achieved?)
45. What are the implications for policy?
46. What are the implications for service practice?

47. What were the total number of references used in the study?
48. Are there any other noteworthy features of the study?
49. List other study references

50. Name of reviewer
51. Review date