Quality assessment of included studies
Sample | Conduct of study | Follow-up | Analysis | Interpretation | Total (x/40) | Overall rating | |||||||||||||||||
Study | 1. Aims clearly stared | 2. Sample size justified | 3. Age of participant defined | 4. Measurements at start clearly stated? | 5. Measurements likely to be valid and reliable? | 6. Risk factors recorded clearly? | 7. Was the intervention before follow-up defined? | 8. Setting of the study clear? | 9. Is mode of assessment described? | 10. Did untoward events occur during the study? | 11. Was there a follow-up? | 12. Was follow-up necessary? | 13. Are losses to follow-up defined? | 14. Was basic data adequately described? | 15. Do numbers add up? | 16. Did analysis allow for passage of time? | 17. Was statistical significance assessed? | 18. Were the main findings interpreted adequately? | 19. Were null/negative findings interpreted? | 20. Are important effects overlooked? | |||
1 | Bell et al 52 | Yes | Yes | Yes | Yes | Yes | No | Yes | ? | Yes | No | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | No | 35 | 87.5 |
2 | Bock et al 53 | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | No | 36 | 90 |
3 | Bruyndonckx et al 36 | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | No | 36 | 90 |
4 | Bustos et al 54 | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | No | No | Yes | No | Yes | Yes | Yes | Yes | Yes | No | No | 30 | 75 |
5 | Calcaterra et al 55 | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | No | No | Yes | No | Yes | Yes | Yes | Yes | Yes | ? | No | 31 | 77.5 |
6 | Dobe et al e46 | ? | No | Yes | ? | ? | No | Yes | ? | ? | No | No | Yes | No | Yes | Yes | Yes | Yes | Yes | ? | No | 26 | 65 |
7 | Farpour-Lambert, et al 56 | Yes | Yes | Yes | Yes | Yes | No | Yes | ? | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | No | 37 | 92.5 |
8 | Ford et al 48 57 | Yes | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | ? | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | ? | 35 | 87.5 |
9 | Gajewska et al 37 | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | No | No | Yes | No | Yes | Yes | Yes | Yes | Yes | ? | No | 31 | 77.5 |
10 | Garanty-Bogacka et al 58 | Yes | No | Yes | Yes | Yes | ? | ? | ? | Yes | ? | No | ? | No | Yes | ? | Yes | Yes | Yes | ? | No | 26 | 65 |
11 | Grønbæk et al
59
Kazankov et al 60 | Yes | ? | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | No | 37 | 92.5 |
12 | Hvidt et al 61 | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | ? | 34 | 85 |
13 | Kirk et al 47 | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | ? | No | Yes | ? | Yes | Yes | Yes | Yes | Yes | ? | ? | 29 | 72.5 |
14 | Klijn et al 62 | Yes | No | Yes | Yes | Yes | No | Yes | ? | Yes | No | No | Yes | No | No | Yes | Yes | Yes | Yes | No | No | 27 | 67.5 |
15 | Lazzer et al 63 | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | No | No | 32 | 80 |
16 | Meyer et al 64 | Yes | No | Yes | Yes | Yes | No | No | Yes | Yes | No | No | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | No | 30 | 75 |
17 | Miraglia et al 65 | Yes | No | No | Yes | Yes | No | Yes | ? | Yes | No | No | Yes | No | ? | Yes | Yes | Yes | ? | Yes | Yes | 25 | 62.5 |
18 | Morell-Azanza et al
66
Rendo-Urteaga et al 67 | Yes | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | No | No | 32 | 80 |
19 | Murer et al
68
Aeberli et al 69 | Yes | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | No | 38 | 92 |
20 | Murdolo et al 70 | Yes | No | Yes | Yes | Yes | No | No | No | Yes | No | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | No | No | 28 | 70 |
21 | Ning et al
71
Bean et al 72 | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | No | No | 34 | 85 |
22 | Pacifico et al 73 | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | No | ? | 31 | 77.5 |
23 | Racil et al 32 | Yes | No | Yes | Yes | Yes | No | Yes | ? | Yes | No | No | ? | No | Yes | Yes | Yes | Yes | Yes | Yes | ? | 29 | 72.5 |
24 | Racil et al 33 | Yes | No | ? | Yes | Yes | No | Yes | ? | Yes | No | No | Yes | No | Yes | Yes | Yes | Yes | Yes | No | No | 28 | 70 |
25 | Reinehr et al 38 | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | No | No | Yes | No | Yes | Yes | Yes | Yes | Yes | No | ? | 29 | 72.5 |
26 | Reinehr et al 74 75 | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | No | 32 | 80 |
27 | Rohrer et al 76 | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | ? | No | 33 | 82.5 |
28 | Rolland-Cachera et al 77 | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | ? | Yes | Yes | Yes | Yes | No | No | 33 | 82.5 |
29 | Roth et al 78 | Yes | No | Yes | Yes | Yes | No | Yes | No | Yes | No | No | Yes | No | Yes | Yes | Yes | Yes | Yes | No | No | 28 | 70 |
30 | Savoye et al 79 | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | No | No | 34 | 85 |
31 | Savoye et al 80 81 | Yes | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | No | No | 36 | 90 |
32 | Savoye et al 82 | Yes | Yes | Yes | Yes | Yes | No | Yes | ? | Yes | No | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | No | 35 | 87.5 |
33 | Schiel et al 83 | Yes | No | ? | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | ? | Yes | No | ? | Yes | 29 | 72.5 |
34 | Seabra et al 34 | Yes | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | No | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | No | No | 34 | 85 |
35 | Truby et al 84 | Yes | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | No | 38 | 95 |
36 | van der Baan-Slootweg et al 85 | Yes | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | No | No | 36 | 90 |
37 | Visuthranukul et al 86 | Yes | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | No | 38 | 95 |
38 | Vitola et al 87 | Yes | No | Yes | Yes | Yes | No | ? | ? | Yes | No | No | Yes | No | Yes | Yes | Yes | Yes | Yes | No | No | 28 | 70 |
39 | Wickham et al
88
Evans et al 89 | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | ? | Yes | Yes | Yes | Yes | No | Yes | ? | 30 | 75 |
For Q6. Were risk factors clearly recorded? We said ‘no’ rather than ‘unclear’ to all the studies that did not record risk factors.
For Q10. Did untoward events occur during the study? We said ‘no’ rather than unclear if not mentioned.
Rating: not satisfactory 1%–50%; moderate quality=51%–80%; high quality=81%.
?, unclear.