Objectives: To assess whether the use of the revised Cochrane risk of bias tool for randomized trials (RoB2) in systematic reviews (SRs) adheres to RoB2 guidance.Methods: We searched MEDLINE, Embase, Cochrane Library from 2019 to May 2021 to identify SRs using RoB2. We analyzed methods and results sections to see whether risk of bias was assessed at outcome measure level and applied to primary outcomes of the SR as per RoB2 guidance. The relation between SR characteristics and adequacy of RoB2 use was examined by logistic regression analysis. Results: Two hundred-eight SRs were included. We could assess adherence in 137 SRs as 12 declared using RoB2 but actu-ally used RoB1 and 59 did not report the number of primary outcomes. The tool usage was adherent in 69.3% SRs. Considering SRs with multiple primary outcomes, adherence dropped to 28.8%. We found a positive association between RoB2 guidance adherence and the methodological quality of the reviews assessed by AMSTAR2 (p-for-trend 0.007). Multivariable regression analysis suggested journal impact factor [first quartile vs. other quartiles] was associated with RoB2 adherence (OR 0.34; 95% CI: 0.16-0.72).Conclusions: Many SRs did not adhere to RoB2 guidance as they applied the tool at the study level rather than at the outcome measure level. Lack of adherence was more likely among low and very low quality reviews. (c) 2022 The Author(s). Published by Elsevier Inc. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).

Adherence of systematic reviews to Cochrane RoB2 guidance was frequently poor: a meta epidemiological study / Minozzi, Silvia; Gonzalez-Lorenzo, Marien; Cinquini, Michela; Berardinelli, Daniela; Cagnazzo, Celeste; Ciardullo, Stefano; De Nardi, Paola; Gammone, Mariarosaria; Iovino, Paolo; Lando, Alex; Rissone, Marco; Simeone, Giovanni; Stracuzzi, Marta; Venezia, Giovanna; Moja, Lorenzo; Costantino, Giorgio. - In: JOURNAL OF CLINICAL EPIDEMIOLOGY. - ISSN 0895-4356. - ELETTRONICO. - 152:(2022), pp. 47-55. [10.1016/j.jclinepi.2022.09.003]

Adherence of systematic reviews to Cochrane RoB2 guidance was frequently poor: a meta epidemiological study

Iovino, Paolo;
2022

Abstract

Objectives: To assess whether the use of the revised Cochrane risk of bias tool for randomized trials (RoB2) in systematic reviews (SRs) adheres to RoB2 guidance.Methods: We searched MEDLINE, Embase, Cochrane Library from 2019 to May 2021 to identify SRs using RoB2. We analyzed methods and results sections to see whether risk of bias was assessed at outcome measure level and applied to primary outcomes of the SR as per RoB2 guidance. The relation between SR characteristics and adequacy of RoB2 use was examined by logistic regression analysis. Results: Two hundred-eight SRs were included. We could assess adherence in 137 SRs as 12 declared using RoB2 but actu-ally used RoB1 and 59 did not report the number of primary outcomes. The tool usage was adherent in 69.3% SRs. Considering SRs with multiple primary outcomes, adherence dropped to 28.8%. We found a positive association between RoB2 guidance adherence and the methodological quality of the reviews assessed by AMSTAR2 (p-for-trend 0.007). Multivariable regression analysis suggested journal impact factor [first quartile vs. other quartiles] was associated with RoB2 adherence (OR 0.34; 95% CI: 0.16-0.72).Conclusions: Many SRs did not adhere to RoB2 guidance as they applied the tool at the study level rather than at the outcome measure level. Lack of adherence was more likely among low and very low quality reviews. (c) 2022 The Author(s). Published by Elsevier Inc. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
2022
152
47
55
Minozzi, Silvia; Gonzalez-Lorenzo, Marien; Cinquini, Michela; Berardinelli, Daniela; Cagnazzo, Celeste; Ciardullo, Stefano; De Nardi, Paola; Gammone, Mariarosaria; Iovino, Paolo; Lando, Alex; Rissone, Marco; Simeone, Giovanni; Stracuzzi, Marta; Venezia, Giovanna; Moja, Lorenzo; Costantino, Giorgio
File in questo prodotto:
File Dimensione Formato  
1-s2.0-S0895435622002244-main.pdf

accesso aperto

Tipologia: Pdf editoriale (Version of record)
Licenza: Creative commons
Dimensione 353.98 kB
Formato Adobe PDF
353.98 kB Adobe PDF

I documenti in FLORE sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificatore per citare o creare un link a questa risorsa: https://hdl.handle.net/2158/1349973
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 5
  • ???jsp.display-item.citation.isi??? 4
social impact