Home Analysis of Statistical Biases in Studies Used to Formulate Guidelines
Post
Cancel

Analysis of Statistical Biases in Studies Used to Formulate Guidelines

Rationale and Objectives

To analyze the statistical biases in the studies used to derive cardiac magnetic resonance–based major and minor criteria for the diagnosis of arrhythmogenic right ventricular cardiomyopathy (ARVC).

Materials and Methods

ARVC is a rare disorder of the heart that can lead to sudden death in young adults. Cardiac magnetic resonance imaging (CMR) plays a role in the diagnosis by contributing to the criteria set by experts. The original criteria emphasized qualitative analysis of CMR. The criteria were modified in 2010 to provide quantitative cutoffs.

Results

We apply the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool for systematic review of diagnostic accuracy to the studies cited in the guidelines written in 1994 and revised in 2010. We use the signaling questions in QUADAS-2 to identify different types of statistical bias.

Conclusions

The studies have understandable biases that affect the sensitivity and specificity of CMR in the diagnosis of ARVC, as well as the truth of the disease state. There is potential to overdiagnose ARVC particularly in low prevalence populations.

Arrhythmogenic right ventricular cardiomyopathy (ARVC) is a rare cardiomyopathy that primarily affects the right ventricle (RV) and is potentially fatal if untreated . The incidence is 1 in 5000 individuals . Affected individuals can present with ventricular arrhythmias and sudden cardiac death and typically present in the third decade of life. There is a genetic component of unclear magnitude .

A task force was established in 1994 , and another convened in 2009, , to develop criteria for the diagnosis of ARVC ( Table 1 ). Cardiac magnetic resonance imaging (CMR) contributes to the criteria for the diagnosis of ARVC.

Table 1

Summary of the Original (1994) and Modified (2010) Task Force Criteria for the Diagnosis of ARVC/D

Adapted from .

Global or Regional Dysfunction and Structural Alterations Original Task Force Criteria (1994) Modified Task Force Criteria (2010) Not divided according to modality:

By MRI:

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

ARVC/D, arrhythmogenic right ventricular cardiomyopathy/dysplasia; BSA, body surface area; F, female; LV, right ventricle; M, male; MRI, magnetic resonance imaging; RVEDV, right ventricular end-diastolic volume; RVEF, right ventricular ejection fraction; Se, sensitivity; Sp, specificity.

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Method

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

An Overview of Bias

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Analysis

Get Radiology Tree app to read full this article<

Table 2

The QUADAS-2 Tool was Used to Evaluate Studies Included in the Development of the Original and Revised Task Force Criteria for the Diagnosis of ARVC/D

ARVC/D, arrhythmogenic right ventricular cardiomyopathy/dysplasia; QUADAS-2, Quality Assessment of Diagnostic Accuracy Studies.

Each study is evaluated on four domains–patient selection, index test, reference standard, and flow and timing–for the risk of bias and applicability concerns. The format of the results reported here follows the downloadable template provided at http://www.quadas.org .

Table 3

Evaluation of Biases Introduced into the Studies Used to Develop the Original and Modified Task Force Criteria for ARVC/D

Study IB VB DGSB SB IGSB Original Task Force Criteria Ricci et al., 1992 X X Robertson et al., 1985 X X Daubert et al., 1988 X X Blomström et al., 1988 X X X Daliento et al., 1990 X X Revised Task Force Criteria Marcus et al., 2009 X X X X Sen-Chowdhry et al., 2006 X X Bluemke et al., 2003 X X Bomma et al., 2004 X X X X

ARVC/D, arrhythmogenic right ventricular cardiomyopathy/dysplasia; DGSB, double gold standard bias; IB, incorporation bias; IGSB, imperfect gold standard bias; SB, spectrum bias; VB, verification bias.

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Discussion

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

References

  • 1. Thiene G.: Arrhythmogenic cardiomyopathy: from autopsy to genes and transgenic mice (SCVP Achievement Award Lecture, San Antonio, TX, February 27, 2011). Cardiovasc. Pathol 2012; 21: pp. 229-239.

  • 2. Romero J., Mejia-Lopez E., Manrique C., et. al.: Arrhythmogenic right ventricular cardiomyopathy (ARVC/D): a systematic literature review. Clin. Med. Insights. Cardiol 2013; 7: pp. 97-114.

  • 3. James C.A., Calkins H.: Update on arrhythmogenic right ventricular dysplasia/cardiomyopathy (ARVD/C). Curr. Treat. Options Cardiovasc. Med 2013; 15: pp. 476-487.

  • 4. Kayser H., van der Wall E.E., Sivanathan M., et. al.: Arrhythmogenic right ventricular dysplasia: a review. RadioGraphics 2002; 22: pp. 639-650.

  • 5. Sen-Chowdhry S., Syrris P., Ward D., et. al.: Clinical and genetic characterization of families with arrhythmogenic right ventricular dysplasia/cardiomyopathy. Circulation 2007; 115: pp. 1710-1720.

  • 6. Den Haan A.D., Tan B.Y., Zikusoka M.N., et. al.: Comprehensive desmosome mutation analysis in North Americans with arrhythmogenic right ventricular dysplasia/cardiomyopathy. Circ. Cardiovasc. Genet 2009; 2: pp. 428-435.

  • 7. Mckenna W.J., Thiene G., Nava A., et. al.: Diagnosis of arrhythmogenic right ventricular dysplasia/cardiomyopathy. Br Hear. J 1994; 71: pp. 215-218.

  • 8. Marcus F.I., McKenna W.J., Sherrill D., et. al.: Diagnosis of arrhythmogenic right ventricular cardiomyopathy/dysplasia: proposed modification of the task force criteria. Circulation 2010; 121: pp. 1533-1541.

  • 9. Ricci C., Longo R., Pagnan L., et. al.: Magnetic resonance imaging in right ventricular dysplasia. Am. J. Cardiol 1992; 70: pp. 1589-1595.

  • 10. Hamada S., Takamiya M., Ohe T., et. al.: Arrhythmogenic right ventricular dysplasia: evaluation with electron-beam CT. Radiology 1993; 187: pp. 723-727.

  • 11. Robertson J.H., Bardy G.H., German L.D., et. al.: Comparison of two-dimensional echocardiographic and angiographic findings in arrhythmogenic right ventricular dysplasia. Am. J. Cardiol 1985; 55: pp. 1506-1508.

  • 12. Daubert C., Descaves C., Foulgoc J.L., et. al.: Critical analysis of cineangiographic criteria for diagnosis of arrhythmogenic right ventricular dysplasia. Am. Heart J 1988; 115: pp. 448-459.

  • 13. Blomström-Lundqvist C., Beckman-Suurküla M., Wallentin I., et. al.: Ventricular dimensions and wall motion assessed by echocardiography in patients with arrhythmogenic right ventricular dysplasia. Eur. Heart J 1988; 9: pp. 1291-1302.

  • 14. Daliento L., Rizzoli G., Thiene G., et. al.: Diagnostic accuracy of right ventriculography in arrhythmogenic right ventricular cardiomyopathy. Am. J. Cardiol 1990; 66: pp. 741-745.

  • 15. te Riele A., Tandri H., Bluemke D.A.: Arrhythmogenic right ventricular cardiomyopathy (ARVC): cardiovascular magnetic resonance update. J. Cardiovasc. Magn. Reson 2014; 16: pp. 50.

  • 16. Whiting P.F., Rutjes A.W.S., Westwood M.E., et. al.: QUADAS-2: a revised tool for the Quality Assessment of Diagnostic Accuracy Studies. Ann. Intern. Med 2011; 155: pp. 529-536.

  • 17. C. Ricci, R. Longo, L. Pagnan, L.D. Palma, B. Pinamonti, F. Camerini, et al., Magnetic resonance imaging in right ventricular dysplasia, (1992) 1589–1595.

  • 18. Marcus F.I., Zareba W., Calkins H., et. al.: Arrhythmogenic right ventricular cardiomyopathy/dysplasia clinical presentation and diagnostic evaluation: results from the North American Multidisciplinary Study. Heart Rhythm 2009; 6: pp. 984-992.

  • 19. Sen-Chowdhry S., Prasad S.K., Syrris P., et. al.: Cardiovascular magnetic resonance in arrhythmogenic right ventricular cardiomyopathy revisited: comparison with task force criteria and genotype. J. Am. Coll. Cardiol 2006; 48: pp. 2132-2140.

  • 20. Bluemke D.A., Krupinski E.A., Ovitt T., et. al.: MR imaging of arrhythmogenic right ventricular cardiomyopathy: morphologic findings and interobserver reliability. Cardiology 2003; 99: pp. 153-162.

  • 21. Bomma C., Rutberg J., Tandri H., et. al.: Misdiagnosis of arrhythmogenic right ventricular dysplasia/cardiomyopathy. J Cardiovasc Electrophysiol 2004; 15: pp. 300-306.

  • 22. Sica G.T.: Bias in research studies. Radiology 2006; 238: pp. 780-789.

  • 23. Kohn M.A., Carpenter C.R., Newman T.B.: Understanding the direction of bias in studies of diagnostic test accuracy. Acad. Emerg. Med 2013; 20: pp. 1194-1206.

  • 24. Newman T.B., Kohn M.A.: Evidence-based diagnosis.2009.Cambridge University PressNew York, NY

  • 25. Vermes E., Strohm O., Otmani A., et. al.: Impact of the revision of arrhythmogenic right ventricular cardiomyopathy/dysplasia task force criteria on its prevalence by CMR criteria. JACC. Cardiovasc. Imaging 2011; 4: pp. 282-287.

  • 26. Liu T., Pursnani A., Sharma U.C., et. al.: Effect of the 2010 task force criteria on reclassification of cardiovascular magnetic resonance criteria for arrhythmogenic right ventricular cardiomyopathy. J. Cardiovasc. Magn. Reson 2014; 16: pp. 47.

This post is licensed under CC BY 4.0 by the author.