Home Radiology Research in Quality and Safety
Post
Cancel

Radiology Research in Quality and Safety

Promoting quality and safety research is now essential for radiology as reimbursement is increasingly tied to measures of quality, patient safety, efficiency, and appropriateness of imaging. This article provides an overview of key features necessary to promote successful quality improvement efforts in radiology. Emphasis is given to current trends and future opportunities for directing research. Establishing and maintaining a culture of safety is paramount to organizations wishing to improve patient care. The correct culture must be in place to support quality initiatives and create accountability for patient care. Focused educational curricula are necessary to teach quality and safety-related skills and behaviors to trainees, staff members, and physicians. The increasingly complex healthcare landscape requires that organizations build effective data infrastructures to support quality and safety research. Incident reporting systems designed specifically for medical imaging will benefit quality improvement initiatives by identifying and learning from system errors, enhancing knowledge about safety, and creating safer systems through the implementation of standardized practices and standards. Finally, validated performance measures must be developed to accurately reflect the value of the care we provide for our patients and referring providers. Common metrics used in radiology are reviewed with focus on current and future opportunities for investigation.

Introduction

The Institute of Medicine (IOM) brought much attention to medical errors and the quality of health care in the United States through their pivotal report “To Err is Human” in 1999. Two years later, in “Crossing the Quality Chasm,” the IOM recommended a strategy for improving quality by promoting patient-centered aims, aligning payment policieswith quality improvement, practicing evidence-based medicine, and developing an information technology infrastructure . Despite national efforts to drive these changes through meaningful use, national quality goals, and payment incentives such as the Practice Quality Reporting System, the effects on care quality and delivery have been limited in the face of rising costs.

As proposed by the IOM, recent legislation has sought to align quality improvement with new payment policies. Scheduled to begin as early as 2019, the Medicare Access and CHIP Reauthorization Act will increasingly tie quality to reimbursement through the Merit Based Incentive Payment (MIPS) program and Advanced Alternative Payment Models. Of the two, most physicians are expected to be reimbursed through MIPS, in which quality (50%) and clinical practice improvement activities (15%) comprise the majority of the reimbursement criteria . Although these measures have yet to be finalized, robust quality and safety programs will be necessary to improve patient care and will determine physician reimbursement going forward.

Given the need for change through quality improvement activities, the AUR Radiology Research Alliance convened a task force to explore this topic, with the results presented in this review. This article examines five key dimensions of a quality and safety program including an organization’s safety culture, incident reporting, education requirements, information technology infrastructure, and common performance measures in radiology. Opportunities for current and future research in each category are discussed in the following sections.

Culture of Safety

Health organizations that establish a culture of safety operate with fewer adverse safety events . A positive safety culture recognizes that medical errors are often caused by underlying systems-level issues, and that human error is inevitable within a highly complex and dynamic healthcare environment . Rather than blaming and punishing individuals for errors, individuals are encouraged to speak up and disclose both errors and near-misses, so as to uncover latent issues, learn from mistakes, and facilitate crafting solutions that will mitigate future events . A culture of safety embraces the role of all workers in reducing patient harm, decreases authority gradients, and empowers frontline staff to make changes toward improvements . Providing a work environment where staff feel comfortable and safe in disclosing errors, without fear of retribution, facilitates such a system .

The related concept of “just culture” balances the focus on systems-level issues with individual accountability . A just culture considers an individual’s intent, adherence to safety procedures, and history of unsafe acts in determining the level of responsibility and associated consequences . This model recognizes that safety problems are exacerbated and errors underreported if individuals with good intention are punished for errors that occur while following standard procedures . Individuals are thus disciplined only in the setting of unjustified reckless behavior.

Measuring Institutional Culture

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Creating a Culture of Safety

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Quality and Safety (QS) Education

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Incident Reporting in Imaging

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

IT Infrastructure

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Radiology Quality and Safety Performance Metrics

Get Radiology Tree app to read full this article<

TABLE 1

Individual and Group Performance Indicators by IOM Quality Aims

IOM Aim Example of Individual Radiologist PI Example of Group PI Safe Adherence to patient safety policies, participation in incident reporting, critical results reporting Institutional dose reduction programs, facility design, call to order process for procedures Timely Critical results reporting, report turnaround time, daily management huddle participation Patient wait time, time from order to study completion Efficient Application of ALARA principles, incidental findings management Room turnaround times, reducing system overutilization, RVU per FTE, and measuring value-added work Effective Standardized reporting, use of subspecialty guidelines, evidence-based use of imaging techniques, radiology-pathology correlation participation Measuring adverse events within department, use of ACR appropriateness criteria, clinical decision support Equitable Practicing within the promoted local diversity culture Providing uniform access to imaging services/follow-up across socioeconomic status, adjusting waiting areas and consent procedures to be gender and culturally sensitive Patient centered Number of patient counseling sessions, named positively in patient satisfaction surveys, knowledge of patient history when selecting the imaging protocol and interpreting the imaging studies Providing patient radiology information through online portals, adjusting procedure consent, and reporting information to lay terms

ACR, American College of Radiology; IOM, Institute of Medicine; RVU, relative value unit; FTE, full time employee; ALARA, as low as reasonably achievable.

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

TABLE 2

Performance Metrics Grouped by Elements of Patient Care

Element of Care Definition Examples Structure Setting of healthcare delivery to the patient Professional certification, maintenance of certification, licensure, advanced certification, other professional skills, daily management huddle participation Process Delivery of care to the patient Use of appropriateness criteria, critical results reporting, report turnaround times, adherence to ALARA principles, adherence to local patient safety policies, participation in incident reporting, providing a patient-centered experience Outcome Contribution to the patient’s health outcome and satisfaction Infection rates, wrong site events, procedural complication rates, biopsy yields

ALARA, as low as reasonably achievable.

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Individual Versus Group Performance Metrics

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Benchmarking and Overview of National Efforts

Get Radiology Tree app to read full this article<

Commonly Used Quality and Safety Performance Indicators

Radiation Dose Monitoring and Optimization

Get Radiology Tree app to read full this article<

Decision Support for Ordering Providers

Get Radiology Tree app to read full this article<

Critical Results Reporting

Get Radiology Tree app to read full this article<

Report TATs

Get Radiology Tree app to read full this article<

Peer Review

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Procedural Competency

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Get Radiology Tree app to read full this article<

Conclusion

Get Radiology Tree app to read full this article<

References

  • 1. Institute of Medicine : To err is human: building a safer health system. Washington, DC2000.

  • 2. Centers for Medicare and Medicaid Services : Quality initiatives and patient assessment instruments. Available at https://www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-Instruments/Value-Based-Programs/MACRA-MIPS-and-APMs/NPRM-QPP-Fact-Sheet.pdf Accessed July 11, 2016

  • 3. Muething S.E., Goudie A., Schoettker P.J., et. al.: Quality improvement initiative to reduce serious safety events and improve patient safety culture. Pediatrics 2012; 130: pp. e423-e431.

  • 4. Mardon R.E., Khanna K., Sorra J., et. al.: Exploring relationships between hospital patient safety culture and adverse events. J Patient Saf 2010; 6: pp. 226-232.

  • 5. Pronovost P.J., Berenholtz S.M., Goeschel C.A., et. al.: Creating high reliability in health care organizations. Health Serv Res 2006; 41: pp. 1599-1617.

  • 6. Larson D.B., Kruskal J.B., Krecke K.N., et. al.: Key concepts of patient safety in radiology. Radiographics 2015; 35: pp. 1677-1693.

  • 7. Siewert B., Hochman M.G.: Improving safety through Human Factors Engineering. Radiographics 2015; 35: pp. 1694-1705.

  • 8. Cosby K.S., Croskerry P.: Profiles in patient safety: authority gradients in medical error. Acad Emerg Med 2004; 11: pp. 1341-1345.

  • 9. Abujudeh H.H.: “Just culture”: is radiology ready?. J Am Coll Radiol 2015; 12: pp. 4-5.

  • 10. Singer S.J., Gaba D.M., Falwell A., et. al.: Patient safety climate in 92 US hospitals: differences by work area and discipline. Med Care 2009; 47: pp. 23-31.

  • 11. Institute of Medicine : Keeping patients safe: transforming the work environment of nurses.2004.National Academies PressWashington, DC

  • 12. The Joint Commission : Revisions to LD.03.01.01. Hospital Accrediation Program. Jan 2012; Available at http://www.jointcommission.org/assets/1/6/Pre-Pubs_LD.03.01.01_HAP.pdf Accessed October 28, 2015

  • 13. Agency for Healthcare Research and Quality : Hospital survey on patient safety culture. Available at http://www.ahrq.gov/professionals/quality-patient-safety/patientsafetyculture/hospital/index.html Accessed October 28, 2015

  • 14. Donnelly L.F., Dickerson J.M., Goodfriend M.A., et. al.: Improving patient safety: effects of a safety program on performance and culture in a department of radiology. AJR Am J Roentgenol 2009; 193: pp. 165-171.

  • 15. Legg J.S., Aaron L., Dempsey M.C.: Patient safety perceptions among vascular interventional technologists. J Allied Health 2013; 42: pp. 106-111.

  • 16. Singer S.J., Meterko M., Baker L.C., et. al.: Patient Safety Climate in Healthcare Organizations (PSCHO).2006.Measurement Instrument Database for the Social Science Available at http://www.midss.org/sites/default/files/pscho_survey_2006.pdf Accessed October 28, 2015

  • 17. Singer S.J., Falwell A., Gaba D.M., et. al.: Patient safety climate in US hospitals: variation by management level. Med Care 2008; 46: pp. 1149-1156.

  • 18. Donnelly L.F., Dickerson J.M., Goodfriend M.A., et. al.: Improving patient safety in radiology. AJR Am J Roentgenol 2010; 194: pp. 1183-1187.

  • 19. Falcone R.A., Daugherty M., Schweer L., et. al.: Multidisciplinary pediatric trauma team training using high-fidelity trauma simulation. J Pediatr Surg 2008; 43: pp. 1065-1071.

  • 20. Ruddy R.M., Patterson M.D.: Medical simulation: a tool for recognition of and response to risk. Pediatr Radiol 2008; 38: pp. S700-S706.

  • 21. Bump G.M., Calabria J., Gosman G., et. al.: Evaluating the clinical learning environment: resident and fellow perceptions of patient safety culture. J Grad Med Educ 2015; 7: pp. 109-112.

  • 22. Accreditation Council for Graduate Medical Education : Clinical Learning Environment Review (CLER). Available at https://www.acgme.org/Portals/0/PDFs/CLER/CLER_Brochure.pdf Accessed May 9, 2016

  • 23. Kadom N., Sloan K., Gupte G., et. al.: Radiology residency quality improvement curriculum: lessons learned. Curr Probl Diagn Radiol 2016; 45: pp. 319-323.

  • 24. Institute for Healthcare Improvement : Open school for health care professionals. Available at http://www.ihi.org/education/ihiopenschool/Pages/default.aspx Accessed May 9, 2015

  • 25. American Hospital Association : Hospitals in pursuit of excellence. Available at www.hpoe.org Accessed May 9, 2016

  • 26. Swensson J., McMahan L., Rase B., et. al.: Curricula for teaching MRI safety, and MRI and CT contrast safety to residents: how effective are live lectures and online modules?. J Am Coll Radiol 2015; 12: pp. 1093-1096.

  • 27. Pfeifer K., Staib L., Arango J., et. al.: High-fidelity contrast reaction simulation training: performance comparison of faculty, fellows, and residents. J Am Coll Radiol 2016; 13: pp. 81-87.

  • 28. Gould B.E., Grey M.R., Huntington C.G., et. al.: Improving patient care outcomes by teaching quality improvement to medical students in community-based practices. Acad Med 2002; 77: pp. 1011-1018.

  • 29. Coleman M.T., Nasraty S., Ostapchuk M., et. al.: Introducing practice-based learning and improvement ACGME core competencies into a family medicine residency curriculum. Jt Comm J Qual Saf 2003; 29: pp. 238-247.

  • 30. Oyler J., Vinci L., Arora V., et. al.: Teaching internal medicine residents quality improvement techniques using the ABIM’s practice improvement modules. J Gen Intern Med 2008; 23: pp. 927-930.

  • 31. Peters A.S., Kimura J., Ladden M.D., et. al.: A self-instructional model to teach systems-based practice and practice-based learning and improvement. J Gen Intern Med 2008; 23: pp. 931-936.

  • 32. Patow C.A., Karpovich K., Riesenberg L.A., et. al.: Residents’ engagement in quality improvement: a systematic review of the literature. Acad Med 2009; 84: pp. 1757-1764.

  • 33. Voss J.D., May N.B., Schorling J.B., et. al.: Changing conversations: teaching safety and quality in residency training. Acad Med 2008; 83: pp. 1080-1087.

  • 34. Wong B.M., Etchells E.E., Kuper A., et. al.: Teaching quality improvement and patient safety to trainees: a systematic review. Acad Med 2010; 85: pp. 1425-1439.

  • 35. Leape L.L.: Reporting of adverse events. N Engl J Med 2002; 347: pp. 1633-1638.

  • 36. Jones D.N., Benveniste K.A., Schultz T.J., et. al.: Establishing national medical imaging incident reporting systems: issues and challenges. J Am Coll Radiol 2010; 7: pp. 582-592.

  • 37. Itri J.N., Krishnaraj A.: Do we need a national incident reporting system for medical imaging?. J Am Coll Radiol 2012; 9: pp. 329-335.

  • 38. World Alliance for Patient Safety : WHO draft guidelines for adverse event reporting and learning systems.2005.

  • 39. Altman D.E., Clancy C., Blendon R.J.: Improving patient safety—five years after the IOM report. N Engl J Med 2004; 351: pp. 2041-2043.

  • 40. Leape L.L., Berwick D.M.: Five years after to err is human: what have we learned?. JAMA 2005; 293: pp. 2384-2390.

  • 41. White J.: Adverse event reporting and learning systems: a review of the literature.2007.

  • 42. Pennsylvania Patient Safety Authority : Annual report 2015. Available at http://patientsafetyauthority.org/PatientSafetyAuthority/Documents/annual_report_2015.pdf Accessed May 9, 2016

  • 43. The Royal Australian and New Zealand College of Radiologists : Welcome to the Radiology Events Register (RaER): Australian Patient Safety Foundation. Available at http://www.raer.org.au/ Accessed December 14, 2015

  • 44. Welti K.: Disclosure of medical adverse events: a study of the University of Michigan health system model.2007.Massachusetts Bar Association Available at http://www.massbar.org/publications/section-review/2007/v9-n1/disclosure-of-medical-adverse-events-a-study-of-the-university-of-michigan-health-system-model Accessed July 11, 2016

  • 45. Malpass A., Helps S.C., Runciman W.B.: An analysis of Australian adverse drug events. J Qual Clin Pract 1999; 19: pp. 27-30.

  • 46. Kaldjian L.C., Jones E.W., Wu B.J., et. al.: Reporting medical errors to improve patient safety: a survey of physicians in teaching hospitals. Arch Intern Med 2008; 168: pp. 40-46.

  • 47. Mendelson D.S., Rubin D.L.: Imaging informatics: essential tools for the delivery of imaging services. Acad Radiol 2013; 20: pp. 1195-1212.

  • 48. Safdar N.M., Siegel E., Erickson B.J., et. al.: Enabling comparative effectiveness research with informatics: show me the data!. Acad Radiol 2011; 18: pp. 1072-1076.

  • 49. Post A.R., Kurc T., Cholleti S., et. al.: The Analytic Information Warehouse (AIW): a platform for analytics using electronic health record data. J Biomed Inform 2013; 46: pp. 410-424.

  • 50. Chute C.G., Beck S.A., Fisk T.B., et. al.: The Enterprise Data Trust at Mayo Clinic: a semantically integrated warehouse of biomedical data. J Am Med Inform Assoc 2010; 17: pp. 131-135.

  • 51. Ferranti J.M., Langman M.K., Tanaka D., et. al.: Bridging the gap: leveraging business intelligence tools in support of patient safety and financial effectiveness. J Am Med Inform Assoc 2010; 17: pp. 136-143.

  • 52. VanLare J.M., Conway P.H.: Value-based purchasing—national programs to move from volume to value. N Engl J Med 2012; 367: pp. 292-295.

  • 53. Institute of Medicine, Committee on Quality of Health Care in America : Crossing the quality chasm: a new health system for the 21st century. Washington, DC2001.

  • 54. Donabedian A.: Evaluating the quality of medical care. 1966. Milbank Q 2005; 83: pp. 691-729.

  • 55. American College of Radiology : ACR Accreditation. Available at http://www.acraccreditation.org/ Accessed July 14, 2016

  • 56. Narayan A., Cinelli C., Carrino J.A., et. al.: Quality measurements in radiology: a systematic review of the literature and survey of radiology benefit management groups. J Am Coll Radiol 2015; 12: pp. 1173-1181. e23

  • 57. Gray C.G.: Team vs. individual performance appraisals. Available at http://smallbusiness.chron.com/team-vs-individual-performance-appraisals-20040.html Accessed July 17, 2016

  • 58. Office of Personnel Management (OPM) : 1998: performance appraisal for teams. Available at https://www.opm.gov/policy-data-oversight/performance-management/reference-materials/historical/teams.pdf Accessed July 17, 2016

  • 59. Hunter J.: The W. Edwards Deming Institute Blog. Available at https://blog.deming.org/2012/10/dr-deming-called-for-the-elimination-of-the-annual-performance-appraisal/ Accessed July 17, 2016

  • 60. Deming W.E.: Out of the crisis.1986.Massachusetts Institute of Technology, Center for Advanced Engineering StudyCambridge (MA)

  • 61. Agency for Healthcare Research and Quality (AHRQ) : 2014: safety culture. Available at http://www.ahrq.gov/professionals/quality-patient-safety/patientsafetyculture/hospital/2014/index.html Accessed July 17, 2016

  • 62. Office of Personnel Management (OPM) : 1993: evaluating team performance. Available at https://www.opm.gov/policy-data-oversight/performance-management/reference-materials/historical/evaluating_team.pdf Accessed July 17, 2016

  • 63. Centers for Medicare and Medicaid Services : Medicare Program; Merit-Based Incentive Payment System (MIPS) and Alternative Payment Model (APM) incentive under the physician fee schedule, and criteria for physician-focused payment models. Available at https://www.federalregister.gov/articles/2016/05/09/2016-10032/medicare-program-merit-based-incentive-payment-system-mips-and-alternative-payment-model-apm Accessed July 17, 2016

  • 64. Morin R.L., Seibert J.A., Boone J.M.: Radiation dose and safety: informatics standards and tools. J Am Coll Radiol 2014; 11: pp. 1286-1297.

  • 65. Centers for Medicare and Medicaid Services : Physician quality reporting system. Available at https://www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-Instruments/PQRS/index.html Accessed March 21, 2016

  • 66. Hendee W.R., Becker G.J., Borgstede J.P., et. al.: Addressing overutilization in medical imaging. Radiology 2010; 257: pp. 240-245.

  • 67. Khorasani R., Hentel K., Darer J., et. al.: Ten commandments for effective clinical decision support for imaging: enabling evidence-based practice to improve quality and reduce waste. AJR Am J Roentgenol 2014; 203: pp. 945-951.

  • 68. Zafar H.M., Mills A.M., Khorasani R., et. al.: Clinical decision support for imaging in the era of the Patient Protection and Affordable Care Act. J Am Coll Radiol 2012; 9: 907–18 e5

  • 69. Johnson C.D., Swensen S.J., Applegate K.E., et. al.: Quality improvement in radiology: white paper report of the Sun Valley Group meeting. J Am Coll Radiol 2006; 3: pp. 544-549.

  • 70. Sanelli P.C., Gold R.L., Greenberg E.D., et. al.: Work-in-progress toward incorporating patients’ preferences in practice guidelines for imaging aneurysmal subarachnoid hemorrhage. Acad Radiol 2009; 16: pp. 535-540.

  • 71. Itri J.N.: Patient-centered radiology. Radiographics 2015; 35: pp. 1835-1846.

  • 72. Lacson R., O’Connor S.D., Andriole K.P., et. al.: Automated critical test result notification system: architecture, design, and assessment of provider satisfaction. AJR Am J Roentgenol 2014; 203: pp. W491-W496.

  • 73. Larson P.A., Berland L.L., Griffith B., et. al.: Actionable findings and the role of IT support: report of the ACR Actionable Reporting Work Group. J Am Coll Radiol 2014; 11: pp. 552-558.

  • 74. The Joint Commission : Sentinel event data. Available at http://www.jointcommission.org/sentinel_event.aspx Accessed May 9, 2016

  • 75. The Joint Commission : Hospital national patient safety goals. Available at http://www.jointcommission.org/assets/1/6/2015_HAP_NPSG_ER.pdf Accessed May 9, 2016

  • 76. Kelley L.: Improving satisfaction performance through faster turnaround times. Radiol Manage 2011; 33: pp. 38-41.

  • 77. Rosenkrantz A.B., Bonavita J.A., Foran M.P., et. al.: Is there an association between radiologist turnaround time of emergency department abdominal CT studies and radiologic report quality?. Emerg Radiol 2014; 21: pp. 5-10.

  • 78. Hussain S., Hussain J.S., Karam A., et. al.: Focused peer review: the end game of peer review. J Am Coll Radiol 2012; 9: pp. 430-433. e1

  • 79. Borgstede J.P., Lewis R.S., Bhargavan M., et. al.: RADPEER quality assurance program: a multifacility study of interpretive disagreement rates. J Am Coll Radiol 2004; 1: pp. 59-65.

  • 80. Brook O.R., Romero J., Brook A., et. al.: The complementary nature of peer review and quality assurance data collection. Radiology 2015; 274: pp. 221-229.

  • 81. Abujudeh H., Pyatt R.S., Bruno M.A., et. al.: RADPEER peer review: relevance, use, concerns, challenges, and direction forward. J Am Coll Radiol 2014; 11: pp. 899-904.

  • 82. Butler G.J., Forghani R.: The next level of radiology peer review: enterprise-wide education and improvement. J Am Coll Radiol 2013; 10: pp. 349-353.

  • 83. Loreto M., Kahn D., Glanc P.: Survey of radiologist attitudes and perceptions regarding the incorporation of a departmental peer review system. J Am Coll Radiol 2014; 11: pp. 1034-1037.

  • 84. Larson D.B., Nance J.J.: Rethinking peer review: what aviation can teach radiology about performance improvement. Radiology 2011; 259: pp. 626-632.

  • 85. Johnson C.D., Krecke K.N., Miranda R., et. al.: Quality initiatives: developing a radiology quality and safety program: a primer. Radiographics 2009; 29: pp. 951-959.

  • 86. Sorace J., Aberle D.R., Elimam D., et. al.: Integrating pathology and radiology disciplines: an emerging opportunity?. BMC Med 2012; 10: pp. 100.

  • 87. Siewert B., Sosna J., McNamara A., et. al.: Missed lesions at abdominal oncologic CT: lessons learned from quality assurance. Radiographics 2008; 28: pp. 623-638.

  • 88. Ladley D., Wilkinson I., Young L.: The impact of individual versus group rewards on work group performance and cooperation: a computational social science approach. J Bus Res 2015; 68: pp. 2412-2425.

  • 89. Kanne J.P.: Peer review in cardiothoracic radiology. J Thorac Imaging 2014; 29: pp. 270-276. quiz 277-278

  • 90. Mendiratta-Lala M., Eisenberg R.L., Steele J.R., et. al.: Quality initiatives: measuring and managing the procedural competency of radiologists. Radiographics 2011; 31: pp. 1477-1488.

  • 91. Bari V.: Direct observation of procedural skills in radiology. AJR Am J Roentgenol 2010; 195: pp. W14-W18.

  • 92. Ahmed K., Keeling A.N., Khan R.S., et. al.: What does competence entail in interventional radiology?. Cardiovasc Intervent Radiol 2010; 33: pp. 3-10.

  • 93. Powell D.K., Jamison D.K., Silberzweig J.E.: An endovascular simulation exercise among radiology residents: comparison of simulation performance with and without practice. Clin Imaging 2015; 39: pp. 1080-1085.

  • 94. Nesbitt C.I., Birdi N., Mafeld S., et. al.: The role of simulation in the development of endovascular surgical skills. Perspect Med Educ 2016; 5: pp. 8-14.

  • 95. Itri J.N., Jones L.P., Kim W., et. al.: Developing an automated database for monitoring ultrasound- and computed tomography-guided procedure complications and diagnostic yield. J Digit Imaging 2014; 27: pp. 270-279.

This post is licensed under CC BY 4.0 by the author.