Automated Test-Item Generation System for Retrieval Practice in Radiology Education.

Acad Radiol

Department of Radiology and Biomedical Imaging, Vice-Chair of Education, Yale University School of Medicine, New Haven, Connecticut. Electronic address:

Published: June 2019


Category Ranking

98%

Total Visits

921

Avg Visit Duration

2 minutes

Citations

20

Article Abstract

Objective: To develop and disseminate an automated item generation (AIG) system for retrieval practice (self-testing) in radiology and to obtain trainee feedback on its educational utility.

Materials And Methods: An AIG software program (Radmatic) that is capable of generating large numbers of distinct multiple-choice self-testing items from a given "item-model" was created. Instead of writing multiple individual self-testing items, an educator creates an "item-model" for one of two distinct item styles: true/false knowledge based items and image-based items. The software program then uses the item model to generate self-testing items upon trainee request. This internet-based system was made available to all radiology residents at our institution in conjunction with our didactic conferences. After obtaining institutional review board approval and informed consent, a written survey was conducted to obtain trainee feedback.

Results: Two faculty members with no computer programming experience were able to create item-models using a standard template. Twenty five of 54 (46%) radiology residents at our institution participated in the study. Twelve of these 25 (48%) study participants reported using the self-testing items regularly, which correlated well with the anonymous website usage statistics. The residents' overall impression and satisfaction with the self-testing items was quite positive, with a score of 7.89 ± 1.91 (mean ± SD) out of 10. Lack of time and email overload were the main reasons provided by residents for not using self-testing items.

Conclusion: AIG enabled self-testing is technically feasible, and is perceived positively by radiology residents as useful to their education.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.acra.2018.09.017DOI Listing

Publication Analysis

Top Keywords

self-testing items
20
radiology residents
12
system retrieval
8
retrieval practice
8
self-testing
8
software program
8
residents institution
8
items
7
radiology
5
automated test-item
4

Similar Publications

Development of the SCI-BodyMap-Measuring Mental Body Representations in Adults With Spinal Cord Injury: Protocol for Item Generation, Reliability, and Validity Testing.

JMIR Res Protoc

September 2025

Division of Physical Therapy and Rehabilitation Science, Department of Family Medicine and Community Health, Medical School, University of Minnesota-Twin Cities, Minneapolis, MN, United States.

Background: Approximately 69% of Americans with spinal cord injury (SCI) have neuropathic pain. Research suggests that impairments in mental body representations (MBRs; ie, representations of the body in the brain) likely contribute to neuropathic pain. Clinical trials in adults with SCI, focused on restoring MBR, led to improvements in sensation and movement as well as neuropathic pain relief.

View Article and Find Full Text PDF

A Scoping Review of Women with Physical Disabilities and Cervical Cancer Screening.

J Womens Health (Larchmt)

September 2025

Department of Physical Medicine and Rehabilitation, University of Michigan, Ann Arbor, Michigan, USA.

Women with physical disabilities (WWPDs) have lower screening rates for cervical cancer than the general population globally. This scoping review aims to define the type of studies and content of studies currently available to promote cervical cancer screening among WWPDs. It seeks to clarify the type of disabilities WWPDs have that lead to the poorest participation in cervical cancer screening and highlight how health care systems can address the disclosed gaps.

View Article and Find Full Text PDF

Self-efficacy and anatomical knowledge have been shown to be important in the development of medical students. Validated instruments designed to measure the construct of anatomical self-efficacy during the clinical years of medical school are limited. In this study, the Anatomical Self-Efficacy Instrument for Clinical Clerkships (ASEI-CC) was developed, and evidence for the reliability of the scores and the validity of the interpretations of the scores was gathered.

View Article and Find Full Text PDF

The knowledge management (KM) competence of health and social care managers is essential for organizations to achieve and maintain competitiveness. The study aimed to develop and validate the Managers' Competence in Knowledge Management (MCKM) instrument, which assesses health and social care MCKM. The study followed four phases: (1) items of the instrument were created based on a conceptual framework; (2) the content validity index was assessed by 11 experts.

View Article and Find Full Text PDF

Introduction: A spiritual distress scale for Thai patients with chronic non-communicable diseases (SDS-Thai-NCDs) has not yet been developed. This study aimed to develop and evaluate its psychometric properties.

Methods: A methodological approach was applied to develop and verify the quality of the scale through seven steps: defining concepts, formatting the scale, creating items, expert review, item selection, field testing, and psychometric property testing.

View Article and Find Full Text PDF