open access

Vol 25, No 6 (2020)
Original research articles
Published online: 2020-11-01
Submitted: 2020-06-22
Get Citation

Prospective validation of a core curriculum progress assimilation instrument for radiation oncology residentship

Geovanne Pedro Mauro, Gabriel Faria Najas, Heloisa de Carvalho, Rosangela Correa Villar
DOI: 10.1016/j.rpor.2020.09.003
·
Rep Pract Oncol Radiother 2020;25(6):951-955.

open access

Vol 25, No 6 (2020)
Original research articles
Published online: 2020-11-01
Submitted: 2020-06-22

Abstract

Objectives

To develop a tool that could assess residents’ knowledge beyond simple information gathering and evaluate its reliability.

Methods

An assessment tool of 40 objective questions and at least one essay-based question was developed to assess residents’ comprehension of general radiation oncology accordingly to validated training curricula beyond level 2 in the Bloom scale. With randomized content, questions were developed such as to be classified as at least 2 in the Bloom scale, so that reasoning and not only information gathering could be assessed. Criteria validation was made using the Classical Test Theory to describe difficulty and discrimination of each item. Reliability was tested by internal consistency using the Cronbach alpha test.

Results

Between 2016 and 2019, 24 residents were assessed. Six different versions of the test were made with a total of 240 objective questions and 18 essay-based questions. Five of the six versions were deemed valid and reliable. Comparisons between 1st (PGY-1) and 3rd (PGY-3) year residents were made. Consistently, PGY-3 residents had scores 150% higher than PGY-1 residents. Only two different PGY-3 reached the most complex level of answers in the essay-based questions. The results demonstrated that the major part of the acquired knowledge and retention occurs in the first six months of training rather than in all the following period.

Conclusion

The instrument can be considered valid. This developed instrument also raised the hypothesis that residents may not assess and analyze their acquired knowledge beyond the application level.

Abstract

Objectives

To develop a tool that could assess residents’ knowledge beyond simple information gathering and evaluate its reliability.

Methods

An assessment tool of 40 objective questions and at least one essay-based question was developed to assess residents’ comprehension of general radiation oncology accordingly to validated training curricula beyond level 2 in the Bloom scale. With randomized content, questions were developed such as to be classified as at least 2 in the Bloom scale, so that reasoning and not only information gathering could be assessed. Criteria validation was made using the Classical Test Theory to describe difficulty and discrimination of each item. Reliability was tested by internal consistency using the Cronbach alpha test.

Results

Between 2016 and 2019, 24 residents were assessed. Six different versions of the test were made with a total of 240 objective questions and 18 essay-based questions. Five of the six versions were deemed valid and reliable. Comparisons between 1st (PGY-1) and 3rd (PGY-3) year residents were made. Consistently, PGY-3 residents had scores 150% higher than PGY-1 residents. Only two different PGY-3 reached the most complex level of answers in the essay-based questions. The results demonstrated that the major part of the acquired knowledge and retention occurs in the first six months of training rather than in all the following period.

Conclusion

The instrument can be considered valid. This developed instrument also raised the hypothesis that residents may not assess and analyze their acquired knowledge beyond the application level.

Get Citation

Keywords

Graduate medical education; Residency; Radiation oncology; Educational measurement

About this article
Title

Prospective validation of a core curriculum progress assimilation instrument for radiation oncology residentship

Journal

Reports of Practical Oncology and Radiotherapy

Issue

Vol 25, No 6 (2020)

Pages

951-955

Published online

2020-11-01

DOI

10.1016/j.rpor.2020.09.003

Bibliographic record

Rep Pract Oncol Radiother 2020;25(6):951-955.

Keywords

Graduate medical education
Residency
Radiation oncology
Educational measurement

Authors

Geovanne Pedro Mauro
Gabriel Faria Najas
Heloisa de Carvalho
Rosangela Correa Villar

Important: This website uses cookies. More >>

The cookies allow us to identify your computer and find out details about your last visit. They remembering whether you've visited the site before, so that you remain logged in - or to help us work out how many new website visitors we get each month. Most internet browsers accept cookies automatically, but you can change the settings of your browser to erase cookies or prevent automatic acceptance if you prefer.

By "Via Medica sp. z o.o." sp.k., ul. Świętokrzyska 73, 80–180 Gdańsk, Poland
tel.:+48 58 320 94 94, fax:+48 58 320 94 60, e-mail: journals@viamedica.pl