Vol 26, No 5 (2021)
Research paper
Published online: 2021-08-13

open access

Page views 6782
Article views/downloads 543
Get Citation

Connect on Social Media

Connect on Social Media

Evaluation of the ability of three commercially available dosimeters to detect systematic delivery errors in Step-and-Shoot IMRT plans

Alison Gray123, Omemh Bawazeer4, Sankar Arumugam123, Philip Vial123, Joseph Descallar2, David Thwaites5, Lois Holloway12356
Rep Pract Oncol Radiother 2021;26(5):793-803.


Background: There is limited data on error detectability for step-and-shoot intensity modulated radiotherapy (sIMRT) plans, despite significant work on dynamic methods. However, sIMRT treatments have an ongoing role in clinical practice.

This study aimed to evaluate variations in the sensitivity of three patient-specific quality assurance (QA) devices to systematic delivery errors in sIMRT plans.

Materials and methods: Four clinical sIMRT plans (prostate and head and neck) were edited to introduce errors in: Multi-Leaf Collimator (MLC) position (increasing field size, leaf pairs offset (1–3 mm) in opposite directions; and field shift, all leaves offset (1–3 mm) in one direction); collimator rotation (1–3 degrees) and gantry rotation (0.5–2 degrees). The total dose for each plan was measured using an ArcCHECK diode array. Each field, excluding those with gantry offsets, was also measured using an Electronic Portal Imager and a MatriXX Evolution 2D ionisation chamber array. 132 plans (858 fields) were delivered, producing 572 measured dose distributions. Measured doses were compared to calculated doses for the no-error plan using Gamma analysis with 3%/3 mm, 3%/2 mm, and 2%/2 mm criteria (1716 analyses).

Results: Generally, pass rates decreased with increasing errors and/or stricter gamma criteria. Pass rate variations with detector and plan type were also observed. For a 3%/3 mm gamma criteria, none of the devices could reliably detect 1 mm MLC position errors or 1 degree collimator rotation errors. 

Conclusions: This work has highlighted the need to adapt QA based on treatment plan type and the need for detector specific assessment criteria to detect clinically significant errors.

Article available in PDF format

View PDF Download PDF file


  1. Mu G, Ludlum E, Xia P. Impact of MLC leaf position errors on simple and complex IMRT plans for head and neck cancer. Phys Med Biol. 2008; 53(1): 77–88.
  2. Low DA, Moran JM, Dempsey JF, et al. Dosimetry tools and techniques for IMRT. Med Phys. 2011; 38(3): 1313–1338.
  3. Miften M, Olch A, Mihailidis D, et al. Tolerance limits and methodologies for IMRT measurement-based verification QA: Recommendations of AAPM Task Group No. 218. Med Phys. 2018; 45(4): e53–e83.
  4. Ezzell GA, Burmeister JW, Dogan N, et al. IMRT commissioning: multiple institution planning and dosimetry comparisons, a report from AAPM Task Group 119. Med Phys. 2009; 36(11): 5359–5373.
  5. Masi L, Casamassima F, Doro R, et al. Quality assurance of volumetric modulated arc therapy: evaluation and comparison of different dosimetric systems. Med Phys. 2011; 38(2): 612–621.
  6. Bailey DW, Kumaraswamy L, Bakhtiari M, et al. EPID dosimetry for pretreatment quality assurance with two commercial systems. J Appl Clin Med Phys. 2012; 13(4): 3736.
  7. García-Vicente F, Fernández V, Bermúdez R, et al. Sensitivity of a helical diode array device to delivery errors in IMRT treatment and establishment of tolerance level for pretreatment QA. J Appl Clin Med Phys. 2012; 13(1): 3660.
  8. Heilemann G, Poppe B, Laub W. On the sensitivity of common gamma-index evaluation methods to MLC misalignments in Rapidarc quality assurance. Med Phys. 2013; 40(3): 031702.
  9. Fredh A, Scherman JB, Fog LS, et al. Patient QA systems for rotational radiation therapy: a comparative experimental study with intentional errors. Med Phys. 2013; 40(3): 031716.
  10. Carlone M, Cruje C, Rangel A, et al. Poster - Thur Eve - 21: ROC analysis in patient specific quality assurance. Med Phys. 2012; 39(7Part3): 4628.
  11. Li G, Bai S, Chen N, et al. Evaluation of the sensitivity of two 3D diode array dosimetry systems to setup error for quality assurance (QA) of volumetric-modulated arc therapy (VMAT). J Appl Clin Med Phys. 2013; 14(5): 13–24.
  12. Hussein M, Rowshanfarzad P, Ebert MA, et al. A comparison of the gamma index analysis in various commercial IMRT/VMAT QA systems. Radiother Oncol. 2013; 109(3): 370–376.
  13. Hussein M, Adams EJ, Jordan TJ, et al. A critical evaluation of the PTW 2D-ARRAY seven29 and OCTAVIUS II phantom for IMRT and VMAT verification. J Appl Clin Med Phys. 2013; 14(6): 4460.
  14. Coleman L, Skourou C. Sensitivity of volumetric modulated arc therapy patient specific QA results to multileaf collimator errors and correlation to dose volume histogram based metrics. Med Phys. 2013; 40(11): 111715.
  15. Kim JI, Park SY, Kim HJ, et al. The sensitivity of gamma-index method to the positioning errors of high-definition MLC in patient-specific VMAT QA for SBRT. Radiat Oncol. 2014; 9: 167.
  16. Vieillevigne L, Molinier J, Brun T, et al. Gamma index comparison of three VMAT QA systems and evaluation of their sensitivity to delivery errors. Phys Med. 2015; 31(7): 720–725.
  17. Kadoya N, Saito M, Ogasawara M, et al. Evaluation of patient DVH-based QA metrics for prostate VMAT: correlation between accuracy of estimated 3D patient dose and magnitude of MLC misalignment. J Appl Clin Med Phys. 2015; 16(3): 5251.
  18. Arumugam S, Xing A, Young T, et al. Sensitivity of a helical diode array dosimeter to Volumetric Modulated Arc Therapy delivery errors. Phys Med. 2015; 31(8): 1043–1054.
  19. Nithiyanantham K, Mani GK, Subramani V, et al. Analysis of direct clinical consequences of MLC positional errors in volumetric-modulated arc therapy using 3D dosimetry system. J Appl Clin Med Phys. 2015; 16(5): 296–305.
  20. Lat SZ, Suriyapee S, Sanghangthum T. Sensitivity in error detection of patient specific QA tools for IMRT plans. J Phys Conf Ser. 2016; 694: 012008.
  21. Wang J, Jin X, Peng J, et al. Are simple IMRT beams more robust against MLC error? Exploring the impact of MLC errors on planar quality assurance and plan quality for different complexity beams. J Appl Clin Med Phys. 2016; 17(3): 147–157.
  22. Liang B, Liu Bo, Zhou F, et al. Comparisons of volumetric modulated arc therapy (VMAT) quality assurance (QA) systems: sensitivity analysis to machine errors. Radiat Oncol. 2016; 11(1): 146.
  23. Defoor DL, Stathakis S, Roring JE, et al. Investigation of error detection capabilities of phantom, EPID and MLC log file based IMRT QA methods. J Appl Clin Med Phys. 2017; 18(4): 172–179.
  24. Au IW, Ciurlionis L, Campbell N, et al. Validation of the Mobius system for patient-specific quality assurance using introduced intentional errors. Australas Phys Eng Sci Med. 2017; 40(1): 181–189.
  25. Woon W, Ravindran PB, Ekayanake P, et al. A study on the effect of detector resolution on gamma index passing rate for VMAT and IMRT QA. J Appl Clin Med Phys. 2018; 19(2): 230–248.
  26. Thongsawad S, Srisatit S, Fuangrod T. Error detection sensitivity test using complex errors on three patient-specific VMAT QA systems. J Phys Conf Ser. 2019; 1285: 012030.
  27. Gay SS, Netherton TJ, Cardenas CE, et al. Dosimetric impact and detectability of multi-leaf collimator positioning errors on Varian Halcyon. J Appl Clin Med Phys. 2019; 20(8): 47–55.
  28. Sanghangthum T, Lat S, Suriyapee S. Investigation of Error Detection Capabilities of Various Patient-Specific Intensity Modulated Radiotherapy Quality Assurance Devices. Int J Med Phys Clin Eng Radiat Oncol. 2019; 08(01): 21–31.
  29. Agarwal A, Rastogi N, Das KJM, et al. Evaluating the dosimetric consequences of MLC leaf positioning errors in dynamic IMRT treatments. J Radiother Pract. 2019; 18(03): 225–231.
  30. Ghafarian M, Price M, Morales-Paliza M. Comparison of pretreatment VMAT quality assurance with the integral quality monitor (IQM) and electronic portal imaging device (EPID). J Appl Clin Med Phys. 2021; 22(3): 166–175.
  31. Sastre-Padro M, Welleweerd J, Malinen E, et al. Consequences of leaf calibration errors on IMRT delivery. Phys Med Biol. 2007; 52(4): 1147–1156.
  32. Létourneau D, Gulam M, Yan Di, et al. Evaluation of a 2D diode array for IMRT quality assurance. Radiother Oncol. 2004; 70(2): 199–206.
  33. Yan G, Liu C, Simon TA, et al. On the sensitivity of patient-specific IMRT QA to MLC positioning errors. J Appl Clin Med Phys. 2009; 10(1): 120–128.
  34. Gueorguiev G, Cotter C, Turcotte JC, et al. Clinical implementation and error sensitivity of a 3D quality assurance protocol for prostate and thoracic IMRT. J Appl Clin Med Phys. 2015; 16(5): 179–192.
  35. Shang Q, Godley A, Huang L, et al. Sensitivity of array detector measurements in determining shifts of MLC leaf positions. J Appl Clin Med Phys. 2017; 18(5): 80–88.
  36. Alaswad M, Coleman L. The sensitivity of patient-specific IMRT QA methods in detecting systematic errors: field-by-field versus single-gantry-angle composite. J Phys Conf Ser. 2019; 1248: 012063.
  37. Bawazeer O, Gray A, Arumugam S, et al. Evaluation of the ability of a 2D ionisation chamber array and an EPID to detect systematic delivery errors in IMRT plans. J Phys Conf Ser. 2014; 489: 012071.
  38. Arumugam S, Xing A, Young T, et al. Comparison of three commercial dosimetric systems in detecting clinically significant VMAT delivery errors. Phys Med. 2016; 32(10): 1238–1244.
  39. Deshpande S, Geurts M, Vial P, et al. Clinical significance of treatment delivery errors for helical TomoTherapy nasopharyngeal plans - A dosimetric simulation study. Phys Med. 2017; 33: 159–169.
  40. Blake SJ, Arumugam S, Holloway L, et al. Investigating the impact of treatment delivery uncertainties on treatment effectiveness for lung SABR. Australas Phys Eng Sci Med. 2017; 40(4): 823–829.
  41. Pogson EM, Aruguman S, Hansen CR, et al. Multi-institutional comparison of simulated treatment delivery errors in ssIMRT, manually planned VMAT and autoplan-VMAT plans for nasopharyngeal radiotherapy. Phys Med. 2017; 42: 55–66.
  42. Alharthi T, Pogson EM, Arumugam S, et al. Pre-treatment verification of lung SBRT VMAT plans with delivery errors: Toward a better understanding of the gamma index analysis. Phys Med. 2018; 49: 119–128.
  43. Pogson EM, Arumugam S, Hansen CR, et al. Comparison of multi-institutional pre-treatment verification for VMAT of nasopharynx with delivery errors. Phys Med. 2018; 53: 25–31.
  44. Alharthi T, Arumugam S, Vial P, et al. Pre-treatment verification of lung SBRT VMAT plans with delivery errors: Toward a better understanding of the gamma index analysis. Phys Med. 2018; 49: 119–128.
  45. Alharthi T, Vial P, Holloway L, et al. Intrinsic detector sensitivity analysis as a tool to characterize ArcCHECK and EPID sensitivity to variations in delivery for lung SBRT VMAT plans. J Appl Clin Med Phys. 2021; 22(6): 229–240.
  46. Gregory K, Bibbo G, Pattison JE. A standard approach to measurement uncertainties for scientists and engineers in medicine. Australas Phys Eng Sci Med. 2005; 28(2): 131–139.
  47. Xing A, Arumugam S, Deshpande S, et al. Streamlining EPID-based IMRT quality assurance: auto-analysis and auto-report generation. J Phys Conf Ser. 2014; 489: 012084.
  48. Hanley J, Dresser S, Simon W, et al. Task Group 142, American Association of Physicists in Medicine. Task Group 142 report: quality assurance of medical accelerators. Med Phys. 2009; 36(9): 4197–4212.
  49. Bonferroni Method. http://www.ma.utexas.edu/users/mks/384E07/multcomp. (7th October 2019).
  50. Low DA, Zhu XR, Purdy JA, et al. The influence of angular misalignment on fixed-portal intensity modulated radiation therapy. Med Phys. 1997; 24(7): 1123–1139.