TY - GEN
T1 - Artificial intelligence-based radiotherapy planning with reinforcement learning
AU - Hrinivich, William T.
AU - Lee, Junghoon
N1 - Funding Information:
This work was supported by an AAPM Research Seed Funding Grant.
Publisher Copyright:
© 2021 SPIE.
PY - 2021
Y1 - 2021
N2 - Treatment planning is an essential step in radiation therapy (RT). It requires solving a complex inverse optimization problem through time-consuming adjustment of a set of parameters to meet clinical objectives in a trial and error fashion. Fast and robust treatment plan optimization is important to achieve effective RT of cancer patients. We propose an artificial intelligence (AI)-based RT planning strategy that uses a deep-Q reinforcement learning (RL) to automatically optimize machine parameters by finding an optimal machine control policy. The network uses RT planning CT and contours as input, and dual deep-Q networks that are trained to control the dose rate and multi-leaf collimator positions based on the current dose distribution and machine parameter state. The Q-value is computed as the discounted cumulative cost based on dose objectives, and minimized by experience-replay RL to determine the policy. The proposed approach was applied to prostate cancer RT planning, and validated on 10 prostate cancer cases. Dose distributions generated by RL were compared to conformal arcs and clinical intensity modulated radiotherapy (IMRT) plans. RL was able to generate RT plan with comparable target and normal tissue dose to clinical plans with mean±SD doses of 83.1±1.7 Gy, 39.9±10.0 Gy, and 39.6±13.9 Gy for planning target volume (PTV), rectum, and bladder, respectively (vs 84.4±1.0 Gy, 41.8±15.0 Gy, and 50.6±11.4 Gy for clinical IMRT). This preliminary study demonstrates the potential of an RL approach to enable rapid AI-based RT plan optimization, significantly reducing time and burden required for RT planning.
AB - Treatment planning is an essential step in radiation therapy (RT). It requires solving a complex inverse optimization problem through time-consuming adjustment of a set of parameters to meet clinical objectives in a trial and error fashion. Fast and robust treatment plan optimization is important to achieve effective RT of cancer patients. We propose an artificial intelligence (AI)-based RT planning strategy that uses a deep-Q reinforcement learning (RL) to automatically optimize machine parameters by finding an optimal machine control policy. The network uses RT planning CT and contours as input, and dual deep-Q networks that are trained to control the dose rate and multi-leaf collimator positions based on the current dose distribution and machine parameter state. The Q-value is computed as the discounted cumulative cost based on dose objectives, and minimized by experience-replay RL to determine the policy. The proposed approach was applied to prostate cancer RT planning, and validated on 10 prostate cancer cases. Dose distributions generated by RL were compared to conformal arcs and clinical intensity modulated radiotherapy (IMRT) plans. RL was able to generate RT plan with comparable target and normal tissue dose to clinical plans with mean±SD doses of 83.1±1.7 Gy, 39.9±10.0 Gy, and 39.6±13.9 Gy for planning target volume (PTV), rectum, and bladder, respectively (vs 84.4±1.0 Gy, 41.8±15.0 Gy, and 50.6±11.4 Gy for clinical IMRT). This preliminary study demonstrates the potential of an RL approach to enable rapid AI-based RT plan optimization, significantly reducing time and burden required for RT planning.
KW - Artificial intelligence
KW - Deep Q-learning
KW - Radiotherapy planning
KW - Reinforcement learning
UR - http://www.scopus.com/inward/record.url?scp=85105548369&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85105548369&partnerID=8YFLogxK
U2 - 10.1117/12.2580726
DO - 10.1117/12.2580726
M3 - Conference contribution
AN - SCOPUS:85105548369
T3 - Progress in Biomedical Optics and Imaging - Proceedings of SPIE
BT - Medical Imaging 2021
A2 - Linte, Cristian A.
A2 - Siewerdsen, Jeffrey H.
PB - SPIE
T2 - Medical Imaging 2021: Image-Guided Procedures, Robotic Interventions, and Modeling
Y2 - 15 February 2021 through 19 February 2021
ER -