BACKGROUND: Validation of the 2016 RANO MRI scorecard for leptomeningeal metastasis failed for multiple reasons. Accordingly, this joint EORTC Brain Tumor Group and RANO effort sought to prospectively validate a revised MRI scorecard for response assessment in leptomeningeal metastasis. METHODS: Coded paired cerebrospinal MRI of 20 patients with leptomeningeal metastases from solid cancers at baseline and follow-up after treatment and instructions for assessment were provided via the EORTC imaging platform. The Kappa coefficient was used to evaluate the interobserver pairwise agreement. RESULTS: Thirty-five raters participated, including 9 neuroradiologists, 17 neurologists, 4 radiation oncologists, 3 neurosurgeons, and 2 medical oncologists. Among single leptomeningeal metastases-related imaging findings at baseline, the best median concordance was noted for hydrocephalus (Kappa = 0.63), and the worst median concordance for spinal linear enhancing disease (Kappa = 0.46). The median concordance of raters for the overall response assessment was moderate (Kappa = 0.44). Notably, the interobserver agreement for the presence of parenchymal brain metastases at baseline was fair (Kappa = 0.29) and virtually absent for their response to treatment. 394 of 700 ratings (20 patients x 35 raters, 56%) were fully completed. In 308 of 394 fully completed ratings (78%), the overall response assessment perfectly matched the summary interpretation of the single ratings as proposed in the scorecard instructions. CONCLUSION: This study confirms the principle utility of the new scorecard, but also indicates the need for training of MRI assessment with a dedicated reviewer panel in clinical trials. Electronic case report forms with "blocking options" may be required to enforce completeness and quality of scoring.
Prospective validation of a new imaging scorecard to assess leptomeningeal metastasis: A joint EORTC BTG and RANO effort / Le Rhun, E.; Devos, P.; Winklhofer, S.; Lmalem, H.; Brandsma, D.; Kumthekar, P.; Castellano, A.; Compter, A.; Dhermain, F.; Franceschi, E.; Forsyth, P.; Furtner, J.; Galldiks, N.; Gallego Perez-Larraya, J.; Gempt, J.; Hattingen, E.; Hempel, J. M.; Lukacova, S.; Minniti, G.; O'Brien, B.; Postma, T. J.; Roth, P.; Ruda, R.; Schaefer, N.; Schmidt, N. O.; Snijders, T. J.; Thust, S.; van den Bent, M.; van der Hoorn, A.; Vogin, G.; Smits, M.; Tonn, J. C.; Jaeckle, K. A.; Preusser, M.; Glantz, M.; Wen, P. Y.; Bendszus, M.; Weller, M.. - In: NEURO-ONCOLOGY. - ISSN 1523-5866. - 24:10(2022), pp. 1726-1735. [10.1093/neuonc/noac043]
Prospective validation of a new imaging scorecard to assess leptomeningeal metastasis: A joint EORTC BTG and RANO effort
Castellano A.;
2022-01-01
Abstract
BACKGROUND: Validation of the 2016 RANO MRI scorecard for leptomeningeal metastasis failed for multiple reasons. Accordingly, this joint EORTC Brain Tumor Group and RANO effort sought to prospectively validate a revised MRI scorecard for response assessment in leptomeningeal metastasis. METHODS: Coded paired cerebrospinal MRI of 20 patients with leptomeningeal metastases from solid cancers at baseline and follow-up after treatment and instructions for assessment were provided via the EORTC imaging platform. The Kappa coefficient was used to evaluate the interobserver pairwise agreement. RESULTS: Thirty-five raters participated, including 9 neuroradiologists, 17 neurologists, 4 radiation oncologists, 3 neurosurgeons, and 2 medical oncologists. Among single leptomeningeal metastases-related imaging findings at baseline, the best median concordance was noted for hydrocephalus (Kappa = 0.63), and the worst median concordance for spinal linear enhancing disease (Kappa = 0.46). The median concordance of raters for the overall response assessment was moderate (Kappa = 0.44). Notably, the interobserver agreement for the presence of parenchymal brain metastases at baseline was fair (Kappa = 0.29) and virtually absent for their response to treatment. 394 of 700 ratings (20 patients x 35 raters, 56%) were fully completed. In 308 of 394 fully completed ratings (78%), the overall response assessment perfectly matched the summary interpretation of the single ratings as proposed in the scorecard instructions. CONCLUSION: This study confirms the principle utility of the new scorecard, but also indicates the need for training of MRI assessment with a dedicated reviewer panel in clinical trials. Electronic case report forms with "blocking options" may be required to enforce completeness and quality of scoring.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.