BACKGROUND: Validation of the 2016 RANO MRI scorecard for leptomeningeal metastasis failed for multiple reasons. Accordingly, this joint EORTC Brain Tumor Group and RANO effort sought to prospectively validate a revised MRI scorecard for response assessment in leptomeningeal metastasis. METHODS: Coded paired cerebrospinal MRI of 20 patients with leptomeningeal metastases from solid cancers at baseline and follow-up after treatment and instructions for assessment were provided via the EORTC imaging platform. The Kappa coefficient was used to evaluate the interobserver pairwise agreement. RESULTS: Thirty-five raters participated, including 9 neuroradiologists, 17 neurologists, 4 radiation oncologists, 3 neurosurgeons, and 2 medical oncologists. Among single leptomeningeal metastases-related imaging findings at baseline, the best median concordance was noted for hydrocephalus (Kappa = 0.63), and the worst median concordance for spinal linear enhancing disease (Kappa = 0.46). The median concordance of raters for the overall response assessment was moderate (Kappa = 0.44). Notably, the interobserver agreement for the presence of parenchymal brain metastases at baseline was fair (Kappa = 0.29) and virtually absent for their response to treatment. 394 of 700 ratings (20 patients x 35 raters, 56%) were fully completed. In 308 of 394 fully completed ratings (78%), the overall response assessment perfectly matched the summary interpretation of the single ratings as proposed in the scorecard instructions. CONCLUSION: This study confirms the principle utility of the new scorecard, but also indicates the need for training of MRI assessment with a dedicated reviewer panel in clinical trials. Electronic case report forms with "blocking options" may be required to enforce completeness and quality of scoring.

Prospective validation of a new imaging scorecard to assess leptomeningeal metastasis: A joint EORTC BTG and RANO effort / Le Rhun, E.; Devos, P.; Winklhofer, S.; Lmalem, H.; Brandsma, D.; Kumthekar, P.; Castellano, A.; Compter, A.; Dhermain, F.; Franceschi, E.; Forsyth, P.; Furtner, J.; Galldiks, N.; Gallego Perez-Larraya, J.; Gempt, J.; Hattingen, E.; Hempel, J. M.; Lukacova, S.; Minniti, G.; O'Brien, B.; Postma, T. J.; Roth, P.; Ruda, R.; Schaefer, N.; Schmidt, N. O.; Snijders, T. J.; Thust, S.; van den Bent, M.; van der Hoorn, A.; Vogin, G.; Smits, M.; Tonn, J. C.; Jaeckle, K. A.; Preusser, M.; Glantz, M.; Wen, P. Y.; Bendszus, M.; Weller, M.. - In: NEURO-ONCOLOGY. - ISSN 1523-5866. - 24:10(2022), pp. 1726-1735. [10.1093/neuonc/noac043]

Prospective validation of a new imaging scorecard to assess leptomeningeal metastasis: A joint EORTC BTG and RANO effort

Castellano A.;
2022-01-01

Abstract

BACKGROUND: Validation of the 2016 RANO MRI scorecard for leptomeningeal metastasis failed for multiple reasons. Accordingly, this joint EORTC Brain Tumor Group and RANO effort sought to prospectively validate a revised MRI scorecard for response assessment in leptomeningeal metastasis. METHODS: Coded paired cerebrospinal MRI of 20 patients with leptomeningeal metastases from solid cancers at baseline and follow-up after treatment and instructions for assessment were provided via the EORTC imaging platform. The Kappa coefficient was used to evaluate the interobserver pairwise agreement. RESULTS: Thirty-five raters participated, including 9 neuroradiologists, 17 neurologists, 4 radiation oncologists, 3 neurosurgeons, and 2 medical oncologists. Among single leptomeningeal metastases-related imaging findings at baseline, the best median concordance was noted for hydrocephalus (Kappa = 0.63), and the worst median concordance for spinal linear enhancing disease (Kappa = 0.46). The median concordance of raters for the overall response assessment was moderate (Kappa = 0.44). Notably, the interobserver agreement for the presence of parenchymal brain metastases at baseline was fair (Kappa = 0.29) and virtually absent for their response to treatment. 394 of 700 ratings (20 patients x 35 raters, 56%) were fully completed. In 308 of 394 fully completed ratings (78%), the overall response assessment perfectly matched the summary interpretation of the single ratings as proposed in the scorecard instructions. CONCLUSION: This study confirms the principle utility of the new scorecard, but also indicates the need for training of MRI assessment with a dedicated reviewer panel in clinical trials. Electronic case report forms with "blocking options" may be required to enforce completeness and quality of scoring.
2022
brain
feasibility
MRI
response
validation
Humans
Magnetic Resonance Imaging
Treatment Outcome
Brain Neoplasms
Meningeal Carcinomatosis
Oncologists
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.11768/133736
Citazioni
  • ???jsp.display-item.citation.pmc??? 1
  • Scopus 17
  • ???jsp.display-item.citation.isi??? 0
social impact