Altaf H Khan
King Abdullah International Medical Research Center
National Guard Health Affairs
Saudi Arabia
Title: Workshop on Choice of agreement in medical imaging: Inter-rater, intra-rater reliability index or receiver operating curve or any other index to rely on
Biography
Biography: Altaf H Khan
Abstract
As advancement in medical imaging has revolutionized the healthcare industry and now burden rests on the shoulders of the biomedical researchers and clinicians to make fruitful inferences from these bulk of the data. The very fundamental question and the crux of the issue is how radiologists as observers could agree on some reliable indices such as intra or inter-rater agreement, Receiver-Operating Curve (ROC) or any other reliable index which would pave the way for making clinical decision in the prognosis of an illness, because FDA (Federal Drug Administration) also strongly requires in clinical trial studies to establish as well as support the efficacy of medical imaging agent. In this paper, an attempt has been made to discuss existing reliability indices such as Cohen kappa, weighted kappa, and kappa used in triage system as well as review has been done for other existing indices. Also, ROC has been discussed with or without any gold standard medical imaging modalities, since there are no unanimous regulations from the manufacturing industries. Using PROC IML, macros has been written to compute reliability index used in triage system which is based upon taking into account the severity of mis-triage in which the reliability index has been calculated by applying an alternative weighting method. Computed reliability indices such as simple kappa, weighted kappa, as well as triage kappa have been compared with those indices that are available in standard statistical software packages namely SAS, R, Stata, etc. Reliability indices based on Bayesian approach have also been discussed.
