The use of variance components for the assessment of outcome measures in rheumatology


Allen, EJ; Farewell, VT; (2011) The use of variance components for the assessment of outcome measures in rheumatology. Journal of applied statistics, 38 (1). pp. 145-159. ISSN 0266-4763 DOI: https://doi.org/10.1080/02664760903301135

Full text not available from this repository. (Request a copy)

Abstract

There is current interest in the development of new or improved outcome measures for rheumatological diseases. In the early stages of development, attention is usually directed to how well the measure distinguishes between patients and whether different observers attach similar values of the measure to the same patient. An approach, based on variance components, to the assessment of outcome measures is presented. The need to assess different aspects of variation associated with a measure is stressed. The terms 'observer reliability' and 'agreement' are frequently used in the evaluation of measurement instruments, and are often used interchangeably. In this paper, we use the terms to refer to different concepts assessing different aspects of variation. They are likely to correspond well in heterogeneous populations, but not in homogeneous populations where reliability will generally be low but agreement may well be high. Results from a real patient exercise, designed to study a set of tools for assessing myositis outcomes, are used to illustrate the approach that examines both reliability and agreement, and the need to evaluate both is demonstrated. A new measure of agreement, based on the ratio of standard deviations, is presented and inference procedures are discussed. To facilitate the interpretation of the combination of measures of reliability and agreement, a classification system is proposed that provides a summary of the performance of the tools. The approach is demonstrated for discrete ordinal and continuous outcomes.

Item Type: Article
Keywords: agreement, reliability, variance components, myositis, measurement, CONCORDANCE CORRELATION-COEFFICIENT, INTRACLASS, CORRELATION-COEFFICIENT, EVALUATE REPRODUCIBILITY, INITIAL VALIDATION, RELIABILITY, AGREEMENT, DISEASE, SQUARES, KAPPA
Faculty and Department: Faculty of Epidemiology and Population Health > Dept of Medical Statistics
Web of Science ID: 285148900011
URI: http://researchonline.lshtm.ac.uk/id/eprint/1769

Statistics


Download activity - last 12 months
Downloads since deposit
0Downloads
329Hits
Accesses by country - last 12 months
Accesses by referrer - last 12 months
Impact and interest
Additional statistics for this record are available via IRStats2

Actions (login required)

Edit Item Edit Item