A review of statistical methods in the analysis of data arising from observer reliability studies (Part II)

Keywords

Categorical variable, Intraclass correlation, Ordinal data, Statistics, Multivariate statistics

References

• The advanced theory of statisticsG. S. Watson, M. G. Kendall, Alan Stuart — 1945
• The test-retest reliability of qualitative dataLouis Guttman — 1946
• Measuring nominal scale agreement among many raters.Joseph L. Fleiss — 1971
• The Analysis of Cross-Classified Data: Independence, Quasi-Independence, and Interactions in Contingency Tables with or without Missing EntriesLeo A. Goodman — 1968
• Large sample standard errors of kappa and weighted kappa.Joseph L. Fleiss, Jacob Cohen, B. S. Everitt — 1969
• A NEW VIEW OF INTER‐OBSERVER AGREEMENTEugene I. Burdock, Joseph L. Fleiss, Anne S. Hardesty — 1963
• Bias In Multinomial ClassificationP. Krishnaswami, Rajkshwar Nath — 1968
• Observer error in the interpretation of chest films; an international investigation.A. L. Cochrane, L. Henry Garland — 1952
• Measures of the Amount of Ecologic Association Between SpeciesLee R. Dice — 1945
• The technic of homogeneous tests compared with some aspects of scale analysis and factor analysis.Jane Loevinger — 1948
• Response Variance and its EstimationIvan P. Fellegi — 1964
• Measures of response agreement for qualitative data: Some generalizations and alternatives.Richard J. Light — 1971
• A general approach to estimation of variance componentsGary G. Koch — 1967
• Errors of Measurement, Precision, Accuracy and the Statistical Comparison of Measuring InstrumentsFrank E. Grubbs — 1973
• Estimating Individual Rater Reliabilities from Analysis of Treatment EffectsJohn E. Overall — 1968
• Deriving coefficients of reliability and agreement for ratings.Annette E. Maxwell, A. E. G. Pilliner — 1968
• An Alternative Approach to Multivariate Response Error Models for Sample Survey Data with Applications to Estimators Involving Subclass MeansGary G. Koch — 1973
• Generalizability of scores influenced by multiple sources of varianceGoldine C. Gleser, Lee J. Cronbach, Nageswari Rajaratnam — 1965
• THE UNRELIABILITY OF CYANOSIS IN THE RECOGNITION OF ARTERIAL ANOXEMIAJulius H. Comroe, Stella Y. Botelho — 1947
• Disagreement Between Observers in an Epidemiological Study of Respiratory DiseaseR. S. F. Schilling, J. P. W. Hughes, I. Dingwall‐Fordyce — 1955

Cited by

• Maximum Likelihood Estimation of Observer Error‐Rates Using the EM AlgorithmA. P. Dawid, A. M. Skene — 1979
• A Study of Coder VariabilityGraham Kalton, Richard R. Stowell — 1979
• Measurement Error Studies at the National Center for Education Statistics.Sameena Salvucci, Elizabeth Walter, Valerie Martin Conley — 1997
• Agreement between raters and groups of ratersSophie Vanbelle — 2009
• Caring for quality: The use of the Minimum Data Set (MDS) for research into quality of care and patient functioning in nursing homesWilco P. Achterberg — 2004
• Quality of life and its measurement in nursing homesDebby L. Gerritsen — 2004
• Handbook of Multimethod Measurement in PsychologyM. Eid, E. Diener — 2005
• Health-related information postdischarge: telephone versus face-to-face interviewing.Nicol Korner‐Bitensky, Sharon Wood-Dauphinée, Jack Siemiatycki — 1994
• A review of agreement measure as a subset of association measure between ratersA. O. Adejumo, Christian Heumann, Helge Toutenburg — 2004
• The reliability of the Geriatric Mental State ExaminationA. S. Henderson, Paul Duncan‐Jones, Robert Finlay‐Jones — 1983
• The reproducibility of intrapartum cardiotocogram assessments.Marie‐Dominique Beaulieu, J Fabia, Bernard Leduc — 1982
• Using replicate observations in observer agreement studies with binary assessments.Stuart G. Baker, Laurence S. Freedman, Mahesh Parmar — 1991
• The assessment and meaning of intraobserver error in population studies based on discontinuous cranial traits.José Moltó — 1979
• Husband-wife agreement about reproductive goalsLolagene C. Coombs, Dorothy Z. Fernandez — 1978
• Interobserver agreement in the assessment of muscle strength and functional abilities in Guillain‐Barré syndromeR. P. Kleyweg, F.G.A. van der Meché, Paul Schmitz — 1991
• Variability of quantitative digital subtraction coronary angiography before and after percutaneous transluminal coronary angioplasty.Mark Sanz, G.B.John Mancini, Michael T. LeFree — 1987
• Another look at interrater agreement.Rebecca Zwick — 1988
• Como medir a confiabilidade de dobras cutâneasRosely Sichieri, Vânia de Mattos Fonseca, Cláudia de Souza Lopes — 1999
• Estimators of kappa-exact small sample propertiesJohn J. Koval, Nicole Blackman — 1996
• Inter-rater agreement in assessing occupational exposure in a case-control study.Mark S. Goldberg, Jack Siemiatycki, Michel Gérin — 1986

Related papers

• A COMPARISON OF SOME METHODS TO ANALYZE REPEATED MEASURES ORDINAL CATEGORICAL DATAYaobing Sui, Walter W. Stroup — 2001
• The Assignment of Scores Procedure for Ordinal Categorical DataHan-Ching Chen, Nae-Sheng Wang — 2014
• Trend test methods for two-way ordinal categorical dataDing Yaxing — 2006
• Coefficients of Variation for Nominal and Ordinal Categorical DataTarald O. Kvålseth — 1995
• Regression for ordinal variables without underlying continuous variablesVicenç Torra, J DOMINGOFERRER, Josep M. Mateo‐Sanz — 2006
• Modelling and Analysis of Multivariate Ordinal Categorical Data in Longitudinal Set upAtanu Biswas, Apratim Guha — 2013
• Monitoring categorical processes by integrating ordinal informationJunjie Wang, Jinrong Li, Qin Su — 2016
• Noninferiority testing for matched‐pair ordinal data with misclassificationYuanyuan Han, Zhaohua Lu, Wai‐Yin Poon — 2019
• A Unified Framework for the Comparison of Treatments with Ordinal ResponsesTongyu Lu, Wai‐Yin Poon, Siu Hung Cheung — 2013