Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability
Explore this paper's citation graph
Summary
A content analysis of 200 studies utilizing content analysis published in the communication literature between 1994 and 1998 is used to characterize practices in the field and demonstrate that mass communication researchers often fail to assess (or at least report) intercoder reliability and often rely on percent agreement, an overly liberal index.
- Type
- article
- Published
- 2002-10-01
- Cited by
- 3,175
- References
- 42
- OpenAlex
- https://openalex.org/W2160375265
- Semantic Scholar
- https://api.semanticscholar.org/CorpusID:54576697
Keywords
Coding (social sciences), Reliability (semiconductor), Psychology, Content analysis, Consistency (knowledge bases)
References
- Mass Communication Research: Contemporary Methods and Applications
- Investigating Communication: An Introduction to Research Methods
- The Content Analysis Guidebook
- Handbook of applied multivariate statistics and mathematical modeling
- Content analysis in communication research
- Effects of the use of percentage agreement on behavioral observation reliabilities: A reassessment
- Measuring nominal scale agreement among many raters.
- Sampling Error and Selecting Intercoder Reliability Samples for Nominal Content Categories
- Judgment of counseling process: reliability, agreement, and error.
- The Use of Figures of Speech in Print Ad Headlines
- Content Analysis for the Social Sciences and Humanities
- A Content Analysis of Content Analyses: Twenty-Five Years of Journalism Quarterly
- Communications Through Limited-Response Questioning
- Content-Analysis Research: An Examination of Applications with Directives for Improving Research Reliability and Objectivity
- Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit.
- A SAS MACRO for calculating intercoder agreement in content analysis
- A Coefficient of Agreement for Nominal Scales
- Reliability of Nominal Data Based on Qualitative Judgments
- Beyond kappa: A review of interrater agreement measures
- Package report: AGREE, a package for computing nominal scale agreement
Cited by
- The game ontology project: supporting learning while contributing authentically to game studies
- The Commission's agenda: an analysis of changing policy attention of the European Commission from 1995-2012
- Varieties of capitalist debates: how institutions shape public conflicts on economic liberalization in the U.K., France, and Germany
- Cost-benefit analysis in practice
- African American women's use of cosmetics products in relation to their attitudes and self-identity
- Design with Subtle Cues: Visual Expression of Connectedness and Its Downstream Effects.
- I Respectfully Dissent: Linking Judicial Voting Behavior, Media Coverage, and Public Responses in the Study of U.S. Supreme Court Decisions.
- StarvingforPerfect.com: A Theoretically Based Content Analysis of Pro-Eating Disorder Web Sites
- Injury prevention and risk communication: a mental models approach
- The use of sports references in marketing of food and beverage products in supermarkets
- An analysis of online health information on schizophrenia or related conditions: a cross-sectional survey
- Content Analysis of Trends in Print Magazine Tobacco Advertisements
- The formation of issue publics during the Great Recession: examining the influences of news media, geography, and demographics
- Differentiation of Social Marketing and Cause-Related Marketing in US Professional Sport
- Robust Optical Based Hand Interaction for Virtual Reality
- Who are the “Real” Experts? The Debate Surrounding COVID-19 Health Risk Management: An Israeli Case Study
- Teachers at Work: Factors Influencing Satisfaction, Retention and the Professional Well-Being of Elementary and Secondary Educators
- Voluntary Disclosure of GHG Emission Information by Australian Companies
- Apartheid in the Great Outdoors: American Advertising and the Reproduction of a Racialized Outdoor Leisure Identity
- The New American Conservation Movement: New Strategies, Focus and Organizations for the 21st Century
Related papers
- On Quantitative Metrics for the Consistency and Availability in Distributed Databases
- Qualitative Consistency of Treatment Effects in Multiregional Clinical Trials
- M13. Keep Consistency in Good Old Days: the Effect of Nostalgia on Consumers' Consistency Seeking Behavior
- Highway Geometric Design Consistency: Speed Models and Local or Global Assessment
- Consistency of Decision Processes
- Consistency of Holland Code and Its Relation to Persistence in a College Major.
- Consistency Improvement With a Feedback Recommendation in Personalized Linguistic Group Decision Making
- Qualitative Content Analysis in Practice
- The Subjective Precision of Computers: A Methodological Comparison with Human Coding in Content Analysis