Thought this might be of address to those on the list.
-- Ken Litkowski TEL.: 301-482-0237 CL Research EMAIL: ken@clres.com 9208 Gue Road Damascus, MD 20872-1025 USA Home Page: http://www.clres.com
attached mail follows:
CONTENT Publication Alert...
Fan, Xitao, and Michael Chen. "Published Studies of Interrater Reliability Often Overestimate Reliability: Computing the Correct Coefficient." _Educational and Psychological Measurement_ 60, no. 4 (2000): 523-542.
>From the abstract: "It is erroneous to generalize the interrater reliability coefficient estimated from two or more raters rating only a (small) portion of the sample to the rest of the sample data for which only one rater is used for scoring, although such generalization is often made implicitly in practice... The authors provide a sample of published studies in different disciplines that inappropriately generalized reliability coefficients involving several raters to scores generated by a single rater."
================================================================= CONTENT Publication Alert is a service provided to members of CONTENT, the Internet mailing list for discussion of content analysis. To subscribe to CONTENT, visit the Content Analysis Resources web site, at http://www.gsu.edu/~wwwcom/content.html. =================================================================
This archive was generated by hypermail 2b29 : Sun Aug 20 2000 - 21:11:13 MET DST