Statement validity assessment: inter-rater reliability of criteria-based content analysis in the mock-crime paradigm

Purpose. The inter-rater reliability of criteria-based content analysis (CBCA) - the main component of statement validity assessment (SVA) - was investigated in a mock-crime study. The study also addressed the issue of the adequacy of diverse statistical indices of reliability. Furthermore, CBCA...

Full description

Saved in:  
Bibliographic Details
Authors: Gödert, Heinz Werner 1970- (Author) ; Gamer, Matthias 1976- (Author) ; Rill, Hans-Georg 1970- (Author) ; Vossel, Gerhard 1950- (Author)
Format: Electronic Article
Language:English
Published: 2005
In: Legal and criminological psychology
Year: 2005, Volume: 10, Issue: 2, Pages: 225-245
Online Access: Volltext (lizenzpflichtig)
Volltext (lizenzpflichtig)
Journals Online & Print:
Drawer...
Check availability: HBZ Gateway

MARC

LEADER 00000caa a22000002 4500
001 1847400388
003 DE-627
005 20230616150735.0
007 cr uuu---uuuuu
008 230605s2005 xx |||||o 00| ||eng c
024 7 |a 10.1348/135532505X52680  |2 doi 
035 |a (DE-627)1847400388 
035 |a (DE-599)KXP1847400388 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 2,1  |2 ssgn 
100 1 |a Gödert, Heinz Werner  |d 1970-  |e VerfasserIn  |0 (DE-588)123738490  |0 (DE-627)082738092  |0 (DE-576)293853274  |4 aut 
109 |a Gödert, Heinz Werner 1970- 
245 1 0 |a Statement validity assessment  |b inter-rater reliability of criteria-based content analysis in the mock-crime paradigm 
264 1 |c 2005 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
520 |a Purpose. The inter-rater reliability of criteria-based content analysis (CBCA) - the main component of statement validity assessment (SVA) - was investigated in a mock-crime study. The study also addressed the issue of the adequacy of diverse statistical indices of reliability. Furthermore, CBCA's effectiveness in distinguishing between true and false statements was analysed. Methods. Three raters were trained in CBCA. Subsequently, they analysed transcripts of 102 statements referring to a simulated theft of money. Some of the statements were based on experience and some were confabulated. The raters used 4-point scales, respectively, to judge the degree to which 18 of the 19 CBCA criteria were fulfilled in each statement. Results. The analysis of rater judgment distributions revealed that, with judgments of individual raters varying only slightly across transcripts, the weighted kappa coefficient, the product-moment correlation, and the intra-class correlation were inadequate indices of reliability. The Finn-coefficient and percentage agreement, which were calculated as indices independent of rater judgment distributions, were sufficiently high with respect to 17 of the 18 assessed criteria. CBCA differentiated significantly between truthful and fabricated accounts. Conclusions. The inter-rater reliability of CBCA achieved in the present study was satisfactory both, if considered absolutely, and as compared with other empirical findings. This suggests that CBCA can be utilized in the mock-crime paradigm with a sufficient degree of reliability. 
700 1 |a Gamer, Matthias  |d 1976-  |e VerfasserIn  |0 (DE-588)136405630  |0 (DE-627)582078903  |0 (DE-576)301003092  |4 aut 
700 1 |a Rill, Hans-Georg  |d 1970-  |e VerfasserIn  |0 (DE-588)123220777  |0 (DE-627)082421099  |0 (DE-576)293610800  |4 aut 
700 1 |a Vossel, Gerhard  |d 1950-  |e VerfasserIn  |0 (DE-588)133716902  |0 (DE-627)552682632  |0 (DE-576)300046650  |4 aut 
773 0 8 |i Enthalten in  |t Legal and criminological psychology  |d Hoboken, NJ [u.a.] : Wiley, 1996  |g 10(2005), 2, Seite 225-245  |h Online-Ressource  |w (DE-627)320441695  |w (DE-600)2005001-X  |w (DE-576)090886615  |x 2044-8333  |7 nnns 
773 1 8 |g volume:10  |g year:2005  |g number:2  |g pages:225-245 
856 4 0 |u https://doi.org/10.1348/135532505X52680  |x Resolving-System  |z lizenzpflichtig  |3 Volltext 
856 4 0 |u https://onlinelibrary.wiley.com/doi/abs/10.1348/135532505X52680  |x Verlag  |z lizenzpflichtig  |3 Volltext 
936 u w |d 10  |j 2005  |e 2  |h 225-245 
951 |a AR 
ELC |a 1 
LOK |0 000 xxxxxcx a22 zn 4500 
LOK |0 001 4329350424 
LOK |0 003 DE-627 
LOK |0 004 1847400388 
LOK |0 005 20230605121751 
LOK |0 008 230605||||||||||||||||ger||||||| 
LOK |0 040   |a DE-2619  |c DE-627  |d DE-2619 
LOK |0 092   |o n 
LOK |0 852   |a DE-2619 
LOK |0 852 1  |9 00 
LOK |0 935   |a krzo 
ORI |a SA-MARC-krimdoka001.raw