東華大學圖書館 |

Language: English

Help

回圖書館首頁

手機版館藏查詢

Back

Switch To: Labeled | MARC Mode | ISBD

Linked to FindBook

Google Book

Amazon

博客來

Lambda Coefficient of Rater-Mediated Agreement: Evaluation of an Alternative Chance-Corrected Agreement Coefficient.

Record Type:	Electronic resources : Monograph/item
Title/Author:	Lambda Coefficient of Rater-Mediated Agreement: Evaluation of an Alternative Chance-Corrected Agreement Coefficient./
Author:	Holcomb, Timothy Scott.
Published:	Ann Arbor : ProQuest Dissertations & Theses, : 2022,
Description:	279 p.
Notes:	Source: Dissertations Abstracts International, Volume: 83-10, Section: A.
Contained By:	Dissertations Abstracts International83-10A.
Subject:	Educational tests & measurements. -
Online resource:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=29162899
ISBN:	9798426829244

Lambda Coefficient of Rater-Mediated Agreement: Evaluation of an Alternative Chance-Corrected Agreement Coefficient.
Holcomb, Timothy Scott.

Lambda Coefficient of Rater-Mediated Agreement: Evaluation of an Alternative Chance-Corrected Agreement Coefficient. - Ann Arbor : ProQuest Dissertations & Theses, 2022 - 279 p.

Source: Dissertations Abstracts International, Volume: 83-10, Section: A.

Thesis (Ph.D.)--The University of North Carolina at Charlotte, 2022.

This item must not be sold to any third party vendors.

In this study, the performance of the Lambda Coefficient of Rater-Mediated Agreement was evaluated with other chance-corrected agreement coefficients. Lambda is grounded in rater-mediated assessment theory and was developed as an alternative to Kappa (Cohen, 1960) and other chance-corrected agreement coefficients. Lambda has two variations, a general form that is calculated similarly to how most chance-corrected agreement coefficients are calculated, such as Kappa (Lambert et al., 2021). The general form of Lambda is referred to as Lambda-1. Lambda-2 differs from Lambda-1 in the calculation of the proportion of expected chance agreement. Lambda-2 uses known population proportions when available and applies those proportions in the calculation of expected chance agreement. In total, six coefficients were calculated using generated data by varying the amount and location of agreement and disagreement between ratings across two-, three-, and four-point rating scales. The exact agreement specifications ranged from 75% to 95% across 115 planned data conditions. The simulations adjusted prevalence indices according to exact agreement specifications (Xie, 2013). Results demonstrated the robustness of Lambda-1 and Lambda-2 to data conditions that are problematic for other coefficients. Both variations of Lambda produced benchmark agreement results that maintained meaning that may be diminished by other coefficients.

ISBN: 9798426829244Subjects--Topical Terms:

3168483
Educational tests & measurements.
Subjects--Index Terms:

Chance-corrected agreement coefficient

Lambda Coefficient of Rater-Mediated Agreement: Evaluation of an Alternative Chance-Corrected Agreement Coefficient.
LDR:02686nmm a2200361 4500 001 2350730
005 20221020130430.5
008 241004s2022 ||||||||||||||||| ||eng d
020 $a 9798426829244
035 $a (MiAaPQ)AAI29162899
035 $a AAI29162899
040 $a MiAaPQ $c MiAaPQ
100 1 $a Holcomb, Timothy Scott. $3 3690239
245 1 0 $a Lambda Coefficient of Rater-Mediated Agreement: Evaluation of an Alternative Chance-Corrected Agreement Coefficient.
260 1 $a Ann Arbor : $b ProQuest Dissertations & Theses, $c 2022
300 $a 279 p.
500 $a Source: Dissertations Abstracts International, Volume: 83-10, Section: A.
500 $a Advisor: Lambert, Richard.
502 $a Thesis (Ph.D.)--The University of North Carolina at Charlotte, 2022.
506 $a This item must not be sold to any third party vendors.
520 $a In this study, the performance of the Lambda Coefficient of Rater-Mediated Agreement was evaluated with other chance-corrected agreement coefficients. Lambda is grounded in rater-mediated assessment theory and was developed as an alternative to Kappa (Cohen, 1960) and other chance-corrected agreement coefficients. Lambda has two variations, a general form that is calculated similarly to how most chance-corrected agreement coefficients are calculated, such as Kappa (Lambert et al., 2021). The general form of Lambda is referred to as Lambda-1. Lambda-2 differs from Lambda-1 in the calculation of the proportion of expected chance agreement. Lambda-2 uses known population proportions when available and applies those proportions in the calculation of expected chance agreement. In total, six coefficients were calculated using generated data by varying the amount and location of agreement and disagreement between ratings across two-, three-, and four-point rating scales. The exact agreement specifications ranged from 75% to 95% across 115 planned data conditions. The simulations adjusted prevalence indices according to exact agreement specifications (Xie, 2013). Results demonstrated the robustness of Lambda-1 and Lambda-2 to data conditions that are problematic for other coefficients. Both variations of Lambda produced benchmark agreement results that maintained meaning that may be diminished by other coefficients.
590 $a School code: 0694.
650 4 $a Educational tests & measurements. $3 3168483
650 4 $a Educational evaluation. $3 526425
653 $a Chance-corrected agreement coefficient
653 $a Interrater reliability
653 $a Rater mediated assessment
653 $a Rater mediated assessment theory
653 $a Reliability
690 $a 0288
690 $a 0443
710 2 $a The University of North Carolina at Charlotte. $b Educational Leadership. $3 1277940
773 0 $t Dissertations Abstracts International $g 83-10A.
790 $a 0694
791 $a Ph.D.
792 $a 2022
793 $a English
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=29162899