東華大學圖書館 |

Language: English

Help

回圖書館首頁

手機版館藏查詢

Back

Switch To: Labeled | MARC Mode | ISBD

Investigating raters' development of...

Kim, Hyun Jung.

Linked to FindBook

Google Book

Amazon

博客來

Investigating raters' development of rating ability on a second language speaking assessment.

Record Type:	Language materials, printed : Monograph/item
Title/Author:	Investigating raters' development of rating ability on a second language speaking assessment./
Author:	Kim, Hyun Jung.
Description:	279 p.
Notes:	Source: Dissertation Abstracts International, Volume: 72-05, Section: A, page: .
Contained By:	Dissertation Abstracts International72-05A.
Subject:	Education, Tests and Measurements. -
Online resource:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=3448033
ISBN:	9781124535173

Investigating raters' development of rating ability on a second language speaking assessment.
Kim, Hyun Jung.

Investigating raters' development of rating ability on a second language speaking assessment. - 279 p.

Source: Dissertation Abstracts International, Volume: 72-05, Section: A, page: .

Thesis (Ed.D.)--Teachers College, Columbia University, 2011.

The purpose of the study was to investigate the extent to which raters coming from diverse backgrounds exhibited different levels of rating ability while scoring speaking performances. The study also aimed to examine how raters with different backgrounds could develop their rating ability over time. For this purpose, raters' background characteristics were first explored in regard to (1) experience in rating L2 speaking assessments, (2) TESOL experience, (3) rater training accompanied with rating experience, and (4) relevant coursework completed. Raters were classified into novice, developing, and expert groups accordingly in order to examine the extent to which the three rater groups exhibited different scoring behaviors in each of the three rating sessions, which were separated by a one-month interval. Each rater group's changes in rating patterns were also investigated across the rating sessions.

ISBN: 9781124535173Subjects--Topical Terms:

1017589
Education, Tests and Measurements.

Investigating raters' development of rating ability on a second language speaking assessment.
LDR:03299nam 2200301 4500 001 1399761
005 20110926095520.5
008 130515s2011 ||||||||||||||||| ||eng d
020 $a 9781124535173
035 $a (UMI)AAI3448033
035 $a AAI3448033
040 $a UMI $c UMI
100 1 $a Kim, Hyun Jung. $3 1288442
245 1 0 $a Investigating raters' development of rating ability on a second language speaking assessment.
300 $a 279 p.
500 $a Source: Dissertation Abstracts International, Volume: 72-05, Section: A, page: .
500 $a Adviser: James Purpura.
502 $a Thesis (Ed.D.)--Teachers College, Columbia University, 2011.
520 $a The purpose of the study was to investigate the extent to which raters coming from diverse backgrounds exhibited different levels of rating ability while scoring speaking performances. The study also aimed to examine how raters with different backgrounds could develop their rating ability over time. For this purpose, raters' background characteristics were first explored in regard to (1) experience in rating L2 speaking assessments, (2) TESOL experience, (3) rater training accompanied with rating experience, and (4) relevant coursework completed. Raters were classified into novice, developing, and expert groups accordingly in order to examine the extent to which the three rater groups exhibited different scoring behaviors in each of the three rating sessions, which were separated by a one-month interval. Each rater group's changes in rating patterns were also investigated across the rating sessions.
520 $a In each of the three rating sessions, the three groups of raters scored a set of pre-recorded speaking responses to five semi-direct placement speaking tasks with an analytic scoring rubric. The raters also recorded how they arrived at certain scoring decisions while rating examinee responses on the first two tasks. Before each rating session the raters were trained, and before the second and third rating sessions they were provided with individual feedback on their previous rating performance.
520 $a The three groups of raters' analytic ratings were statistically analyzed in the first phase of the study, focusing on severity, internal consistency, and interaction effects. Statistically, the novice and developing rater groups did not show distinctive rating patterns, especially in regard to interaction effects, while the expert raters displayed the highest rating ability across the three rating sessions. However, in the second phase of the study, in which the raters' verbal reports were qualitatively analyzed focusing on their use of the given scoring criteria, the three groups of raters displayed different rating patterns and developmental paths across the three rating session's. The findings from this study suggest that the different weaknesses that the three rater groups exhibited need to be addressed through individual or group rater training to help raters improve rating ability, and ultimately to minimize rater effects.
590 $a School code: 0055.
650 4 $a Education, Tests and Measurements. $3 1017589
650 4 $a Education, English as a Second Language. $3 1030294
690 $a 0288
690 $a 0441
710 2 $a Teachers College, Columbia University. $3 1018028
773 0 $t Dissertation Abstracts International $g 72-05A.
790 1 0 $a Purpura, James, $e advisor
790 $a 0055
791 $a Ed.D.
792 $a 2011
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=3448033