Comprehensive Assessment Tracking System

All-USA Scholarship - Improved Writing Rubrics

Rating: 
5
Average: 5 (3 votes)
Wednesday, September 23, 2015 to Friday, November 6, 2015
Abstract: 

As reported on the 2014 CATS "All-USA Scholarship Selection Process," a "6-Trait Writing Rubric" replaced the EMCC Writing Rubric for scoring the 2015 essays. 2014 scorers reported displeasure with the EMCC Writing Rubric, especially regarding content. The 2015 rubric was customized to weight heavily "Ideas & Content," and the semi-finalist judging score sheet was adjusted accordingly. 2015 scorers reported the new rubric was more effective in judging the value of the experiences and accomplishments in the essays. Additionally, they reported the rubric was more efficient because of clearer criteria. Contrasting inter-rater reliability of the 2014 with the 2015 rubric showed more closely aligned scores, making the selection of the semi-finalists clear. Due to confidentiality, scores cannot be provided for this CATS. We suggest continuing the use of the revised 6-Trait Writing Rubric for this competition. Our findings also suggest that broader application of the 6-Trait writing Rubric is beneficial and warrants consideration in other areas, such as composition courses, the Writing Center & the SAAC Writing/Composition Ability.

Completed Full Cycle: 
Yes
Course Number: 
Institutional Assessment

Comments

ROSAA00006's picture
up
0 users have voted.

Comment removed

HEA2156907's picture
up
0 users have voted.

I like that you are continually looking at this and making adjustments accordingly.  

OLGYZ58951's picture
up
0 users have voted.

HI Ro and Marylyn,
It is exciting how you continue to improve the process for the scholarships.

I also like how the results can be used in courses as well.
Smiles

Olga

PETAA00009's picture
up
0 users have voted.

As one of the scorers, I can attest to the efficacy of the 6-trait rubric, at least as it applied to the All-USA papers that we assessed. Great job of listening to the scorers and modifying accordingly!

REBZS76641's picture
up
0 users have voted.

I have been on this committee for 10+ years, and the process of scoring the papers has become so much easier.  Thanks for continually looking to improve the process.