Developing WSU’s Guide to Effective Student Learning Outcomes Assessment Rubric

The table below charts the steps that Washington State University’s Office of Assessment and Innovation (OAI) and its stakeholders went through to develop the Guide to Effective Program Assessment rubric used in the WSU System of Student Learning Outcomes Assessment. Description Generalized Model Specific example of application at WSU’s Office of Assessment and Innovation. Determine [...]

Rubric revision process

With the NWCCU report filed we turned to some assessment of our inter-rater reliability, viewing that as an opportunity to understand what might be differences in our shared understandings. These may be rubric elements or interpretations of rubric language. This google doc is the space where we are looking at that rating data and recording [...]

How a rubric can communicate

OAI has been finishing up its 2009-10 cycle of reviews of program-level assessment, see the University’s portfolio for details about the process and the results. One of the responses to a program regarding communication with stakeholders had a summary of the utility of a rubric as a communication tool: Under “Communication” the report states: “Program [...]

Analysis of Inter-rater agreement 2009-10

Lee, Thanks for telling me that you completed rating Honors also. Our average ratings for that program were 5; 5.5; 4.5; 5  so we are a little lower than you, but in the same category “Integrating” in all but one. You can see all our results here: https://universityportfolio.wsu.edu/2009-2010/Pages/default.aspx We are exploring two measures of inter-rater [...]

Examining the quality of our assessment system

With most of the 59 programs rated for this round, we are beginning an analysis of our system of assessment. To re-cap, we drafted a rubric about a year ago and tested it with Honors college self-study and a made-up Dept of Rocket Science self-study. We revised the rubric with discussions among staff and some [...]

Norming on the Guide to Assessment Rubric

Results of Norming on the Guide to Assessment rubric This image captures the data from OAI’s norming work on the first 2 dimensions of the May 17 Guide to Assessment rubric. The sample being assessed is the Sociology self-study from December 2009. The red data are from Gary & Nils’ presentation to the Assessment, Teaching [...]

Institutional Self-Assessment Rubric

This post is in support of a TLT webinar, the series is titled “Power of Rubrics“ [Archive of session] Gary Brown, Theron DesRosier, Jayme Jacobson & Nils Peterson, Washington State University Introduction and Background on the Problem Washington State University is in the process of responding to changes in by its accrediting body, NWCCU. The [...]

Process Concerns–One Voice Speaks For Many

December 14, 2009 Note sent to College Liaison from a Program Assessment Point: I have a few comments on the assessment report. I will have something to you by Friday, but I also have some serious reservations about the assessments themselves. I did have a very nice meeting with Gary to talk about some of [...]

A of A Rubric Draft December (revised)

document attached to email with no body  a of a rubric expanded revised 12_1 Dr. Gary R. Brown, Director The Office of Assessment and Innovation Washington State University 509 335-1352 509 335-1362 (fax) browng@wsu.edu https://mysite.wsu.edu/personal/browng/GRBWorld/

RE: Assessment Updates and Tasks

Just a quick note to say please hold off on using the Rocket Science model and ‘digest’ rubric.  We did our first round of experimenting with the process today with 15 raters and found we need to provide clarity in the model.  More importantly and for our discussion, the shorter rubric, however much nicer it [...]