Chart of raw scores on 3 related engineering assessment reports, Fall 2010

Re: chart of raw scores on 3 related engineering assessment reports, Fall 2010 Kimberly, Thanks for making this graph, its a helpful visualization of the raters’ differences. You, Jayme and I have confirmed that the three reports are substantially identical. The other observation you made the other day was that Raters 1 & 2 were [...]

Examining the quality of our assessment system

With most of the 59 programs rated for this round, we are beginning an analysis of our system of assessment. To re-cap, we drafted a rubric about a year ago and tested it with Honors college self-study and a made-up Dept of Rocket Science self-study. We revised the rubric with discussions among staff and some [...]

Sanity Checking the May 17 scores

We have done a process to review language and scores on individual responses.  A couple weeks ago, Ashley led an activity to compare (in each dimension) across 4 programs. That found a couple anomalies. This is an experiment to compare across the 22 programs that provided a report May 17. (Actually a few are not [...]

Norming on the Guide to Assessment Rubric

Results of Norming on the Guide to Assessment rubric This image captures the data from OAI’s norming work on the first 2 dimensions of the May 17 Guide to Assessment rubric. The sample being assessed is the Sociology self-study from December 2009. The red data are from Gary & Nils’ presentation to the Assessment, Teaching [...]