Rubrics: A Method for Surfacing Values and Improving the Credibility of Evaluation

Abstract

Background: The challenges of valuing in evaluation have been the subject of much debate; on what basis do we make judgments about performance, quality, and effectiveness? And according to whom? (Julnes, 2012b).

There are many ways identified in the literature for carrying out assisted valuation (Julnes, 2012c). One way of assisting the valuation process is the use of evaluative rubrics.

This practice-based article unpacks the learnings of a group of evaluators who have used evaluative rubrics to grapple with this challenge. Compared to their previous practice, evaluative rubrics have allowed them to surface and deal with values in a more transparent way. In their experience when evaluators and evaluation stakeholders get clearer about values, evaluative judgments become more credible and warrantable.

Purpose: Share practical lessons learned from working with rubrics.

Setting: Aotearoa (New Zealand).

Intervention: Not applicable.

Research Design: Not applicable.

Data Collection and Analysis: Not applicable.

Findings: They have found that while evaluative rubrics look beguilingly simple they are hard to do well. However, when done well, evaluative rubrics can substantially increase the use and credibility of evaluation.

Keywords: Rubrics; values; valuation; stakeholder; validity; credibility; utility