Measures for a College and Career Indicator: Innovative Measures
From the publishers: “This white paper considers innovative measures – specifically metacognitive assessments, performance assessments, and the California State Seal of Biliteracy – as potential measures to be included in California’s college and career indicator. The white paper begins by describing the criteria that each innovative measure is evaluated against. Next, innovative measures are evaluated against the framework being used for all five categories of potential college and career preparedness measures. This white paper concludes with a summary that identifies major strengths, weaknesses, and tradeoffs.”
The publishers clearly describe their purposes and meet them, using quality methodology and avoiding bias. While each assessment type is nicely evaluated across multiple dimensions, the paper does not explore combinations of assessments that might be used in a state assessment program. This is an excellent review of available quantitative research studies, though some of the studies cited are speculative and users should be careful regarding conclusions. Additionally many of the studies are five or more years old, pointing to the need for new studies, including ones that look at combined measures. Communications quality is typical of a white paper. Users are likely to be state education agencies looking to improve their state assessment systems. Although this study is specific to California, it has implications for all states thereby increasing the paper’s utility. Evidence of effectiveness is not addressed but an effect on learning is possible, albeit some years in the future.