DesignLAK19: Ensuring validity in assessment design and analytics

Abstract

The 4th Annual DesignLAK Workshop focuses on how learning design can be used to inform validity of the measures used for assessment analytics. It has long been acknowledged that the validity of measures for assessment is one of the most important, but complex, concepts in education (Black & Wiliam, 2014; Newton & Baird, 2016). The field of learning analytics, and more specifically assessment analytics, is opening up new ways to collect data that can be used to measure student learning. However, with this increase comes concern about whether such measures are valid in helping us to assess student knowledge, competencies and/or skills. This half-day, interactive workshop aims to explore how learning design can be used to inform how we evaluate validity of assessment measures. Participants will have an opportunity to engage with key issues through expert presentations, discussion and assessment design scenarios. The outcome of the workshop will include the generation of key considerations for addressing validity in learning analytics with reference to learning design.