The shift towards competency-based education (CBE) has sparked important conversations about how assessments can be designed to better support students' learning journeys. Competency-based education emphasizes measurable student outcomes, focusing on knowledge, skills, and abilities rather than traditional seat time (Oroszi, 2020).
As part of this evolution, programmatic assessments have emerged as a crucial tool, prioritizing ‘assessment for learning’ rather than ‘assessment of learning’. In short, this means that assessments are designed to be meaningful, transparent, and aligned with the principles of CBE.
In this blog post, we’ll explore what programmatic assessments are, how they work, and why they are such a powerful tool for fostering student success in competency-based education—so much so that in 2024, nearly 60% of educators expect their districts to begin implementing competency-based education (CBE) initiatives within the next five years, reflecting a growing awareness and interest in this educational approach.
What is programmatic assessment in competency-based education?
Programmatic assessment refers to a comprehensive approach to designing an assessment program that optimizes its learning, decision-making, and curriculum quality-assurance functions. According to Prof. C.P.M. Van Der Vlueten, Professor of Education at Maastricht University, Netherlands, “Programmatic assessment is an integral approach to the design of an assessment program with the intent to optimize its learning function, its decision-making function, and its curriculum quality-assurance function.” (Van der Vleuten, et al. 2015)
This means that individual assessment methods are selected based on how well they align with curriculum outcomes and their ability to provide valuable information to students, teachers, and institutions. These assessments are treated as data points that, collectively, guide the learner's progress from low-stakes to high-stakes decisions. In competency-based education, this alignment ensures that every assessment contributes to developing and validating the skills and competencies essential for success.
How do programmatic assessments work?
The fundamental principle of programmatic assessment is to decouple the assessment moment from the decision moment. Rather than basing pass-fail decisions on a single high-stakes test, programmatic assessments aggregate data from multiple, lower-stakes assessments over time.
These assessments are structured as a journey, beginning with low-stakes assessments that provide formative feedback and progressing to higher-stakes assessments that evaluate overall competency. Key components include:
- Feedback loops: Continuous feedback allows students to understand their strengths and areas for improvement. Feedback supports incremental growth and fosters a culture of learning.
- Master plan: Recommended by Van der Vleuten, et al. (2015), a comprehensive framework to outline all assessments, their purposes, and their alignment with specific learning outcomes is essential as part of a programmatic assessment. This ensures consistency and clarity for both students and educators. Northeastern University describes assessment plans as being, “living documents that are modified over time as the program changes (its curriculum, interests, goals, etc.).”
- Diverse assessment methods: Programmatic assessments use a variety of methods, such as projects, oral examinations, essays, and skill-based demonstrations, to evaluate both technical knowledge and behavioral competencies like communication and collaboration.
For example, a student studying Renaissance literature might complete a group project to assess collaboration skills, participate in an oral exam to demonstrate their ability to synthesize information, and write a critical essay to showcase analytical thinking.
This gives their educators a comprehensive view of the student’s competence, discounting the undue influence of test anxiety that might skew performance in a single high-stakes exam. By relying on multiple, varied assessments, programmatic assessment ensures that a student’s skills and knowledge are evaluated more holistically, offering a fairer and more accurate representation of their abilities.
Why is feedback orientation critical in programmatic assessment?
Feedback is the cornerstone of programmatic and authentic assessment, particularly within a competency-based education framework. Each assessment provides actionable insights that guide the student’s next steps.
Unlike traditional high-stakes assessments, where outcomes are final, programmatic assessments use feedback to:
- Promote continuous improvement: Feedback loops allow students to identify areas for growth and make timely adjustments, ensuring steady progress toward mastering competencies.
- Encourage students to take ownership of their learning: By integrating actionable suggestions, students become active participants in their educational journey, developing autonomy and self-regulation skills that set them up for their future careers.
- Foster transparency by making expectations and progress clear to students: Clear feedback outlines the criteria for success, helping students understand how their performance aligns with learning objectives and what steps they need to take next. This can be provided in the form of grading forms or rubrics which contain definitions of marking criteria for an assignment.
The multi-faceted feedback that students receive as part of an oral presentation, for example, might highlight strengths in articulation while suggesting improvements in time management. Students can then apply this feedback to future tasks, building on their skills incrementally.
Ultimately, feedback orientation empowers students to take control of their learning journey, equipping them with the skills and mindset needed for long-term success in both academic and professional settings.
How does competency-based education benefit from programmatic assessments?
Competency-based education relies on students demonstrating mastery in specific areas. Programmatic assessments support this by:
- It ensures alignment: Each assessment is explicitly tied to defined competencies, ensuring that students’ progress is measured against clear standards.
- It encourages skill development: By incorporating behavioral and professional skills alongside academic knowledge, programmatic assessments prepare students for real-world challenges.
- It supports personalization: Students progress at their own pace, receiving tailored feedback that addresses their unique needs.
- It enhances engagement: Diverse assessment methods keep students engaged and motivated, catering to different learning styles and strengths.
What are the challenges in implementing programmatic assessments?
While programmatic assessments offer significant benefits, implementing them within a competency-based education model presents unique challenges. Govaerts, Van der Vleuten, and Schut (2022) outline several key obstacles and offer insights into addressing them:
- Resource intensity: Designing and managing a comprehensive assessment program requires time, effort, and resources. It is incredibly important to support the achievement of assessment goals “by removing unnecessary (administrative) burdens from overloaded staff and learners.”
- Training needs: Educators need training to provide effective feedback and align assessments with competencies. The trio advise that the professional development of faculty members leveraging programmatic assessment generally consists of workshops, training, lectures, and guidelines, coaching on the job by more knowledgeable others (including experienced faculty), and learning through networking within communities of practice.
- Data management: Tracking multiple data points for each student necessitates robust systems and tools. In their study, Govaerts, Van der Vleuten, and Schut note that, “the development of a user-friendly assessment evidence data-base, dashboard, or electronic portfolio is essential for PA to be effective.”
Additional studies on programmatic assessment highlight other challenges that institutions must address:
- Student buy-in: Assessment culture can be a big factor in moving students to a programmatic approach, especially when they are more accustomed to traditional assessments. This is evidenced by Colbert and Bierer (2022) in their study into the importance of professional development in programmatic assessment. To combat this, students may require guidance to adapt to the programmatic approach.
- Equity in feedback quality: Research by Rich et al. (2022) highlights how stronger-performing students often receive less actionable feedback, while weaker-performing students may be subject to a problem-focused assessment culture rather than one emphasizing growth. This imbalance risks undermining the developmental goals of programmatic assessment.
To overcome these challenges, institutions must invest in professional development, adopt advanced technology for data management, and foster a culture that communicates the benefits of programmatic assessment while ensuring equitable outcomes for all students.
How can technology support programmatic assessments?
Technology plays such a core role in facilitating programmatic assessments. Tools like learning management systems (LMS) and grading platforms help streamline the process by:
Automating data collection and analysis
It’s important to highlight that automated data analysis must be bolstered with human judgement and subjectivity. Poignantly, Associate Professor Priya Khanna and Professor Gary Velan at UNSW Medicine & Health highlight that, “numeric scores need to be supplemented with narrative feedback to strengthen both the richness of the data as well as credibility of the decisions around student progression.”
Providing centralized platforms for feedback and communication
Writing for Times Higher Education, Deputy Registrar of Evaluation at Manipal Academy of Higher Education, Sreejith G, emphasises the need for a robust assessment system to produce competent graduates. He goes on to say that, “Using robust assessment rubrics strengthens an assessment programme … We use these rubrics to monitor progress with day-to-day activities recorded in students’ e-log book which is integrated into the learning management system and periodically assessed.”
Supporting diverse assessment formats
Technology enables the incorporation of varied assessment formats, such as video submissions, collaborative online projects, and interactive simulations, that align with diverse learning outcomes. These formats accommodate different student strengths and learning styles, offering a more holistic evaluation of competencies. For instance, students can showcase communication skills through recorded presentations or demonstrate teamwork in virtual group assignments.
By integrating these formats into a central platform, educators can assess a broader range of skills and behaviors, ensuring alignment with the goals of competency-based education.
Enhancing transparency
Real-time access to progress data fosters transparency, empowering students to track their performance and understand how each assessment contributes to their overall competency development. Tools like grading software reduce administrative tasks and allow educators to dedicate more time to personalized feedback.
Additionally, e-portfolios and self-assessment modules encourage students to reflect on their learning journey, linking their achievements to specific learning objectives. By making the assessment process more transparent, technology helps build trust and clarity between educators and students, ultimately enhancing the effectiveness of programmatic assessments.
What is the future of programmatic assessments in competency-based education?
As education systems worldwide shift towards competency-based models, programmatic assessments will likely become more prevalent. Emerging trends include:
- Increased use of AI: Artificial intelligence can provide real-time, personalized feedback and identify patterns in student performance.
- Greater emphasis on equity: Programmatic assessments can be designed to reduce biases, ensuring all students have equal opportunities to succeed.
- Integration with workforce needs: By aligning assessments with industry standards, educators can ensure students graduate with the skills employers value most.
- Policy support: Initiatives like academic credit banks in India highlight the growing recognition of programmatic assessments in national education policies.
Programmatic assessments are a vital component of competency-based education, providing a structured, transparent, and learner-centered approach to assessment.
By focusing on continuous feedback, aligning with specific competencies, and leveraging technology, educators can design assessments that truly support students' growth and success. As institutions embrace these methods, they pave the way for a more equitable and effective education system that prepares students for the complexities of the modern world.