Author: Jamie Moriarty

  • Putting it all together: intentional, aligned, meaningful, and manageable assessment

    Over the summer I have expanded my knowledge of educational assessment and of assessment technologies during my course, CEP 813, Electronic Assessment For Teaching and Learning. I have broadened my perspective of what assessment technology includes (Selwyn, 2011), developed a more critical eye for assessments (Au, 2008) and grading in general (Kohn, 2011), and turned towards developing more equitable, supportive, and culturally relevant assessments (Montegegro & Jankowski, 2017). I experimented with assessment technologies, practiced with different assessment techniques, and played with assessment design prompts.

    For my final assessment design in CEP 813, I designed a module for my student employees at the library makerspace. Students will learn a new makerspace technology, develop their ability to teach others, and create high quality media to support others in learning that technology. Using a common makerspace framework of imitate, modify, innovate (Zigler, 2023), students follow a tutorial, then consider how it could be improved or create a new tutorial, and take high quality photos or videos that support the improved tutorial. 

    I used three digital technologies in this assessment design: Notion, Lucidspark, and Zulip. Notion is basically the three ring binder holding all the content, worksheets, progress tracking, and due dates together. Zulip provides synchronous communications that are easy to catch up on later, asynchronously. Finally, Lucidspark crams an infinite collaborative whiteboard right inside the three ring binder. The technology trifecta results in a flexible asynchronous or synchronous communication method, digitally, and collaboratively. It allows for a variety of ways to participate in content with images, words, writing, video, or just audio. However, it is always crucial to consider the benefits and risks, and carefully consider the technology’s privacy and data policies – especially when it comes to student data.

    Screenshot of the content database that houses each module page.

    In the spirit of well crafted, meaningful, and measurable learning objectives, I would like to take you on a journey of how my final assessment design is intentional, aligned, meaningful, and manageable.

    LO1 – Create assessments that intentional

    Assessment doesn’t need to be a stress-inducing experience, it can be a supportive guiding process such as the creative sketchbook with integrated reflections and assessments I created just last month. When combining formative assessment with social collaborative learning, assessment supports and cultivates a learning community (Sheppard, 2000). In order to intentionally craft assessments that support learning, they must be designed with the goals and outcomes in mind. 

    LO2 – Create assessments that are aligned 

    Using Backward Design (Wiggins & McTighe, 2005), I start with learning objectives or the outcomes the learners need to learn, and how I’ll measure those objectives with assessment. I always find it tempting to jump straight into designing content and activities, but without the target and a yardstick, the path will not align with the goal. I also plan for how to assess the assessment and consider what data I might need for calibrating the alignment.

    LO3 – Create assessments that are meaningful

    Meaningful assessments are ones that feel like a natural path towards your personal trajectory because they have immediate value in one’s life, align with personal values, and connect the current learning experience to prior understandings. My learning objectives for the assessment include a fill in the blank fifth objective for a personal goal or aspect to develop during the module. By acknowledging the learner’s prior knowledge, personal goals, and supporting their growth, the assessment is a valuable and meaningful tool for learning (Montegegro & Jankowski, 2017). Using Universal Design for Learning (CAST, 2024), the digital collaborative notebook and interactive whiteboard support social collaborative learning in a flexible manner that supports learner agency and provides multiple means of engagement, representation, and expression. 

    LO4 – Create assessments that are manageable

    Manageable assessments are focused on the goals while also supporting learnings through clear goals, scaffolding through tutorials and self-guided content, provide opportunities  for social learning, self-assessment, and reflections. The guidebook collects all of these components and combines them into a single digital guidebook for instructor-learner interactions, and social collaborative activities using an infinite whiteboard.

    However, in order for an assessment to be manageable it must be easy to access and use, easy to track progress and tasks, and support clear communication – for both the learner and the instructor. The assessment technology guides the learner along a focused path rather than creating distractions or barriers. In this case, Notion supports both learner and instructor by tracking progress, automatic reminders, notifications to the instructor for feedback, ensures instantly collected assessment data, and supports easily giving the learner feedback. 

    Assessment rubric for tutorial module organized by three level of experience and two paths for LO4.

    The last component of manageable assessment is the evaluation of the progress, feedback to the learner, and feedback from the learner for improvement of the assessment for future learners. The criteria for success are clearly communicated to the learner and evaluated as fairly and objectively as possible. For this assessment, I created a rubric based on the idea that the students have different experience levels and need appropriately matched goals with a description of what success looks like for each objective. Students receive narrative feedback for each criteria based on their experience level description of success. The feedback is specific, meaningful, and manageable for the instructor to provide and manageable for the student to apply. It includes celebration of the learning progress, and feedback for how to further improve at each formative stage and at the end with a summative assessment.

    With intentional, aligned, meaningful, and manageable assessments, learners are empowered on their journey to success, the instructor is empowered with the right data to support the learner, and the assessment itself is calibrated with feedback. 

    Explore the guidebook yourself in a public view only mode.

    Screenshot of Guidebook Example.

    References

    Au, W. (2008). Unequal by design: High-stakes testing and the standardization of inequality. Routledge.

    CAST (2024). Universal Design for Learning Guidelines version 3.0 [graphic organizer]. https://udlguidelines.cast.org/static/udlg3-graphicorganizer-digital-nonumbers-a11y.pdf 

    Kohn, A. (2011). The case against grades. Alfie Kohn. https://www.alfiekohn.org/article/case-grades/. 

    Montenegro, E., & Jankowski, N. A. (2017). Equity and assessment: Moving towards culturally responsive assessment. (Occasional Paper No. 29). University of Illinois and Indiana University, National Institute for Learning Outcomes Assessment (NILOA).

    Shepard, L. A. (2000). The role of assessment in a learning culture. Educational Researcher, 29 (7), 4-14. 

    Wiggins, G., & McTighe, J. (2005). Understanding by design, (2nd Ed.). Association for Supervision and Curriculum Development.

    Zigler, M. (2023). 3 modes of making: Imitation, modification, innovation (First edition.). Make Community, LLC.

  • Rethinking the Role of Assessment in the Iterative Design for Learning Cycle

    When designing a new learning experience, starting with the finish line in mind is non-negotiable. Backward design keeps the goal and assessment aligned and in focus so every activity contributes to the learning process (Wiggins & McTighe, 2005). When designing an assessment for my course this summer, CEP 813, I was reminded that real design is nota linear process, it’s an iterative cycle. I often refine, clarify, or simplify learning objectives mid-process, embracing a roundabout design philosophy (Darby, 2021). Without assessment at the start of reverse engineering the goal, it wouldn’t help guide the data collection towards actionable useful information. 

    Another core philosophy behind my design is that assessment must support the learner along their journey, not just assign a score. In fact, standard grading scales can do far more harm than good (Wiggins & McTighe, 2005), and are rooted in a student-deficit model of education (Au, 2008). Instead, formative assessment can be a tool for collaborative social learning, not competition (Shepard, 2000).

    Generative AI image from Diffit. Graphic shows a teal illustration of the back of a professional camera with an image on the LCD showing focus peaking which highlights the in focus soldering iron that is a screw driver?

    Bringing AI into the Design Loop

    To help build out support for the content with a guided learning activity, I experimented with Diffit to brainstorm various learner perspectives based on different experience levels and prior knowledge. To complete my workbook, I leaned into AI and used Google Gemini for more example images.

    Since technical content gets outdated quickly, LLMs struggle with those nuances especially where language intentionally sounds less natural due to differences in context specific words. I spent a good amount of time making corrections and closely reading the content, so I eventually switched to using them as inspiration for the flow, content distribution, and active learning prompts.

    Where Social Constructionism and Flexibility Meet

    I designed the resulting digital workbook to flex and differentiate. I focused on making the activities and assessment adaptable, flexible, and collaborative.

    • Adaptable: content scales in challenge for different experience levels and prior knowledge or experience with the subject. 
    • Flexible: additional challenges are provided and prompts can be interpreted with more challenging content. Reducing activities or learning objectives can be easily negotiated. 
    • Collaborative: along with Team Lead involvement and additional context given to each student, students are encouraged with a self-sustaining community of practice within the team.

    Take a Look at the full guidebook at the end of this post.

    Looking Ahead to Data

    Now comes the important part of polishing up the workbook and putting the assessment it into practice to see what the data reveals. I am particularly curious about how a student’s major might impact their learning progress as a student employee. 

    • Will peak-semester cognitive load in content-heavy majors alter how students perform in reflective activities? How might they perceive the workload?
    • How do the assessment types that different majors tend to experience (i.e. exam, essay, project, portfolio) shape their perception of the support level in the activity?

    Once the data is collected, I’ll be using it to help me improve future assessments for my student employee team that are manageable, supportive, designed with universal principles in mind, and aligned with my learning objective and their personal goals. 

    I’m eager to keep refining the learning journey!

    References

    Au, W. (2008). Unequal by design: High-stakes testing and the standardization of inequality. Routledge.

    Montenegro, E., & Jankowski, N. A. (2017). Equity and assessment: Moving towards culturally responsive assessment. (Occasional Paper No. 29). University of Illinois and Indiana University, National Institute for Learning Outcomes Assessment (NILOA).

    Shepard, L. A. (2000). The role of assessment in a learning culture. Educational Researcher, 29 (7), 4-14. 

    Wiggins, G., & McTighe, J. (2005). Understanding by design, (2nd Ed.). Association for Supervision and Curriculum Development.

    Generative AI Use

    Diffit (https://web.diffit.me/) and Google Gemini (https://gemini.google.com/) were used in the making of this assessment.

  • Hold the Phone: Balancing Cool Tech and Cognitive Load in Onboarding 

    Gif of grey cat saying "Just send an email!" frustrated at the phone. Digital drawn cute illustration with light pink-orange background and office desk.

    What does Mural do that a stack of paper sticky notes doesn’t?

    The digital nature allows for asynchronous participation across the cohort’s schedule and for me to quickly engage as I bounce between resource fairs, events, tours, and classes. Prompt engagement helps me to foster these new relationships while I’m not physically present. By modeling collective knowledge building and collaboration, this assessment can foster the community of practice I seek to cultivate, aligning with theories on knowledge management and communities of practice (Wenger et al., 2002).

    Mural also allows freedom in responses – unlike multiple choice questions that limit conversation and reduce learning to numbers. Unlike a set of selectable choices, Mural helps me facilitate conversations around the complex scenarios a student might encounter rather than scenarios that can be reduced to a single right answer. After all, grades wouldn’t have helped achieve the goals anyways (Kohn, 2011).

    After each member of the cohort reviews their feedback, there are 4 final questions that capture crucial data for me.

    • Mural assessment activity detail of question "how are you feeling about the phones?"
    • Mural assessment activity detail of question "lingering questions?"
    • Mural assessment activity detail of question "how was this activity?"
    • Mural assessment activity detail of question "what could have made this training activity better?"

    These open-ended questions provide me with actionable insights like identifying comprehension gaps, assessing content and activity efficacy, and gauging confidence levels. The data allows me to quickly identify if I need to intervene, tailor the next training to this unique cohort, and improve future training.

    The risk of adding new technologies doesn’t always outweigh the risk, but I’d never know what possibilities it may hold until I can experiment with it. Knowing which tools are truly beneficial requires a critical lens, having the learning objectives in mind, and focusing on the learner first.

    Mural (2023). Data protection & privacy. Mural. https://support.mural.co/s/article/data-protection-privacy 

    Vygotsky, L. S., & Cole, M. (1978). Mind in society: The development of higher psychological processes. Harvard University Press.

  • Supporting Creativity with a Creative Assessment

    Alignment

    Example sketchbook intro page. The first page includes the learning outcome, objectives, and description of assignment. The second page explains how the sketchbook will be assessed and has several questions to orient instructor to learner's needs.
    Example sketchbook intro page. The first page includes the learning outcome, objectives, and description of assignment. The second page explains how the sketchbook will be assessed and has several questions to orient instructor to learner’s needs.

    Scaffolding

    Example Sketchbook page with prompted reflection on left. Right side has sketching in 3 perspectives prompt matching to icons from TinkerCad.
    Example Sketchbook page with prompted reflection on left. Right side has sketching in 3 perspectives prompt matching to icons from TinkerCad.
    • Left side of sketchbook prompt about design requirements with design thinking diagram. Right side prompts generating ideas.
    • Left side of sketchbook prompts "do you need to revise any of your design requirements?" Right side prompts with assessment question "reflect on the process so far. How does iterative design influence your process for this assignment?"
    • Left side of sketchbook shows being close to done with design and close to starting implementation. The right side prompts "sketch your best design for your tape dispenser."
    • Left side of sketchbook page prompts "revise your design using the information gathered from the testing and evaluation stages." Right side includes assessed reflection prompt.

    References

    Image Credit

  • Testing Trauma: why studying harder doesn’t work

    Gif titled "excuse me, wow." Close up of man looked socked and raising eyebrows in disbelief and disapproval.
    Gif titled "suspicious monkey" children's puppet looks awkwardly side to side without moving his head.

    References

    Image Credits

  • A Total Bust: Why my best assessment was a smashed sculpture.

    Stock image of book "Figure Sculpting Volume 1: Planes & Construction Techniques in Clay" with image of a male torso in clay.

    My figure sculpture aspirations.

    Small glazed clay sculpture about 10 inches in total height of a simplistic female figure is sitting on a rock facing downward. There are no facial features or details in the fingers.

    Where I started.

    Golum in Lord of the Rings looks up longingly and proudly at the gold ring. Text below says "my precious".
    This meme depicts how I felt about that masterpiece.
    Gif of hydraulic press squshing a yellow rubber duck.

    This is my impression of that slow squash.

    Gif from Schitts Creek saying "I've done it before and I can do it again."

    I might not have had this level of enthusiasm until the “third draft”…

    Plain clay male torso with draped fabric around one side of the hip. Torso includes many anatomical details of an athletic young man.
    After many smashed busts, I hope you can appreciate the progress as much as I do.

    References

  • Beyond the Grade: Actionable Assessment that Actually Matters

    Published May 25 and last modified May 30, 2026.

    Assessment in education consists of two primary components: assessing the learner to enhance their learning, and for the instructor to assess the learning in order to improve the whole educational experience.

    Decorative illustration of a table lamp shining.

    All too often, education focuses narrowly on assessing outcomes rather than embedding assessment into the learning process in a student-centric manner. To leverage assessment, we must pivot the focus to the former of assessing for the purpose of supporting the learner’s learning.

    I believe it is crucial to first acknowledge the learner’s prior experiences and the wider cultural context of high-stakes assessment before I can cultivate a positive low-stakes approach to assessment. Particularly in the United States of America, assessment has long carried with it outdated hereditarian theory, social efficiency models, behaviorism and a misguided emphasis on objective measurements of intelligence and memorization of information. These persistent beliefs and prior experiences create psychological risks to students’ self-worth and confidence in learning. As Shepard (2000) explains, utilizing assessment to enhance learning demands a shift in the learning culture and social meaning of evaluation.

    To truly leverage assessment that supports the learning process, it must pivot towards supporting each and every learner’s journey through a foundation of trust, equity, and a collaborative approach. Through cultivating a learning environment that is collaborative, learner-centered, and setting a tone of mutual support, trust between the instructor and learner can be built.

    Six different hands are holding each other's wrists to form a hexagon. Image is tightly cropped with a blurry background of grass.

    Trust and mutual respect allows the learner to view the instructor as a partner in growth. Crucially, a fair and equitable assessment practice is necessary at the core of the assessment practice in order to build and sustain this relationship of trust both between the learner and instructor and the wider class community as a whole.

    To actively support the learning process, assessment must be timely and actionable. When assessment is on-going and embedded throughout the learning experience, feedback becomes a dynamic part of the learner’s experience. When assessment is embedded into the continuous loop of learning, the learner is able to gauge their progress and understand what actions or focus is necessary to move forward, while also providing valuable information for the instructor to provide scaffolding, strategies, or possibly to adjust the learning design entirely to support all the learners.

    Further, assessment must be actionable rather than passive. Without utility in the information created, the assessment risks devolving into mundane busy-work. When grounded in a growth mindset of continuous development, actionable feedback ensures that all learners whether they are already meeting the learning objectives or not, are able to develop their self-directed learning skills, to push their boundaries, and stretch their capabilities in exciting directions. Ensuring that assessments are actionable and useful requires intentional and thoughtful design.

    To provide effective, well designed assessment, I utilize Backwards Design and Iterative Design methods. Starting with measurable and clear learning objectives and working backwards ensures that the assessment is aligned with learning and creates useful data that can be applied to enhance outcomes. Yet, we as instructors must not only utilize iteration and improvement focused practices, we must also embody and model them for the learners. Through modeling and displaying how assessment is used to iterate and improve your own teaching, the learner gains valuable insights into how they are a part of the collaborative learning environment. When instructors demonstrate using an assessment to improve themselves or the course itself, the learner can truly transform their perspective on the role of assessment in their learning and become a catalyst for demonstrating to all the value that assessment holds for the learning experience.

    References

    Shepard, L. A. (2000). The role of assessment in a learning culture. Educational Researcher, 29 (7), 4-14. 

    Image Attribution

    Anemone123. (2017). Team spririt teamwork community [Photograph]. Pixabay. https://pixabay.com/photos/team-spirit-teamwork-community-2447163/

    Andrey_and_Olesya. (2023). Lamp beam table lamp reading [Illustration]. Pixabay. https://pixabay.com/illustrations/lamp-beam-table-lamp-reading-7898064/

  • Learning about Learning

    May 2, 2026

    7–11 minutes
    Meme picturing old CRT TV on a rolling cart. Text says "It makes me sad that kids today will never know the unspeakable joy of walking into a classroom and finding a television cart." Credit and logo "Bored Teachers."
    Decorative illustration of a brain.

    Footnotes

    1. No knowledge from that HTML courses aided me in the creation of this webpage. I used Google Gemini for guidance to attempt to embed a script or iframe code which is unfortunately blocked by WordPress on accounts that are not self-hosted, such as mine. ↩︎
    2. In the 2007 comprehensive assessment of FLVS by the Florida TaxWatch Center for Educational Performance and Accountability, data from the academic year of 2005-2006 depicts high withdrawal rates when compared to traditional school enrollments. Withdrawals in the subjects of computer science and business technology are notable in Chart 34 on page 65 (2007). ↩︎
    3.  Based on the 2009 report by Mackey, K. and Horn, M.B., it seems that the primary motivation of FLVS was to reduce the cost of education in the state of Florida and effectiveness was measured by quantity of enrollment which resulted in the program’s funding allocation. Studies had not been conducted to compare FLVS learning outcomes against traditional high school courses (2009). ↩︎
    4. For more about my online teaching pedagogy, see my Online Learning Manifesto. ↩︎

    References