Fairness at Scale: How to Calibrate and Coordinate Large-Scale Marking

In the second of our blog series on leading extra large modules,  the team from the University of Exeter Business School are concentrating on consistency in assessment.

Consistency in assessment is a cornerstone of quality. Here’s how to make marking fair and efficient when your module enrols hundreds.

Fair and consistent marking is challenging in any context – but when your module has 500+ students, it becomes mission-critical. One inconsistent marker can affect dozens of students. One error in your VLE can delay hundreds of grades. And one ambiguous brief can produce confusion across an entire cohort. That’s why calibration, clarity, and communication are key.

Here’s how educators at Exeter are managing the complex task of assessment and marking in extra-large modules.

1. Begin with the Brief

The foundation of effective marking is a clear, robust assessment brief. When expectations are transparent, both students and markers are more confident. One tip: provide a detailed guidance presentation and record an assignment briefing session with crystal-clear audio. Students refer back to it repeatedly, and it significantly reduces follow-up questions.

Also, think carefully about the design of the assessment. Avoid high-risk formats that could trigger a flood of mitigation requests. When hundreds of students are enrolled, even a small percentage seeking alternatives can result in weeks of admin.

2. Equip the Marking Team

A “Marker Pack” is essential. This should include:

·       Annotated example submissions across different grade bands

·       A marking guide with common expectations and references to module content

·       A summary of what to reward (and what to flag)

·       A system for dealing with unexpected responses or anomalies

Crucially, the pack should be distributed well in advance of marking deadlines. Markers should also have a firm grasp of the module content, even if they didn’t teach it directly. This ensures they can recognise informed responses and reference points accurately.

3. Calibrate Early and Communicate Often

Calibration exercises are non-negotiable. Before marking begins, allocate a sample of the same student work to all markers and compare results. Discuss differences openly and revisit the marking guide as needed. This is your chance to identify divergence early – before it impacts final marks.

Regular communication is equally important. Create a shared space (e.g. Teams) for queries and decisions. Expect surprises: unusual answers, tech glitches, or student misunderstandings. By sharing these in real time, your team can remain aligned and confident.

4. Plan for Problems

Large cohorts magnify every hiccup. Be prepared for:

·       Platform issues (e.g. submission problems on the VLE)

·       Delays in grade release if moderation uncovers discrepancies

·       Duplicate or missing scripts during the handoff between systems

To reduce panic and protect timelines:

·       Appoint one or two go-to problem solvers for quick triage

·       Create a troubleshooting flowchart so team members know who to contact

·       Keep morale up – especially during peak pressure periods

A calm, supported marking team is more likely to deliver consistent, high-quality feedback.

5. After the Storm: Reflect and Improve

Once marking is done, gather the team for a short debrief. What worked? What didn’t? Were students well prepared? Did any unexpected patterns emerge?

These insights can help refine the assessment for next year, improve briefing materials, and even feed into curriculum adjustments. Continuous improvement is especially vital when the stakes, and the student numbers, are high.

For more information please contact: