Chapter 12. Real Understanding in the AI Era
In my doctoral research with university teachers in Pakistan, a computer scientist described a habit that takes almost no equipment. Chapter 5 quoted the same teacher on homework. Here I want to ask what the habit certifies. For online quizzes, the computer scientist draws on a question bank that gives each student different values, ‘forcing each student to solve a unique problem’ (Ilyas, 2026, p. 186, Participant H01). Quick assessments go out as a link with two or three immediate questions (p. 187). After that comes the step that matters most here. ‘Then sometimes we ask them questions from their own submissions to ensure they actually understand what they wrote’ (Ilyas, 2026, p. 188, Participant H01).
Nothing in that account is new technology. A teacher reads a student’s work, points to a line and asks what it means. My thesis reads the practice as a check on authorship and comprehension at once (Ilyas, 2026, p. 188). I would put it a little more cautiously. A question can show whether a student understands a piece of work, but it cannot prove how the work was produced. That narrower claim is still a large one.
What the chapter covers
- Fluent is not the same as known
- Knowing has more than one account
- Trusting a source we cannot see inside
- Expertise and the work of judging
- Authorship, originality and ownership
- Validity, beyond catching cheats
- What a degree can still certify
- Oral assessment on campus, and what it costs
- When the examiner is a machine
- In practice
- When resources are thin
- Questions for reflection
- Framework connections
Questions for reflection
Take these questions to your next programme meeting, or to a quiet hour after marking.
- In the course you teach now, which piece of assessed work would tell you most if a student had to talk you through it?
- When a student’s work is fluent, what tells you whether the student understands it?
- Which sources do your students trust without checking, and what would teach them when to doubt?
- What would a five-minute oral cost your department in rooms, staff and timetable hours?
- In which language can your students best show what they know, and does your assessment allow it?