The Assessment Crisis is Bigger than AI

The last few months have seen my campus scrambling to get back to in-person assessment and to reopen testing centers. Like many universities that quietly had deemphasized such exams during the COVID years, now at UC Irvine there is rising faculty demand to quickly change course. Many worry about the validity of take-home and online assessments, as campus officials search for rooms or even build new ones. Meanwhile, already stressed students feel increasingly desperate over high-stakes tests that can make or break academic success. While the crisis seems recent at UCI, what’s really happening predates the rise of generative AI and won’t be fixed with more exam rooms.

Much of higher education now sees online assessment as an arms race it can’t win, with over 150 institutions planning to end it this year. Earlier this month, the Law School Admission Council (LSAC) announced t it would return the LSAT to in-person testing by summer 2026, citing “security concerns,” “score inflation,” and “the misuse of technology to facilitate cheating.”[1]  All Ivy League schools also are reverting to standardized tests for admissions after eliminating them during the last decade.  Complicating matters further is the reality of cash-strapped schools facing infrastructure bottlenecks because they’ve  repurposed or sold off testing centers.[2]  Driving this frantic backtracking is the logical but incorrect belief that assessment is losing meaning at a time when ChatGPT can generate answers in a few seconds. Hence the current retreat to blue books, testing rooms, and internet-free conditions.

“Generative AI did not create assessment issues. It revealed them,” according to Emma Ransome of Birmingham City University.[3]  Ransome explains that traditional measures like timed exams, standardized tasks, and recall-based tests historically have done poorly in evaluating skills universities claim to instill such as critical thinking, ethical judgement, and synthesizing ideas. Generative AI has made the disconnect between what is being measured and what is being taught even more apparent. If a large language model can successfully complete a multiple choice pharmacology exam, or if an LLM can generate a decent survey essay about the causes of World War I, one shouldn’t be asking how to stop students from using it.  Instead the issue should be what kind of knowledge those conventional measures assessed in the first place.

Continue reading “The Assessment Crisis is Bigger than AI”

Treating Students as Suspects

It’s no secret that online learning has its problems, witnessed in the historic failure and drop-out rates resulting from thrown-together course overhauls in the early COVID months. Less widely reported has been another kind of failure owing to a loss faith in educational institutions and a widening trust gap between teachers and students.

Inherent school power inequities  have aggravated  antagonisms – now made even worse by a range of surveillance and security technologies. The distance in “distance learning” can create an atmosphere of alienation and distrust. When the in-person classroom is reduced to a screen image, teachers and students can seem more like abstractions than actual people.

This opens the door for all sorts of communication failures and misunderstandings, not to mention stereotyping and harm. The objectifying tendencies of media representations long have been associated distortions in the way individuals and groups view each other, whether in the marketing of products, sensationalizing news items, or spreading ideologies on social networks. When “Zoom school” does this, underlying beliefs and assumptions can overtake the reality of encounters, generating attitudes that destabilize the learning environment.

These problems have become especially evident in the panic about student dishonesty in online learning, as the absence of classroom proximity quickly escalated in into assumptions of cheating. Early in the 2020s a torrent of news reports warned of an “epidemic” of dishonesty in online learning, with some surveys showing over 90 percent educators believing cheating occurred more in distance education than in-person instruction.[i] New technologies often have stoked such fears, in this instance building on the distrust many faculty hold toward students, some of it racially inflected. [ii] Closer examination of the issue has revealed that much of the worry came from faculty with little direct knowledge of the digital classroom, online student behavior, and preventative techniques now commonly used.  Indeed more recent research has shown no significant differences between in-person and online academic integrity.[iii] Continue reading “Treating Students as Suspects”