Racism and Sexism in Teaching Evaluations

In the world of academia, where the pursuit of knowledge and excellence in teaching are paramount, one might assume that evaluation methods would be impartial and objective. However, a thought-provoking article by David Delgado Shorter, a UCLA Professor of World Arts and Cultures, sheds light on the problematic nature of student evaluations. In his article titled “Teaching Evaluations Are Racist, Sexist, And Often Useless: It’s Time To Put These Flawed Measures In Their Place,” Shorter questions the validity and fairness of using student evaluations as a basis for academic merit and promotion decisions.

Shorter’s journey into this subject began when he reviewed his own teaching evaluations from the previous years, aiming to compile them for promotion purposes. What he found was a mixture of bizarre comments and personal narratives that had little to do with the actual course content. He realized that this was not an isolated incident; many of his Black and Asian colleagues, especially women, faced even more problematic evaluations.

These concerns prompted Shorter to delve into the research surrounding teaching evaluations. He discovered a wealth of peer-reviewed papers spanning decades, all pointing to the same disturbing trend: gender and racial biases in student evaluations. Women consistently received lower ratings than men, and younger women were often judged less professionally than their older counterparts. Women of color faced additional challenges, being rated as less effective than white women. These biases, based on gender, race, and even seemingly unrelated factors like the time of day a course was taught, raised serious questions about the validity of using student evaluations as a sole measure of teaching effectiveness.

The American Sociological Association (ASA) recognized these issues and recommended in 2019 that student evaluations should not be used as the sole basis for merit and promotion decisions unless part of a broader, more holistic assessment. Some universities, such as the University of Southern California, the University of Oregon, and the University of Nebraska at Lincoln, have already taken steps to combine student evaluations with other forms of assessment in personnel decisions. The ASA’s stance has garnered support from nearly two dozen professional organizations.

The legal implications of relying solely on student evaluations are also a cause for concern. In a case at Ryerson University (now Toronto Metropolitan University) in 2009, an arbitrator, William Kaplan, acknowledged “serious and inherent limitations” of student evaluations, describing them as “imperfect at best and downright biased and unreliable at worst.” This raises the possibility of legal challenges if colleges continue to use these evaluations as the primary criterion for decision-making.

In response to these issues, Shorter’s own department at UCLA decided to prioritize fairness and reliability. They chose not to rely on student evaluations for job security and instead implemented a system that allowed faculty members to use peer-assessment and self-evaluation, with documented revisions to pedagogical statements. This approach aligns with the principle that academics should be assessed by their peers and experts in their respective fields rather than relying solely on student evaluations.

Losing Confidence in Higher Education

In recent times, America has been witnessing a seismic shift in the perception and value of higher education. Historically, a college degree had been regarded as a quintessential stepping stone to financial stability and a prosperous future. The early 2010s saw a high rate of affirmation from college graduates, with 86 percent considering their investment in college education to be worthwhile.[i]Additionally, 70 percent of high school graduates chose to pursue higher education directly after their graduation in 2009, showcasing the predominant belief in the benefits of a college education. The economic data around this time period significantly favored those with a bachelor’s degree, who were found to earn about two-thirds more than individuals with just a high school diploma. This earnings gap suggested that higher education could be a reliable pathway to greater financial security and prosperity.

Unfortunately, a stark contrast can be observed in recent years, as public sentiment regarding higher education has experienced a monumental shift. As of 2021, undergraduate enrollment figures plummeted to below 15.5 million, compared to over 18 million a decade earlier.[ii]Surveys conducted during this time reveal a staggering decline in the value attached to a college degree, with only 41 percent of young adults considering it very important, a dramatic decrease from the 74 percent recorded previously.[iii]  This waning confidence is mirrored in the diminishing trust towards higher education institutions, with only a third of the American populace expressing a high degree of faith in them.[iv] Continue reading “Losing Confidence in Higher Education”

“The Instruction Myth” Revisited

In the vast landscape academia, one constant lingers. The venerated lecture is an historical artifact that traces its origins to the very inception of higher learning. Such a tradition, efficient as it might be for transmitting facts, often falls short in sparking genuine engagement. A growing body of evidence-based research shows that this is arguably the least effective way to generate learning, especially in our digitally charged era where learning has undergone a dramatic metamorphosis.

Our digital age hasn’t just redefined how we retrieve information, but reshaped our very expectations of learning. The omnipresence of online tools and multifaceted communication avenues heralds a marked shift in pedagogy. Brick-and-mortar classrooms, once the sole sanctums of knowledge, are being complemented by, if not at times replaced by, vibrant alternative modalities.

As John Tagg insightfully noted in his now- classic The Instruction Myth: Why Higher Education is Hard to Change, And How to Change It (Rutgers, 2019), established education structures can unwittingly ensnare itself in a misguided “universal solution” mindset. They risk glossing over the rich potentials of diverse learners, their individualized backgrounds, and inclinations. In this milieu, learning that foregrounds students’ individual aptitudes emerges as a promising way forward. Such adaptive approaches beckon a richer, more encompassing educational horizon. Continue reading ““The Instruction Myth” Revisited”

Welcome to Cyberschool

While technology always has played a role in education , it went into hyperdrive with the pandemic-driven move to online learning. Up to this point, economic pressures and growing student numbers already were causing a panic in education. Schools were struggling to trim budgets as “accountability” scrutinized everyone. These extant conditions presented an upside to some of the changes that would occur.  Most dramatically, the shift to doing schoolwork at home eliminated shortfalls in classroom space and, at least temporarily, student housing as well. As the pandemic continued the share of higher education offered online jumped from 10 percent in 2019 to 33 percent a few years later.[i]  But as everyone now knows, so-called “distance learning” isn’t for everyone and doesn’t work for all kinds of material.  Research shows that one-size-fits-all character of mechanical course delivery disadvantages students of many kinds.

Online schooling isn’t as new as you might think. The idea of distance learning dates to vocational and self-improvement correspondence courses of the eighteenth century, which arose with improvements  in mail delivery systems. Often cited as an early example was a shorthand course offered by Caleb Phillips, advertised in a 1721 edition of Boston Gazette with claims that “students may by having several lessons sent weekly to them, be as perfectly instructed as those that live in Boston.”[ii] By the 1800s all manner of vocational skills were being taught by mail, as well hobbies like drawing and painting. The University of London became the first college to offer distance learning degrees in 1858. By the end of the century, learning by mail had become big business for institutions like the Pennsylvania-based International Correspondence Schools (ICS). In the decade between 1895 and 1905, ICS grew from 72,000 to 900,000 students signing up to learn technical and management skills.[iii] Much of this growth was due to the innovation of sending entire textbooks rather than single lessons, along with promotion by a large in-person sales team. Continue reading “Welcome to Cyberschool”

Why Professors Ignore the Science of Teaching

A recent article appearing in the Chronicle of Higher Education explored the apparent reluctance of college and university professors to embrace the growing body of research about how students learn and what teaching methods work best. While many faculty simply cling to what has worked for them in the past, others feel overworked and unable the consider changing. In the meantime, an increasingly diverse student population experiences increasing inequity as a result.

Beth McMurtrie’s “Why the Science of Teaching is Often Ignored” opens with a discussion of a recent study by five Harvard University researchers who published some novel research. The group was trying to figure out why active learning, a form of teaching that has had measurable success, often dies a slow death in the classroom. They compared the effects of a traditional lecture with active learning, where students solve problems in small groups.

The results were not surprising; students who were taught in an active method performed better on standardized tests. The academic press praised the study for its clever design and its resonance with professors who had trouble with active learning. Yet despite being praised in some quarters, the study was criticized in others.

This mixed reaction reveals a central paradox of higher education, according to McMurtrie. Teaching and learning research has grown dramatically over the decades, encompassing thousands of experiments, journals, books, and programs to bring learning science  into classrooms. But a lot of faculty members haven’t read it, aren’t sure what to do with it, or are skeptical. Continue reading “Why Professors Ignore the Science of Teaching”

Inclusive Pedagogy

The pandemic years have been rough on college students everywhere, with record levels of academic stress and losses in student learning.  While occurring throughout higher education, these problems haven’t affected all groups the same way. Students from privileged backgrounds have fared better than the under-resourced, with disparities in network access, income, and external responsibilities exacerbating inequities. As I saw these dynamics play out in the large undergraduate general education courses I teach, I began wondering if instructional methods might be partly to blame and if changes might improve matters going forward. Working with UC Irvine’s Division of Teaching Excellence and Innovation (DTEI) helped me to rethink my own teaching by searching out ways that I unconsciously had been putting up roadblocks

Usually when educators speak of “inclusion” they are thinking of course content and ways to incorporate diverse perspectives or voices previously excluded. While this approach remains a central tenant of inclusive teaching, a deeper look at the issue can reveal biases or barriers built into the teaching of even the most progressive educators. Practices of exclusion can be the result of habits or structures that have become so routinized in instruction that they seem natural or neutral approaches. Costly books, rigid deadlines, and high-stakes exams are among practices that privilege students with money, time flexibility, and testing skills, for example.

Faculty attitudes also can get in the way of inclusion. This often is manifest in principles of “rigor” intended to elevate worthy over unworthy students. Such attitudes create a scarcity mentality toward success rather than one that makes high achievement possible for all students. Decades of educational research has shown the deleterious effects of such practices in conflating grades with knowledge acquisition. The grade pressure that frequently drives “rigor” has been shown to affect some students more than others, while creating an atmosphere of anxiety and an emphasis on types of learning easily that can be easily tested. Not only does this create learning inequities, but it also tends to discourage collaboration, questioning, and diverse opinion. Continue reading “Inclusive Pedagogy”

When School is a Factory

For 20 years, I have been teaching large arts and humanities general education courses at the University of California, Irvine. These 400-student classes are part of the undergraduate “breadth requirements” common in most colleges and universities, and hence draw enrollments from across the academic disciplines. At UC Irvine, this means that most of the class comprises science, technology, engineering, and math (STEM) majors. Aside from an orientation to more practical fields, I’ve noticed a clear shift in student attitudes in recent years –– a heightened preoccupation with grades and rankings, combined with growing anxieties about future earnings. Many of my colleagues see this as well, often disparaging students more concerned with GPA metrics than learning itself, while increasingly behaving more like consumers of educational commodities. I take a more sanguine view.

Bear in mind that many of today’s college students grew up during the Great Recession, when families of all incomes had money worries. With scant knowledge of a world before 9/11, it’s little wonder that polls show millennials expecting lower earnings than their parents, seeing the United States on a downward spiral, and believing the two-party system as fatally flawed.[i] Rising income inequality doesn’t help matters, especially at UC Irvine where 6 in 10 students get financial aid and half are the first in their families earning a college degree.[ii] Because of this, Irvine has been cited by the New York Times as the country’s leading “upward mobility engine” –– making the campus a national model of what public higher education can do.[iii] But it’s still not a cake-walk for degree seekers. As at most public universities in America, the majority of Irvine’s full-time students also work at jobs to make ends meet.[iv] Continue reading “When School is a Factory”