A recent controversy reminded me that confirmation bias isn’t confined to the political Right. Those of us who lean Left engage in it too, and–unfortunately– so do serious observers of the political scene who ought to know better.
One reason for the academic process known as “peer review” is to ensure that scholars have accurately interpreted the work of other scholars, and to check that the methodologies they’ve employed have been correctly applied. (Errors in methodology aren’t necessarily intentional–they can be the result of the researcher seeing what she is convinced she’ll see.)
What triggered these reminders was a recent article from The Atlantic, pointing to serious flaws in the arguments and conclusions in White Rural Rage, a recent best-seller by political scientist Tom Schaller and journalist Paul Waldman. I was particularly interested in the article and the scholarship it cited, because my own reading has convinced me that urban-rural divisions are indeed a significant part of America’s current polarization. But the critique of this particular book looks to be firmly grounded.
In the weeks since its publication, a trio of reviews by political scientists have accused Schaller and Waldman of committing what amounts to academic malpractice, alleging that the authors used shoddy methodologies, misinterpreted data, and distorted studies to substantiate their allegations about white rural Americans. I spoke with more than 20 scholars in the tight-knit rural-studies community, most of them cited in White Rural Rage or thanked in the acknowledgments, and they left me convinced that the book is poorly researched and intellectually dishonest.
The Atlantic author, Tyler Austin Harper, says he was initially frustrated by the book’s resort to familiar stereotypes, but when he dug deeper, he found significant problems with White Rural Rage that extended “beyond its anti-rural prejudice. As an academic and a writer, I find Schaller and Waldman’s misuse of other scholars’ research indefensible.”
I won’t go through all of the misquoted scholarship that Harper enumerates in the linked analysis, but the largest error he identifies by far is the failure to define their use of the term “rural.”
The most obvious problem with White Rural Rage is its refusal to define rural. In a note in the back of the book, the authors write, “What constitutes ‘rural’ and who qualifies as a rural American … depends on who you ask.” Fair enough. The rural-studies scholars I spoke with agreed that there are a variety of competing definitions. But rather than tell us what definition they used, Schaller and Waldman confess that they settled on no definition at all: “We remained agnostic throughout our research and writing by merely reporting the categories and definitions that each pollster, scholar, or researcher used.” In other words, they relied on studies that used different definitions of rural, a decision that conveniently lets them pick and choose whatever research fits their narrative. This is what the scholars I interviewed objected to—they emphasized that the existence of multiple definitions of rural is not an excuse to decline to pick one. “This book amounts to a poor amalgamation of disparate literatures designed to fit a preordained narrative,” Cameron Wimpy, a political scientist at Arkansas State University, told me. It would be like undertaking a book-length study demonizing Irish people, refusing to define what you mean by Irish, and then drawing on studies of native Irish in Ireland, non-Irish immigrants to Ireland, Irish Americans, people who took a 23andMe DNA test that showed Irish ancestry, and Bostonians who get drunk on Saint Patrick’s Day to build your argument about the singular danger of “the Irish.” It’s preposterous.
Serious scholars confirm the existence of a very real urban/rural divide, and cultural differences between urban dwellers and Americans living in thinly-populated, economically-struggling parts of the country. But careful scholarship has distinguished between residents of non-metropolitan areas who fit the book’s “rural” stereotype and those who do not. In 2019, I cited a fascinating study from the Niskanan Center that focused on attitudinal differences linked to residential density–the lengthy study found that values of small town residents of “rural” America who lived close to others in the hearts of those communities differed from those of their more isolated neighbors.
The bottom line here is twofold: it’s important to avoid stereotyping, and essential to define our terms. As our political battles heat up, too many of us use language to label opponents rather than as vehicles to convey information.
Is there an urban/rural divide? Yes. Is it important to understand its roots and effects? Yes again. But as I used to tell my students–and as someone should have told the authors of this book–it depends upon how you are defining rural, and it’s more complicated than you want to understand.
Comments