A new report from the Stanford History Education Group finds that fact checkers read less but learn more – far outpacing historians and top college students.
BY CARRIE SPECTOR
How do expert researchers go about assessing the credibility of information on the internet? Not as skillfully as you might guess – and those who are most effective use a tactic that others tend to overlook, according to scholars at Stanford Graduate School of Education.
Sam Wineburg (Image credit: L.A. Cicero)
A new report released recently by the Stanford History Education Group(SHEG) shows how three different groups of “expert” readers – fact checkers, historians and Stanford undergraduates – fared when tasked with evaluating information online.
The fact checkers proved to be fastest and most accurate, while historians and students were easily deceived by unreliable sources.
“Historians sleuth for a living,” said Professor Sam Wineburg, founder of SHEG, who co-authored the report with doctoral student Sarah McGrew. “Evaluating sources is absolutely essential to their professional practice. And Stanford students are our digital future. We expected them to be experts.”
The report’s authors identify an approach to online scrutiny that fact checkers used consistently but historians and college students did not: The fact checkers read laterally, meaning they would quickly scan a website in question but then open a series of additional browser tabs, seeking context and perspective from other sites.
In contrast, the authors write, historians and students read vertically, meaning they would stay within the original website in question to evaluate its reliability. These readers were often taken in by unreliable indicators such as a professional-looking name and logo, an array of scholarly references or a nonprofit URL.
When it comes to judging the credibility of information on the internet, Wineburg said, skepticism may be more useful than knowledge or old-fashioned research skills. “Very intelligent people were bamboozled by the ruses that are part of the toolkit of digital deception today,” he said.
The new report builds on research that SHEG released last year, which found that students from middle school through college were easily duped by information online. In that study, SHEG scholars administered age-appropriate tests to 7,804 students from diverse economic and geographic backgrounds.
For the new report, the authors set out to identify the tactics of “skilled” – rather than typical – users. They recruited participants they expected to be skilled at evaluating information: professional fact checkers at highly regarded news outlets, PhD historians with full-time faculty positions at universities in California and Washington state, and Stanford undergraduates.
“It’s the opposite of a random sample,” Wineburg said. “We purposely sought out people who are experts, and we assumed that all three categories would be proficient.”
The study sample consisted of 10 historians, 10 fact checkers and 25 students. Each participant engaged in a variety of online searches while SHEG researchers observed and recorded what they did on-screen.
In one test, participants were asked to assess the reliability of information about bullying from the websites of two different groups: the American Academy of Pediatrics (AAP), the largest professional organization of pediatricians in the world, and the American College of Pediatricians (ACPeds), a much smaller advocacy group that characterizes homosexuality as a harmful lifestyle choice.
“It was extremely easy to see what [ACPeds] stood for,” Wineburg said – noting, for example, a blog post on the group’s site that called for adding the letter P for pedophile to the acronym LGBT. Study participants were asked to evaluate an article on the ACPeds website indicating that programs designed to reduce bullying against LGBT youth “amount to special treatment” and may “validat[e] individuals displaying temporary behaviors or orientations.”
Fact checkers easily identified the group’s position. Historians, however, largely expressed the belief that both pediatricians’ sites were reliable sources of information. Students overwhelmingly judged ACPeds’ site the more reliable one.
In another task, participants were asked to perform an open web search to determine who paid the legal fees on behalf of a group of students who sued the state of California over teacher tenure policies in Vergara v. California, a case that cost more than $1 million to prosecute. (A Silicon Valley entrepreneur financed the legal team, a fact not always mentioned in news reports about the lawsuit.) Again, the fact checkers came out well ahead of the historians and students, searching online sources more selectively and thoroughly than the others.
The tasks transcended partisan politics, Wineburg said, pointing out that advocates across the political spectrum promulgate questionable information online.
“These are tasks of modern citizenship,” he said. “If we’re interested in the future of democracy in our country, we have to be aware of who’s behind the information we’re consuming.”
The fact checkers’ tactic of reading laterally is similar to the idea of “taking bearings,” a concept associated with navigation. Applied to the world of internet research, it involves cautiously approaching the unfamiliar and looking around for a sense of direction. The fact checkers “understood the web as a maze filled with trap doors and blind alleys,” the authors wrote, “where things are not always what they seem.”
Wineburg and McGrew observed that even historians and students who did read laterally did not necessarily probe effectively: They failed to use quotation marks when searching for contiguous expressions, for instance, or clicked indiscriminately on links that ranked high in search results, not understanding how the order is influenced by search engine optimization. Fact checkers showed what the researchers called click restraint, reviewing search results more carefully before proceeding.
The authors of the report say their findings point to the importance of redeveloping guidelines for users of all ages to learn how to assess credibility on the internet. Many schools and libraries offer checklists and other educational materials with largely outdated criteria, Wineburg said. “Their approaches fit the web circa 2001.”
In January SHEG will begin piloting new lesson plans at the college level in California, incorporating internet research strategies drawn from the fact checkers’ tactics. Wineburg sees it as one step toward updating a general education curriculum to reflect a new media landscape and the demands of civic engagement.
In the state’s 2016 election alone, he noted, voters were confronted with 17 ballot initiatives to consider. “If people spent 10 minutes researching each one, that would be an act of incredible civic duty,” he said. “The question is, how do we make those 10 minutes count?”
From Spector, C. (2017, October 24). Stanford scholars observe “experts” to see how they evaluate the credibility of information online. Retrieved from https://news.stanford.edu/press-releases/2017/10/24/fact-checkers-ouline-information/
Logging in, please wait...
0 General Document comments
0 Sentence and Paragraph comments
0 Image and Video comments
I think about this and realize that although this may be true for many teens, I do believe that some teens have indeed held newspapers and many times at that. Along with this it leads me to think about how older generations are judging our generation because we get our news from online. Even though we no longer use newspapers as often I like to think that there are easier and more up to date ways to get news and our generation simply uses those strategies.
New Conversation
Hide Full Comment Hide Thread Detail
If anything, newspapers are doing extremely well nowadays. If I remember hearing this correctly there was talk about how CM Life is more successful than the TV and radio stations here at CMU. If anything, newspapers are the basis for a lot of news heard elsewhere. Journalism programs aren’t dying soon and there is still demand for students wanting to participate in newswriting/newspapers. If anything, there is more news accessibility now because of newspapers diversifying how they present their content to physical and internet-based platforms.
New Conversation
Hide Full Comment
This quote actually frustrates me in its accuracy. There is no great way to teach students how to validate information and more importantly there is not a very solid approach on how to teach these students to look for it.
New Conversation
Hide Full Comment Hide Thread Detail
I agree that this is frustrating because I do not believe there is 1 specific way to “teach” children. Each child has their own learning style and it is educators job to help the child discover that style in order for them to be successful in their learning, whether this be in a subject or developing skills to find information.
New Conversation
Hide Full Comment
New Conversation
I feel weird thinking that there are different “levels” of readers. I understand that there are some ways in which some people can be better at reading that others but I don’t like that there is classification perse about it that comes into factor for Stanford studies.
New Conversation
Hide Full Comment
Learning about the idea of reading laterally has interested me because it was not something I have heard of before. I think it is interesting and not something that I would typically do unless I was doing very extensive research on a topic. However, a question arises in my head, though you are seeking out other sources, how can you be sure that those articles are reliable?
New Conversation
Hide Full Comment
I absolutely love the idea of judging credibility with a skeptic point of view. There are so many people and sources that aren’t credible out there today that it is almost impossible to 100% believe everything you read the first time. That is why it is so important to approach information found on the internet with skepticism and keep an open mind about everything that we read. Fact check everything!
New Conversation
Hide Full Comment
I can understand younger kids getting confused by online content but I would hope that most college students would be better at deciphering what is “true” for themselves. If anything, I think that college students are often better at figuring these things out than some adults because they were raised in an era of technology. There have been some occasions where I have to explain things to relatives of mine because they took something online literally or didn’t read into it more than what was necessary to fully understand the concept. This can get concerning with things like the upcoming elections because people can put information out there and easily influence decisions without many having opinions about it. Also, there tends to be instances where people release biased media but don’t necessarily disclose the bias which can influence readers who don’t know it is essentially propaganda.
New Conversation
Hide Full Comment
General Document Comments 0
As we prepare for our “reading laterally” activity next Monday, please read, view, and discuss work from the Stanford History Education Group via NowComment.
Please offer one initial comment on something you notice in the video, and one initial comment on something you notice in the article. Then, reply at least once to each of the other members of your group. For instance:
What do you notice about the way that the researchers from the SHEG describe the ways most people read online? How does this compare to your own reading habits?
As you consider what the SHEG has discovered in their research, and the fact that we have midterm elections coming up in two weeks, what might you want to discuss with your friends and family?
Finally, as you consider the tools that we have been learning about in HON 206, are there ways that you might be able to change your own online reading habits to combat some of the challenges that the SHEG describes?
New Conversation
Hide Full Comment