Category: achievement gaps

  • Taking Intermittent Quizzes Reduces Achievement Gaps & Enhances Online Learning – The 74

    Taking Intermittent Quizzes Reduces Achievement Gaps & Enhances Online Learning – The 74

    Inserting brief quiz questions into an online lecture can boost learning and may reduce racial achievement gaps, even when students are tuning in remotely in a distracting environment.

    That’s a main finding of our recent research published in Communications Psychology. With co-authors Dahwi Ahn, Hymnjyot Gill and Karl Szpunar, we present evidence that adding mini-quizzes into an online lecture in science, technology, engineering or mathematics – collectively known as STEM – can boost learning, especially for Black students.

    In our study, we included over 700 students from two large public universities and five two-year community colleges across the U.S. and Canada. All the students watched a 20-minute video lecture on a STEM topic. Each lecture was divided into four 5-minute segments, and following each segment, the students either answered four brief quiz questions or viewed four slides reviewing the content they’d just seen.

    This procedure was designed to mimic two kinds of instructions: those in which students must answer in-lecture questions and those in which the instructor regularly goes over recently covered content in class.

    All students were tested on the lecture content both at the end of the lecture and a day later.

    When Black students in our study watched a lecture without intermittent quizzes, they underperformed Asian, white and Latino students by about 17%. This achievement gap was reduced to a statistically nonsignificant 3% when students answered intermittent quiz questions. We believe this is because the intermittent quizzes help students stay engaged with the lecture.

    To simulate the real-world environments that students face during online classes, we manipulated distractions by having some participants watch just the lecture; the rest watched the lecture with either distracting memes on the side or with TikTok videos playing next to it.

    Surprisingly, the TikTok videos enhanced learning for students who received review slides. They performed about 8% better on the end-of-day tests than those who were not shown any memes or videos, and similar to the students who answered intermittent quiz questions. Our data further showed that this unexpected finding occurred because the TikTok videos encouraged participants to keep watching the lecture.

    For educators interested in using these tactics, it is important to know that the intermittent quizzing intervention only works if students must answer the questions. This is different from asking questions in a class and waiting for a volunteer to answer. As many teachers know, most students never answer questions in class. If students’ minds are wandering, the requirement of answering questions at regular intervals brings students’ attention back to the lecture.

    This intervention is also different from just giving students breaks during which they engage in other activities, such as doodling, answering brain teaser questions or playing a video game.

    Why it matters

    Online education has grown dramatically since the pandemic. Between 2004 and 2016, the percentage of college students enrolling in fully online degrees rose from 5% to 10%. But by 2022, that number nearly tripled to 27%.

    Relative to in-person classes, online classes are often associated with lower student engagement and higher failure and withdrawal rates.

    Research also finds that the racial achievement gaps documented in regular classroom learning are magnified in remote settings, likely due to unequal access to technology.

    Our study therefore offers a scalable, cost-effective way for schools to increase the effectiveness of online education for all students.

    What’s next?

    We are now exploring how to further refine this intervention through experimental work among both university and community college students.

    As opposed to observational studies, in which researchers track student behaviors and are subject to confounding and extraneous influences, our randomized-controlled study allows us to ascertain the effectiveness of the in-class intervention.

    Our ongoing research examines the optimal timing and frequency of in-lecture quizzes. We want to ensure that very frequent quizzes will not hinder student engagement or learning.

    The results of this study may help provide guidance to educators for optimal implementation of in-lecture quizzes.

    The Research Brief is a short take on interesting academic work.

    This article is republished from The Conversation under a Creative Commons license. Read the original article.

    Source link

  • Across All Ages & Demographics, Test Results Show Americans Are Getting Dumber – The 74

    Across All Ages & Demographics, Test Results Show Americans Are Getting Dumber – The 74


    Get stories like this delivered straight to your inbox. Sign up for The 74 Newsletter

    There’s no way to sugarcoat it: Americans have been getting dumber.

    Across a wide range of national and international tests, grade levels and subject areas, American achievement scores peaked about a decade ago and have been falling ever since. 

    Will the new NAEP scores coming out this week show a halt to those trends? We shall see. But even if those scores indicate a slight rebound off the COVID-era lows, policymakers should seek to understand what caused the previous decade’s decline. 

    There’s a lot of blame to go around, from cellphones and social media to federal accountability policies. But before getting into theories and potential solutions, let’s start with the data.

    Until about a decade ago, student achievement scores were rising. Researchers at Education Next found those gains were broadly shared across racial and economic lines, and achievement gaps were closing. But then something happened, and scores started to fall. Worse, they fell faster for lower-performing students, and achievement gaps started to grow.

    This pattern shows up on test after test. Last year, we looked at eighth grade math scores and found growing achievement gaps in 49 of 50 states, the District of Columbia and 17 out of 20 large cities with sufficient data.

    But it’s not just math, and it’s not just NAEP. The American Enterprise Institute’s Nat Malkus has documented the same trend in reading, history and civics. Tests like NWEA’s MAP Growth and Curriculum Associates’ i-Ready are showing it too. And, as Malkus found in a piece released late last year, this is a uniquely American problem. The U.S. now leads the world in achievement gap growth.

    What’s going on? How can students here get back on track? Malkus addresses these questions in a new report out last week and makes the point that any honest reckoning with the causes and consequences of these trends must account for the timing, scope and magnitude of the changes.

    Theory #1: It’s accountability

    As I argued last year, my top explanation has been the erosion of federal accountability policies. In 2011 and 2012, the Obama administration began issuing waivers to release states from the most onerous requirements of the No Child Left Behind Act. Congress made those policies permanent in the 2015 Every Student Succeeds Act. That timing fits, and it makes sense that easing up on accountability, especially for low-performing students, led to achievement declines among those same kids.

    However,  there’s one problem with this explanation: American adults appear to be suffering from similar achievement declines. In results that came out late last year, the average scores of Americans ages 16 to 65 fell in both literacy and numeracy on the globally administered Program for the International Assessment of Adult Competencies. 

    And even among American adults, achievement gaps are growing. The exam’s results are broken down into six performance levels. On the numeracy portion, for example, the share of Americans scoring at the two highest levels rose two points, from 10% to 12%, while the percentage of those at the bottom two levels rose from 29% to 34%. In literacy, the percentage of Americans scoring at the top two levels fell from 14% to 13%, while the lowest two levels rose from 19% to 28%. 

    These results caused Peggy Carr, the commissioner of the National Center for Education Statistics, to comment, “There’s a dwindling middle in the United States in terms of skills.” Carr could have made the same comment about K-12 education —  except that these results can’t be explained by school-related causes.

    Theory #2: It’s the phones

    The rise of smartphones and social media, and the decline in reading for pleasure, could be contributing to these achievement declines. Psychologist Jean Twenge pinpointed 2012 as the first year when more than half of Americans owned a smartphone, which is about when achievement scores started to decline. This theory also does a better job of explaining why Americans of all ages are scoring lower on achievement tests.

    But there are some holes in this explanation. For one, why are some of the biggest declines seen in the youngest kids? Are that many 9-year-olds on Facebook or Instagram? Second, why are the lowest performers suffering the largest declines in achievement? Attention deficits induced by phones and screens should affect all students in similar ways, and yet the pattern shows the lowest performers are suffering disproportionately large drops.

    But most fundamentally, why is this mostly a U.S. trend? Smartphones and social media are global phenomena, and yet scores in Australia, England, Italy, Japan and Sweden have all risen over the last decade. A couple of other countries have seen some small declines (like Finland and Denmark), but no one has else seen declines like we’ve had here in the States.

    Other theories: Immigration, school spending or the Common Core

    Other theories floating around have at least some kernels of truth. Immigration trends could explain some portion of the declines, although it’s not clear why those would be affecting scores only now. The Fordham Institute’s Mike Petrilli has partly blamed America’s “lost decade” on economic factors, but school spending has rebounded sharply in recent years without similar gains in achievement. Others, including historian Diane Ravitch and the Pioneer Institute’s Theodor Rebarber, blame the shift to the Common Core state standards, which was happening about the same time. But non-Common Core states suffered similar declines, and scores have also dropped in non-Common Core subjects.

    Note that COVID is not part of my list. It certainly exacerbated achievement declines and reset norms within schools, but achievement scores were already falling well before it hit America’s shores.

    Instead of looking for one culprit, it could be a combination of these factors. It could be that the rise in technology is diminishing Americans’ attention spans and stealing their focus from books and other long-form written content. Meanwhile, schools have been de-emphasizing basic skills, easing up on behavioral expectations and making it easier to pass courses. At the same time, policymakers in too many parts of the country have stopped holding schools accountable for the performance of all students.

    That’s a potent mix of factors that could explain these particular problems. It would be helpful to have more research to pinpoint problems and solutions, but if this diagnosis is correct, it means students, teachers, parents and policymakers all have a role to play in getting achievement scores back on track. 


    Get stories like these delivered straight to your inbox. Sign up for The 74 Newsletter

    Source link