Last week, FIRE filed a comment in the FCC’s “In re: delete, delete, delete” docket, in which the agency said it “seeks comment on every rule, regulation, or guidance document that the FCC should eliminate.” As the agency observed, this review is necessary in light of their statutory mandate to uncover and remove regulations “no longer necessary in the public interest.” FIRE’s comments remind the FCC that the Commission itself has said, “The public interest is best served by permitting free expression of views.” Therefore, in its hunt for “unnecessary regulatory burdens,” the Commission should start with its regulations on content. Such policies include discretionary speech-based investigations and its news distortion policy, which run headlong into the First Amendment and Communications Act directives that deny the FCC the power of censorship. The FCC’s current chairman claims to base FCC decisions on “the law, the facts, and the First Amendment.” With this proceeding, it’s time to put up or shut up.
Tag: review
-
Banks to waive HECS-HELP loans in mortgage applications – Campus Review
People with student debt can now borrow more for a house as new government guidance filters through to the banks.
Please login below to view content or subscribe now.
Membership Login
-
Did union fights for better conditions unintentionally casualise the workforce? – Campus Review
A new research paper has investigated the factors that have “legitimised” the creation and acceptance of a casual academic workforce in Australia.
Please login below to view content or subscribe now.
Membership Login
-
Data breach affects 10,000 Western Sydney University students – Campus Review
Students from Western Sydney University (WSU) have had their data accessed and likely posted to the dark web in a data breach event.
Please login below to view content or subscribe now.
Membership Login
-
To Improve Peer Review, Give Reviewers More Choice (opinion)
“Greetings! You’ve been added to our journal’s editorial system because we believe you would serve as an excellent reviewer of [Unexciting Title] manuscript …”
You probably get these, too. It feels like such emails are propagating. The peer-review system may still be the best we have for academic quality assurance, but it is vulnerable to human overload, preferences and even mood. A result can be low-effort, late or unconstructive reviews, but first the editors must be lucky enough to find someone willing to do a review at all. There should be a better way. Here’s an idea of how to rethink the reviewer allocation process.
The Pressure on Peer Review
As the number of academic papers continues to grow, so do refereeing tasks. Scientists struggle to keep up with increasing demands to publish their own work while also accepting the thankless task of reviewing others’ work. In the wake, low-effort, AI-generated and even plagiarized reviewer reports find fertile ground, feeding a vicious circle that slowly undermines the process. Peer review—the bedrock of scientific quality control—is under pressure.
Editors have been experimenting with ways to rethink the peer-reviewing process. Ideas include paying reviewers, distributing review tasks among multiple reviewers (on project proposals), transparently posting reviews (already an option for some Nature journals) or tracking and giving virtual credits for reviews (as with Publon). However, in one aspect, journals have apparently not experimented a lot: how to assign submitted papers to qualified reviewers.
The standard approach for reviewer selection is to match signed-up referees with submitted papers using a keyword search, the paper’s reference list or the editors’ knowledge of the field and community. Reviewers are invited to review only one paper at a time—but often en masse to secure enough reviews—and if they decline, someone else may be invited. It’s an unproductive process.
Choice in Work Task Allocation Can Improve Performance
Inspired by our ongoing research on giving workers more choice in work task allocation in a manufacturing setting, it struck me that academic referees have limited choices when asked to review a paper for a journal. It’s basically a “yes, I’ll take it” or “no, I won’t.” They are only given the choice of accepting or rejecting one paper from a journal at a time. That seems to be the modus operandi across all disciplines I have encountered.
In our study in a factory context, productivity increased when workers could choose among several job tasks. The manufacturer we worked with had implemented a smartwatch-based work task allocation system: Workers wore smartwatches showing open work tasks that they could accept or reject. In a field experiment, we provided some workers the opportunity to select from a menu of open tasks instead of only one. Our results showed that giving choice improved work performance.
A New Approach: Reviewers’ Choice
Similar to the manufacturing setting, academic reviewers might also do better in a system that empowers them with options. One way to improve peer review may be as simple as presenting potential referees with a few submitted papers’ titles and abstracts to choose from for review.
The benefits of choice in reviewer allocation are realistic: Referees may be more likely to accept a review when asked to select one among several, and their resulting review reports should be more timely and developmental when they are genuinely curious about the topic. For example, reviewers could choose one among a limited set of titles and abstracts that fit their area of domain or methodological expertise.
Taking it further, publishers could consider pooling submissions from several journals in a cross-journal submission and peer-review platform. This could help make the review process focus on the research, not where it’s submitted—aligned with the San Francisco Declaration on Research Assessment. I note that double-blind reviews rather than single-blind may be preferable in such a platform to reduce biases based on affiliations and names.
What Can Go Wrong
In light of the increased pressure on the publishing process, rethinking the peer-review process is important in its own right. However, shifting to an alternative system based on choice introduces a few new challenges. First, there is the risk of authors exposing ideas to a broader set of reviewers, who may be more interested in getting ideas for their next project than engaging in a constructive reviewing process.
Relatedly, if the platform is cross-journal, authors may be hesitant to expose their work to many reviewers in case of rejections. Second, authors may be tempted to use clickbait titles and abstracts—although this may backfire on the authors when reviewers don’t find what they expected in the papers. Third, marginalized or new topics may find no interested reviewers. As in the classic review process, such papers can still be handled by editors in parallel. While there are obstacles that should be considered, testing a solution should be low in risk.
Call to Action
Publishers already have multi-journal submission platforms, making it easier for authors to submit papers to a range of journals or transfer manuscripts between them. Granting more choices to reviewers as well should be technically easy to implement. The simplest way would be to use the current platforms to assign reviewers a low number of papers and ask them to choose one. A downside could be extended turnaround times, so pooling papers across a subset of journals could be beneficial.
For success, the reviewers should be vetted and accept a code of conduct. The journal editors must accept that their journals will be reviewed at the same level and with the same scrutiny as other journals in the pool. Perhaps there could be tit-for-tat guidelines, like completing two constructive reviews or more for each paper an author team submits for review. Such rules could work when there is an economy of scale in journals, reviewers and papers. Editors, who will try it first?
-
Fireside chat with Paul LeBlanc – Episode 163 – Campus Review
La Trobe University vice-chancellor Theo Farrell and VC Fellow Susan Zhang quizzed Southern New Hampshire University president Paul LeBlanc about artificial intelligence (AI) at the latest HEDx conference in Melbourne.
Please login below to view content or subscribe now.
Membership Login
-
UniSQ to cut 259 jobs after all other Qld, WA universities post surpluses – Campus Review
The University of Southern Queensland (UniSQ) will shed 259 jobs to plug a multi-million dollar budget hole despite all other Queensland universities reporting a 2024 surplus.
Please login below to view content or subscribe now.
Membership Login
-
UTS is showing how to achieve student equity now, not in 2050 – Campus Review
The University of Technology Sydney (UTS) has taken bold steps to reach its own equity targets in a time when sector voices are calling on institutions to take action.
Please login below to view content or subscribe now.
Membership Login
-
Is our North Star already outdated? – Campus Review
Two prominent student-success-driven university leaders have urged immediate action to improve student success, warning against waiting for government green-lights like the Australian Universities Accord.
Please login below to view content or subscribe now.
Membership Login
-
Coalition announces harsher international student caps – Campus Review
The Coalition has said it would cap international students at 240,000 and triple the visa application fee to $5,000 for those applying to Group of Eight universities to free up room in the rental market.
Please login below to view content or subscribe now.
Membership Login