24 Recent Articles about AI & Academic Scholarship

Who is responsible when AI helps to write science? – Nature

Academic publishers must not get stuck in 'war of AI against AI', STM chief exec warns – The Bookseller

AI policies are repeating every mistake of plagiarism policies – Times Higher Ed

Ready for the robot reviewers – Science

The AI ‘Ghosts’ Contaminating Academic Publishing – 404 Media

Can Anthropic’s invisible watermarks curb ‘AI slop’? Researchers remain sceptical – Nature

AI is pushing scientific publishing to the brink. Is it time to replace the scientific paper? – Tim Quarth

AI Helped Researchers Win NIH Grants. Will Science Suffer? – Inside Higher Ed

Philosophy Journal Publishes Largely AI-Authored Article — On Purpose

The U.S. Office for Research Integrity released guidance on generative AI

This may be the first academic profession to see its work taken over by AI – Washington Post

AI Is Ruining Scholarship – Chronicle of Higher Ed

Peer review is overwhelmed—can it survive in the AI era? - Arstechnica

How well does AI peer review work? – Paul Litvak

AI agents are checking the scientific literature — and spotting decades-old errors – Nature

From policing authors to stewarding science: Governing artificial intelligence across the scientific publishing pipeline in medical journals – Science Policy Review

AI Slop Risks Future Discovery – Issues in Science & Technology – Issues in Science & Technology

OpenAI’s latest math breakthroughs commit research misconduct, experts say – Scientific American

AI Is Ruining Scholarship – Chronicle of Higher Ed

Q&A from the slop trenches: fabricated citations, hallucinated authors, and “clear LLM slop” in conference submissions. – GeoSpatial ML

AI will reorganize science. Will research remain a human enterprise? - PNAS

Scientists using LLMs will ‘do more, less well’, modelling study predicts – Nature

Scholarly Publications in an Era of Artificial Intelligence - Sage

21 Recent Articles about AI & Academic Scholarship

AI reviewers make it easier to get research published. US study calls it paper-laundering – The Print

Doctored data sets could trick AI agents - Nature

Award-winning Korea studies scholar accused of using AI-fabricated citations – NK News

AI tools meant to vet science are surprisingly easy to fool – Science News

‘Humanizer’ tool can erase signs of AI-written text — alarming scientists – Nature

AI-assisted reviews will result in ordinary, uncontroversial research – The Times Higher Ed

AI Slop Is a Tenure Problem, Not Just a Tech Problem – Inside Higher Ed

In the AI era, the human struggle can no longer be the point of research - The Times Higher Ed

Artificial intelligence in scientific review and writing: What should we be doing? – Oxford Acamdemic

A large language model pipeline for automated citation quality scoring across engineering journal quartiles with expert validation – Nature

Research integrity in the age of AI (podcast) - The Lancet

French research thrown into turmoil by a multifaceted crisis that includes funding, publishing volume, and AI – Le Monde  

University launches investigation into its faculty member's paper allegedly containing AI watermarks in graphics – Global Times

Scientists decry conference’s use of hidden prompts to snare AI peer reviews – The Transmitter

New AI Agents Pose ‘Existential Threat’ to How Grants Are Awarded – Inside Higher Ed

Publication fraud in the era of generative artificial intelligence – British Pharmacological Society

Anyone can fake a scientific image with AI, tricking even academic journals – and undermining trust in science – The Conversation

AI promised to democratise academic publishing – the evidence says otherwise – The London School of Economics

Journal investigating paper on cognitive impact of generative AI – Retraction Watch

Did AI write this article? Perish the thought. But we tracked how artificial intelligence is changing five creative fields – The Economist

Scientists want you to read their research papers—so they’re using gen AI to turn them into TikTok videos – Fast Company

AI is eating the academic publishing industry alive

If the exposure of AI-generated slop, hallucinated references, fabricated data and voiceless prose brings about the downfall of the Big Five (academic) publishing oligopoly, I cannot mourn it. An industry that profits so spectacularly from unpaid labour, that sells publicly funded research to the public at an enormous mark-up, that has used its stranglehold on prestige to distort what universities are for, well, this industry deserves disruption. - Sioux McKenna writing in the Daily Maverick

AI Bias in Academic Publishing

A new study finds “academic publication reviewers continue to penalise authors from countries where English is less widely spoken, even after ChatGPT became widely available. Write naturally and risk being flagged as a non-native speaker; write with AI assistance and risk being flagged as an AI user. The problem was never purely linguistic but structural, and AI tools are not designed to address structural bias.” -London School of Economics

37 Recent Articles about AI & Academic Scholarship

AI tools are smuggling biases in their summaries – The London School of Economics & Political Science  

Plagiarism of ideas in the age of generative artificial intelligence - Nature  

AI research papers are getting better, and it’s a big problem for scientists. – The Verge

Fraudulent citations, blamed on AI hallucinations, are becoming more common in research papers – Stat

Researchers who use hallucinated references to face arXiv ban - Nature

 Will Make the Academic Article Obsolete – Chronicle of Higher Ed

AI agents may be skilled researchers—but not always honest ones – Science.org 

Safeguards against GenAI hallucinations in literature review – Times Higher Ed 

As researchers aim for universal AI disclosure guidelines, the devil is in the details - Science.org

Retractions ‘must be the start of AI slop clean-up’, says critic – Times Higher Ed

AI Slop Is Flooding Academic Journals. A Top Journal Measured It - Forbes

First AI tool to detect suspicious peer reviews rolled out by academic publisher - Nature  

Performance of AI Tools in Citing Retracted Literature – JMIR Publishing  

The AI scientist: now academic papers can be fully automated, what does this mean for the future of research? – The Conversation  

How AI is Quietly Distorting Academic Enquiry and what to do about it – Times Higher Ed

Meet the academics refusing to use generative AI - Nature

Modeling scientific uncertainty in language: Applied linguistic insights from human and artificial intelligence texts – Science Direct

Researchers already use AI—it’s time to agree on how to use it responsibly – Research Professional News 

Illicit Use of AI by Philosophers Refereeing for Journals – Daily Nous 

Artificial intelligence in the retraction spotlight – Frontiers  

Detecting Fraud-Associated Characteristics In The Medical AI Literature: A Multi-Signal NLP Framework Reveals Distinct Paper Mill Subtypes - Open Science Framework

Could agentic AI topple grant-funding systems? - Nature 

Study: AI Policies Fail to Reduce Undisclosed AI Use – The Scientist

Do Large Language Models know Which Published Articles have been Retracted? – ArXiv

AI Wrote A Harvard Physicist’s Most Recent Paper. No One Knows What It Means for Science – The Crimson 

No humans allowed: scientific AI agents get their own social network - Nature  

Enacting AI disclosure in scholarly publishing – Wily 

Harvard says researcher who published nearly 100 articles in 2 1/2 years has no affiliation with the university – Free Beacon  

Institutional support for ethical AI adoption in higher education amid the rising trend of manuscript retractions - Nature 

AI Can Improve Scholarly Writing — If We Use It Right – Chronicle of Higher Ed

AI Conferences Should Embrace Submission Explosion via Autonomous Review Pipelines - Preprints 

Hallucinated citations highest in social sciences preprints site - Nature 

An AI did the astrophysics. The paper got halted. – Blankline 

Major accounting firm retracts study after researchers discover AI hallucinations - Financial Times

The uncritical adoption of AI in science is alarming — we urgently need guard rails - Nature

AI-generated research papers are overwhelming peer review – The Verge

25 research papers from one university in India retracted in 5 years amid integrity and AI concerns – India Today

27 Recent Articles about AI & Academic Scholarship

Where Does Publishing’s A.I. Problem Leave Authors and Readers? – New York Times

Dozens of AI disease-prediction models were trained on dubious data – Nature   

Frontiers issues AI guidance spanning full publishing lifecycle – Research Information  

Tackle ‘AI slop’ in education research ‘or lose teacher trust’ – Times Higher Ed

Plagiarised research passed automated tests, and I detected it – but only because it copied my work – Conversation

If a Large Language Model can replicate your scientific contribution, the problem is not the LLM – Nature

Bloodhound code sniffs out copied-and-pasted numerical data – Retraction Watch

Scientists Invented a Fake Disease Caused by Blue Light—Now It's in Medical Papers  - Inc

AI Is a Better Researcher Than You That claim got a political scientist denounced. Is it true? – Chronicle of Higher Ed  

Cite unseen: when AI hallucinates scientific articles- Science.org

Hallucinated citations are polluting the scientific literature. What can be done? - Nature 

Anonymisation in research must be overhauled for AI era – Research Professional News

What is p hacking, is it bad, and can you get AI to do it for you? – Towards Data Science

Policies Permitting LLM Use for Polishing Peer Reviews Are Currently Not Enforceable – ArXiv

A citation alert led researchers to a network of fake articles. But who is benefiting? – Retraction Watch  

More AI will not beat the Red Queen - Wonkhe

STM Plants a Flag About Responsible Use of Research Content in GenAI – Scholarly Kitchen   

Prompt injection in manuscripts: exploiting loopholes or crossing ethical lines? – Springer  

Seeing Is Believing? Scientific Misconduct and the Detection of Problematic Images – International Anesthesia Research Society

How to build an AI scientist: first peer-reviewed paper spills the secrets - Nature  

Major conference catches illicit AI use — and rejects hundreds of papers - Nature

An AI-authored paper just passed peer review. The scientific community isn’t ready – Scientific American  

Wikipedia Bans AI-Generated Content – 404 Media

The European Research Council sets out firm line on use of AI in peer review – Research Professional News  

AI models fail to accurately pick out which social science studies could be replicated - OSF

Generative AI in academic writing: a comparison of human-authored and ChatGPT-generated research article titles - Nature

Restoring Trust in Science: Storytelling, AI, and Integrity in Scholarly Publishing – ISMPP (webinar recording)

AI takes the creativity out of cheating

Confronted with allegations that they had cheated in an introductory data science course and fudged their attendance, dozens of undergraduates at the University of Illinois Urbana-Champaign recently sent two professors a mea culpa via email.  But there was one problem, a glaring one: They had not written the emails. Artificial intelligence had done the writing. -More in the New York Times

Academic Leaders Disagree on Students using AI

“What constitutes legitimate use of AI and what is out of bounds? Academic leaders don’t always agree whether hypothetical scenarios described appropriate uses of AI or not: For one example—in which a student used AI to generate a detailed outline for a paper and then used the outline to write the paper—the verdict (in a recent survey) was completely split.” -Inside Higher Ed

Straight A’s won’t matter in real life

When I was in college, I obsessed over getting straight A’s, said Adam Grant. Now that I’m a professor, “I watch in dismay” when I see students joining the same “cult of perfectionism.” They think straight A’s will provide entrée to elite graduate schools and prestigious careers. The evidence, however, says otherwise. Research across industries shows that while there’s a modest correlation between grades and job performance the first year out of college, after a few years, the difference is “trivial.” Why? “Getting straight A’s requires conformity. Having an influential career demands originality.” While straight-A students are locked in their dorm rooms or library pursuing “meaningless perfection,” their peers are developing skills that aren’t captured by grades: “creativity, leadership, and teamwork skills and social, emotional, and political intelligence.” Real career success doesn’t come from “finding the right solution to a problem—it’s more about finding the right problem to solve.” In high school Steve Jobs pulled a 2.65 GPA, J.K. Rowling had a C average at Exeter, and Martin Luther King Jr. managed only one A in four years at Morehouse College. This tells us that “underachieving in school can prepare you to overachieve in life.”

Adam Grant writing in The New York Times (as quoted in The Week Magazine

15 Articles about AI’s impact on College Faculty & Administrators

15 Articles about How Students are Using AI

Plagiarism & False Data in Academic Papers

There are countless credible accusations of (academic) misconduct that go uncorrected; I myself have published articles challenging the integrity of hundreds of papers. The majority of them have not been retracted, corrected or even remarked upon. I would wager that most reasonably large universities (my own included) have faculty members who are known to have plagiarized, fabricated, falsified, claimed undue credit, hidden financial conflicts of interest or misbehaved in numerous other ways and who have seemingly gone unpunished."

New York University professor Charles Seife writing in the New York Times

12 Articles on Cheating with AI & AI Detectors

The Trouble With AI Writing Detection – Inside Higher Ed

College application season is here. So is the struggle to find out if AI wrote students’ essays – Cal Matters 

If using ChatGPT to write essays becomes widespread, those students who elect not to use it, who prefer to do the work themselves, may suffer a penalty for doing so. – Chronicle of Higher Ed

Results of a new survey flip the early narrative on ChatGPT—that students would rush to use it to cheat on assignments and that teachers would scramble to keep up—on its head. Half of students, ages 12-18, said they have never used ChatGPT. – Ed Week

OpenAI debates when to release its AI-generated image detector – Tech Crunch

Universities Rethink Using AI Writing Detectors to Vet Students’ Work – Bloomberg 

Identifying AI’s flaws motivates students and helps them build confidence, which can discourage cheating. Pointing out where it still really messes up is very powerful for empowering students to see their own strengths as human thinkers. – Chronicle of Higher Ed

Students cheat out of desperation so one professor will give multi-level assignments that force students to submit papers at various stages to keep track of their progress. – Yahoo News

The AI Detection Arms Race Is On And college students are developing the weapons, quickly building tools that identify AI-generated text—and tools to evade detection. – Wired

Simply leaving it up to students to decide whether they’re going to do the work, without further comment or intervention or negative sanction from me, is a failure of pedagogy. – Chronicle of Higher Ed

AI detectors have low efficiency, and simple modifications can allow even the most robust detectors to be easily bypassed. – Science Direct 

Suspicion, Cheating & Bans: AN Hits America's Schools (podcast) – New York Times

Should Students Choose Higher-Paying Majors?

Pushing students from science into the humanities tended to decrease their later-life wages — that’s finding is not surprising. But the converse also appeared to be true: Pushing students from the humanities into science also tended to, if anything, decrease their wages. While there are certain very high-paying majors (like engineering, economics, and computer science) that increase students’ earning potential even if they would prefer to study something else, helping students to study their most-preferred major generally seems to provide long-run financial benefits even in the humanities.

Students should know that when it comes to choosing a college degree, small differences in average-wage-by-major statistics shouldn’t be taken too seriously. Especially when the average wage differences between majors are not very big, students should put their own strengths first and not let the statistics cloud their understanding of their own interests.

Zachary Bleemer writing in the The Chronicle of Higher Ed

17 articles about AI & Academic Scholarship

Scientific authorship in the time of ChatGPT - Chemistry

AI could rescue scientific papers from the curse of jargon – Free Think

Science journals ban listing of ChatGPT as co-author on papers – The Guardian

ChatGPT listed as author on research papers: many scientists disapprove – Nature (subscription req)

Abstracts written by ChatGPT fool scientists – Nature (subscription req)

The World Association of Medical Editors has created guidelines for the use of ChatGPT and other chatbots - Medscape (sub req)  

ChatGPT: our study shows AI can produce academic papers good enough for journals – just as some ban it – The Conversation

It’s Not Just Our Students — ChatGPT Is Coming for Faculty Writing – Chronicle of Higher Ed 

As scientists explore AI-written text, journals hammer out policies – Science

AI writing tools could hand scientists the ‘gift of time’ – Nature

ChatGPT Is Everywhere Love it or hate it, academics can’t ignore the already pervasive technology– Chronicle of Higher Ed

Academic Publishers Are Missing the Point on ChatGPT – Scholarly Kitchen

AI Is Impacting Education, but the Best Is Yet to Come – Inside Higher Ed 

AI makes plagiarism harder to detect, argue academics – in paper written by chatbot – The Guardian

How to Cite ChatGPT – APA Style

Researchers claim to have developed tool capable of detecting scientific text generated by ChatGPT with 99% accuracy – University of Kansas

ChatGPT: five priorities for research – The Journal Nature

Also:

21 quotes about cheating with AI & plagiarism detection                        

13 quotes worth reading about Generative AI policies & bans                   

20 quotes worth reading about students using AI                                    

27 quotes about AI & writing assignments                                                               

27 thoughts on teaching with AI            

22 quotes about cheating with AI & plagiarism detection        

14 quotes worth reading about AI use in academic papers                       

13 Quotes worth reading about AI’s impact on College Administrators & Faculty

17 articles about AI & Academic Scholarship            

13 quotes worth reading about Generative AI policies & bans

Eaton, the academic-integrity expert, cautions against trying to ban the use of ChatGPT entirely. That, she says, “is not only futile but probably ultimately irresponsible.” Chronicle of Higher Ed

I would compare this to using steroids in baseball. If you don’t ban steroids in baseball, then the reality is every player has to use them. Even worse than that, if you ban them but don’t enforce it, what you actually do is create a situation where you weed out all of the honest players. Chronicle of Higher Ed 

study surveyed 372 students seeking admission into college for fall 2023 and found that nearly half, 39% of those students, would not consider attending a college that's banned ChatGPT or other AI tools. ZDNET

Several leading academic journals and publishers updated their submission guidelines to explicitly ban researchers from listing ChatGPT as a co-author, or using text copied from a ChatGPT response. Some professors have criticized these bans as shortsightedly resistant to an inevitable technological change. Chronicle of Higher Ed

Blocking access to ChatGPT at school won’t matter, at least for any student with access to a tablet or laptop outside of school. Ed Week

ChatGPT and AI writer has been banned in educational institutions around the world, from high schools across America(opens in new tab) and Australia to universities in France and India with some university professors having caught their students using ChatGPT to write their entire assignments. Tech Radar 

A number of universities that say they are planning to expel students who are caught using the software. Thomas Lancaster, a computer scientist and expert on contract cheating at Imperial College London, said many universities were “panicking”. The Guardian 

Los Angeles Unified, the second-­largest school district in the US, immediately blocked access to OpenAI’s website from its schools’ network. Others soon joined. By January, school districts across the English-speaking world had started banning the software, from Washington, New York, Alabama, and Virginia in the United States to Queensland and New South Wales in Australia. MIT Tech Review

The New York City Department of Education has banned ChatGPT in its schools, as has the University of Sciences Po, in Paris, citing concerns it may foster rampant plagiarism and undermine learning. Washington Post

Teachers at Oceana High School in Pacifica, California have sent out messages to students warning against using AI-writing software for assignments. Mashable

Washington University in St. Louis and University of Vermont in Burlington are among the institutions that have amended their academic integrity policies to include the usage of AI tools like ChatGPT. Stanford Daily 

Also:

21 quotes about cheating with AI & plagiarism detection                        

13 quotes worth reading about Generative AI policies & bans                   

20 quotes worth reading about students using AI                                    

27 quotes about AI & writing assignments            

22 examples of teaching with AI                                                           

27 thoughts on teaching with AI   

13 thoughts on the problems of teaching with AI                                  

Fake scientific papers are alarmingly common ­­­

When neuropsychologist Bernhard Sabel put his new fake-paper detector to work, he was “shocked” by what it found. After screening some 5000 papers, he estimates up to 34% of neuroscience papers published in 2020 were likely made up or plagiarized; in medicine, the figure was 24%.

Jeffrey Barinard writing in Science Magazine

Ditching Peer Review

If we let people say whatever they want, they will sometimes say untrue things, and that sounds scary. But we don’t actually prevent people from saying untrue things right now; we just pretend to. In fact, right now we occasionally bless untrue things with big stickers that say “INSPECTED BY A FANCY JOURNAL,” and those stickers are very hard to get off. That’s way scarier.

Adam Mastroianni writing in Experimental History

Resisting Simple Solutions

People who have always operated without skin in the game (or without their skin in the right game) seek the complicated, centralized, and avoid the simple like the pest. Practitioners on the other hand have opposite instincts, looking for the simplest heuristics.

People who are bred, selected, and compensated to find complicated solutions do not have an incentive to implement simplified ones. 

Nassim Nicholas Taleb, Skin in the Game