Close Menu
    National News Brief
    Wednesday, November 18
    • Home
    • Business
    • Lifestyle
    • Science
    • Technology
    • International
    • Arts & Entertainment
    • Sports
    National News Brief
    Home » AI-generated responses are undermining crowdsourced research studies

    AI-generated responses are undermining crowdsourced research studies

    Team_NationalNewsBriefBy Team_NationalNewsBriefAugust 19, 2025 Science No Comments3 Mins Read
    Share
    Facebook Twitter LinkedIn Pinterest Email


    Some people who take part in online research projects are using AI to save time

    Daniele D’Andreti/Unsplash

    Online questionnaires are being swamped by AI-generated responses – potentially polluting a vital data source for scientists.

    Platforms like Prolific pay participants small sums for answering questions posed by researchers. They are popular among academics as an easy way to gather participants for behavioural studies.

    Anne-Marie Nussberger and her colleagues at the Max Planck Institute for Human Development in Berlin, Germany, decided to investigate how often respondents use artificial intelligence after noticing examples in their own work. “The incidence rates that we were observing were really shocking,” she says.

    They found that 45 per cent of participants who were asked a single open-ended question on Prolific copied and pasted content into the box – an indication, they believe, that people were putting the question to an AI chatbot to save time.

    Further investigation of the contents of the responses suggested more obvious tells of AI use, such as “overly verbose” or “distinctly non-human” language. “From the data that we collected at the beginning of this year, it seems that a substantial proportion of studies is contaminated,” she says.

    In a subsequent study using Prolific, the researchers added traps designed to snare those using chatbots. Two reCAPTCHAs – small, pattern-based tests designed to distinguish humans from bots – caught out 0.2 per cent of participants. A more advanced reCAPTCHA, which used information about users’ past activity as well as current behaviour, weeded out another 2.7 per cent of participants. A question in text that was invisible to humans but readable to bots asking them to include the word “hazelnut” in their response, captured another 1.6 per cent, while preventing any copying and pasting identified another 4.7 per cent of people.

    “What we need to do is not distrust online research completely, but to respond and react,” says Nussberger. That is the responsibility of researchers, who should treat answers with more suspicion and take countermeasures to stop AI-enabled behaviour, she says. “But really importantly, I also think that a lot of responsibility is on the platforms. They need to respond and take this problem very seriously.”

    Prolific didn’t respond to New Scientist’s request for comment.

    “The integrity of online behavioural research was already being challenged by participants of survey sites misrepresenting themselves or using bots to gain cash or vouchers, let alone the validity of remote self-reported responses to understand complex human psychology and behaviour,” says Matt Hodgkinson, a freelance consultant in research ethics. “Researchers either need to collectively work out ways to remotely verify human involvement or return to the old-fashioned approach of face-to-face contact.”

    Topics:



    Source link

    Team_NationalNewsBrief
    • Website

    Keep Reading

    Why the bipartisan BAAJA permitting bill could quietly revolutionize nuclear power

    A 52,000-year-old runaway star was a long-standing cosmic cold case. Now scientists think they’ve cracked it

    Readers respond to the July/August 2026 issue

    U.S. officially loses measles elimination status in a body blow to public health

    Infinitesimals are essential to calculus. But are they even real?

    Betelgeuse and its ‘Betel-buddy’ could light up Earth’s skies

    Add A Comment

    Comments are closed.

    Editors Picks

    Coco Gauff fires her coach days before U.S. Open in bizarre move

    August 21, 2025

    Republican House Makes Trump Tax Cuts Permanent

    April 11, 2025

    Taylor Swift and Travis Kelce donate US$26 million to charities ahead of wedding

    July 3, 2026

    Kristin Cavallari Shares Details Of Custody Agreement With Ex

    October 2, 2024

    How a surprising twist on rewilding could help settle our carbon debt

    March 25, 2025
    Categories
    • Arts & Entertainment
    • Business
    • International
    • Latest News
    • Lifestyle
    • Opinions
    • Politics
    • Science
    • Sports
    • Technology
    • Top Stories
    • Trending News
    • World Economy
    About us

    Welcome to National News Brief, your one-stop destination for staying informed on the latest developments from around the globe. Our mission is to provide readers with up-to-the-minute coverage across a wide range of topics, ensuring you never miss out on the stories that matter most.

    At National News Brief, we cover World News, delivering accurate and insightful reports on global events and issues shaping the future. Our Tech News section keeps you informed about cutting-edge technologies, trends in AI, and innovations transforming industries. Stay ahead of the curve with updates on the World Economy, including financial markets, economic policies, and international trade.

    Editors Picks

    Hacks, AI or overdue updates – why have there been so many outages?

    November 18, 2026

    Cyber Warfare: The Entire Digital World Is A Target

    November 18, 2026

    Cyclones and Bulldogs Shine in NFL Week 10 Action

    November 18, 2026

    Katie Price Undergoes More Surgery Despite Family Fears

    November 18, 2026
    Categories
    • Arts & Entertainment
    • Business
    • International
    • Latest News
    • Lifestyle
    • Opinions
    • Politics
    • Science
    • Sports
    • Technology
    • Top Stories
    • Trending News
    • World Economy
    • Privacy Policy
    • Disclaimer
    • Terms and Conditions
    • About us
    • Contact us
    Copyright © 2024 Nationalnewsbrief.com All Rights Reserved.

    Type above and press Enter to search. Press Esc to cancel.