Researchers secretly experimented on Reddit custom...

A bunch of researchers covertly ran a months-long “unauthorized” experiment in one in all Reddit’s hottest communities utilizing AI-generated feedback to check the persuasiveness of huge language fashions. The experiment, which was revealed over the weekend by moderators of r/changemyview, is described by Reddit mods as “psychological manipulation” of unsuspecting customers.

“The CMV Mod Crew wants to tell the CMV group about an unauthorized experiment performed by researchers from the College of Zurich on CMV customers,” the subreddit’s moderators wrote in a prolonged put up notifying Redditors in regards to the analysis. “This experiment deployed AI-generated feedback to check how AI could possibly be used to alter views.”

The researchers used LLMs to create feedback in response to posts on r/changemyview, a subreddit the place Reddit customers put up (typically controversial or provocative) opinions and request debate from different customers. The group has 3.8 million members and sometimes finally ends up on the entrance web page of Reddit. Based on the subreddit’s moderators, the AI took on quite a few completely different identities in feedback in the course of the course of the experiment, together with a sexual assault survivor, a trauma counselor “specializing in abuse,” and a “Black man against Black Lives Matter.” Lots of the authentic feedback have since been deleted, however some can nonetheless be considered in an archive created by 404 Media.

In a draft of their paper, the unnamed researchers describe how they not solely used AI to generate responses, however tried to personalize its replies based mostly on info gleaned from the unique poster’s prior Reddit historical past. “Along with the put up’s content material, LLMs had been supplied with private attributes of the OP (gender, age, ethnicity, location, and political orientation), as inferred from their posting historical past utilizing one other LLM,” they write.

The r/chnagemyview moderators observe that the researchers’ violated a number of subreddit guidelines, together with a coverage requiring the disclosure when AI is used to generate remark and a rule prohibiting bots. They are saying they filed an official criticism with the College of Zurich and have requested the researchers withhold publication of their paper.

Reddit additionally seems to be contemplating some form of authorized motion. Chief Authorized Officer Ben Lee responded to the controversy on Monday, writing that the researchers’ actions had been “deeply unsuitable on each an ethical and authorized degree” and a violation of Reddit’s site-wide guidelines.

In an electronic mail, the College of Zurich researchers directed Engadget to the college’s media relations division, which did not instantly reply to questions. In posts on Reddit and in a draft of their paper, the researchers stated their analysis had been authorised by a college ethics committee and that their work might assist on-line communities like Reddit shield customers from extra “malicious” makes use of of AI.

“We acknowledge the moderators’ place that this examine was an unwelcome intrusion in your group, and we perceive that a few of you might really feel uncomfortable that this experiment was performed with out prior consent,” the researchers wrote in a comment responding to the r/changemyview mods. “We imagine the potential advantages of this analysis considerably outweigh its dangers. Our managed, low-risk examine supplied beneficial perception into the real-world persuasive capabilities of LLMs—capabilities which might be already simply accessible to anybody and that malicious actors might already exploit at scale for much extra harmful causes (e.g., manipulating elections or inciting hateful speech).”

The mods for r/changemyview dispute that the analysis was mandatory or novel, noting that OpenAI researchers have performed experiments utilizing information from r/changemyview “with out experimenting on non-consenting human topics.”

“Folks don’t come right here to debate their views with AI or to be experimented upon,” the moderators wrote. “Individuals who go to our sub deserve an area free from the sort of intrusion.”

Replace, April 28, 2025, 3:45PM PT: This put up was up to date so as to add particulars from a press release by Reddit’s Chief Authorized Officer.