How a Russian Fake News Site Used AI to Mass-Produce Persuasive Lies

A covert Russian propaganda site used generative AI to mass-produce misleading articles, without sacrificing their persuasive power. A new study shows how easily these tools can scale up and sharpen the spread of false narratives.

Research: Generative propaganda: Evidence of AI’s impact from a state-backed disinformation campaign. Image Credit: Roman Samborskyi / ShutterstockResearch: Generative propaganda: Evidence of AI’s impact from a state-backed disinformation campaign. Image Credit: Roman Samborskyi / Shutterstock

A study of the use of AI by a Russian-backed propaganda outlet shows how AI allows propagandists to increase their production capacity without any loss in persuasive power.

In December 2023, following a BBC report identifying DCWeekly.org as part of a Russian disinformation operation, researchers at Clemson University's Media Forensics Hub published an investigation revealing that the site DCWeekly.org was a Russian propaganda outlet, part of a broader network disseminating pro-Kremlin and anti-Ukrainian narratives.

Morgan Wack and colleagues found that prior to September 20, 2023, much of the content on the site was simply lifted from other right-leaning outlets, including Russian state media. After that date, however, the stories were generally AI-scored, selected, and rewritten using OpenAI’s GPT-3 model, allowing the site to use a broader range of sources —including translated Russian state media and mainstream outlets like Fox News— but with the tone and emphasis tweaked to better suit likely aims of the propagandists.

The authors examined 22,889 articles published on the site before and after the shift, which followed a period of declining output, but before the site's true motives were exposed. By leveraging the timing of its adoption, the research team shows how AI allowed the propagandists behind the site to more than double their rate of publication, as compared to their most active pre-AI period.

The use of AI by DCWeekly also corresponded with an increase in the breadth of topics covered on the site, which ranged from Russia's purported successes in Ukraine to the tyranny of gun control legislation in the United States, as measured through topic modeling and natural language inference classification.

As a final step, the authors conducted a survey of 880 American adults recruited through the online survey platform Prolific and found that the content in the post-adoption period maintained the same level of persuasiveness and credibility as the pre-AI period.

The study suggests AI may help propagandists flood online discourse with divisive content, even if individual articles do not become more persuasive. After DCWeekly’s exposure, similar AI-assisted fake news sites emerged, suggesting a scalable disinformation template. According to the authors, immediate action should be taken to mitigate the influence of AI-assisted propaganda campaigns.

Source:
Journal reference:

Comments

The opinions expressed here are the views of the writer and do not necessarily reflect the views and opinions of AZoAi.
Post a new comment
Post

While we only use edited and approved content for Azthena answers, it may on occasions provide incorrect responses. Please confirm any data provided with the related suppliers or authors. We do not provide medical advice, if you search for medical information you must always consult a medical professional before acting on any information provided.

Your questions, but not your email details will be shared with OpenAI and retained for 30 days in accordance with their privacy principles.

Please do not ask questions that use sensitive or confidential information.

Read the full Terms & Conditions.

You might also like...
MIT and NVIDIA Create Lightning-Fast AI That Generates Ultra-Realistic Images