Disrupting a covert Iranian influence operation
OpenAI’s claim that it disrupted an Iranian-run online influence campaign using its models prompts broader questions about how effective such AI-generated propaganda actually is and who it really persuades. Commenters highlight deeper concerns: pervasive state and private astroturfing, the ease and low cost of running large-scale disinformation with LLMs, and the risk that “safety” measures double as regulatory capture and political bias. Many also worry that providers like OpenAI must monitor user content to detect abuses, eroding privacy while doing little to stop actors who can simply switch to local or open-source models.
Perceived scale and effectiveness of the operation
- Many see the exposed campaign as small, crude, and “script-kiddie” level, questioning whether it had any measurable impact.
- Others argue impact can come from high-volume slop: headlines and superficial “news” that feed echo chambers, build fake legitimacy, and are then amplified by bots.
- Some want actual reach metrics rather than guesses; without those, they find the threat hard to assess.
Use of ChatGPT vs local / open models
- Several note Iran (and other states) could easily use domestic or open-source LLMs; ChatGPT is not needed for propaganda.
- Counterpoint: running large open models at scale still costs serious GPU money; API access is cheaper and easier, especially for “less fancy” countries or loosely organized actors.
- Others say self-hosted and third-party open-model providers can already be cheaper than OpenAI at scale.
OpenAI’s motives, monitoring, and bias
- Some view the post as PR and regulatory theater: showcasing “responsible AI” to justify keeping powerful models centralized and regulated in ways that favor large incumbents.
- Concerns are raised that OpenAI must be inspecting user prompts/outputs or their derivatives to detect such operations, reinforcing that nothing on the service is truly private.
- There is sharp debate over perceived pro-Israel bias at OpenAI: some highlight that OpenAI has also blocked Israeli-linked operations; others point to inflammatory past statements by a senior figure as evidence of deep, unaddressed bias.
Watermarking, detection, and training data
- A few criticize OpenAI for not watermarking text, comparing it to “scraping serial numbers off guns.”
- Others question how text watermarking would even work reliably at scale.
- Some ask how OpenAI avoids re-training on this kind of generated propaganda when scraping the broader web, raising concerns about model “poisoning.”
Broader disinformation and platform issues
- Commenters stress that all major powers and many private groups run influence operations; OpenAI itself is accused by some of shaping opinion via model biases.
- There is extensive discussion of Reddit, X, and other platforms being flooded with bots and LLM content, making public opinion easy to game and hard to distinguish from authentic speech.