The Rise of AI-Generated Misinformation

Social media has become an essential source of information, especially for the younger generation. As a study identified, 74% of Gen Z is especially likely to get news daily on social media platforms as compared to 68% for millennials. In an era when digital information is becoming pervasive and easily accessible, it has become difficult to verify and differentiate between fact and fiction. 

While using social media to spread information, content creators and influencers play a vital role. However, the vast and easy flow of digital information constantly threatens misinformation. A study by UNESCO identified, “62% of the surveyed digital  content  creators admitted to not verifying the accuracy of information before sharing it with their audiences.”

A major contributor to the spread of misinformation is the increasing use of social media to consume and spread information. Regular journalism comes with the credibility that the news is verified and comes from authentic sources; however, social media is a different dimension. It has quickly become a hub of sensationalism, controversies, and misinformation that outperform factual news reporting. 

A survey conducted with influencers indicated that “41.6% use the number of likes and views of the online content as the primary factor to determine online source   credibility.” Thus, engagement rates act as the business model for disinformation on social media. The barrage of online information only reinforces the fact that people are more interested in information that sides with their point of view, rather than rationalising what they consume. Maria Ressa, the CEO of Rappler and a 2021 Nobel Peace Prize recipient, stated, “If an accurate news report gets less engagement than a sensationalized falsehood, the falsehood wins.”

Misinformation spreads due to various factors, primarily the use of AI to disseminate false information. These days, where artificial intelligence is widely used to create content, the same is also used to create deepfakes, altered images, and audio that play a pivotal role in creating widespread confusion and chaos. The use of AI to spread misinformation became a great area of concern, especially during the 2024 elections in the US, where it was feared that AI could be used in “influencing voters' perceptions of candidates, creating and distributing false messages about where and when to cast a ballot.”

Similarly, the use of AI has led to major contributions to spreading misinformation due to the developments in generative AI. The real problem is the inability to distinguish real from fake, which makes generative AI the real danger. Deepfakes are used in modern-day robberies and data theft. According to a report, “in 2020, a deepfake voice was used to carry out a $35 million bank heist in Hong Kong”. 

Social media is not just a tool for individuals, but it is increasingly becoming a digital weapon for governments and public officials. These platforms are used to spread political agendas, create widespread narratives, and manipulate perception. In some instances, governments use state-run networks to spread state-approved content, filter out criticism, and distort narratives. 

Spread of misinformation is increasingly active during times of crisis, when users are subject to vulnerability, making it easier to orchestrate narratives. Recently, we’ve witnessed this during the multiple global conflicts in 2025, leading to large-scale sharing of deepfakes and altered videos and imagery generated from nations, marking a new era of digital modern warfare. 

Misinformation is quickly becoming a point of concern for everyone. It not only impacts an individual, but it also has far-reaching consequences for businesses and the economy overall. Reports indicate that online misinformation globally costs the economy approximately $78 billion annually.

Eight out of ten surveyed individuals believe that the effects of online misinformation significantly impact businesses. This is primarily due to misinformation affecting the consumer purchasing power, damaging brand reputation, and stakeholder interest. In a consumer survey, 90% said reliable information is a “very important” or “fairly important” factor when purchasing from a particular business. Furthermore, fake news and misinformation also contribute to losses in the stock market, with the study revealing an annual loss in stock market value, amounting to $39 billion.

In times when access to all sorts of information has become easier and a lot of information is available to everybody, it is important to take individual steps to avoid sharing misinformation and spreading disinformation. When coming across information that is cited in different sources, it is important to check credible sources and authentic fact-checkers to verify if the information is true before sharing it. Ultimately, in a digital world, every individual needs to be equipped with digital literacy and be able to distinguish between real and fabricated information.