With the increasing use of artificial intelligence (AI), the threat of fake and morphed content on social media is also rapidly increasing. Meanwhile, a dispute has intensified between Meta India and the Indian government over an alleged morphed video created using AI. The Hyderabad Cyber Crime Police have filed an FIR against Meta India head Arun Srinivas and several social media users. The case relates to the circulation of an alleged AI-generated video featuring Prime Minister Narendra Modi on social media. According to reports, a video shared by Prime Minister Narendra Modi was edited using AI tools and circulated on social media in a different context. It is alleged that this morphed video was used to spread misinformation. The video was also shared on Meta’s platforms, such as Facebook and Instagram, prompting an investigation into the matter.
Hyderabad Cyber Crime Police say a preliminary investigation is underway to determine who created these videos, who uploaded and shared them on social media, and whether provisions of the Indian Penal Code (IPC) and the Information Technology Act (IT Act) were violated. The investigation is in its preliminary stages, and legal responsibility for any individual or entity has not yet been determined.
Investigating agencies are not only focused on identifying the creators of the videos, but are also examining how social media platforms are able to identify and remove such AI-generated and morphed content in a timely manner. Consequently, Meta India’s role has also come under scrutiny. Police are attempting to understand what steps the company’s content moderation system took to prevent or remove these videos. Previously, Hyderabad Cyber Crime Police summoned Meta officials for questioning. They were asked what technical systems the company has in place to identify and remove AI-generated content such as fake videos, deepfakes, and online scams. Meta representatives briefed the investigating agencies on the company’s content moderation process and assured full cooperation in the investigation.
This entire incident has sparked a new debate about the misuse of AI technology. Experts believe that AI-based editing tools can create videos that appear completely real. If these are not identified in time, they can be used to spread misinformation, mislead people, and influence social or political climates.
Morphed videos are videos in which a person’s face, voice, or expressions are altered using digital technology or AI to appear realistic. While they are often used for entertainment, when used to spread misinformation or malign a person’s image, they pose a serious legal and social concern. The case is currently under investigation. Police say further action will be taken based on digital evidence, technical investigations, and available facts. Only after the investigation is complete will it be clear who played what role in this case and what further legal action will be taken.