When most people think of artificial intelligence, they’re probably thinking of—and worrying about—ChatGPT and deepfakes. AI-generated text and images dominate our social media feeds and the other websites we visit, sometimes .
When most people think of artificial intelligence, they’re probably thinking of—and worrying about—ChatGPT and deepfakes. AI-generated text and images dominate our social media feeds and the other websites we visit, sometimes without us knowing it, and are often used to spread unreliable and misleading information.
But what if text-generating models like ChatGPT could actually spot deepfake images?
A University at Buffalo-led research team has applied large language models (LLMs), including OpenAI’s ChatGPT and Google’s Gemini, toward spotting deepfakes of human faces. Their study, presented last week at the IEEE/CVF Conference on Computer Vision & Pattern Recognition, found that LLMs’ performance lagged behind that of state-of-the-art deepfake detection algorithms, but their natural language processing may actually make them the more practical detection tool in the future.
The study is also published on the arXiv preprint server.
«What sets LLMs apart from existing detection methods is the ability to explain their findings in a way that’s comprehensible to humans, like identifying an incorrect shadow or a mismatched pair of earrings», says the study’s lead author, Siwei Lyu, Ph.D., SUNY Empire Innovation Professor in the Department of Computer Science and Engineering, within the UB School of Engineering and Applied Sciences. «LLMs were not designed or trained for deepfake detection, but their semantic knowledge makes them well suited for it, so we expect to see more efforts toward this application.»
Collaborators on the study include the University at Albany and the Chinese University of Hong Kong, Shenzhen.How language models understand images
Trained on much of the available text on the internet—amounting to some 300 billion words—ChatGPT finds statistical patterns and relationships between words in order to generate responses.
The latest versions of ChatGPT and other LLMs can also analyze images.
