Research Evolution and Hotspots Analysis of Disinformation Induced by Generative Artificial Intelligence (2020–2025)

Main Article Content

Hancheng Zheng

Keywords

generative artificial intelligence, disinformation, deepfake, large language models, bibliometrics, network analysis

Abstract

The ubiquitous integration of social media in our day to day life has one inevitable consequence, namely the serious threat of artificial intelligence (AI)-produced fake news and misinformation. Generative models can nowadays generate natural looking text with high quality. They are used in many different settings, and the consequences affect everyone which from individual users up through organizations, institutions, and societies. Monitoring where that research is going is not just an academic exercise, which requires identifying real hotspots. The data set for this analysis consists of 571 papers in English published by the Web of Science Core Collection, exclusively in 2020-2025 period. Multidimensional quantitative data of the literature analysis are acquired by CiteSpace and VOSviewer. It can be seen that there is a significant increase in publication after 2023. Currently, the United States and China are dominant in world production. Oddly enough, while overall macro-level productivity is high, institutions barely collaborate with each other at the micro-level. The thematic focus has shifted. The earlier works were largely chasing computer vision tasks such as detecting deepfakes; today’s literature is heavy on controlling multimodal disinformation generated by LLMs. This trend is already seeping into risky domains, especially health care and journalism. Even with the emergence of new trends, fundamental knowledge here still resides on generative adversarial networks, residual networks, and preliminary deepfake evaluations. Finally, our study provides insight into the landscape of what is known within the discipline. Policy makers and scientists have a data-driven reference point from which to identify gaps in research and design policies that truly integrate science.

Abstract 39 | PDF Downloads 8

References

  • [1] Dwivedi, Y. k., Kshetri, N., Hughes, L., Slade, E. louise, Jeyaraj, A., Kar, A. kumar, Baabdullah, A. m., Koohang, A., Raghavan, V., Ahuja, M., Albanna, H., Albashrawi, M. ahmad, Al-Busaidi, A. s., Balakrishnan, J., Barlette, Y., Basu, S., Bose, I., Brooks, L., Buhalis, D., … Wright, R. (2023). “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71(102642). https://doi.org/10.1016/j.ijinfomgt.2023.102642
  • [2] Mirsky, Y., & Lee, W. (2021). The Creation and Detection of Deepfakes: A Survey. ACM Comput. Surv., 54(1), 7:1-7:41. https://doi.org/10.1145/3425780
  • [3] Masood, M., Nawaz, M., Malik, K. M., Javed, A., Irtaza, A., & Malik, H. (2023a). Deepfakes generation and detection: State-of-the-art, open challenges, countermeasures, and way forward. Applied Intelligence, 53(4), 3974–4026. https://doi.org/10.1007/s10489-022-03766-z
  • [4] Zou, Q.-Y., Chen, G., Wu, X.-K., Huang, P., & Chen, M. (2025). AIE-FND: Enhancing UAV-Based Fake News Detection Technique via AI-Generated Insights From Media Experts. Ieee Transactions on Consumer Electronics, 71(4), 10965–10976. https://doi.org/10.1109/TCE.2025.3603976
  • [5] Zhou, F., Yan, X., Wang, Y., & Xiong, Y. (2025). Collaborative Governance and Decision Support Strategies for Misinformation Generated by Generative Artificial Intelligence. Journal of Organizational and End User Computing, 37(1), 1–24. https://doi.org/10.4018/JOEUC.397671
  • [6] Zou, Q.-Y., Chen, G., Wu, X.-K., Huang, P., & Chen, M. (2025). AIE-FND: Enhancing UAV-Based Fake News Detection Technique via AI-Generated Insights From Media Experts. Ieee Transactions on Consumer Electronics, 71(4), 10965–10976. https://doi.org/10.1109/TCE.2025.3603976
  • [7] Masood, M., Nawaz, M., Malik, K. M., Javed, A., Irtaza, A., & Malik, H. (2023b). Deepfakes generation and detection: State-of-the-art, open challenges, countermeasures, and way forward. Applied Intelligence, 53(4), 3974–4026. https://doi.org/10.1007/s10489-022-03766-z
  • [8] Farquhar, S., Kossen, J., Kuhn, L., & Gal, Y. (2024). Detecting hallucinations in large language models using semantic entropy. Nature, 630(8017), 625–630. https://doi.org/10.1038/s41586-024-07421-0
  • [9] Bar-Or Nirman, D., Weizman, A., & Azaria, A. (2025). Fool Me, Fool Me: User Attitudes Toward LLM Falsehoods. Ieee Access, 13, 200351–200366. https://doi.org/10.1109/ACCESS.2025.3632748
  • [10] Ma, Y., Zhang, X., Ren, J., Wang, R., Wang, M., & Chen, Y. (2025). Linguistic features of AI mis/disinformation and the detection limits of LLMs. Nature Communications, 17(1). https://doi.org/10.1038/s41467-025-67145-1
  • [11] Singh, V. K., Singh, P., Karmakar, M., Leta, J., & Mayr, P. (2021). The journal coverage of Web of Science, Scopus and Dimensions: A comparative analysis. Scientometrics, 126(6), 5113–5142. https://doi.org/10.1007/s11192-021-03948-5
  • [12] Goodfellow, I. J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2014). Generative Adversarial Nets. Advances in Neural Information Processing Systems, 27. https://proceedings.neurips.cc/paper/2014/hash/f033ed80deb0234979a61f95710dbe25-Abstract.html
  • [13] He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition, 770–778. http://openaccess.thecvf.com/content_cvpr_2016/html/He_Deep_Residual_Learning_CVPR_2016_paper.html
  • [14] Masood, M., Nawaz, M., Malik, K. M., Javed, A., Irtaza, A., & Malik, H. (2023a). Deepfakes generation and detection: State-of-the-art, open challenges, countermeasures, and way forward. Applied Intelligence, 53(4), 3974–4026. https://doi.org/10.1007/s10489-022-03766-z
  • [15] Goodfellow, I. J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2014). Generative Adversarial Nets. Advances in Neural Information Processing Systems, 27. https://proceedings.neurips.cc/paper/2014/hash/f033ed80deb0234979a61f95710dbe25-Abstract.html
  • [16] Verdoliva, L. (2020). Media forensics and deepfakes: An overview. IEEE journal of selected topics in signal processing, 14(5), 910–932.
  • [17] Rössler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Nießner, M. (2018). FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Faces (arXiv:1803.09179). arXiv. https://doi.org/10.48550/arXiv.1803.09179
  • [18] Hsu, C.-C., Zhuang, Y.-X., & Lee, C.-Y. (2020). Deep fake image detection based on pairwise learning. Applied Sciences, 10(1), 370.
  • [19] Zhang, Y., Zheng, L., & Thing, V. L. (2017). Automated face swapping and its detection. 2017 IEEE 2nd international conference on signal and image processing (ICSIP), 15–19. https://ieeexplore.ieee.org/abstract/document/8124497/
  • [20] Li, Y., & Lyu, S. (2018). Exposing deepfake videos by detecting face warping artifacts. arXiv preprint arXiv:1811.00656. http://openaccess.thecvf.com/content_CVPRW_2019/papers/Media%20Forensics/Li_Exposing_DeepFake_Videos_By_Detecting_Face_Warping_Artifacts_CVPRW_2019_paper.pdf
  • [21] He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition, 770–778. http://openaccess.thecvf.com/content_cvpr_2016/html/He_Deep_Residual_Learning_CVPR_2016_paper.html
  • [22] Liu, Z., Luo, P., Wang, X., & Tang, X. (2015). Deep learning face attributes in the wild. Proceedings of the IEEE international conference on computer vision, 3730–3738. http://openaccess.thecvf.com/content_iccv_2015/html/Liu_Deep_Learning_Face_ICCV_2015_paper.html
  • [23] Ciftci, U. A., Demir, I., & Yin, L. (2020). How do the hearts of deep fakes beat? Deep fake source detection via interpreting residuals with biological signals. 2020 IEEE international joint conference on biometrics (IJCB), 1–10. https://ieeexplore.ieee.org/abstract/document/9304909/
  • [24] Masood, M., Nawaz, M., Malik, K. M., Javed, A., Irtaza, A., & Malik, H. (2023b). Deepfakes generation and detection: State-of-the-art, open challenges, countermeasures, and way forward. Applied Intelligence, 53(4), 3974–4026. https://doi.org/10.1007/s10489-022-03766-z
  • [25] Spitale, G., Biller-Andorno, N., & Germani, F. (2023). AI model GPT-3 (dis)informs us better than humans. Science Advances, 9(26), eadh1850. https://doi.org/10.1126/sciadv.adh1850
  • [26] Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Nießner, M. (2019). Faceforensics++: Learning to detect manipulated facial images. Proceedings of the IEEE/CVF international conference on computer vision, 1–11. http://openaccess.thecvf.com/content_ICCV_2019/html/Rossler_FaceForensics_Learning_to_Detect_Manipulated_Facial_Images_ICCV_2019_paper.html
  • [27] Sallam, M. (2023). ChatGPT utility in healthcare education, research, and practice: Systematic review on the promising perspectives and valid concerns. Healthcare, 11(6), 887. https://www.mdpi.com/2227-9032/11/6/887
  • [28] Crothers, E. N., Japkowicz, N., & Viktor, H. L. (2023). Machine-generated text: A comprehensive survey of threat models and detection methods. IEEE Access, 11, 70977–71002.
  • [29] Goodfellow, I. J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2014). Generative Adversarial Nets. Advances in Neural Information Processing Systems, 27. https://proceedings.neurips.cc/paper/2014/hash/f033ed80deb0234979a61f95710dbe25-Abstract.html
  • [30] Cascella, M., Montomoli, J., Bellini, V., & Bignami, E. (2023). Evaluating the Feasibility of ChatGPT in Healthcare: An Analysis of Multiple Clinical and Research Scenarios. Journal of Medical Systems, 47(1), 33. https://doi.org/10.1007/s10916-023-01925-4