Analyzing people`s awareness of the difference between human text and artificial intelligence generated texts(ChatGPT 4.0).
DOI:
https://doi.org/10.58445/rars.1789Keywords:
Artificial Intelligence, human-written textsAbstract
Recent advancements in AI technologies have improved AI's ability to generate text, making the distinctions between AI-generated and human-written texts less identifiable, which increases the potential of being deceived by AI in various areas(e.g. education, creative industries). This study investigates the awareness of Kazakhstan's population regarding the differences between human-written and AI-generated texts. A survey was conducted in which respondents were presented with both types of texts. Participants were asked to provide personal details (e.g., gender, age, specialization), identify the origin of each text, and explain their reasoning.
Our findings indicate that Kazakhstan`s population has a low AI-generated text recognition rate, and also mixed awareness about AI technologies in general. Factors such as age and the methods used were found to have a significant impact on AI recognition levels. The findings suggest that AI technologies can already be used to deceive people, and that certain actions, such as special apps or websites that would automatically identify whether the text was generated by an AI or not, has to be implemented to address this issue . Our findings on the most effecient methods people used to identify AI, or the factors that had the biggest impact on AI recognition levels can serve as a source of vital data when implemeting those actions.
References
Wang, H., Luo, X., Wang, W., & Yan, X. (2023). Bot or Human? Detecting ChatGPT
Imposters with A Single Question. ArXiv, abs/2305.06424.
Jones, C.R., & Bergen, B.K. (2024). People cannot distinguish GPT-4 from a human in a
Turing test. ArXiv, abs/2405.08007.
Jannai, D., Meron, A., Lenz, B., Levine, Y., & Shoham, Y. (2023). Human or Not? A
Gamified Approach to the Turing Test. ArXiv, abs/2305.20010.
Strachan, J.W., Albergo, D., Borghini, G., Pansardi, O., Scaliti, E., Gupta, S., Saxena,
K., Rufo, A., Panzeri, S., Manzi, G., Graziano, M.S., & Becchio, C. (2024).
Testing theory of mind in large language models and humans. Nature Human
Behaviour, 8, 1285 - 1295.
Stock-Homburg, R.M. (2023). The Tightrope Between Human and AI-Generated
Innovation: A Turing Test. SSRN Electronic Journal.
Hamada, M., Temirkhanova, D., Serikbay, D., Salybekov, S., & Omarbek, S. (2021).
Artificial Intelligence to Improve the Business Efficiency and Effectiveness for
Enterprises in Kazakhstan. SAR Journal - Science and Research.
Downloads
Posted
Categories
License
Copyright (c) 2024 Sultan Daniyarov, Diyar Zhumatayev
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.