Preprint / Version 1

Analyzing people`s awareness of the difference between human text and artificial intelligence generated texts(ChatGPT 4.0).

##article.authors##

  • Sultan Daniyarov National School of Physics & Math (FIZMAT)
  • Diyar Zhumatayev National School of Physics & Math (FIZMAT)

DOI:

https://doi.org/10.58445/rars.1789

Keywords:

Artificial Intelligence, human-written texts

Abstract

Recent advancements in AI technologies have improved AI's ability to generate text, making the distinctions between AI-generated and human-written texts less identifiable, which increases the potential of being deceived by AI in various areas(e.g. education, creative industries). This study investigates the awareness of Kazakhstan's population regarding the differences between human-written and AI-generated texts. A survey was conducted in which respondents were presented with both types of texts. Participants were asked to provide personal details (e.g., gender, age, specialization), identify the origin of each text, and explain their reasoning.

Our findings indicate that Kazakhstan`s population has a low AI-generated text recognition rate, and also mixed awareness about AI technologies in general. Factors such as age and the methods used were found to have a significant impact on AI recognition levels. The findings suggest that AI technologies can already be used to deceive people, and that certain actions, such as special apps or websites that would automatically identify whether the text was generated by an AI or not, has to be implemented to address this issue . Our findings on the most effecient methods people used to identify AI, or the factors that had the biggest impact on AI recognition levels can serve as a source of vital data when implemeting those actions.

References

Wang, H., Luo, X., Wang, W., & Yan, X. (2023). Bot or Human? Detecting ChatGPT

Imposters with A Single Question. ArXiv, abs/2305.06424.

Jones, C.R., & Bergen, B.K. (2024). People cannot distinguish GPT-4 from a human in a

Turing test. ArXiv, abs/2405.08007.

Jannai, D., Meron, A., Lenz, B., Levine, Y., & Shoham, Y. (2023). Human or Not? A

Gamified Approach to the Turing Test. ArXiv, abs/2305.20010.

Strachan, J.W., Albergo, D., Borghini, G., Pansardi, O., Scaliti, E., Gupta, S., Saxena,

K., Rufo, A., Panzeri, S., Manzi, G., Graziano, M.S., & Becchio, C. (2024).

Testing theory of mind in large language models and humans. Nature Human

Behaviour, 8, 1285 - 1295.

Stock-Homburg, R.M. (2023). The Tightrope Between Human and AI-Generated

Innovation: A Turing Test. SSRN Electronic Journal.

Hamada, M., Temirkhanova, D., Serikbay, D., Salybekov, S., & Omarbek, S. (2021).

Artificial Intelligence to Improve the Business Efficiency and Effectiveness for

Enterprises in Kazakhstan. SAR Journal - Science and Research.

Downloads

Posted

2024-10-18

Categories