ORIGINAL PAPER
Turing test in examining the advancement of human – ChatGPT interaction: an academic experiment
 
More details
Hide details
1
Politechnika Warszawska, Polska
 
 
Online publication date: 2025-08-11
 
 
Publication date: 2025-08-11
 
 
NSZ 2025;20(2)
 
KEYWORDS
ABSTRACT
Research objectives and hypothesis/research questions:
The aim is to assess the ability of the ChatGPT 4.0 system to imitate a human having a conversation and to reflect on the conducted experiment. Two hypotheses were formulated for the purposes of the study. The first assumed that ChatGPT 4.0 can effectively imitate a human while having a conversation on a given topic. The second hypothesis concerned the influence of the participants’ answers on the assessment of ChatGPT 4.0’s ability to pass the Turing test.

Research methods:
The experiment consisted of conducting three interactive conversations and voting, in which one of the interlocutors was ChatGPT, and collecting reflections in an evaluation survey. The results of the experiment confirmed the hypothesis that the bot can effectively imitate a human. Confirmation should be treated as a statement of the maturity of generative technology.

Main results:
Based on the conducted Turing test, it can be concluded that the machine meets the standards of deceiving a human by more than 30% in accordance with the developed Turing method. While for the first goal the experiment showed a positive answer to the hypothesis, i.e. ChatGPT can effectively imitate a human during a conversation on a given topic, the method itself seems to be unsuited to contemporary needs. It is a very good inspiration for contemporary researchers. Regardless of its creator, A. Turing, it would probably be used in a different form, which does not deny the inventiveness of the author, who formulated the principle, the idea of which remains relevant after 75 years. The value of the Turing test is to predict the needs and possibilities of digital technologies in the 1940s, i.e. in the analog era.

Implications for theory and practice:
The study showed the maturity of the language model and was an opportunity to reflect on the use of generative technologies in education. A warning may be the identified problem of knowledge verification during exams, which is being discussed in the academic community, which will probably contribute to the faster absorption of generative solutions in education.
REFERENCES (23)
1.
AORINKA ANENDYI, 2024. Przyszłość tłumaczeń: jak sztuczna inteligencja zmienia grę, https://www.linguise.com/pl/bl... (dostęp: 26.05.2025).
 
2.
BIEVER, C., 2023. ChatGPT broke the Turing test – the race is on for new ways to assess AI, Nature, vol. 619, nr 7971, s. 686-689.
 
3.
BUSINESS INSIDER, CNBC, 2024. Zastąpi ich sztuczna inteligencja? Ten zawód może zniknąć już za trzy lata, https://businessinsider.com.pl... (dostęp: 26.05.2025).
 
4.
FARAZOULI, A., CERRATTO-PARGMAN, T., BOLANDER-LAKSOV, K., MCGRATH, C., 2024. Hello GPT! Goodbye home examination? An exploratory study of AI chatbots impact on university teachers’ assessment practices, Assessment and Evaluation in Higher Education, vol. 49, nr 3, s. 363-375.
 
5.
FLORIDI, L., CHIRIATTI, M., 2020. GPT-3: Its Nature, Scope, Limits, and Consequences, Minds and Machines, vol. 30, nr 4, s. 681-694.
 
6.
GAMS, M., KRAMAR, S., 2024. Evaluating ChatGPT’s Consciousness and Its Capability to Pass the Turing Test: A Comprehensive Analysis, Journal of Computer and Communications, Scientific Research Publishing, vol. 12, nr 3, s. 219-237.
 
7.
HULMAN, A., DOLLERUP, O.L., MORTENSEN, J.F., FENECH, M.E., NORMAN, K., STØVRING, H., HANSEN, T.K., 2023. ChatGPT – versus human-generated answers to frequently asked questions about diabetes: A Turing test-inspired survey among employees of a Danish diabetes center, edited by Kolahi, PLoS ONE, vol. 18, nr 8.
 
8.
KAPUŚCIŃSKI, M., 2025. ChatGPT 4.5 – Co nowego? Praktyczne przykłady i możliwości zastosowań, https://ttms.com/pl/chatgpt-4-... (dostęp: 17.05.2025).
 
9.
KOZŁOWSKI, P., 2025. Egzamin unieważniony. Studenci korzystali ze sztucznej inteligencji, https://edukacja.dziennik.pl/a... (dostęp: 17.05.2025).
 
10.
MEI, Q., XIE, Y., YUAN, W., JACKSON, M.O., 2024. A Turing test of whether AI chatbots are behaviorally similar to humans, Proceedings of the National Academy of Sciences of the United States of America, vol. 121, nr 9.
 
11.
NCBR, 2020. Sztuczna inteligencja – czy pamiętamy o teście Turinga?, https://www.gov.pl/web/ncbr/sz... (dostęp: 13.05.2025).
 
12.
PACELT, O., 2020. Test Turinga zdany? Naukowcy nie są zgodni. Czym w ogóle jest?, https://botland.com.pl/blog/te... (dostęp: 10.05.2025).
 
13.
PINAR SAYGIN, A., CICEKLI, I., AKMAN, V., 2000. Turing Test: 50 Years Later, Minds and Machines, vol. 10, nr 4, s. 463-518.
 
14.
RESTREPO ECHAVARRÍA, R., 2025. ChatGPT-4 in the Turing Test, Minds and Machines, vol. 35, nr 1, s. 8.
 
15.
SCARFE, P., WATCHAM, K., CLARKE, A., ROESCH, E., 2024. A real-world test of artificial intelligence infiltration of a university examinations system: A ‘Turing Test’ case study, PLoS ONE, vol. 19, nr 6.
 
16.
SCOTT, C., 2024. Study finds ChatGPT’s latest bot behaves like humans, only better, https://humsci.stanford.edu/fe... (dostęp: 11.05.2025).
 
17.
STUDZIŃSKA, J., 2020. Test Turinga dla (automatycznego) przekładu poezji, Porównania, vol. 26, s. 299-313.
 
18.
TAN, K.P.-S., LIU, Y.V., LITVIN, S.W., 2025. ChatGPT and online service recovery: How potential customers react to managerial responses of negative reviews, Tourism Management, vol. 107.
 
19.
TONONI, G., 2012. Integrated information theory of consciousness: an updated account, Archives Italiennes De Biologie, vol. 150, nr 2-3, s. 56-90.
 
20.
TURING, A.M., 1950. Computing Machinery and Intelligence, Mind, vol. 59, nr 236, s. 433-460.
 
21.
WEIZENBAUM, J., 1976. Computer Power and Human Reason. From Judgment to Calculations, San Francisco: W.H. Freeman.
 
22.
WIERZBICKI, A.P., 2018. Teoria i praktyka wspomagania decyzji, Warszawa: Wydawnictwa Uniwersytetu Warszawskiego.
 
23.
WODECKI, A., 2023. Generative technologies in higher education – assessment of the current state, essential skills, and a proposal for a didactic method, E-Mentor, vol. 100, nr 3.
 
eISSN:2719-860X
ISSN:1896-9380
Journals System - logo
Scroll to top