Chatbots from the users’ perspective
A systematic literature review
DOI:
https://doi.org/10.14267/VEZTUD.2024.07-08.07Keywords:
chatbot, human-chatbot interaction, HCIAbstract
The application of chatbots in business organizations is becoming ever more widespread. When developing an interface, besides the aspects of efficiency, human values, and users’ social and emotional needs also should be respected. From this perspective, understanding the impact of human-chatbot interaction (HCI) on individuals’ behavior is paramount. This article aims to contribute to the exploration of users’ perspectives on chatbots through a systematic literature review of 31 papers examined with content analysis. The results show that besides functionality, entertainment is also important for users during HCI. The growing magnitude of humanlike attributes that could support this need does however not provide users with the feeling of satisfaction but can evoke feelings of anxiety instead.
Downloads
References
Ashfaq, M., Yun, J., Yu, S., & Loureiro, S.M.C. (2020). I, Chatbot: Modeling the determinants of users’ satisfaction and continuance intention of AI-powered service agents. Telematics and Informatics, 54, 101473. https://doi.org/10.1016/j.tele.2020.101473
Beattie, A., Edwards, A.P., & Edwards, C. (2020). A bot and a smile: Interpersonal impressions of chatbots and humans using emoji in computer-mediated communication. Communication Studies, 71(3), 409-427. https://doi.org/10.1080/10510974.2020.1725082
Behera, R.K., Bala, P.K., & Ray, A. (2021). Cognitive Chatbot for personalized contextual customer service: Behind the scene and beyond the hype. Information Systems Frontiers, 26, 899–919. https://doi.org/10.1007/s10796-021-10168-y
Bilquise, G., Ibrahim, S., & Shaalan, K. (2022). Emotionally Intelligent Chatbots: A Systematic Literature Review. Human Behavior and Emerging Technologies, 2022(1), 1-23. https://doi.org/10.1155/2022/9601630
Brachten, F., Kissmer, T., & Stieglitz, S. (2021). The acceptance of chatbots in an enterprise context–A survey study. International Journal of Information Management, 60, 102375. https://doi.org/10.1016/j.ijinfomgt.2021.102375
Calvaresi, D., Ibrahim, A., Calbimonte, J.P., Schegg, R., Fragniere, E., & Schumacher, M. (2021). The evolution of chatbots in tourism: A systematic literature review. In Information and Communication Technologies in Tourism 2021: Proceedings of the ENTER 2021 eTourism Conference, January 19–22, 2021 (pp. 3-16). Springer International Publishing. https://link.springer.com/chapter/10.1007/978-3-030-65785-7_1
Chaves, A.P., & Gerosa, M.A. (2019). How should my chatbot interact? A survey on human-chatbot interacComputer Interaction, 37(2), 729-758. https://doi.org/10.1080/10447318.2020.1841438.
Cheng, X., Bao, Y., Zarifis, A., Gong, W., & Mou, J. (2021). Exploring consumers’ response to text-based chatbots in e-commerce: the moderating role of task complexity and chatbot disclosure. Internet Research, 32(2), 496-517. https://doi.org/10.1108/INTR-08-2020-0460.
Cheng, Y., & Jiang, H. (2020). How do AI-driven chatbots impact user experience? Examining gratifications, perceived privacy risk, satisfaction, loyalty, and continued use. Journal of Broadcasting & Electronic Media, 64(4), 592-614. https://doi.org/10.1080/08838151.2020.1834296.
Chung, M., Ko, E., Joung, H., & Kim, S.J. (2020). Chatbot e-service and customer satisfaction regarding luxury brands. Journal of Business Research, 117, 587-595. https://doi.org/10.1016/j.jbusres.2018.10.004.
Ciechanowski, L., Przegalinska, A., Magnuski, M., & Gloor, P. (2019). In the shades of the uncanny valley: An experimental study of human–chatbot interaction. Future Generation Computer Systems, 92, 539-548. https://doi.org/10.1016/j.future.2018.01.055.
Cooper, H.M. (1988). Organizing knowledge syntheses: A taxonomy of literature reviews. Knowledge in Society, 1(1), 104-126. https://doi.org/10.1007/BF03177550
Croes, E.A., & Antheunis, M.L. (2021). Can we be friends with Mitsuku? A longitudinal study on the process of relationship formation between humans and a social chatbot. Journal of Social and Personal Relationships, 38(1), 279-300. https://doi.org/10.1177/0265407520959463.
Dautenhahn, K. (2013). Human-robot interaction. In The Encyclopedia of Human-Computer Interaction (2nd Ed.), Chapter 38. 2013. https://www.interaction-design.org/literature/book/the-encyclopedia-of-human-computer-interaction-2nd-ed/human-robot-interaction
Davis, F.D. (1987). User acceptance of information systems: the technology acceptance model (TAM) Working Paper 529. University of Michigan. https://deepblue.lib.umich.edu/bitstream/handle/2027.42/35547/b1409190.0001.001.pdf?seque
Denecke, K., Hochreutener, S.L, Pöpel, A., & May, R. (2018). Self-anamnesis with a conversational user interface: concept and usability study. Methods of Information in Medicine, 57(05/06), 243-252. https://doi.org/10.1055/s-0038-1675822
Denecke, K., Vaaheesan, S., & Arulnathan, A. (2020). A mental health chatbot for regulating emotions (SERMO) concept and usability test. IEEE Transactions on Emerging Topics Computing. https://doi.org/10.1109/TETC.2020.2974478
De Cicco, R., Silva, S.C., & Alparone, F.R. (2020). Millennials’ attitude toward chatbots: an experimental study in a social relationship perspective. International Journal of Retail & Distribution Management, 48(11), 1213-1233. https://doi.org/10.1108/IJRDM-12-2019-0406.
Eren, B.A. (2021). Determinants of customer satisfaction in chatbot use: evidence from a banking application in Turkey. International Journal of Bank Marketing, 39(2), 294-311. https://doi.org/10.1108/IJBM-02-2020-0056.
Fink, A. (2019). Conducting research literature reviews: From the internet to paper. Sage Publications.
Gentner, T., Neitzel, T., Schulze, J., & Buettner, R. (2020). A systematic literature review of medical chatbot research from a behavior change perspective. In 2020 IEEE 44th Annual Computers, Software, and Applications Conference (COMPSAC) (pp. 735-740). IEEE. https://doi.org/10.1109/COMPSAC48688.2020.0-172
Gladden, M.E. (2016). Posthuman management: Creating effective organizations in an age of social robotics, ubiquitous AI, human augmentation, and virtual worlds. Defragmenter Media.
Go, E., & Sundar, S.S. (2019). Humanizing chatbots: The effects of visual, identity and conversational cues on humanness perceptions. Computers in Human Behavior, 97, 304-316. https://doi.org/10.1016/j.chb.2019.01.020
Han, M.C. (2021). The impact of anthropomorphism on consumers’ purchase decision in chatbot commerce. Journal of Internet Commerce, 20(1), 46-65. https://doi.org/10.1080/15332861.2020.1863022
Harmat, V. (2023). The application of the sensemaking perspective for the examination of employees’ behavioural responses to the HR chatbot. Organizacija, 56(3), 233-246. https://doi.org/10.2478/orga-2023-0016
Hill, J., Ford, W.R., & Farreras, I.G. (2015). Real conversations with artificial intelligence: A comparison between human–human online conversations and human– chatbot conversations. Computers in Human Behavior, 49, 245-250. https://doi.org/10.1016/j.chb.2015.02.026.
Jang, M., Jung, Y., & Kim, S. (2021). Investigating managers’ understanding of chatbots in the Korean financial industry. Computers in Human Behavior, 120, 106747. https://doi.org/10.1016/j.chb.2021.106747.
Kasilingam, D.L. (2020). Understanding the attitude and intention to use smartphone chatbots for shopping. Technology in Society, 62, 101280. https://doi.org/10.1016/j.techsoc.2020.101280
Kassing, J.W., & Sanderson, J. (2015). Playing in the new media game or riding the virtual bench: Confirming and disconfirming membership in the community of sport. Journal of Sport and Social Issues, 39(1), 3-18. https://doi.org/10.1177/0193723512458931
Kohlmann, D. (2018). Forradalmak az attitűdkutatásban: A kognitív-kísérleti és társas konstruktivista kutatási programok összevetése. Magyar Pszichológiai Szemle, 73(2), 315-344. https://doi.org/10.1556/0016.2018.73.2.9
Lee, S., Lee, N., & Sah, Y.J. (2020). Perceiving a mind in a chatbot: Effect of mind perception and social cues on co-presence, closeness, and intention to use. International Journal of Human–Computer Interaction, 36(10), 930-940. https://doi.org/10.1080/10447318.2019.1699748.
Li, L., Lee, K.Y., Emokpae, E., & Yang, S.B. (2021). What makes you continuously use chatbot services? Evidence from chinese online travel agencies. Electronic Markets, 31, 575–599. https://doi.org/10.1007/s12525-020-00454-z
Luo, B., Lau, R.Y., Li, C., & Si, Y. W. (2022). A critical review of state‐of‐the‐art chatbot designs and applications. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 12(1), e1434. https://doi.org/10.1002/widm.1434
Marciniak, R., Móricz, P., & Baksa, M. (2020). Lépések a kognitív automatizáció felé: Digitális átalakulás egy magyarországi üzleti szolgáltatóközpontban. Vezetéstudomány/ Budapest Management Review, 51(6), 42-55. https://doi.org/10.14267/VEZTUD.2020.06.05
Mayer, R.C., Davis, J.H., & Schoorman, F.D. (1995). An integrative model of organizational trust. Academy of Management Review, 20(3), 709-734. https://doi.org/10.2307/258792
Mehra, B. (2021). Chatbot personality preferences in Global South urban English speakers. Social Sciences & Humanities Open, 3(1), 100131. https://doi.org/10.1016/j.ssaho.2021.100131.
Mori, M. (1970). Bukimi no tani [the uncanny valley]. Energy, 7(4), 33-35.
Nordheim, C.B., Følstad, A., & Bjørkli, C.A. (2019). An initial model of trust in chatbots for customer service – findings from a questionnaire study. Interacting with Computers, 31(3), 317-335. https://doi.org/10.1093/iwc/iwz022.
Okoli, C., & Schabram, K. (2010). A guide to conducting a systematic literature review of information systems research. Working Papers on Information Systems, 10(26). http://sprouts.aisnet.org/10-26
Park, N., Jang, K., Cho, S., & Choi, J. (2021). Use of offensive language in human-artificial intelligence chatbot interaction: The effects of ethical ideology, social competence, and perceived humanlikeness. Computers in Human Behavior, 121, 106795. https://doi.org/10.1016/j.chb.2021.106795.
Pérez, J.Q., Daradoumis, T., & Puig, J.M.M. (2020). Rediscovering the use of chatbots in education: A systematic literature review. Computer Applications in Engineering Education, 28(6), 1549-1565. https://doi.org/10.1002/cae.22326
Randolph, J. (2009). A guide to writing the thesis literature review. Practical Assessment, Research, and Evaluation, 14(1), 13.
Rapp, A., Curti, L., & Boldi, A. (2021). The human side of human-chatbot interaction: A systematic literature review of ten years of research on text-based chatbots. International Journal of Human-Computer Studies, 151, 102630. https://doi.org/10.1016/j.ijhcs.2021.102630.
Rese, A., Ganster, L., & Baier, D. (2020). Chatbots in retailers’ customer communication: How to measure their acceptance? Journal of Retailing and Consumer Services, 56, 102176. https://doi.org/10.1016/j.jretconser.2020.102176
Richad, R., Vivensius, V., Sfenrianto, S., & Kaburuan, E.R. (2019). Analysis of factors influencing millennial’s technology acceptance of chatbot in the banking industry in Indonesia. International Journal of Civil Engineering and Technology, 10(4), 1270-1281. https://doi.org/10.34218/IJM.10.3.2019.011
Rossmann, A., Zimmermann, A., & Hertweck, D. (2020). The impact of chatbots on customer service performance. In Advances in the human side of service engineering: Proceedings of the AHFE 2020 Virtual Conference on The Human Side of Service Engineering, July 16-20, 2020, USA (pp. 237-243). Springer International Publishing.
Schuetzler, R.M., Grimes, G.M., & Scott Giboney, J. (2020). The impact of chatbot conversational skill on engagement and perceived humanness. Journal of Management Information Systems, 37(3), 875-900. https://doi.org/10.1080/07421222.2020.1790204.
Shumanov, M., & Johnson, L. (2021). Making conversations with chatbots more personalized. Computers in Human Behavior, 117, 106627. https://doi.org/10.1016/j.chb.2020.106627.
Schuitema, G., Steg, L., & Forward, S. (2010). Explaining differences in acceptability before and acceptance after the implementation of a congestion charge in Stockholm. Transportation Research Part A: Policy and Practice, 44(2), 99-109. https://doi.org/10.1016/j.tra.2009.11.005
Skjuve, M., Følstad, A., Fostervold, K.I., & Brandtzaeg, P.B. (2021). My chatbot companion-a study of human- chatbot relationships. International Journal of Human-Computer Studies, 149, 102601. https://doi.org/10.1016/j.ijhcs.2021.102601.
Skjuve, M., Haugstveit, I.M., Følstad, A., & Brandtzaeg, P. (2019). Help! Is my chatbot falling into the uncanny valley? An empirical study of user experience in human–chatbot interaction. Human Technology, 15(1), 30-54. https://doi.org/10.17011/ht/urn.201902201607
Suhaili, S.M., Salim, N., & Jambli, M.N. (2021). Service chatbots: A systematic review. Expert Systems with Applications, 184, 115461. https://doi.org/10.1016/j.eswa.2021.115461
Szűcs, Z., & Jinil, Y. (2018). A chatbotok jelensége, taxonómiája, felhasználási területei, erősségei és kihívásai. Információs Társadalom: Társadalomtudományi Folyóirat, 18(2), 41-55. https://inftars.infonia.hu/pub/inftars.XVIII.2018.2.3.pdf
Toader, D.C., Boca, G., Toader, R., Măcelaru, M., Toader, C., Ighian, D., & Rădulescu, A.T. (2019). The effect of social presence and chatbot errors on trust. Sustainability, 12(1), 256. https://doi.org/10.3390/su12010256.
Tsai, W.H.S., Liu, Y., & Chuan, C.H. (2021). How chatbots’ social presence communication enhances consumer engagement: The mediating role of parasocial interaction and dialogue. Journal of Research in Interactive Marketing, 15(3), 460-482. https://doi.org/10.1108/JRIM-12-2019-0200.
Willcocks, L.P., Lacity, M., & Craig, A. (2015). The IT function and robotic process automation. LSE. http://www.lse.ac.uk/management/research/outsourcingunit/
S., Schneider, J., Di Mitri, D., Weidlich, J., Rittberger, M., & Drachsler, H. (2021). Are we there yet? - a systematic literature review on chatbots in education. Frontiers in Artificial Intelligence, 4, 654924. https://doi.org/10.3389/frai.2021.654924
Wube, H.D., Esubalew, S.Z., Weldesellasie, F.F., & Debelee, T.G. (2022). Text-based chatbot in financial sector: a systematic literature review. Data Science in Finance and Economics, 2(3), 232-259. https://doi.org/10.3934/DSFE.2022011
Zamora, J. (2017). I’m sorry, dave, I’m afraid I can’t do that: Chatbot perception and expectations. In Proceedings of the 5th International Conference on Human Agent Interaction (pp. 253-260). ACM. https://doi.org/10.1145/3125739.3125766
Zarouali, B., Van den Broeck, E., Walrave, M., & Poels, K. (2018). Predicting consumer responses to a chatbot on Facebook. Cyberpsychology, Behavior, and Social Networking, 21(8), 491-497. https://doi.org/10.1089/cyber.2017.0518.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Corvinus University of Budapest, publisher of Vezetéstudomány / Budapest Management Review
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors assign copyright to Vezetéstudomány / Budapest Management Review. Authors are responsible for permission to reproduce copyright material from other sources.
