2024-03-29T05:50:47Zhttps://eprints.lib.hokudai.ac.jp/dspace-oai/requestoai:eprints.lib.hokudai.ac.jp:2115/449552022-11-17T02:08:08Zhdl_2115_20053hdl_2115_145Evaluating Subjective Aspects of HCI on an Example of a Non-Task Oriented Conversational SystemDybala, PawelPtaszynski, MichalRzepka, RafalAraki, KenjiHCIconversational systemsevaluation methodology007The evaluation of subjective aspects of HCI, such as human-likeness, likeability or users' emotions towards computers is still quite a neglected issue, especially in the field of non-task oriented conversational systems (chatterbots). In this paper we try to bridge this gap by proposing a new methodology of evaluation. The methods presented were tested in our research on humor-equipped chatterbots. We describe them in details, discuss their drawbacks and usability. In one of the presented methods we used an emotiveness analysis system, which itself can be considered an AI tool, as it was used to detect users' emotions towards conversational systems, and to perform their automatic evaluation. We also propose some methods that we have not used yet, which, however, seem applicable in this field, such as brain scanning techniques. Finally, we give some ideas that should be addressed in the future.World Scientific PublishingJournal Articleapplication/pdfhttp://hdl.handle.net/2115/44955https://eprints.lib.hokudai.ac.jp/dspace/bitstream/2115/44955/1/IJAIT19-6_819-856.pdf0218-2130International Journal on Artificial Intelligence Tools1968198562010-12enginfo:doi/10.1142/S0218213010000431Electronic version of an article published as International Journal on Artificial Intelligence Tools (IJAIT) , 19(6), 2010, 819-856, 10.1142/S0218213010000431 © copyright World Scientific Publishing Company, http://www.worldscinet.com/ijait/ijait.shtmlauthor