Hokkaido University Collection of Scholarly and Academic Papers >
Graduate School of Information Science and Technology / Faculty of Information Science and Technology >
Peer-reviewed Journal Articles, etc >
Evaluating Subjective Aspects of HCI on an Example of a Non-Task Oriented Conversational System
Title: | Evaluating Subjective Aspects of HCI on an Example of a Non-Task Oriented Conversational System |
Authors: | Dybala, Pawel Browse this author | Ptaszynski, Michal Browse this author | Rzepka, Rafal Browse this author | Araki, Kenji Browse this author |
Keywords: | HCI | conversational systems | evaluation methodology |
Issue Date: | Dec-2010 |
Publisher: | World Scientific Publishing |
Journal Title: | International Journal on Artificial Intelligence Tools |
Volume: | 19 |
Issue: | 6 |
Start Page: | 819 |
End Page: | 856 |
Publisher DOI: | 10.1142/S0218213010000431 |
Abstract: | The evaluation of subjective aspects of HCI, such as human-likeness, likeability or users' emotions towards computers is still quite a neglected issue, especially in the field of non-task oriented conversational systems (chatterbots). In this paper we try to bridge this gap by proposing a new methodology of evaluation. The methods presented were tested in our research on humor-equipped chatterbots. We describe them in details, discuss their drawbacks and usability. In one of the presented methods we used an emotiveness analysis system, which itself can be considered an AI tool, as it was used to detect users' emotions towards conversational systems, and to perform their automatic evaluation. We also propose some methods that we have not used yet, which, however, seem applicable in this field, such as brain scanning techniques. Finally, we give some ideas that should be addressed in the future. |
Rights: | Electronic version of an article published as International Journal on Artificial Intelligence Tools (IJAIT) , 19(6), 2010, 819-856, 10.1142/S0218213010000431 © copyright World Scientific Publishing Company, http://www.worldscinet.com/ijait/ijait.shtml |
Relation: | http://www.worldscinet.com/ijait/ijait.shtml |
Type: | article (author version) |
URI: | http://hdl.handle.net/2115/44955 |
Appears in Collections: | 情報科学院・情報科学研究院 (Graduate School of Information Science and Technology / Faculty of Information Science and Technology) > 雑誌発表論文等 (Peer-reviewed Journal Articles, etc)
|
Submitter: Pawel Dybala
|