Hokkaido University Collection of Scholarly and Academic Papers >
Graduate School of Information Science and Technology / Faculty of Information Science and Technology >
Peer-reviewed Journal Articles, etc >
Affect-as-Information Approach to a Sentiment Analysis Based Evaluation of Conversational Agents
Title: | Affect-as-Information Approach to a Sentiment Analysis Based Evaluation of Conversational Agents |
Authors: | Ptaszynski, Michal Browse this author | Dybala, Pawel Browse this author | Higuchi, Shinsuke Browse this author | Rzepka, Rafal Browse this author →KAKEN DB | Araki, Kenji Browse this author →KAKEN DB |
Issue Date: | 16-Jan-2017 |
Journal Title: | Proceedings of the 2008 International Conference on Intelligent Agents, Web Technologies & Internet Commerce (IAWTIC'08) |
Start Page: | 901 |
End Page: | 906 |
Publisher DOI: | 10.1109/CIMCA.2008.122 |
Abstract: | In this paper we propose a novel method forautomatic evaluation of conversational agents. Themethod is based on analyzing the user’s affectconveyed in utterances. From analyzing: the user’sgeneral emotional engagement in the conversation andthe emotion types conveyed by the user in theconversation, a simple psychological reasoning isderived about the user’s sentiment about the agent’sperformance. The evaluation experiment on twoJapanese-speaking conversational agents showed thesame tendencies in the results returned by the systemconstructed on the proposed method and the user’sopinion about the two agents checked in the afterwardsurvey. Thus the method can be used for evaluation ofJapanese-speaking conversational agents. |
Conference Name: | 2008 International Conference on Intelligent Agents, Web Technologies & Internet Commerce (IAWTIC'08) |
Conference Place: | Vienna |
Rights: | © 2008 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. |
Type: | proceedings (author version) |
URI: | http://hdl.handle.net/2115/64078 |
Appears in Collections: | 情報科学院・情報科学研究院 (Graduate School of Information Science and Technology / Faculty of Information Science and Technology) > 雑誌発表論文等 (Peer-reviewed Journal Articles, etc)
|
Submitter: RZEPKA Rafal
|