open access

https://hdl.handle.net/2115/64078

Affect-as-Information Approach to a Sentiment Analysis Based Evaluation of Conversational Agents

英語

2017-01-16

Proceedings of the 2008 International Conference on Intelligent Agents, Web Technologies & Internet Commerce (IAWTIC'08)

901-906

In this paper we propose a novel method forautomatic evaluation of conversational agents. Themethod is based on analyzing the user’s affectconveyed in utterances. From analyzing: the user’sgeneral emotional engagement in the conversation andthe emotion types conveyed by the user in theconversation, a simple psychological reasoning isderived about the user’s sentiment about the agent’sperformance. The evaluation experiment on twoJapanese-speaking conversational agents showed thesame tendencies in the results returned by the systemconstructed on the proposed method and the user’sopinion about the two agents checked in the afterwardsurvey. Thus the method can be used for evaluation ofJapanese-speaking conversational agents.

会議発表論文

Accepted Manuscript

© 2008 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.