|
Hokkaido University Collection of Scholarly and Academic Papers >
Graduate School of Information Science and Technology / Faculty of Information Science and Technology >
Peer-reviewed Journal Articles, etc >
MIss RoBERTa WiLDe: Metaphor Identification Using Masked Language Model with Wiktionary Lexical Definitions
| Title: | MIss RoBERTa WiLDe: Metaphor Identification Using Masked Language Model with Wiktionary Lexical Definitions |
| Authors: | Babieno, Mateusz Browse this author | | Takeshita, Masashi Browse this author | | Radisavljevic, Dusan Browse this author | | Rzepka, Rafal Browse this author →KAKEN DB | | Araki, Kenji Browse this author →KAKEN DB |
| Keywords: | metaphor detection | | figurative language | | lexical definitions | | Wiktionary | | language models | | RoBERTa | | Sentence-BERT |
| Issue Date: | 17-Feb-2022 |
| Publisher: | MDPI |
| Journal Title: | Applied sciences |
| Volume: | 12 |
| Issue: | 4 |
| Start Page: | 2081 |
| Publisher DOI: | 10.3390/app12042081 |
| Abstract: | Recent years have brought an unprecedented and rapid development in the field of Natural Language Processing. To a large degree this is due to the emergence of modern language models like GPT-3 (Generative Pre-trained Transformer 3), XLNet, and BERT (Bidirectional Encoder Representations from Transformers), which are pre-trained on a large amount of unlabeled data. These powerful models can be further used in the tasks that have traditionally been suffering from a lack of material that could be used for training. Metaphor identification task, which is aimed at automatic recognition of figurative language, is one of such tasks. The metaphorical use of words can be detected by comparing their contextual and basic meanings. In this work, we deliver the evidence that fully automatically collected dictionary definitions can be used as the optimal medium for retrieving the non-figurative word senses, which consequently may help improve the performance of the algorithms used in metaphor detection task. As the source of the lexical information, we use the openly available Wiktionary. Our method can be applied without changes to any other dataset designed for token-level metaphor detection given it is binary labeled. In the set of experiments, our proposed method (MIss RoBERTa WiLDe) outperforms or performs similarly well as the competing models on several datasets commonly chosen in the research on metaphor processing. |
| Rights: | © 2022 by the authors; licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/). |
| Type: | article |
| URI: | http://hdl.handle.net/2115/85076 |
| Appears in Collections: | 情報科学院・情報科学研究院 (Graduate School of Information Science and Technology / Faculty of Information Science and Technology) > 雑誌発表論文等 (Peer-reviewed Journal Articles, etc)
|
|
