Hokkaido University Collection of Scholarly and Academic Papers >
Graduate School of Information Science and Technology / Faculty of Information Science and Technology >
Peer-reviewed Journal Articles, etc >
Data-Augmentation Method for BERT-based Legal Textual Entailment Systems in COLIEE Statute Law Task
Title: | Data-Augmentation Method for BERT-based Legal Textual Entailment Systems in COLIEE Statute Law Task |
Authors: | Aoki, Yasuhiro Browse this author | Yoshioka, Masaharu Browse this author →KAKEN DB | Suzuki, Youta Browse this author |
Issue Date: | 28-Feb-2022 |
Publisher: | Springer |
Journal Title: | The Review of Socionetwork Strategies |
Volume: | 16 |
Start Page: | 175 |
End Page: | 196 |
Publisher DOI: | 10.1007/s12626-022-00104-0 |
Abstract: | A legal textual entailment task is a task to recognize entailment between a law article and its statements. In the Competition on Legal Information Extraction/Entailment (COLIEE), this task is designed as a task to confirm the entailment of a yes/no answer from the given civil code article(s). Based on the development of deep-learning-based natural language processing tools such as bidirectional encoder representations from transformers (BERT), many participants in the task used such tools, and the best performance system of COLIEE 2020 was a BERT-based system. However, because of the limitation of the size of training data provided by the task organizer, training such tools to adapt to the variability of the questions is difficult. In this paper, we propose a data-augmentation method to make training data using civil code articles for understanding the syntactic structure of the questions and articles for entailment. Our BERT-based ensemble system, which uses this augmentation method, achieves the best performance (accuracy = 0.7037) in Task 4 of COLIEE 2021. We also introduce the results of additional experiments to discuss the characteristics of the proposed method. |
Type: | article |
URI: | http://hdl.handle.net/2115/85078 |
Appears in Collections: | 情報科学院・情報科学研究院 (Graduate School of Information Science and Technology / Faculty of Information Science and Technology) > 雑誌発表論文等 (Peer-reviewed Journal Articles, etc)
|
|