Overview of SMP-CAIL2020-Argmine: The Interactive Argument-Pair Extraction in Judgement Document Challenge

分类： 计算机科学 >> 计算机科学的集成理论 提交时间： 2022-11-27 合作期刊: 《数据智能（英文）》

Jian, Yuan Zhongyu, Wei Yixu, Gao Wei, Chen Yun, Song Donghua, Zhao Jinglei, Ma Zhen, Hu Shaokun, Zou Donghai, Li Xuanjing, Huang

摘要： In this paper we present the results of the Interactive Argument-Pair Extraction in Judgement Document Challenge held by both the Chinese AI and Law Challenge (CAIL) and the Chinese National Social Media Processing Conference (SMP), and introduce the related data set SMP-CAIL2020-Argmine. The task challenged participants to choose the correct argument among five candidates proposed by the defense to refute or acknowledge the given argument made by the plaintiff, providing the full context recorded in the judgement documents of both parties. We received entries from 63 competing teams, 38 of which scored higher than the provided baseline model (BERT) in the first phase and entered the second phase. The best performing system in the two phases achieved accuracy of 0.856 and 0.905, respectively. In this paper, we will present the results of the competition and a summary of the systems, highlighting commonalities and innovations among participating systems. The SMP-CAIL2020-Argmine data set and baseline models have been already released.

 点击量 2417  下载量 510  评论 0