Law Commons^™

The Need For Annotated Corpora From Legal Documents, And For (Human) Protocols For Creating Them: The Attribution Problem, Vern R. Walker

Hofstra Law Faculty Scholarship

This paper argues that in order to make progress today in automating argumentation mining from legal documents, we have a critical need for two things. First, we need a sufficient supply of manually annotated corpora, as well as theoretical and experimental evidence that those annotated data are accurate. Second, we need protocols for effectively training people to perform the tasks and sub-tasks required to create those annotations. Such protocols are necessary not only for a team approach to annotation and for quality assurance of the finished annotations, but also for developing and testing software to assist humans in the process …