Hostname: page-component-586b7cd67f-dsjbd Total loading time: 0 Render date: 2024-11-30T19:56:35.282Z Has data issue: false hasContentIssue false

Evaluation-driven design of a robust coreference resolution system

Published online by Cambridge University Press:  12 August 2003

ANDREI POPESCU-BELIS
Affiliation:
ISSCO/TIM/ETI, University of Geneva, 40, bvd. du Pont d'Arve, CH-1211 Geneva 4, Switzerland (e-mail: [email protected])

Abstract

In this paper, we describe a system for coreference resolution and emphasize the role of evaluation for its design. The goal of the system is to group referring expressions (identified beforehand in narrative texts) into sets of coreferring expressions that correspond to discourse entities. Several knowledge sources are distinguished, such as referential compatibility between a referring expression and a discourse entity, activation factors for discourse entities, size of working memory, or meta-rules for the creation of discourse entities. For each of them, the theoretical analysis of its relevance is compared to scores obtained through evaluation. After looping through all knowledge sources, an optimal behavior is chosen, then evaluated on test data. The paper also discusses evaluation measures as well as data annotation, and compares the present approach to others in the field.

Type
Papers
Copyright
2003 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)