Recall-Oriented Evaluation Metrics for Consistent Translation of Japanese Legal Sentences

摘要

We propose new evaluation metrics for statutory sentences translated from Japanese to English. Since translation variety is unacceptable and consistency is crucial in legal translation, a new metric called CIEL has been proposed that evaluates translation consistency. That metric is based on precision with a recall strategy. However, since we believe that recall-oriented metrics are more suitable for consistent evaluation, we propose recall-oriented metrics to evaluate the consistency of legal translations and illustrate their performances by comparing them with other metrics.