Multi-Perspective Evaluation of the FAMESpeech-to-Speech Translation System for Catalan, English and Spanish

摘要

This paper describes the final evaluation of the FAME interlingua-based speech-to-speech translation system for Catalan, English and Spanish. It is an extension of the already existing NESPOLE! System that translates between English, French, German and Italian. However, the FAME modules have now been integrated in an Open Agent Architecture platform. We describe three types of evaluation (task-oriented, performance-based and of user satisfaction) and present their results when applied to our system. We also compare the results of the system with those obtained by a stochastic translator developed independently within the FAME project.