MT for L10n: How we build and evaluate MT systems at eBay

摘要

PILOT GOAL Which is the best engine? 1. For the final user: NMT For the post-editor/vendor: NMT RESEARCH GOALS 1.1 Is BLEU equally reliable for SMT and NMT? NO 1.2 Is there a difference between perceived quality and PE effort? YES 1.3 Segment length - HE quality; Does length affect adequacy/fluency YES Does NMT and SMT quality vary per segment length YES.