Machine Translation at eBay: Are We There Yet?

Olga Pospelova 2016

• eBay serves over 7 billion translations daily

• e-commerce domain systems for 10+ language directions

• Content: item titles, item descriptions, user search

queries, user-to-user communication

From Raw Machine Translation to Human Quality

MT

output

Human

Translatio

n

Light Post-Editing Full Post-Editing

Syntax

Errors

eBay

Specific

Requirements

Minor

Gramma

r Errors

Fluency

/Style

Lexica

l

Errors

Improving MT Output: High Quality Training Corpus

Quality Management

Set quality expectations

Pilot projects

Training and onboarding

Context

Reference materials

TMs

Automatic sampling ofcontent for review

Provide continuous feedback to post-editors/translators

Vendor

Management

Improving MT Output: NER tagging

Brand

name

Product

name

Storage

capacity Color

Brand

name

Human Evaluation

Source TargetSource

segment OK?

All of

information

preserved?

Main noun

identifying

item translated

correctly?

Translation

alone easy to

read and

understand?

Brand names

correctly

translated?

new apple (iwatch)

watch sport edition

42mm - pre-order -

worldwide ship!

novo apple iwatch,

relógio , edição de

esporte 42mm-pré-

encomenda - mundial

navio!

Y Y N Y

birkenstock madrid

mujer castao claro

estrechos sandalias

zapatos eu 40

birkenstock madrid

mujer castao claro

estrechos sandalias

sapatos da ue 40

N

• Rating (1-5 scale)

• Ranking

• Error Analysis

• Decision Tree

User Evaluation