quality estimation: the holy grail in the mt scene (gábor bessenyei, ceo of morphologic...

11
Powered by MorphoLogic Localisation Quality estimation: the Holy Grail in the MT scene TAUS Roundtable, March 15 th , Vienna Gábor Bessenyei CEO

Upload: taus-enabling-better-translation

Post on 16-Jan-2017

259 views

Category:

Technology


1 download

TRANSCRIPT

Powered by MorphoLogic Localisation

Quality estimation: the Holy Grail in the MT scene

TAUS Roundtable, March 15th, Vienna

Gábor BessenyeiCEO

2

Introduction

Copyright © 2016 MorphoLogic Localisation Ltd. 2Copyright © 2016 MorphoLogic Localisation Ltd.

Quality

Measuring QualityProviding QualityQuality

estimation model

Analytics Threshold value

Word based pricing

PO & quote creation

before project start

Composite Engines

3

Quality - Where use MT?

Copyright © 2016 MorphoLogic Localisation Ltd.

coveredby TMqualified

MT

useless MT

Threshold

4

A Globalese engine

Copyright © 2016 MorphoLogic Localisation Ltd.

5

Quality ThresholdBy setting the threshold value higher, project managers can ensure that only the best translations will actually be reinserted to the machine-translated file.

Copyright © 2016 MorphoLogic Localisation Ltd.

Low quality MT excluded by Threshold

Low quality MT excluded by Threshold

6

Quality EstimationThe Quality Estimation feature allows project managers to get an overview about the quality of the engine that is applied to the translation project. It can be used for cost planning, resource planning and project scheduling.

Copyright © 2016 MorphoLogic Localisation Ltd.

7

Quality EvaluationWhen comparing the files translated by Globalese to the post-edited ones, different comparison metrics are available, each detailed by segment.

Copyright © 2016 MorphoLogic Localisation Ltd.

no changes neededcompletely hopeless

8

Quality Evaluation versus Quality Estimation

Copyright © 2016 MorphoLogic Localisation Ltd.

  QA Evaluation DifferenceRep 468 466   372 548 -176  348 654 -306  1105 676 429  338 288 50  151 142 9  0 2 -2Trash 289 284 5Total 3071 3060 9

  720 1202 -482  1443 964 479Total 2163 2166 -3

Composite Engine

9Copyright © 2016 MorphoLogic Localisation Ltd.

Quality estimation model

Phrase-based

Hierarchical phrase-

based

10

Word-based pricing

Copyright © 2016 MorphoLogic Localisation Ltd.

same fileonly counts

once

75%and above

repetitionsonly count

once

globaleseMT

[email protected]

www.globalese-mt.com

More info, personal demo and free evaluation system:

Thank you for your attention

Booth no. 27

Next event: