treating translation quality metrics as business intelligence by steve richardson (lds church);...
TRANSCRIPT
![Page 1: Treating translation quality metrics as business intelligence by Steve Richardson (LDS Church); moderated by Clove Lynch and Eduardo D'Antonio (VMWare)](https://reader035.vdocuments.mx/reader035/viewer/2022062904/587bea441a28ab765a8b5737/html5/thumbnails/1.jpg)
Treating Translation Quality Metrics as Business Intelligence
PanelistsSteve Richardson, LDS ChurchSamuel Läubli, AutoDeskHyunjoo Han, AutoDeskNancy Anderson, EMC
ModeratorsEduardo D’Antonio, VMwareClove Lynch, VMware
![Page 2: Treating translation quality metrics as business intelligence by Steve Richardson (LDS Church); moderated by Clove Lynch and Eduardo D'Antonio (VMWare)](https://reader035.vdocuments.mx/reader035/viewer/2022062904/587bea441a28ab765a8b5737/html5/thumbnails/2.jpg)
Key Questions
• What can we learn from sharing our data?• Specifically, what kind of business intelligence
could we get (that we don’t have today) from sharing this data?
• How is technology helping you measure it today?
• How could the TAUS DQF and Quality Dashboard contribute?
![Page 3: Treating translation quality metrics as business intelligence by Steve Richardson (LDS Church); moderated by Clove Lynch and Eduardo D'Antonio (VMWare)](https://reader035.vdocuments.mx/reader035/viewer/2022062904/587bea441a28ab765a8b5737/html5/thumbnails/3.jpg)
LDS Church
![Page 4: Treating translation quality metrics as business intelligence by Steve Richardson (LDS Church); moderated by Clove Lynch and Eduardo D'Antonio (VMWare)](https://reader035.vdocuments.mx/reader035/viewer/2022062904/587bea441a28ab765a8b5737/html5/thumbnails/4.jpg)
Translation at the Church of Jesus Christ of Latter-day Saints
• 15M+ members in 168 countries• Approximately 100M translated words produced annually • Materials in 90+ languages in dozens of domains are
translated on a regular basis• MT systems deployed for English to/from 39 languages• Materials in 100+ languages are available at LDS.ORG
![Page 5: Treating translation quality metrics as business intelligence by Steve Richardson (LDS Church); moderated by Clove Lynch and Eduardo D'Antonio (VMWare)](https://reader035.vdocuments.mx/reader035/viewer/2022062904/587bea441a28ab765a8b5737/html5/thumbnails/5.jpg)
Measuring Quality at the Church• Challenges:
– 1,000+ full-time & contracted translators around the world
– From paper to CAT tools w/high speed internet• Until now:
– Policies and human processes focused on individual translators’ work
– Tried SAE J2450; moved to simpler methods– Never been able to measure the overall effect on
quality of published materials
![Page 6: Treating translation quality metrics as business intelligence by Steve Richardson (LDS Church); moderated by Clove Lynch and Eduardo D'Antonio (VMWare)](https://reader035.vdocuments.mx/reader035/viewer/2022062904/587bea441a28ab765a8b5737/html5/thumbnails/6.jpg)
Measuring Quality at the Church:A current example
![Page 7: Treating translation quality metrics as business intelligence by Steve Richardson (LDS Church); moderated by Clove Lynch and Eduardo D'Antonio (VMWare)](https://reader035.vdocuments.mx/reader035/viewer/2022062904/587bea441a28ab765a8b5737/html5/thumbnails/7.jpg)
Measuring Quality at the Church:What we want to know
• What is the quality of our final output?• Does our focus on translators and the
processes we use equate to improved final quality, decreased cost, and timeliness?
• What is the cost/benefit ratio of the various steps in our translation/review processes?
![Page 8: Treating translation quality metrics as business intelligence by Steve Richardson (LDS Church); moderated by Clove Lynch and Eduardo D'Antonio (VMWare)](https://reader035.vdocuments.mx/reader035/viewer/2022062904/587bea441a28ab765a8b5737/html5/thumbnails/8.jpg)
Over the past two years, we have standardized on these systems and tools:
We have used DQF a number of times to measure MT quality, ranking, and PE productivity
![Page 9: Treating translation quality metrics as business intelligence by Steve Richardson (LDS Church); moderated by Clove Lynch and Eduardo D'Antonio (VMWare)](https://reader035.vdocuments.mx/reader035/viewer/2022062904/587bea441a28ab765a8b5737/html5/thumbnails/9.jpg)
DQF Quality Evaluation
![Page 10: Treating translation quality metrics as business intelligence by Steve Richardson (LDS Church); moderated by Clove Lynch and Eduardo D'Antonio (VMWare)](https://reader035.vdocuments.mx/reader035/viewer/2022062904/587bea441a28ab765a8b5737/html5/thumbnails/10.jpg)
DQF Ranking Evaluation
German Swedish Norwegian
Danish Polish
![Page 11: Treating translation quality metrics as business intelligence by Steve Richardson (LDS Church); moderated by Clove Lynch and Eduardo D'Antonio (VMWare)](https://reader035.vdocuments.mx/reader035/viewer/2022062904/587bea441a28ab765a8b5737/html5/thumbnails/11.jpg)
AABB
CC
DDEE
AA BB CC DD EE
DQF Productivity Evaluation
CC
DD
![Page 12: Treating translation quality metrics as business intelligence by Steve Richardson (LDS Church); moderated by Clove Lynch and Eduardo D'Antonio (VMWare)](https://reader035.vdocuments.mx/reader035/viewer/2022062904/587bea441a28ab765a8b5737/html5/thumbnails/12.jpg)
Set up DQF Workflow in SDL WorldServer
![Page 13: Treating translation quality metrics as business intelligence by Steve Richardson (LDS Church); moderated by Clove Lynch and Eduardo D'Antonio (VMWare)](https://reader035.vdocuments.mx/reader035/viewer/2022062904/587bea441a28ab765a8b5737/html5/thumbnails/13.jpg)
Create DQF-enabled Project in WorldServer
![Page 14: Treating translation quality metrics as business intelligence by Steve Richardson (LDS Church); moderated by Clove Lynch and Eduardo D'Antonio (VMWare)](https://reader035.vdocuments.mx/reader035/viewer/2022062904/587bea441a28ab765a8b5737/html5/thumbnails/14.jpg)
Download Project to SDL Trados Studio
![Page 15: Treating translation quality metrics as business intelligence by Steve Richardson (LDS Church); moderated by Clove Lynch and Eduardo D'Antonio (VMWare)](https://reader035.vdocuments.mx/reader035/viewer/2022062904/587bea441a28ab765a8b5737/html5/thumbnails/15.jpg)
After Translation, View DQF Report
![Page 16: Treating translation quality metrics as business intelligence by Steve Richardson (LDS Church); moderated by Clove Lynch and Eduardo D'Antonio (VMWare)](https://reader035.vdocuments.mx/reader035/viewer/2022062904/587bea441a28ab765a8b5737/html5/thumbnails/16.jpg)
Integrating DQF into our Translation Processes
• Continue to assess individual translator performance to target training needs
• Assess quality and productivity across translators, languages, and content types
• Evaluate effect of our process steps on final output quality, cost, and timeliness
• Further analyze productivity and refine pay rates for MT post-editing
• Compare our measurements to industry averages to adjust and/or improve
![Page 17: Treating translation quality metrics as business intelligence by Steve Richardson (LDS Church); moderated by Clove Lynch and Eduardo D'Antonio (VMWare)](https://reader035.vdocuments.mx/reader035/viewer/2022062904/587bea441a28ab765a8b5737/html5/thumbnails/17.jpg)
EMC
![Page 18: Treating translation quality metrics as business intelligence by Steve Richardson (LDS Church); moderated by Clove Lynch and Eduardo D'Antonio (VMWare)](https://reader035.vdocuments.mx/reader035/viewer/2022062904/587bea441a28ab765a8b5737/html5/thumbnails/18.jpg)
Aggregate Quality per Language
![Page 19: Treating translation quality metrics as business intelligence by Steve Richardson (LDS Church); moderated by Clove Lynch and Eduardo D'Antonio (VMWare)](https://reader035.vdocuments.mx/reader035/viewer/2022062904/587bea441a28ab765a8b5737/html5/thumbnails/19.jpg)
Linguistic Quality per vendor
![Page 20: Treating translation quality metrics as business intelligence by Steve Richardson (LDS Church); moderated by Clove Lynch and Eduardo D'Antonio (VMWare)](https://reader035.vdocuments.mx/reader035/viewer/2022062904/587bea441a28ab765a8b5737/html5/thumbnails/20.jpg)
Autodesk