the rise and fall of topics

61
Page 1 The Rise and Fall and Rise of TOPICS Semantic Technology Conference June 16, 2009 Barbara McGlamery Rachel Lovinger Photo by Adam Ahmed

Upload: rachel-lovinger

Post on 15-Jan-2015

1.891 views

Category:

Education


3 download

DESCRIPTION

Presentation by Rachel Lovinger and Barbara McGlamery at the 2009 Semantic Technology Conference.

TRANSCRIPT

Page 1: The Rise and Fall of TOPICS

Page 1

The Rise and Fall and Rise of TOPICS Semantic Technology ConferenceJune 16, 2009Barbara McGlameryRachel Lovinger

Photo by Adam Ahmed

Page 2: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 2

IntroductionTime Inc Interactive•Early adopter of Semantic Web technologies•Used successfully in many redesigns of Time Inc. sites

The Price of Innovation•Steep learning curve•No one to learn from

Page 3: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 3

Agenda

• How It Got Started

• Challenges

• Looking Forward

• Summary

Page 5: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 5

EW.com’s Category ToolWhat we were trying to do•Standardize keywords•Update once, publish everywhere•Expose rich data relationships

Our Solution: Category Tool•Relational database•Controlled vocabulary•Hierarchical structure of terms•Defined relationships between categories•Precision search terms

Page 6: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 6

Why it needed to be replaced•It wasn’t scalable •It couldn’t handle complex data relationships

EW.com’s Category Tool

79th Annual Academy AwardsOscars 2007 Common Name

Best Picture Best Actress

Helen Mirren

Babel

Letters from Iwo Jima

Nom

inee

s

Little Miss Sunshine

The QueenThe Departed

WinnerWinner N

omin

ees

Penelope Cruz

Judi Dench

Meryl Streep

Kate Winslet

Performance in Performance in

Performance in

Performance in

Performance in

Page 7: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 7

Category Tool 2.0: The Next GenerationRequirements•Structured, controlled metadata•Relationships between data•Frequent updates•Integrated with CMS, for content tagging•Sharable, expandable, reliable

In late 2003 we met with a large group of stakeholders, and then as a smaller working group. We decided to build a new classification system based on RDF and OWL, and we decided to call it TOPICS.

Page 8: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 8

TOPICS: The Next GenerationWhy semantic?•Based on forward-looking industry standard formats•Formats designed to express and efficiently read complex metadata•The power of inferencing

Why build instead of buy?•The tools we needed to integrate with a complex publishing process and CMS didn’t exist in 2003

Page 9: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 9

TOPICS stands for…

TIME

ONTOLOGIES for

PUBLISHING,

INFERENCE,

CLASSIFICATION and

SEMANTICS

TIME

ONTOLOGIES for

PUBLISHING

INTELLIGENT

CONTENT

(SYSTEM)

Page 10: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 10

Building TOPICSTiming•3 ½ months to define requirements and write specifications•8 months to build

Cost•Over $500K in capitalized cost (in real dollars about $1M)

Resources•3 people wrote the spec•2 people built it•Several others were involved in other ways

Page 11: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 11

•AOL Home: (12/04)•Teen People: (1/05)•Real Simple: (2/05)•In Style: (7/05)

Launching the first sites

Page 12: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 12

Challenges

Photo by hounddiggity

Page 13: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 13

Types of Challenges We Faced

•Perception •Performance & Scalability•Business Development•Technical Development

Page 14: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 14

Getting ApprovalIn late 2003 we had a meeting with all of the executive sponsors of our department.

•Business users explained their requirements and described current systems•Tech experts explained why current systems could not support the growing needs•All stakeholders agreed that a next generation system was needed

Photo by hobvias sudoneighm

Page 15: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 15

No Executive SponsorWe had their blessing, but we had no executive sponsor.

• We checked in once when the specs were done• Again about 5 months into the build (functional, but not pretty)

We have done the “What is TOPICS and why do we need it?”

song and dance about 30 times in 5 years.

Page 16: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 16

Lessons Learned

•Get an Executive Sponsor

•Check in often

•Let that person do your PR while you focus on the work

Page 17: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 17

Page 18: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 18

MyHomeIdeas GoalsRelaunch the AOL Home channel as a deep, easy-to-use and fulfilling source of home inspiration•Design Assistant – thousands of photos from a variety of Time Inc. magazines•Browse by room, room detail or solution•Refine results by style or publication

Page 19: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 19

MyHomeIdeas: Only Photos Tagged

Page 20: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 20

MyHomeIdeas: Meaningless Related Links

Page 21: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 21

MyHomeIdeas: Bad Press (from inside)

Page 22: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 22

Lessons Learned•Get involved with functionality discussions early to identify all the places where integration should happen

•Use realistic sample data in design comps

•A little knowledge can be dangerous - make sure that everyone on the team is fully filled in

Page 23: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 23

Page 24: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 24

Real Simple GoalsCreate a useful directory of Home Solutions•Browse by a range of categories•Meaningful related solutions•Website directory

Page 25: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 25

Real Simple: Hard-coded Navigational Taxonomy

Page 26: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 26

Real Simple: Difficulty Sharing

Page 27: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 27

Lessons Learned• Don’t hardcode the taxonomy into a display template!

•Establish guidelines for shared metadata – what should be shared and what shouldn’t

Page 28: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 28

Page 29: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 29

InStyle GoalsShowcase the latest fashion products• Hierarchical browse of products• Meaningful related products• Discovery of new and trusted brands

Page 30: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 30

InStyle: No Technical Specifications

Page 31: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 31

InStyle: Slow to Retrieve and Sort Data

CMS TOPICS

Article

TemplateSearch Index

Article #123Brad Pitt

Page 32: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 32

InStyle: Editors Reluctant to Tag

“Why should I tag if it doesn’t show up in search?”

Page 33: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 33

Lessons Learned• Develop detailed technical specification

• Determine standards for template developers

• Reduce time spent processing complex queries

• Editorial training geared toward website functionality

Page 34: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 34

Page 35: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 35

Redesign EW.com•Enhance All About Pages•Boost interactivity with audience•Use additional technology to build audience (SEO, RSS, etc)•Create comprehensive media products database

EW.com Goals

Page 36: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 36

EW.com: Simultaneous Large Projects

Page 37: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 37

EW.com: Development Setting

DEV…..QA…. PROD

Too many chefsNew hardware

Instituted New Environments

Page 38: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 38

EW.com: Move to TOPICS version 2.0

Page 39: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 39

EW.com: Complex Data Migration

Page 40: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 40

{MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasIndustryRating MediaProductsTax:PG13} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:WillFerrell} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:DannyDeVito} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:QuincyJones} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:TomCruise} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:KatieCouric} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:KellyOsbourne} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:StevenSpielberg} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:BritneySpears} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:FredSavage} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:GwynethPaltrow} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:JackOsbourne} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:SharonOsbourne} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:KevinSpacey} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:OzzyOsbourne} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGenre MediaProductsTax:Comedy} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasFranchise MediaProductsTax:AustinPowers} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasDistributor CompaniesTax:NewLineCinema} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasDirector personsTax:JayRoach} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasAuthor personsTax:MichaelMcCullers} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasAuthor personsTax:MikeMyers} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:gotVideoGradeCPlusBy personsTax:MissySchwartz} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:gotVideoGradeBy personsTax:MissySchwartz} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:gotMovieGradeBy personsTax:LisaSchwarzbaum} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:gotMovieGradeBBy personsTax:LisaSchwarzbaum} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:gotGradeBy personsTax:MissySchwartz} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:gotGradeBy personsTax:LisaSchwarzbaum} {MediaProductsTax:MovieAustinPowersinGoldmember dcOnt:subject {}} {MediaProductsTax:MovieAustinPowersinGoldmember dcOnt:relation {}} {MediaProductsTax:MovieAustinPowersinGoldmember dcOnt:language en} {MediaProductsTax:MovieAustinPowersinGoldmember dcOnt:date {08/15/2006 02:05:21PM}} {MediaProductsTax:MovieAustinPowersinGoldmember dcOnt:creator http://user/test#sdsouza-migration} {MediaProductsTax:MovieAustinPowersinGoldmember dcOnt:contributor {}}

EW.com: Too Much Data

Page 41: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 41

EW.com: Scaled Down Dynamic Functionality

Page 42: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 42

Lessons Learned• Solve scalability issues before migration

• Allow enough time and resources for development

• Don’t give up functionality that you consider essential to the site

Page 43: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 43

Page 44: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 44

Redesign People.com• Enhanced and automated Celebrity pages• News items classified by subject• Integration of archive with main site

People Goals

Page 45: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 45

People: Simultaneous Large Projects

Page 46: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 46

People: Shortsightedness

Page 47: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 47

Lessons Learned•More thorough business development

•Solve scalability issues before migration

•Allow enough time for development

Page 48: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 48

People mistakenly believed that TOPICS was a prototype

Other Challenges: Prototype

Photo by Steve Jurvetson

Page 49: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 49

Other Challenges: Search vs. Tagging

“Can’t we just get a better search engine and do all of this with unstructured content?”

Photo by Danard Vincente

Page 50: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 50

QA and Design had no easy way to look at the data in TOPICS

Other Challenges: No Visualization

Page 51: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 51

Editors found it difficult to use

Other Challenges: User Interface

Page 52: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 52

Other Challenges: Vision

All of the people who originated the project left the company. No one who was left had a big picture view of where the project was going. No one was strategizing about how it could be used across the organization.

Photo by Prabhu

Page 53: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 53

Lessons Learned•When the project launches, announce it

•Promote the benefits clearly and often

•Provide visualizations and easy-to-use interface

•Make sure someone is in charge of the vision

Page 55: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 55

•Buy-in from Southern Living and SPC sites•Increased web traffic

Change of heart

Page 56: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 56

Improved Perception•User tagging•Tagging Tool redesign•Proven functionality

Page 57: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 57

•Additional hardware improved performance•Caching of TOPICS data in CMS allows quicker response times•Integration with new CMS

Enhanced Performance

Article

Template

Article #123Brad Pitt

TOPICS

TOPICS COPY

CMS

Search Index

Page 58: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 58

•Establish executive sponsorship •Determine new uses•Enhance taxonomy management tools•Move to more semantically enabled database•Upgrade query language to SPARQL•More thorough integration with CMS and other systems

Where is it going next?

Page 59: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 59

Summary

Photo by ken ratcliff

Page 60: The Rise and Fall of TOPICS

© 2009 Barbara McGlamery & Rachel LovingerPage 60

Universal Challenges

•Executive sponsorship•Vision, business strategy•Scalability & RDF data storage issues•Efficiency of APIs•Guidelines for shared metadata•Robust, easy-to-use interface•Training and communications for business users•Standards for design, functional specs, implementation•Data migration