the rise and fall of topics
DESCRIPTION
Presentation by Rachel Lovinger and Barbara McGlamery at the 2009 Semantic Technology Conference.TRANSCRIPT
Page 1
The Rise and Fall and Rise of TOPICS Semantic Technology ConferenceJune 16, 2009Barbara McGlameryRachel Lovinger
Photo by Adam Ahmed
© 2009 Barbara McGlamery & Rachel LovingerPage 2
IntroductionTime Inc Interactive•Early adopter of Semantic Web technologies•Used successfully in many redesigns of Time Inc. sites
The Price of Innovation•Steep learning curve•No one to learn from
© 2009 Barbara McGlamery & Rachel LovingerPage 3
Agenda
• How It Got Started
• Challenges
• Looking Forward
• Summary
© 2009 Barbara McGlamery & Rachel LovingerPage 4
How It Got Started
Photo by David Fulmer
© 2009 Barbara McGlamery & Rachel LovingerPage 5
EW.com’s Category ToolWhat we were trying to do•Standardize keywords•Update once, publish everywhere•Expose rich data relationships
Our Solution: Category Tool•Relational database•Controlled vocabulary•Hierarchical structure of terms•Defined relationships between categories•Precision search terms
© 2009 Barbara McGlamery & Rachel LovingerPage 6
Why it needed to be replaced•It wasn’t scalable •It couldn’t handle complex data relationships
EW.com’s Category Tool
79th Annual Academy AwardsOscars 2007 Common Name
Best Picture Best Actress
Helen Mirren
Babel
Letters from Iwo Jima
Nom
inee
s
Little Miss Sunshine
The QueenThe Departed
WinnerWinner N
omin
ees
Penelope Cruz
Judi Dench
Meryl Streep
Kate Winslet
Performance in Performance in
Performance in
Performance in
Performance in
© 2009 Barbara McGlamery & Rachel LovingerPage 7
Category Tool 2.0: The Next GenerationRequirements•Structured, controlled metadata•Relationships between data•Frequent updates•Integrated with CMS, for content tagging•Sharable, expandable, reliable
In late 2003 we met with a large group of stakeholders, and then as a smaller working group. We decided to build a new classification system based on RDF and OWL, and we decided to call it TOPICS.
© 2009 Barbara McGlamery & Rachel LovingerPage 8
TOPICS: The Next GenerationWhy semantic?•Based on forward-looking industry standard formats•Formats designed to express and efficiently read complex metadata•The power of inferencing
Why build instead of buy?•The tools we needed to integrate with a complex publishing process and CMS didn’t exist in 2003
© 2009 Barbara McGlamery & Rachel LovingerPage 9
TOPICS stands for…
TIME
ONTOLOGIES for
PUBLISHING,
INFERENCE,
CLASSIFICATION and
SEMANTICS
TIME
ONTOLOGIES for
PUBLISHING
INTELLIGENT
CONTENT
(SYSTEM)
© 2009 Barbara McGlamery & Rachel LovingerPage 10
Building TOPICSTiming•3 ½ months to define requirements and write specifications•8 months to build
Cost•Over $500K in capitalized cost (in real dollars about $1M)
Resources•3 people wrote the spec•2 people built it•Several others were involved in other ways
© 2009 Barbara McGlamery & Rachel LovingerPage 11
•AOL Home: (12/04)•Teen People: (1/05)•Real Simple: (2/05)•In Style: (7/05)
Launching the first sites
© 2009 Barbara McGlamery & Rachel LovingerPage 12
Challenges
Photo by hounddiggity
© 2009 Barbara McGlamery & Rachel LovingerPage 13
Types of Challenges We Faced
•Perception •Performance & Scalability•Business Development•Technical Development
© 2009 Barbara McGlamery & Rachel LovingerPage 14
Getting ApprovalIn late 2003 we had a meeting with all of the executive sponsors of our department.
•Business users explained their requirements and described current systems•Tech experts explained why current systems could not support the growing needs•All stakeholders agreed that a next generation system was needed
Photo by hobvias sudoneighm
© 2009 Barbara McGlamery & Rachel LovingerPage 15
No Executive SponsorWe had their blessing, but we had no executive sponsor.
• We checked in once when the specs were done• Again about 5 months into the build (functional, but not pretty)
We have done the “What is TOPICS and why do we need it?”
song and dance about 30 times in 5 years.
© 2009 Barbara McGlamery & Rachel LovingerPage 16
Lessons Learned
•Get an Executive Sponsor
•Check in often
•Let that person do your PR while you focus on the work
© 2009 Barbara McGlamery & Rachel LovingerPage 17
© 2009 Barbara McGlamery & Rachel LovingerPage 18
MyHomeIdeas GoalsRelaunch the AOL Home channel as a deep, easy-to-use and fulfilling source of home inspiration•Design Assistant – thousands of photos from a variety of Time Inc. magazines•Browse by room, room detail or solution•Refine results by style or publication
© 2009 Barbara McGlamery & Rachel LovingerPage 19
MyHomeIdeas: Only Photos Tagged
© 2009 Barbara McGlamery & Rachel LovingerPage 20
MyHomeIdeas: Meaningless Related Links
© 2009 Barbara McGlamery & Rachel LovingerPage 21
MyHomeIdeas: Bad Press (from inside)
© 2009 Barbara McGlamery & Rachel LovingerPage 22
Lessons Learned•Get involved with functionality discussions early to identify all the places where integration should happen
•Use realistic sample data in design comps
•A little knowledge can be dangerous - make sure that everyone on the team is fully filled in
© 2009 Barbara McGlamery & Rachel LovingerPage 23
© 2009 Barbara McGlamery & Rachel LovingerPage 24
Real Simple GoalsCreate a useful directory of Home Solutions•Browse by a range of categories•Meaningful related solutions•Website directory
© 2009 Barbara McGlamery & Rachel LovingerPage 25
Real Simple: Hard-coded Navigational Taxonomy
© 2009 Barbara McGlamery & Rachel LovingerPage 26
Real Simple: Difficulty Sharing
© 2009 Barbara McGlamery & Rachel LovingerPage 27
Lessons Learned• Don’t hardcode the taxonomy into a display template!
•Establish guidelines for shared metadata – what should be shared and what shouldn’t
© 2009 Barbara McGlamery & Rachel LovingerPage 28
© 2009 Barbara McGlamery & Rachel LovingerPage 29
InStyle GoalsShowcase the latest fashion products• Hierarchical browse of products• Meaningful related products• Discovery of new and trusted brands
© 2009 Barbara McGlamery & Rachel LovingerPage 30
InStyle: No Technical Specifications
© 2009 Barbara McGlamery & Rachel LovingerPage 31
InStyle: Slow to Retrieve and Sort Data
CMS TOPICS
Article
TemplateSearch Index
Article #123Brad Pitt
© 2009 Barbara McGlamery & Rachel LovingerPage 32
InStyle: Editors Reluctant to Tag
“Why should I tag if it doesn’t show up in search?”
© 2009 Barbara McGlamery & Rachel LovingerPage 33
Lessons Learned• Develop detailed technical specification
• Determine standards for template developers
• Reduce time spent processing complex queries
• Editorial training geared toward website functionality
© 2009 Barbara McGlamery & Rachel LovingerPage 34
© 2009 Barbara McGlamery & Rachel LovingerPage 35
Redesign EW.com•Enhance All About Pages•Boost interactivity with audience•Use additional technology to build audience (SEO, RSS, etc)•Create comprehensive media products database
EW.com Goals
© 2009 Barbara McGlamery & Rachel LovingerPage 36
EW.com: Simultaneous Large Projects
© 2009 Barbara McGlamery & Rachel LovingerPage 37
EW.com: Development Setting
DEV…..QA…. PROD
Too many chefsNew hardware
Instituted New Environments
© 2009 Barbara McGlamery & Rachel LovingerPage 38
EW.com: Move to TOPICS version 2.0
© 2009 Barbara McGlamery & Rachel LovingerPage 39
EW.com: Complex Data Migration
© 2009 Barbara McGlamery & Rachel LovingerPage 40
{MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasIndustryRating MediaProductsTax:PG13} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:WillFerrell} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:DannyDeVito} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:QuincyJones} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:TomCruise} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:KatieCouric} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:KellyOsbourne} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:StevenSpielberg} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:BritneySpears} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:FredSavage} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:GwynethPaltrow} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:JackOsbourne} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:SharonOsbourne} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:KevinSpacey} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGuestPerformer personsTax:OzzyOsbourne} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasGenre MediaProductsTax:Comedy} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasFranchise MediaProductsTax:AustinPowers} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasDistributor CompaniesTax:NewLineCinema} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasDirector personsTax:JayRoach} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasAuthor personsTax:MichaelMcCullers} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:hasAuthor personsTax:MikeMyers} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:gotVideoGradeCPlusBy personsTax:MissySchwartz} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:gotVideoGradeBy personsTax:MissySchwartz} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:gotMovieGradeBy personsTax:LisaSchwarzbaum} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:gotMovieGradeBBy personsTax:LisaSchwarzbaum} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:gotGradeBy personsTax:MissySchwartz} {MediaProductsTax:MovieAustinPowersinGoldmember MediaProductsOnt:gotGradeBy personsTax:LisaSchwarzbaum} {MediaProductsTax:MovieAustinPowersinGoldmember dcOnt:subject {}} {MediaProductsTax:MovieAustinPowersinGoldmember dcOnt:relation {}} {MediaProductsTax:MovieAustinPowersinGoldmember dcOnt:language en} {MediaProductsTax:MovieAustinPowersinGoldmember dcOnt:date {08/15/2006 02:05:21PM}} {MediaProductsTax:MovieAustinPowersinGoldmember dcOnt:creator http://user/test#sdsouza-migration} {MediaProductsTax:MovieAustinPowersinGoldmember dcOnt:contributor {}}
EW.com: Too Much Data
© 2009 Barbara McGlamery & Rachel LovingerPage 41
EW.com: Scaled Down Dynamic Functionality
© 2009 Barbara McGlamery & Rachel LovingerPage 42
Lessons Learned• Solve scalability issues before migration
• Allow enough time and resources for development
• Don’t give up functionality that you consider essential to the site
© 2009 Barbara McGlamery & Rachel LovingerPage 43
© 2009 Barbara McGlamery & Rachel LovingerPage 44
Redesign People.com• Enhanced and automated Celebrity pages• News items classified by subject• Integration of archive with main site
People Goals
© 2009 Barbara McGlamery & Rachel LovingerPage 45
People: Simultaneous Large Projects
© 2009 Barbara McGlamery & Rachel LovingerPage 46
People: Shortsightedness
© 2009 Barbara McGlamery & Rachel LovingerPage 47
Lessons Learned•More thorough business development
•Solve scalability issues before migration
•Allow enough time for development
© 2009 Barbara McGlamery & Rachel LovingerPage 48
People mistakenly believed that TOPICS was a prototype
Other Challenges: Prototype
Photo by Steve Jurvetson
© 2009 Barbara McGlamery & Rachel LovingerPage 49
Other Challenges: Search vs. Tagging
“Can’t we just get a better search engine and do all of this with unstructured content?”
Photo by Danard Vincente
© 2009 Barbara McGlamery & Rachel LovingerPage 50
QA and Design had no easy way to look at the data in TOPICS
Other Challenges: No Visualization
© 2009 Barbara McGlamery & Rachel LovingerPage 51
Editors found it difficult to use
Other Challenges: User Interface
© 2009 Barbara McGlamery & Rachel LovingerPage 52
Other Challenges: Vision
All of the people who originated the project left the company. No one who was left had a big picture view of where the project was going. No one was strategizing about how it could be used across the organization.
Photo by Prabhu
© 2009 Barbara McGlamery & Rachel LovingerPage 53
Lessons Learned•When the project launches, announce it
•Promote the benefits clearly and often
•Provide visualizations and easy-to-use interface
•Make sure someone is in charge of the vision
© 2009 Barbara McGlamery & Rachel LovingerPage 54
Looking Forward
Photo by Max Blinkhorn
© 2009 Barbara McGlamery & Rachel LovingerPage 55
•Buy-in from Southern Living and SPC sites•Increased web traffic
Change of heart
© 2009 Barbara McGlamery & Rachel LovingerPage 56
Improved Perception•User tagging•Tagging Tool redesign•Proven functionality
© 2009 Barbara McGlamery & Rachel LovingerPage 57
•Additional hardware improved performance•Caching of TOPICS data in CMS allows quicker response times•Integration with new CMS
Enhanced Performance
Article
Template
Article #123Brad Pitt
TOPICS
TOPICS COPY
CMS
Search Index
© 2009 Barbara McGlamery & Rachel LovingerPage 58
•Establish executive sponsorship •Determine new uses•Enhance taxonomy management tools•Move to more semantically enabled database•Upgrade query language to SPARQL•More thorough integration with CMS and other systems
Where is it going next?
© 2009 Barbara McGlamery & Rachel LovingerPage 59
Summary
Photo by ken ratcliff
© 2009 Barbara McGlamery & Rachel LovingerPage 60
Universal Challenges
•Executive sponsorship•Vision, business strategy•Scalability & RDF data storage issues•Efficiency of APIs•Guidelines for shared metadata•Robust, easy-to-use interface•Training and communications for business users•Standards for design, functional specs, implementation•Data migration