Building a Facebook application to investigate how people tag pictures

Victor Hartanto Wibisono (U4644427) supervised by: Dr. Lexing Xie

COMP3750: How do people tag pictures? (Final Presentation) 2

Victor

Owner

John

Victor’s Friend

Sam

Stranger

The Problem

COMP3750: How do people tag pictures? (Final Presentation) 3

Victor

Owner

John

Victor’s Friend

Sam

Stranger

girl, Italy, Mary

girl, photo

girl, Mary, pretty

Target Dataset

Picture Friends’ Tags Number of occurrences

Mary 1

Italy 2

Strangers’ Tags Number of occurrences

Girl 1

Photo 2

COMP3750: How do people tag pictures? (Final Presentation) 4

Related Works

• Primary motivations for annotations: organisation and communication (M. Ames, 2007)

• Faceted taxonomy of picture tags (L. Xie, 2010)

• Labelling images with a computer game (L. Von Anh, 2004)

COMP3750: How do people tag pictures? (Final Presentation) 5

Project Timeline Task Planned Actual

Defining Project Requirements / Planning 3 weeks 4 weeks

Learning Technical Tools 1 week

Human Ethics Protocol 2 weeks

Facebook App Implementation 4 weeks 5 weeks

Experimentation 2 weeks

Data Analysis 2 weeks

Writing Project Report & Final Presentation 2 weeks 1 week

TOTAL 13 weeks

COMP3750: How do people tag pictures? (Final Presentation) 6

COMP3750: How do people tag pictures? (Final Presentation) 7

High Level Architecture

Tag Expert

(server-side processes) Facebook Flickr

Database

User

(client-side)

Users’ Attributes Users’ Pictures

COMP3750: How do people tag pictures? (Final Presentation) 8

Server-Side Processes & Tools

Gathering users’ attributes from

Facebook

Obtaining Facebook authorisation

Gathering users’ public photos from Flickr

Gathering users’ tags

PHP & MySQL

Flickr API Facebook SDK & OAuth Facebook Graph API

Facebook Canvas App

COMP3750: How do people tag pictures? (Final Presentation) 9

Facebook Authorisation

COMP3750: How do people tag pictures? (Final Presentation) 10

vlXgu64BQGFSQrY0ZcJBZASMvYvTHu9GQ0YM9rjPSso . eyJhbGdvcml0aG0iOiJITUFDLVNIQTI1NiIsIjAiOiJwYXlsb2FkIn0

• OAuth 2.0

{ "expires":"1339131600", "algorithm":"HMAC-SHA256", "issued_at":"1339127019", "oauth_token":"AAACZCapwPyi8BAHQFyi0fxl4roU8E3geMvZBCcMKfuDIZC7LkQT4Jbc2pCag1…", "user_id":"744338560", "user":{ "country":"au", "locale":"en_US", ... } }

Facebook Graph API

COMP3750: How do people tag pictures? (Final Presentation) 11

{ "id": "744338560", "name": "Victor Hartanto Wibisono", "first_name": "Victor", "middle_name": "Hartanto", "last_name": "Wibisono", "link": "https://www.facebook.com/victorwibisono", "username": "victorwibisono", "hometown": { "id": "107934015907468", "name": "Surabaya, Indonesia" }

• JSON Response

https://graph.facebook.com/victorwibisono?access_token=AAACEdEose0cBAJK9sCuXRBKTT0tZCfFgDJifLcNT1i0yqEq1M6bB7LZChmepSaYxs36p3bMd1f1POJZCidYlZCHkJxqEVsII2GKbbk5CcQZDZD

The Database

COMP3750: How do people tag pictures? (Final Presentation) 12

Table: user

Field

id

username

name

location_name

gender

hometown_name

flickr_nsid

flickr_username

Table: photo

Field

id (auto-incremented)

owner_facebook_id

owner_flickr_nsid

picture_flickr_farm_id

picture_flickr_server_id

picture_flickr_photo_id

picture_flickr_secret

picture_type

picture_facebook_id

picture_facebook_source

Table: friend

Field

person1_facebook_id

person2_facebook_id

Table: tag Field

id picture_id owner_id tagger_id tag_type

COMP3750: How do people tag pictures? (Final Presentation) 13

Users’ Process

Enter Flickr NSID Allow Tag Expert to

access data on Facebook

Start tagging!

AJAX

References

• Morgan Ames and Mor Naaman, “Why we tag: motivations for annotation in mobile and online media”, CHI 2007 (April 28 – May 3 2007) pp. 971 - 980

• Luis von Ahn and Laura Dabbish, “Labeling Images with a Computer Game”, CHI 2004 6:1 (24 – 29 April 2004) pp. 319 – 326

• Lexing Xie, Apostol Natsev, Matthew Hill, John R. Smith and Alex Phillips, “The accuracy and value of machine-generated image tags: design and user evaluation of an end-to-end image tagging system”, CIVR '10 pp. 58 - 65

COMP3750: How do people tag pictures? (Final Presentation) 14

THANK YOU Any questions?

COMP3750: How do people tag pictures? (Final Presentation) 15