augmented participation to live events through social network content enrichment with ecstasys

Dipartimento di

Elettronica, Informazione e

Bioingegneria

Augmented Participation to Live Events

through Social Network Content

Enrichment with ECSTASYS

Marco Brambilla, Daniele Dell’Aglio, Emanuele Della Valle,

Andrea Mauri and Riccardo Volonterio

Dipartimento di Elettronica, Informazione e Bioingegneria

Problem

Conferences (but also exhibitions, sports or

fashion happenings) are complex events – They are composed by parallel and dislocated sub-

events (talks, workshops, tutorials)

27 May 2014 - AI Mashup Challenge @ESWC2014

Danie

le D

ell'

Agli

o -

ECSTA

SY

S

2


Problem




Participants, organisers and interested people

are interested in having an holistic view on the

event


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

2


Problem




Participants, organisers and interested people

are interested in having an holistic view on the

event

It is hard to have a clear vision of what is

happening – Attendees have a partial view of the event (they know

what happens in the place where they are)


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

2


The solution

Attendees share opinions, recommendations,

materials, and reports of the happening through

social media

Let’s capture them!


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

3


The solution

Attendees share opinions, recommendations,

materials, and reports of the happening through

social media

Let’s capture them!

Event-Centered STream Analysis SYStem

(ECSTASYS) – It caputes the the social media contents related to a

live event

– It enriches them in a way that makes it valuable for (local or remote) attendees.


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

3


ECSTASYS as a whole


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

4

Retrieve the tweets


ECSTASYS as a whole


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

4

Retrieve the tweets

Filter the non-relevant ones


ECSTASYS as a whole


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

4

Retrieve the tweets


Identify the conference-related entities


ECSTASYS as a whole


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

4

Retrieve the tweets



Associate each tweet to the event it discusses


ECSTASYS as a whole


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

4

Retrieve the tweets



Associate each tweet to the event it discusses

Visualise them by event


ECSTASYS KB

Deriving the knowledge base


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

5


ECSTASYS KB



Danie

le D

ell'

Agli

o -

ECSTA

SY

S

5

DBLP

SW dog food

Conference

schedule


ECSTASYS KB



Danie

le D

ell'

Agli

o -

ECSTA

SY

S

5

DBLP

SW dog food

Conference

schedule

• Authors

• Paper at the

conference

• Recent papers

• Schedule


ECSTASYS KB



Danie

le D

ell'

Agli

o -

ECSTA

SY

S

5

DBLP

SW dog food

Conference

schedule

SeWeb Conference

Ontology

SKOS

ECSTASYS

vocabulary

• Authors

• Paper at the

conference

• Recent papers

• Schedule


ECSTASYS KB



Danie

le D

ell'

Agli

o -

ECSTA

SY

S

5

DBLP

SW dog food

Conference

schedule

SeWeb Conference

Ontology

SKOS

ECSTASYS

vocabulary

OWLIM

Lite-RL

• Authors

• Paper at the

conference

• Recent papers

• Schedule


Retrieve the data


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

6

Twitter Streaming API

“Ingenious way to learn

languages: duolingo

#www2013”


Retrieve the data


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

6


By keyword

#vonahn

#www2013


languages: duolingo

#www2013”


Retrieve the data


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

6


By keyword

#vonahn

#www2013

By geo


languages: duolingo

#www2013”


By user

Retrieve the data


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

6


By keyword

#vonahn

#www2013

By geo


languages: duolingo

#www2013”


Filter the non-relevant data


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

7

Relevance Filter

Previous conf.

tweets

CRF Model




Danie

le D

ell'

Agli

o -

ECSTA

SY

S

7

Relevance Filter

Previous conf.

tweets

CRF Model

CRF filter over a

model derived by

previous

conference tweets




Danie

le D

ell'

Agli

o -

ECSTA

SY

S

7

Relevance Filter

Previous conf.

tweets

CRF Model

CRF filter over a

model derived by

previous

conference tweets

Tweets with

non-English text




Danie

le D

ell'

Agli

o -

ECSTA

SY

S

7

Relevance Filter

Previous conf.

tweets

CRF Model

CRF filter over a

model derived by

previous

conference tweets

Tweets with

non-English text

Tweets not related

to the conference


Identify the relevant entities


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

8

Entity annotator

AIDA DB

AIDA




Danie

le D

ell'

Agli

o -

ECSTA

SY

S

8

Entity annotator

AIDA DB

AIDA AIDA identifies only

the conference-

related entities




Danie

le D

ell'

Agli

o -

ECSTA

SY

S

8

Entity annotator

ECSTASYS KB AIDA DB

AIDA A custom dataset

for AIDA is derived

by the EKB

AIDA identifies only

the conference-

related entities




Danie

le D

ell'

Agli

o -

ECSTA

SY

S

8

Entity annotator

ECSTASYS KB AIDA DB


for AIDA is derived

by the EKB


the conference-

related entities


languages: duolingo

#www2013”




Danie

le D

ell'

Agli

o -

ECSTA

SY

S

8

Entity annotator

ECSTASYS KB AIDA DB


for AIDA is derived

by the EKB


the conference-

related entities


Identify the associated event


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

9

Domain content linker

ECSTASYS KB


Identify the associated event


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

9

Domain content linker

Keynote

ECSTASYS KB


Validation and disambiguation


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

10

Validator and disambiguator




Danie

le D

ell'

Agli

o -

ECSTA

SY

S

10


Expert crowd




Danie

le D

ell'

Agli

o -

ECSTA

SY

S

10


Expert crowd

Resolve the

linkage

when more

options are

available




Danie

le D

ell'

Agli

o -

ECSTA

SY

S

10


Expert crowd




Danie

le D

ell'

Agli

o -

ECSTA

SY

S

10


Expert crowd

Validate links




Danie

le D

ell'

Agli

o -

ECSTA

SY

S

10


Expert crowd


Visualisation


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

11


Visualisation


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

11

Wall view


Visualisation


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

11

Wall view

Wall view


Conclusions

Is it a mashup? Yes! It puts together data from

Twitter (current and past tweets)

DBLP

Semantic Web Dog Food

Conference schedule

Is it intelligent? Yes! It uses:

AI to filter the non-relevant tweets

NLP for identifying the entities in the text

Semantic Web technologies to integrate data and query it

Crowdsource to validate the results and solve the ambiguous results


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

12


Thank you! Questions?

Augmented Participation to Live Events

through Social Network Content Enrichment

with ECSTASYS

http://demo.search-computing.com/aimc-2014/home

Marco Brambilla, Daniele Dell’Aglio, Emanuele Della Valle,

Andrea Mauri, Riccardo Volonterio

(DEIB, Politecnico di Milano)

[email protected]


Danie

le D

ell'

Agli

o -

ECSTA

SY

S

13






mailto:[email protected]

augmented participation to live events through social network content enrichment with ecstasys

Technology

ai mashup challenge

tweets dipartimento

ecstasys marco brambilla

relevant ones dipartimento

complex events

live events

dislocated subevents

solution attendees