the italian hate map: semantic content analytics for social good

The Italian Hate Map: semantic content analytics for social good

Cataldo Musto, Giovanni Semeraro, Pasquale Lops, Marco de Gemmis (Università degli Studi di Bari ‘Aldo Moro’, Italy - SWAP Research Group)

I-CiTies 2015 2015 CINI Annual Workshop on ICT for Smart Cities and Communities

Palermo (Italy) - October 29-30, 2015

2Cataldo Musto, Giovanni Semeraro, Pasquale Lops, Marco de Gemmis The Italian Hate Map: semantic content analytics for social good. iCities 2015 Workshop, Palermo (Italy) 30.10.2015

The Italian HateMap

http://users.humboldt.edu/mstephens/hate/hate_map.html

Inspired by the Hate Map built by

the Humboldt University

joint research with a psychologists team of Rome University and a

no-profit agency focused on human

rights

Cataldo Musto, Giovanni Semeraro, Pasquale Lops, Marco de Gemmis The Italian Hate Map: semantic content analytics for social good. iCities 2015 Workshop, Palermo (Italy) 30.10.2015

http://users.humboldt.edu/mstephens/hate/hate_map.html

Insight:To aggregate rough people-based data in order to analyze

complex phenomena.

The Italian HateMap

5(Not a new idea) Map of cholera in London, 1854

red = cholera cases blue = water

The Italian HateMap

Research Question:Is it possible to extract and process social media

to detect intolerant content posted on social networks and identify the most at-risk areas of the

Italian country?

The Italian HateMap

A framework for real-time Semantic Analysis of Social Streams

CrowdPulse

Social Data Extraction

features

Semantic Tagging

Sentiment Analysis Processing & VisualizationCataldo Musto, Giovanni Semeraro, Pasquale Lops, Marco de Gemmis The Italian Hate Map: semantic content analytics for social good. iCities 2015 Workshop, Palermo (Italy) 30.10.2015

workflowCrowdPulse

Step 1: Social Data ExtractionCrowdPulse

Step 1: Social Data Extraction

Extraction

Source

Heuristics

CrowdPulse

Extraction

Source

Heuristics

CrowdPulse

Extraction

Source

Heuristics

ContentUser

Content+Geo

#icities2015#democrats

#traffic

@barack_obama@comunepalermo

#earthquake

CrowdPulse

Extraction

Source

Heuristics

ContentUser

Content+Geo

#www2015#democrats

#traffic

@barack_obama@comunefi

#earthquake

GroupWe only extract public content

CrowdPulse

Use Case

Heuristics: Twitter content- 76 intolerant seed terms, defined by the psychologists teams - 5 intolerance dimensions: violence (against women), racism,

homophobia, disability, anti-semitism

CROWDPULSE SETTINGS

The Italian Hate Map

Use Case

Extracted content (seed term: nano/midget)

Tweet about an Italian ministry

CROWDPULSE SETTINGS

Tweet about iPod nano

Tweet about an Italian football player

Use Case

Tweet about an Italian ministry

CROWDPULSE SETTINGS

Tweet about iPod nano

Tweet about an Italian football player

Many non-intolerant Tweets are extracted!

Use Case

Sentiment Analysis and Semantic Tagging of the content

CROWDPULSE SETTINGS

Keyword-based representation introduces a lot of noise in the analysis

(midget)

(ipod nano)

Semantic TaggingMotivations

Cataldo Musto, Giovanni Semeraro, Pasquale Lops, Marco de Gemmis The Italian Hate Map: semantic content analytics for social good. iCities 2015 Workshop, Palermo (Italy) 30.10.2015 19

“E’inutile, il mio nano non segnerà mai”

Semantic TaggingMotivations

INTOLERANTNOT INTOLERANT?

• Entity Linking Algorithms• Input: textual content • Output: identification and

disambiguation of the entities mentioned in the text.

(1) http://tagme.di.unipi.it

(2) http://spotlight.dbpedia.org

Step 2: Semantic Tagging

Solution: semantic processing of extracted content

Algorithms

CrowdPulse

Use Case

Non-intolerant Tweets are detected and filtered out.

CROWDPULSE SETTINGS

CrowdPulseStep 3: Sentiment Analysis

Sentiment AnalysisMotivations

Is this content conveying any opinion?

Sentiment AnalysisMotivations

Is this content conveying any opinion?

This is a crucial issue if people-based findings have to be generated

Sentiment AnalysisDefinition

“It is the field of study that analyzes people’s

opinions, sentiments, evaluations, appraisals, attitudes, and emotions towards entities such as

products, services, organizations, individuals, issues, events, topics, and

their attributes “ (*)

(Pang, Bo, and Lillian Lee. "Opinion mining and sentiment analysis." Foundations and trends in information retrieval, 2008)

We concentrated on the polarity detection taskCataldo Musto, Giovanni Semeraro, Pasquale Lops, Marco de Gemmis The Italian Hate Map: semantic content analytics for social good. iCities 2015 Workshop, Palermo (Italy) 30.10.2015

Use Case

Tweets with positive or neutral sentiment are detected and filtered out.

CROWDPULSE SETTINGS

Use CaseCROWDPULSE SETTINGS

CrowdPulseStep 4: Processing

Use Case

We have to build a map, so we only need geotagged content

CROWDPULSE SETTINGS

Use CaseCROWDPULSE SETTINGS

Definition of heuristics to increase the number of geotagged Tweets

Use CaseThe Italian Hate Map

Dimension #Tweets #Geo %Geo

Homophobia 110,774 8,501 7,66%

Racism 154,170 1,940 1,24%

Violence 1,102,494 28,886 2,62%

Disability 479,654 3,410 0,75%

Anti-Semitism 6,000 1,150 18,03%

CrowdPulseStep 4: Data Visualization

Use CaseCROWDPULSE OUTPUT

Violence against women Disability

based on OpenStreetMap

Use CaseCROWDPULSE OUTPUT

Racism Homophobia

based on OpenStreetMap

Conclusions

Crowdsourcing-based approach

Social content containing the seed terms is extracted and processed in

real-time

Semantic Processing exploited to delete non-intolerant

Tweets

Sentiment Analysis

used to filter out Tweet with irony

3. 4. Analytics Console used to build real-time hate

Almost 2,000,000 social content extracted and analyzed.

Lessons Learned

37Cataldo Musto, Giovanni Semeraro, Pasquale Lops, Marco de Gemmis The Italian Hate Map: semantic content analytics for social good. iCities 2015 Workshop, Palermo (Italy) 30.10.2015

Lessons LearnedThe Italian Hate Map

Given the maps and given the output of the linguistic analysis of intolerant Tweets (co-occurrences between terms,

time lapse, etc.), the psychologists team defined some guidelines to tackle and prevent intolerant behaviors.

These guidelines have been freely distributed to public administration on early 2015.

Lessons Learned

Pipeline of state of the art techniquesSemantic Processing, Sentiment Analysis, Machine Learning, Data Visualization

Use Case: The Italian Hate Map

DEFINITION OF A FRAMEWORK FOR REAL-TIME SEMANTIC CONTENT ANALYSIS

Thanks to the huge availability of textual data very complex

phenomena can be analyzed in a totally new way

questions?Cataldo Musto, PhD

cataldo.musto@uniba.it @cataldomusto

http://www.di.uniba.it/~swap

the italian hate map: semantic content analytics for social good

Technology

field research election: october 21 · 10/5/2019 · and...

people don’t hate change, they hate how you’re trying to...

italian language course program b2 · 2020-03-04 · unit...

mental/emotional health unit part 3...saying, "it's gonna be...

semantic properties of word associations to italian verbs

hate crime in california · 2020-06-30 · hate crime in...

hate speech detection through alberto italian language...

hate crimes understanding hate/bias crimes and incidents

the italian hate map - mappa italiana dell'intolleranza

healing the hate: innovations in hate crime prevention ·...

semantic properties of word associations to italian...

is the ‘hate’ in hate speech the ‘hate’ in hate...

media content analysis on online hate speech ·...

the italian hate map - matera

preventing hate crimes brochure - russian · title:...

semantic interoperability of basic data in the italian...

antisemitic hate crimes and hate incidents in hungary

an overview of the italian “guidelines for semantic...

natural semantic metalanguage theory and some...

Караоке в офиса! · 2017-08-11 · saying it's...