collective classification for spam filtering - cisis 2011
DESCRIPTION
Presentation at CISIS 2011 International conference of the paper: Collective Classification for Spam FilteringTRANSCRIPT
Carlos Laorden
WHAT YOU GOT, THEN? SPAM, EGG,
SPAM, SPAM, BACON AND
SPAM.
SPAM, SPAM, SPAM, BAKED BEANS AND
SPAM.
ANYTHING WITHOUT
SPAM?
I DON’T LIKE SPAM!!
UGH!
Meet the real SPiced hAM
Monty Python’s Flying Circus
Something that repeats and repeats until being annoying
It is a
real problem for Information Security
Billions of daily losses in
productivity
Infected computers
Stolen credentials
We must
fight
Anti-spam methods
Pre-sending
New
protocols
Post-sending
Increase sending
costs Increase risks
for spammers
sender
content
content
Usually
supervised approaches
A significant
labelling work is needed
Usually
supervised approaches
Link structure among documents
Collective Classification
no interest this SpamAssassin word has
this has Ling Spam no interest word
Empirical evaluation
SpamAssassin
Ling Spam t1
t2
t3 D1
D2
D10 D3
D9
D4
D7
D8
D5
D11
D6
0.65
0.70
0.75
0.80
0.85
0.90
0.95
1.00
10% 20% 30% 40% 50% 60% 70% 80% 90%
Collective KNN, k=10
Collective Forest
Collective Woods
Random Woods
Precision
0.10
0.20
0.30
0.40
0.50
0.60
0.70
0.80
0.90
1.00
10% 20% 30% 40% 50% 60% 70% 80% 90%
Collective KNN, k=10
Collective Forest
Collective Woods
Random Woods
Recall
0.55
0.60
0.65
0.70
0.75
0.80
0.85
0.90
0.95
1.00
10% 20% 30% 40% 50% 60% 70% 80% 90%
Collective KNN, k=10
Collective Forest
Collective Woods
Random Woods
AUC
Suitable to overcome the amount
of unclassified spam e-mails
Will we see the END of spam?
95%
“Solution to spam”
Cut their billing systems?
References 1. Monty Python – Spam:
http://www.youtube.com/watch?v=anwy2MPT5RE
2. Spam wall by freezelight: http://www.flickr.com/photos/63056612@N00/155554663/
3. monty python flying circus by the_d8_show: http://www.flickr.com/photos/8056839@N04/478599790/
4. Dollars: http://vegasgravy.com/News-detail/two-women-
caught-for-transporting-drug-money-from-vegas/dollars/
5. Day 97: Infected by dustywrath: http://www.flickr.com/photos/10921499@N07/2187318683
6. my bank sucks by B Rosen: http://www.flickr.com/photos/rosengrant/3537904106/
7. Interlinked documents: http://zhangruiyanz.blogspot.com.es/
8. Honeycomb: http://desktop-
wallpapers.net/3d/Honeycomb.html
9. Feet on table: http://bisystembuilders.com/wp-
content/uploads/2010/02/shutterstock_feet-on-table.jpg
10. Buried on bills: http://getupkids.net/wp-
content/uploads/2013/06/debt_piling.jpg
11. Kill spam: http://www.email-marketing-wizard.com/wp-
content/uploads/2010/03/spammer.jpg