3zqlqj 0dfklqh /hduqlqj 0/ - flyingpenguin.com · z w l l o v z x v x x µ l l v Á l } Ç x Æ m ]...
TRANSCRIPT
![Page 1: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/1.jpg)
flyingpenguin
Pwning Machine Learning (ML) for Fun and Profit
KIWICON X
Davi Ottenheimer
![Page 2: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/2.jpg)
flyingpenguin
Appreciation For Coming
Please Reach Under Your Seat
If You Find A Challenge Token
You Win!
KIWICON X
![Page 3: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/3.jpg)
flyingpenguin
Got Ewe
![Page 4: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/4.jpg)
flyingpenguin
Who Defines ‘Win’?
• Have You Learned– About Chance / Probability
– About Authority
– About Public Speakers
– About Me
• ‘Control’ is a Function of Knowledge
KIWICON X
![Page 5: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/5.jpg)
flyingpenguin
Security A Competitive Game
1. Out-Smart Adversaries (Preserving Rational Authority)
2. Create Efficiencies, Reduce Costs
3. Balance Both Capabilities!– Security = More Success at Less Cost
– Don’t Confuse/Reverse These
KIWICON X
![Page 6: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/6.jpg)
flyingpenguin
In a World ofDecisions For Competition
KIWICON X
![Page 7: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/7.jpg)
flyingpenguin
We Expect MACHINESto Make ‘Winning’ Easier
And Yet...
KIWICON X
![Page 8: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/8.jpg)
flyingpenguin
BAD THINGS ARE HAPPENING
KIWICON X
![Page 9: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/9.jpg)
flyingpenguin
‘Really Interesting Problems’
KIWICON Xhttps://twitter.com/jackyalcine/status/615329515909156865 https://twitter.com/yonatanzunger/status/615586442413146112
![Page 10: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/10.jpg)
flyingpenguin
‘Professional’
KIWICON X
![Page 11: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/11.jpg)
flyingpenguin
‘Unprofessional’
KIWICON X
![Page 12: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/12.jpg)
flyingpenguin
‘Prime Ethnic Composition’
KIWICON Xhttp://www.bloomberg.com/graphics/2016-amazon-same-day/
‘Berman says ethnic composition of neighborhoods isn’t part of data Amazon examines when drawing maps.’
![Page 13: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/13.jpg)
flyingpenguin
False ‘Criminal’ Labeling
‘Blacks falsely labeled future criminals at almost twice the
rate of white defendants’
KIWICON Xhttps://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing
![Page 14: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/14.jpg)
flyingpenguin
False ‘Criminal’ Labeling
‘compared predicted to actualrecidivism: scores wrong 40% of
the time and biased against black defendants.’
KIWICON Xhttps://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing
![Page 15: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/15.jpg)
flyingpenguin
UK False Road Segmentation...
KIWICON X
![Page 16: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/16.jpg)
flyingpenguin
...Machine in Former Colony(Independent Within Commonwealth Since 30 September 1966)
KIWICON X
‘labels more than 90% of pixels correctly’
- UK Creators
http://mi.eng.cam.ac.uk/projects/segnet/
![Page 17: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/17.jpg)
flyingpenguin
https://www.ntsb.gov/investigations/AccidentReports/Pages/HWY16FH018-preliminary.aspx
Chose to kill human because ‘overhead sign’ (more likely a moving bridge)
Death from Autopilot
KIWICON X
60-0 mph Tesla Brake Test =
108 ft
![Page 18: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/18.jpg)
flyingpenguin
REASONS FOR (SAFETY) FAILURES
KIWICON X
![Page 19: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/19.jpg)
flyingpenguin
Remember 1958 Predictions?
‘The Navy revealed the embryo of an electronic computer today that it expects will be able to walk, talk, see, write, reproduce itself and be conscious of its existence’
KIWICON X‘The Perception’ http://fortune.com/ai-artificial-intelligence-deep-machine-learning/
![Page 20: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/20.jpg)
flyingpenguin
Remember 1968 Warnings?
‘No HAL 9000 series computer has ever made a mistake or distorted information. We are all, by any practical definition of the word, foolproof, and incapable of error.’
KIWICON X
![Page 21: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/21.jpg)
flyingpenguin
‘Safety Failure’ Warnings
KIWICON X
Unable Inadequate Mischievous Selfish
BladeRunner Required
![Page 22: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/22.jpg)
flyingpenguin
‘You seem a little shell shocked so let’s just stop you right there...’
KIWICON X
![Page 23: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/23.jpg)
flyingpenguin
2016: Bots Are Seeking & Pattern Matching
Algorithms Now Repeat (Faster) Whatever Mistakes They Learn(see also: decline of civilization)
KIWICON Xflyingpenguin
Image source:
![Page 24: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/24.jpg)
flyingpenguin
Bypass Learning: Design FlawNeo-Nazis Piled in a Backdoor
(‘Repeat after me!’)
KIWICON Xhttps://twitter.com/daviottenheimer/status/712889915533500416
![Page 25: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/25.jpg)
flyingpenguin
Break Supervised Learning
• Predicts Future Data Based on Past
• Inputs Data and Labels– Classification
– Regression
KIWICON X
SPAM NOT SPAM
ViAGR4! P1l1s fur sailViagra pills sale
![Page 26: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/26.jpg)
flyingpenguin
Supervised Break: Face
KIWICON X
Detection Result:Error: “0 face detected”
![Page 27: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/27.jpg)
flyingpenguin
Supervised Break: Sentiment
KIWICON X
Supervised MLTraining Set
Search Algorithm for Feelings
More Precise Classification“Very Happy”
http://www.datasciencecentral.com/profiles/blogs/tricks-in-face-recognition
![Page 28: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/28.jpg)
flyingpenguin
Supervised Break: Fight Faces
KIWICON XFace recognition with deep neural networks. http://cmusatyalab.github.io/openface/
![Page 29: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/29.jpg)
flyingpenguin
Break Un-Supervised Learning
Discovers Hidden Structures Within Unlabeled Data
– Compression
– Clustering
KIWICON X
‘Ostrich’
![Page 30: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/30.jpg)
flyingpenguin
Un-Supervised Break (ID)
KIWICON X
Bus + ‘Ostrich’ = ‘Ostrich’
http://www.popsci.com/byzantine-science-deceiving-artificial-intelligence
Christian Szegedy90%+ Effective Attack
![Page 31: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/31.jpg)
flyingpenguin
Un-Supervised Break (Traffic)
KIWICON X
No Parking + ‘Stop’ = ‘Stop’
http://www.popsci.com/byzantine-science-deceiving-artificial-intelligence
![Page 32: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/32.jpg)
flyingpenguin
Un-Supervised Break (Lip Read)
KIWICON X
LipNet, Sentence-Level Lipreading, Nov 2016https://arxiv.org/pdf/1611.01599v1.pdf
Confused by English Accent
![Page 33: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/33.jpg)
flyingpenguin
Break Reinforcement Learning
• Improves Performance in Dynamic Environs Using Delayed Rewards
• Measures Actions to Achieve Set Goals (Win a Game)
KIWICON X
![Page 34: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/34.jpg)
flyingpenguin
Reinforcement Learning Defeat
KIWICON X
![Page 35: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/35.jpg)
flyingpenguin
Reinforcement Learning Defeat
KIWICON X
![Page 36: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/36.jpg)
flyingpenguin
Reinforcement Learning Defeat
KIWICON Xhttps://www.youtube.com/watch?v=Uj-rK8V-rik&feature=youtu.be&t=24m54s
![Page 37: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/37.jpg)
flyingpenguin
TO FIX ML SAFETY, WE NEED TO BREAK ML MORE
KIWICON X
![Page 38: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/38.jpg)
flyingpenguin
Cognitive BiasOptions
(Menu of Attacks)
KIWICON X
NOT ENOUGH MEANING
NEED TO ACT FAST
flyingpenguin
TOO MUCH INFO
LIMIT TO MEMORY
![Page 39: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/39.jpg)
flyingpenguin
Machines Sort of Like Humans
Expecting machine intelligence
to evolve a human-like brain
like
waiting for airplanes
to grow feathers
KIWICON X
![Page 40: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/40.jpg)
flyingpenguin
Human Learning as Philosophy
KIWICON X
1637: ‘Cogito, ergo sum’
1693: Reflective Process, Articulated Steps
John Locke(1632-1704)
Rene Descartes(1596-1650)
http://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.1002106
![Page 41: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/41.jpg)
flyingpenguin KIWICON X
‘No testimony is sufficient to establish a miracle, unless the testimony be of such a kind that its falsehood would be more miraculous than the fact which it endeavours to establish.’
David HumeEnquiries Concerning the Human
Understanding and Concerning the Principles of Morals
Can’t be false…
![Page 42: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/42.jpg)
flyingpenguin
False Win Can Mean ‘Not False’Despite All Models Being Wrong
A ‘winning result’ is not yet proven enough to be flagged wrong or ruled out*
* Transparency of ML may be inversely related to accountability or legal liability
KIWICON Xhttps://papers.ssrn.com/sol3/papers.cfm?abstract_id=2853462
![Page 43: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/43.jpg)
flyingpenguin
Machine ‘Reflective Process’Expressed as Holdout Method
Initial Data
Training
Training
Testing
Testing Validation
ML Algorithm
Model
"Cross-Validatory Choice and Assessment of Statistical Predictions,"Journal of the Royal Statistical Society. Series B (Methodological), Vol. 36, No. 2., pp. 111-147http://www.stat.washington.edu/courses/stat527/s13/readings/Stone1974.pdf
KIWICON X
EvaluateAlgorithms
Model Tune & Evaluate
Re-EvaluateAlgorithms
![Page 44: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/44.jpg)
flyingpenguin
Bias is Unsafe: Powerful Man Promises A Great Opportunity!
KIWICON X
![Page 45: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/45.jpg)
flyingpenguin
Bias is Unsafe: This is Fine (TIF)
KIWICON X
![Page 46: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/46.jpg)
flyingpenguin
Opportunity + TIF = Tesla(Cognitive Errors)
• AutoPilot Thought It Was Winning– Need to Act Fast
– Make An Impact
• Human Thought He Was Winning– Imagined Tesla Better
– Not Enough Meaning
• ML Opacity + False Wins Led to Death
KIWICON X
![Page 47: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/47.jpg)
flyingpenguin
BUT WAIT...IT GETS WORSE
KIWICON X
![Page 48: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/48.jpg)
flyingpenguin
The Inevitable Militarization of [Insert Technology Here]*
KIWICON Xhttp://www.cyberdefensereview.org/2016/02/08/the-inevitable-militarization-of-artificial-intelligence/*Artificial Intelligence
![Page 49: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/49.jpg)
flyingpenguin
History
KIWICON X
Maxim, an egomaniacal draft dodger, gave the world the first true automatic weapon (Patent No 3493 1883). Used by British in Colonial Africa and by Germans in WWI to turn earth into hell. Died proud.
- C. J. Chivershttps://www.worldcat.org/title/gun/oclc/535493119
![Page 50: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/50.jpg)
flyingpenguin
Harvard Math PhD is Worried
KIWICON X
![Page 51: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/51.jpg)
flyingpenguin
The O’Neil Guide to
KIWICON X
Widespread Impact
Secret (Targets Can’t Understand)
Destructive(Ruin Life, Unfair)
Algorithms We Should Worry About
![Page 52: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/52.jpg)
flyingpenguin KIWICON X
The O’Neil Guide toAlgorithms We Should NOT Worry About
![Page 53: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/53.jpg)
flyingpenguin KIWICON Xflyingpenguin
![Page 54: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/54.jpg)
flyingpenguin
NetFlix is Watching You
• Widespread
• Secret
• Destructive?– Content Type
– View Time
– Correlation
KIWICON X
![Page 55: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/55.jpg)
flyingpenguin
Widespread and Secret Cameras
KIWICON X
Story-Driven Summarization for Egocentric Video
http://www.cs.utexas.edu/~grauman/papers/lu-grauman-cvpr2013.pdf, The Economist “The Data Deluge”
![Page 56: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/56.jpg)
flyingpenguin
Widespread and Secret Health Sensors
KIWICON X
‘we know the estimated numbers of people being served by each waste water treatment plant, we can back-calculate daily loads’
http://gizmodo.com/5844925/chicagos-stickney-wastewater-treatment-plant-is-the-crappiest-place-on-earth, http://planetearth.nerc.ac.uk/news/story.aspx?id=1185http://www.treehugger.com/natural-sciences/fish-near-water-treatment-plants-are-harmed-by-human-drugs.html
Analysis of Greater Chicago Wastewater(1.5 billion gal/day)
• Disease• Drugs• Environmental Risk
![Page 57: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/57.jpg)
flyingpenguin
Widespread and Secret Drug Sensors
KIWICON X
http://gizmodo.com/meth-in-london-heroin-in-zagreb-the-answer-is-found-i-1508209127http://www.thesundaytimes.co.uk/sto/news/uk_news/Health/article1409450.ece
Italy
London
FinlandCroatia
Oregon Canada
‘Cocaine so widely used it has contaminated Britain’s drinking water’
![Page 58: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/58.jpg)
flyingpenguin
Widespread and Secret Police Sensors
KIWICON X
From BlueToad to BlueJay
http://arstechnica.com/tech-policy/2013/09/how-the-cops-watch-your-tweets-in-real-time/
![Page 59: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/59.jpg)
flyingpenguin KIWICON X
Facebook’s Hunter Killer Project‘Trajectory Targeting by Prediction’
https://www.kaggle.com/c/facebook-v-predicting-check-ins
The goal of this competition is to predict which place a person would liketo check in to. For the purposes of this competition, Facebook created anartificial world consisting of more than 100,000 places located in a 10 kmby 10 km square. For a given set of coordinates, your task is to return aranked list of the most likely places. Data was fabricated to resemblelocation signals coming from mobile devices, giving you a flavor of whatit takes to work with real data complicated by inaccurate and noisyvalues. Inconsistent and erroneous location data can disrupt experiencefor services like Facebook Check In.
![Page 60: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/60.jpg)
flyingpenguin
PWN ML FOR FUN & PROFIT (SUPPORTING MUTUAL INTERESTS)*
OR GET PWNED...
KIWICON X* Thomas Hobbes
![Page 61: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/61.jpg)
flyingpenguin
Pwning Machine Learning (ML) for Fun and Profit
KIWICON X
Davi Ottenheimer
flyingpenguin
![Page 62: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/62.jpg)
flyingpenguin
EPILOGUE
KIWICON X* Thomas Hobbes
![Page 63: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/63.jpg)
flyingpenguin
Why Nazis Love Saying ‘Fake’
• Refusal to learn is a ‘deliberate, often psychologically motivated, neglect of information too upsetting to allow’
• ‘Never believe that anti-Semites are completely unaware of the absurdity of their replies. They know that their remarks are frivolous, open to challenge.’ - Jean Paul Sartre
KIWICON X
http://www.washingtonpost.com/sf/brand-connect/bleecker-street/denial/http://abahlali.org/files/Jean-Paul_Sartre_Anti-Semite_and_Jew_An_Exploration_of_the_Etiology_of_Hate__1995.pdf
![Page 64: 3ZQLQJ 0DFKLQH /HDUQLQJ 0/ - flyingpenguin.com · Z W l l o v Z X v X X µ l l v Á l } Ç X Æ M ] A í í ô ñ](https://reader036.vdocuments.mx/reader036/viewer/2022081401/5c65271009d3f2b26e8c4375/html5/thumbnails/64.jpg)
flyingpenguin
‘...they are amusing themselves, for it is their adversary whois obliged to use words responsibly, since he believes inwords. The anti-Semites have the right to play. They even liketo play with discourse for, by giving ridiculous reasons, theydiscredit the seriousness of their interlocutors. They delightin acting in bad faith, since they seek not to persuade bysound argument but to intimidate and disconcert. If you pressthem too closely, they will abruptly fall silent, loftilyindicating by some phrase that the time for argument is past.It is not that they are afraid of being convinced. They fearonly to appear ridiculous or to prejudice by theirembarrassment their hope of winning over some third person totheir side.’
- Jean Paul Sartre
KIWICON X
http://abahlali.org/files/Jean-Paul_Sartre_Anti-Semite_and_Jew_An_Exploration_of_the_Etiology_of_Hate__1995.pdf
Why Nazis Love Saying ‘Fake’