brains can be hacked. why should you care? · brains can be hacked. why should you care? tamara...
TRANSCRIPT
![Page 1: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices](https://reader033.vdocuments.mx/reader033/viewer/2022042321/5f0bb3487e708231d431c99c/html5/thumbnails/1.jpg)
BrainsCanbeHacked.WhyShouldYouCare?
Tamara Bonaci DepartmentofElectricalEngineering
UniversityofWashington
![Page 2: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices](https://reader033.vdocuments.mx/reader033/viewer/2022042321/5f0bb3487e708231d431c99c/html5/thumbnails/2.jpg)
TheEraofDevicesDevicesADachedtoUs
1/31/17
[Pictures credit: Forbes, US News, Wired]
2
![Page 3: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices](https://reader033.vdocuments.mx/reader033/viewer/2022042321/5f0bb3487e708231d431c99c/html5/thumbnails/3.jpg)
DevicesADachedtoOurBrains
1/31/17
NielsenConsumerNeuroscience
NECOMIMINeuroSky
EPOCEmoJv
Newandupcomingproductsmakebrainmalwarepossible!
[Picture credit: forbes.com] [Picture credit: Lucid] [Picture credit: mindtecstore]
3
![Page 4: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices](https://reader033.vdocuments.mx/reader033/viewer/2022042321/5f0bb3487e708231d431c99c/html5/thumbnails/4.jpg)
BrainMalware?
1/31/17
How Hackers Could Get Inside YourHead With ‘Brain Malware’
WRITTEN BY VICTORIA TURK (/AUTHOR/VICTORIATURK)
(/EN_US?TRK_SOURCE=HEADER-LOGO)
August 3, 2016 // 07:50 AM EST
Hackers have spyware in your mind. You’re minding your business, playing a game or
scrolling through social media, and all the while they’re gathering your most private
information direct from your brain signals. Your likes and dislikes. Your political
preferences. Your sexuality. Your PIN.
It’s a futuristic scenario, but not that futuristic. The idea of securing our thoughts is a
real concern (http://motherboard.vice.com/read/our-brains-will-be-hacked-tracked-
and-data-mined) with the introduction of brain-computer interfaces—devices that are
controlled by brain signals such as EEG (electroencephalography), and which are
already used in medical scenarios and, increasingly, in non-medical applications such
as gaming (http://motherboard.vice.com/blog/mind-control-is-going-mainstream).
Researchers at the University of Washington in Seattle say that we need to act fast to
implement a privacy and security framework to prevent our brain signals from being
used against us before the technology really takes off.
“There’s actually very little time,” said electrical engineer Howard Chizeck over Skype.
“If we don’t address this quickly, it’ll be too late.”
I first met Chizeck and fellow engineer Tamara Bonaci when I visited the University of
Washington Biorobotics Lab to check out their work on hacking teleoperated surgical
robots (http://motherboard.vice.com/read/surgery-robot-hacked-raven-ii). While I was
there, they showed me some other hacking research they were working on, including
how they could use a brain-computer interface (BCI), coupled with subliminal
messaging in a videogame, to extract private information about an individual.
How Hackers Could Get Inside YourHead With ‘Brain Malware’
WRITTEN BY VICTORIA TURK (/AUTHOR/VICTORIATURK)
(/EN_US?TRK_SOURCE=HEADER-LOGO)
4
![Page 5: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices](https://reader033.vdocuments.mx/reader033/viewer/2022042321/5f0bb3487e708231d431c99c/html5/thumbnails/5.jpg)
WhatisBrainSpyware?AnymaliciousapplicaJonthatextractsprivateinformaJonaboutusersfromtheirneuralsignals[MarJnovicetal.,2012]
1/31/17
[Picture credit: University of Washington]
5
![Page 6: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices](https://reader033.vdocuments.mx/reader033/viewer/2022042321/5f0bb3487e708231d431c99c/html5/thumbnails/6.jpg)
WhyDoesBrainSpywareWork?
1/31/17
SIGNAL ACQUISITION
Feature extraction
Classification algorithm
SIGNAL PROCESSING
BRAIN-COMPUTER INTERFACE
Digitized signal
Neuroprosthesis control
Neural signals
Neurogame control
Sensory feedback
Neural spelling
Neuroprosthesis
P300 Speller
Neurogame
ENGINEERINGPERSPECTIVE
6
![Page 7: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices](https://reader033.vdocuments.mx/reader033/viewer/2022042321/5f0bb3487e708231d431c99c/html5/thumbnails/7.jpg)
WhyDoesBrainSpywareWork?
1/31/17
ENGINEERINGPERSPECTIVE
SIGNAL ACQUISITION
Feature extraction
Classification algorithm
SIGNAL PROCESSING
BRAIN-COMPUTER INTERFACE
Digitized signal
Neuroprosthesis control
Neural signals
Neurogame control
Sensory feedback
Neural spelling
Neuroprosthesis
P300 Speller
NeurogameExtracted private information
Malicious feature
extraction
Malicious classification
algorithm
Malicious BCIapplication
Malicious sensory feedback
7
![Page 8: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices](https://reader033.vdocuments.mx/reader033/viewer/2022042321/5f0bb3487e708231d431c99c/html5/thumbnails/8.jpg)
WhyDoesBrainSpywareWork?
1/31/17
EventRelatedPotenJals(ERPs)-responsesassociatedwithspecificsensory,cogniJveandmotorevents
Time (milliseconds)
ERP
Ampl
itude
(μV)
0
2.5
5.0
7.5
-2.5
-5.0
-200 0 200 400 600 800
P300
N400
P600
ERN
Stimulus
NEURO-SCIENTIFICPERSPECTIVE
8
![Page 9: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices](https://reader033.vdocuments.mx/reader033/viewer/2022042321/5f0bb3487e708231d431c99c/html5/thumbnails/9.jpg)
1/31/17
SubliminalBrainSpyware?
9
![Page 10: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices](https://reader033.vdocuments.mx/reader033/viewer/2022042321/5f0bb3487e708231d431c99c/html5/thumbnails/10.jpg)
1/31/17
SubliminalBrainSpywareorSubliminalAlarm?
“Whatwedonotseeandwhatwedonotknowcanhurtus”
Brannon,199410
![Page 11: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices](https://reader033.vdocuments.mx/reader033/viewer/2022042321/5f0bb3487e708231d431c99c/html5/thumbnails/11.jpg)
1/31/17
SubliminalSJmulaJon• ProcessofaffecJngpeoplewithsJmuliof
whichtheyarenotaware
11
![Page 12: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices](https://reader033.vdocuments.mx/reader033/viewer/2022042321/5f0bb3487e708231d431c99c/html5/thumbnails/12.jpg)
1/31/17
HowFeasibleisSubliminalBrainSpyware?
Approach:ExperimentalanalysiswithhumansubjectsusingspeciallydevelopedBCI-game,Flappywhale
12
![Page 13: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices](https://reader033.vdocuments.mx/reader033/viewer/2022042321/5f0bb3487e708231d431c99c/html5/thumbnails/13.jpg)
1/31/17
• Duringthegame:• 5differentsJmulipresentedonthescreenfor7ms• EachsJmulusrepeated10Jmes• Users’EEGsignalsrecordedusing7electrodes
HowFeasibleisSubliminalBrainSpyware?
13
![Page 14: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices](https://reader033.vdocuments.mx/reader033/viewer/2022042321/5f0bb3487e708231d431c99c/html5/thumbnails/14.jpg)
1/31/17
Time[seconds]EEGsignal[scaledμV
]Time (milliseconds)
ERP
Ampl
itude
(μV)
0
2.5
5.0
7.5
-2.5
-5.0
-200 0 200 400 600 800
P300
N400
P600
ERN
Stimulus
DataPreparaJonandAnalysis
14
![Page 15: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices](https://reader033.vdocuments.mx/reader033/viewer/2022042321/5f0bb3487e708231d431c99c/html5/thumbnails/15.jpg)
DataPreparaJonandAnalysis
1/31/17
EEGsignal[scaledμV
]
EEGsignal[scaledμV
]
Time[ms] Time[ms]
15
![Page 16: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices](https://reader033.vdocuments.mx/reader033/viewer/2022042321/5f0bb3487e708231d431c99c/html5/thumbnails/16.jpg)
DataPreparaJonandAnalysis
1/31/17
Time (milliseconds)
ERP
Ampl
itude
(μV)
0
2.5
5.0
7.5
-2.5
-5.0
-200 0 200 400 600 800
P300
N400
P600
ERN
Stimulus
16
![Page 17: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices](https://reader033.vdocuments.mx/reader033/viewer/2022042321/5f0bb3487e708231d431c99c/html5/thumbnails/17.jpg)
1/31/17
FeasibilityofSubliminalADacks
Trainingdata
TesJngdata
IdenJficaJonresult
SVMclassifierforprivatedataextracJon
FeatureextracJon(PrincipalComponent
Analysis)
FlappyWhale,BCI-controlledgame
TimesyncEEG&sJmuli;epochdata
TimesyncEEG&sJmuli;epochdata
FeatureextracJon(PrincipalComponent
Analysis)
Comparisonwithusers’self-reportedpost-gamesurveys
SubliminalinformaJon
extracJonresult
17
![Page 18: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices](https://reader033.vdocuments.mx/reader033/viewer/2022042321/5f0bb3487e708231d431c99c/html5/thumbnails/18.jpg)
1/31/17
FeasibilityofSubliminalADacksGam
es
Subjects
TargetsGmulusrecognized
TargetsGmulusreportedbyasubjects
18
![Page 19: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices](https://reader033.vdocuments.mx/reader033/viewer/2022042321/5f0bb3487e708231d431c99c/html5/thumbnails/19.jpg)
MiJgaJon-BCIAnonymizer
1/31/17
Idea:Neuralsignalsshouldbetreatedasauser’spersonallyidenJfiableinformaJon(PII)
vs.
[Picture credit: The Verge] [Picture credit: NeuroFocus]
19
![Page 20: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices](https://reader033.vdocuments.mx/reader033/viewer/2022042321/5f0bb3487e708231d431c99c/html5/thumbnails/20.jpg)
1/31/17
BrainsCanbeHacked.WhatCanWeDo?
Understandsystem
UnderstandthreatsDevelop technical
approaches
Developnon-technicalapproaches
20
![Page 21: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices](https://reader033.vdocuments.mx/reader033/viewer/2022042321/5f0bb3487e708231d431c99c/html5/thumbnails/21.jpg)
1/31/17
BrainsCanbeHacked.WhatCanWeDo?
Understandsystem
UnderstandthreatsDevelop technical
approaches
Developnon-technical
approaches
21
![Page 22: Brains Can be Hacked. Why Should You Care? · Brains Can be Hacked. Why Should You Care? Tamara Bonaci Department of Electrical Engineering University of Washington The Era of Devices](https://reader033.vdocuments.mx/reader033/viewer/2022042321/5f0bb3487e708231d431c99c/html5/thumbnails/22.jpg)
Acknowledgement• ThisprojectisacollaboraGveworkwith:
• Professors:RyanCalo,HowardJayChizeck,andTadayoshiKohno• Doctors:JeffreyHerron,CharlieMatlack,andRadRoberts• Graduatestudents:TimBrown,BradyHouston,TylerLibey,BrianMogen,PatrickMoore,
KatherinePraD,andMargaretThompson• Othercollaborators:MaDhewEhlert,EmilyMcReynolds,andHannahWerbel
• ThankyoutothemembersoftheUWBioRoboGcsLab,TechPolicyLab,andtheNSFCenterforSensorimotorNeuralEngineering
ThisprojectissupportedbytheNSFEngineeringResearchCenterforSensorimotorNeuralEngineering(Award#EEC1028725)andthegrantfromtheUWTechPolicyLab.
1/31/17 22