sri acoustics team - stevens institute of technology · 2018-11-06 · sri acoustics team july...

16
SRI Acoustics Team July 24th, 2014 Update "This material is based upon work supported by the U.S. Department of Homeland Security under Grand Award Number 2008-ST-061-ML0002. The views and conclusions contained in this document are those of the authors and should not be interpreted as necessarily representing the official policies, either expressed or implied, of the U.S. Department of Homeland Security." Robert Garvin, Carrick Porter, Juan Carlos Santos, Dmitriy Savinskiy, Sarah Walsh

Upload: others

Post on 24-Jun-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: SRI Acoustics Team - Stevens Institute of Technology · 2018-11-06 · SRI Acoustics Team July 24th, 2014 Update "This material is based upon work supported by the U.S. Department

SRI Acoustics Team July 24th, 2014 Update

"This material is based upon work supported by the U.S. Department of Homeland Security under Grand Award Number 2008-ST-061-ML0002. The views and conclusions contained in this document are those of the authors and should not be interpreted as necessarily representing the official policies, either expressed or implied,

of the U.S. Department of Homeland Security."

Robert Garvin, Carrick Porter, Juan Carlos Santos, Dmitriy Savinskiy, Sarah Walsh

Page 2: SRI Acoustics Team - Stevens Institute of Technology · 2018-11-06 · SRI Acoustics Team July 24th, 2014 Update "This material is based upon work supported by the U.S. Department

Overview

●  Introduction ●  Methodology ●  Results ●  Recommendations

Page 3: SRI Acoustics Team - Stevens Institute of Technology · 2018-11-06 · SRI Acoustics Team July 24th, 2014 Update "This material is based upon work supported by the U.S. Department

Panga & Jet Ski

Page 4: SRI Acoustics Team - Stevens Institute of Technology · 2018-11-06 · SRI Acoustics Team July 24th, 2014 Update "This material is based upon work supported by the U.S. Department

Slipping Under the Radar

Courtesy of the SRI Synergies Team AIS from marinetraffic.com

Jet Skis on Hudson River

Page 5: SRI Acoustics Team - Stevens Institute of Technology · 2018-11-06 · SRI Acoustics Team July 24th, 2014 Update "This material is based upon work supported by the U.S. Department

Passive Acoustics ●  SPADES ●  Capabilities: ○  Detection ○  Tracking

●  What is missing? ○  Automatic

Classifier

Page 6: SRI Acoustics Team - Stevens Institute of Technology · 2018-11-06 · SRI Acoustics Team July 24th, 2014 Update "This material is based upon work supported by the U.S. Department

Jet Ski: Frequency (Hz)

Frequency (Hz)

Inte

nsity

(dB

) In

tens

ity (d

B)

Acoustic Fingerprint Panga:

Page 7: SRI Acoustics Team - Stevens Institute of Technology · 2018-11-06 · SRI Acoustics Team July 24th, 2014 Update "This material is based upon work supported by the U.S. Department

Resources ●  Vessel Acoustic Data Sets ●  Signal Analysis Algorithms

o  Extraction of key characteristics ●  WEKA

o  Classification tool

Page 8: SRI Acoustics Team - Stevens Institute of Technology · 2018-11-06 · SRI Acoustics Team July 24th, 2014 Update "This material is based upon work supported by the U.S. Department

Signal Analyzer

Process Flowchart

Hydrophone Machine Learning Data Base

Unknown Vessel

Classified Boat

Page 9: SRI Acoustics Team - Stevens Institute of Technology · 2018-11-06 · SRI Acoustics Team July 24th, 2014 Update "This material is based upon work supported by the U.S. Department

Blind Testing of Classifier ●  An automatic classification algorithm was

design using the extracted data. ●  Blind data set had 3 possible options for

classification: Panga, Jet Ski, or Other

Page 10: SRI Acoustics Team - Stevens Institute of Technology · 2018-11-06 · SRI Acoustics Team July 24th, 2014 Update "This material is based upon work supported by the U.S. Department

Blind Testing Results

Trial Actual Predicted Probability:

Other Probability:

Jet Ski Probability:

Panga

1 Panga Panga 0.11 0.008 0.882

2 Panga Panga 0.11 0.008 0.882

3 Panga Panga 0.413 0.015 0.572

4 Panga Other 0.616 0.195 0.19

Trial Actual Predicted Probability:

Other Probability:

Jet Ski Probability:

Panga

1 Other Other 0.914 0.01 0.076

2 Other Other 0.914 0.01 0.076

3 Other Other 0.641 0.068 0.291

4 Other Other 0.641 0.068 0.291

Blind Test 2

Blind Test 5

●  Actual: Panga ●  Classified as: Panga

○  3 of 4 instances correctly identified

●  Actual: Other ●  Classified as: Other

○  4 of 4 instances being correctly identified

Page 11: SRI Acoustics Team - Stevens Institute of Technology · 2018-11-06 · SRI Acoustics Team July 24th, 2014 Update "This material is based upon work supported by the U.S. Department

Conclusions ●  Overall performance indicates automatic

classification is promising ●  Jet Skis prove to be more easily identifiable

than Pangas ●  Pangas similarity to other vessels makes

classification a challenge

Page 12: SRI Acoustics Team - Stevens Institute of Technology · 2018-11-06 · SRI Acoustics Team July 24th, 2014 Update "This material is based upon work supported by the U.S. Department

Recommendations ●  Make the feature extraction automatic ●  Obtain more data to create a larger

database ●  Exploration of the usefulness of other

features ●  Integration with Magello

Page 13: SRI Acoustics Team - Stevens Institute of Technology · 2018-11-06 · SRI Acoustics Team July 24th, 2014 Update "This material is based upon work supported by the U.S. Department

Acoustic Shape Method

Power Spectrum Data Acoustic Shape Compare in Database

Classifies Vessel

Page 14: SRI Acoustics Team - Stevens Institute of Technology · 2018-11-06 · SRI Acoustics Team July 24th, 2014 Update "This material is based upon work supported by the U.S. Department

Planned Integration with Magello

Page 15: SRI Acoustics Team - Stevens Institute of Technology · 2018-11-06 · SRI Acoustics Team July 24th, 2014 Update "This material is based upon work supported by the U.S. Department

Beth Austin DeFares, Dr. Barry Bunin, Dr. Alexander Sutin, Dr. Julie Pullen, Dr. Hady Salloum, Mykhail Tsionsky, Alexander Yakubovsky,

Alex Pollara

Thank You

Page 16: SRI Acoustics Team - Stevens Institute of Technology · 2018-11-06 · SRI Acoustics Team July 24th, 2014 Update "This material is based upon work supported by the U.S. Department

SRI Acoustics Team July 24, 2014

Robert Garvin, Carrick Porter, Juan Carlos Santos, Dmitriy Savinskiy, Sarah Walsh

Questions?