iot$acoustic$sensing$...

Philippe Cousin, Easy Global Market RESSACS 2013, UBO (based on presentaCons of BEIJING, China IoT Conference, 24 APRIL 2013

IOT ACOUSTIC SENSING The Sounds of Smart Environments

the sounds of smart environments

Why AcousCc Sensing ?

AcousCc sensing has an added-‐value facing the “tradiConal” sensing devices, mainly due to two real-‐world advantages: Sensing with Non Line-‐of-‐Sight (NLOS); MulCpurpose sensing.

Sensors are also possibly cheaper that some (e.g. cameras)

Could be complemented with other sensing


AcousCc (Wireless) Sensor Networks

Applications (Acoustic-powered)

Info Feed

WSN

Applications (Acoustic +

Other)

Acoustic WSN


Killer (basic) App: Noise Monitoring

by Fraunhofer Institute for Industrial Engineering

“As part of the effort to tackle noise pollution, the European Union has laid down a common approach to avoiding, preventing or reducing on a prioritized basis the harmful effects of exposure to environmental noise. This approach is based on using common methods to map noise, on providing information to the public and on implementing action plans at local level. This Directive is also to serve as a basis for developing Community measures concerning noise sources.”, Extract of EU Environmental Noise Directive (2002/49/EC).


Acoustic-based Surveillance

Acoustic-powered Energy-Efficiency

Monitoring

But then much +: Some ApplicaCons…

Situational Awareness

(via acoustics)

http://www.s4eeb.org/

e.g. e.g.

http://www.sensorcity.nl


Real-‐Time Monitoring of Crowds / Traffic Flows (using acous;cs)

Monitor crowds’/traffic flows (masses, not individuals alone) in buildings/ci;es to create some "image" of flow paDerns of people/cars for …

[Smart-‐Buildings] Energy Efficiency (e.g. advanced air-‐condi;oning control, etc.)

[Smart-‐Ci;es] City opera;ons, e.g. security/emergency planning in public roads and also traffic management in ci;es.

Relevance for IoT:

IoT Infrastructure: Networks of AcousCc Sensors supporCng audio capture, local processing of audio streams and connecCon to some central monitoring system.

IoT Research: RTD on ‘Intelligent AcousCc SoluCons’ to realise real-‐Cme representaCons of movement and flowing of sounds (of traffic / crowds) expressed e.g. as Cme-‐varying moCon fields/maps


Event Detec;on (via acous;cs)

Detect outstanding (much relevant) events via real-‐;me collec;on and processing of on-‐site audio streams for …

[Smart-‐Buildings] suppor;ng some kind of in-‐door early warning system for people in situa;ons of emergency (person falling, screaming, in distress, etc.)

[Smart-‐Ci;es] suppor;ng some kind of out-‐door early warning system for ci;zens in situa;ons of emergency (car crash -‐> persons screaming/crying, etc.)

Relevance for IoT:

IoT infrastructure: Networks of AcousCc Sensors supporCng audio capture, local processing of audio streams, local event detecCon and communicaCon (so send events) to some central ‘complex event processing’ system.

IoT Research: RealisaCon of an ‘Intelligent AcousCc SoluCon’ to perform on-‐the-‐fly energy-‐posiCve detecCon of acousCcs occurrences in large-‐scale acousCc networks


Localisa;on of Outstanding Events (via Acous;c Source Localisa;on)

Pinpoint the (rela;ve) loca;on of outstanding events via triangula;on of acous;c events to …

[Smart-‐Environments] direct means-‐of-‐ aHen;on (surveillance camera, emergency crews, etc.) to loca;on of situa;on of interest

Relevance for IoT:

IoT Infrastructure: Networks of AcousCc Sensors, local processing of distance-‐to-‐event and communicaCon for performing triangulaCon processing for knowing (relaCve) locaCon.

IoT Research: Perform AcousCc Source LocalisaCon considering acousCc coverage of microphone, intersecCon of sensing areas, type of sensors, acousCc capture paderns, etc.


But also some challenges / risks

Challenges on processing acousCc data at IoT level

e.g. processing and storage for advanced FFT algorithms

Hard to idenCfy events over acousCcs

Possibly, even harder in distributed IoT networks

Users’ might be unaffordable with being “listened”

Hindering successful deployment, privacy & security, etc.

What kind of IoT deployment for applicaCon?

Proper deployment for an acous;c-‐enabled applica;on


ExperimenCng AcousCcs in Real environment using InnovaCve Test-‐beds

7 partners 2 years October 2012-‐oct 2014

The FP7 project

Coordinator


EAR-‐IT Research Experiment Approach


Test-‐beds

http://www.smartsantander.eu/ www.hobnet-project.eu

the sounds of smart environments 13


To listen well, is as powerful a means of influence as to talk well, and is as essen;al to all true conversa;on,

Ancient Chinese Proverb

作为人类沟通和施加影响的一种方式, 聆听的力量并不亚于说话。(*)


Thank you !

[email protected]

iot$acoustic$sensing$...

Documents