arpan pal u-world
TRANSCRIPT
1
Arpan PalResearch Group ManagerInnovation LabTata Consultancy ServicesIndia
April 15, 2023
Use of Ubiquitous Device based Sensing for Building Smart Solutions
Outline• Intelligent Infrastructure using Internet-of-Things
• Application using Mobile Phone based Gateway – Road Monitoring
• Application using Set top Box based Gateway – Home Monitoring
• Intelligent HMI
• Conclusion
3
Intelligent Infrastructure
“Intelligent”• Context-aware
• Sense the environment• Extract meaningful information• Analyze to make inferences• Respond through value-added
information
“Infrastructure”• Home, Building, Store, Vehicle,
Roads, Utility Generation / Distribution Network
IntelligentInfra
@Home
@Building
@Vehicle@Utility
@Mobile
@Store
@Road
Applications• Transportation• Safety• Electricity• Water• Healthcare• Education
Need for• Privacy Preservation• Processing at Edge to reduce bandwidth and hence communication cost
4
Internet-of-Things Architecture for Intelligent Infrastructure
Internet
Sensors (Location, Audio , Camera, …)
Gateway (Stand-alone Device / Smart Phones)
Backend Server & database
Portal
USB, CAN, Zigbee, BT, NFC, WiFi
GSM/GPRS, 3GADSL
BAN
KIN
G
INSU
RAN
CE
AGRI
CULT
URE
HEA
LTH
CARE
GO
VERN
MEN
T
UTI
LITY
MA
NU
FACT
URI
NG
TRA
NSP
ORT
APPLICATION SERVICES
INFRASTRUCTURE PLATFORM
INTERNET
GATEWAY
RESP
ON
DSE
NSE
AN
ALY
ZEEX
TRAC
T
Television / Set top Box
MobilePhones
5
Mobile Phones as Sensor and Gateway
InternetWiFi, 2G/GPRS, 3G
On-board sensorsAccelerometer, GPS,
CompassCamera, Microphone
Internet
Sensors (Location, Audio , Camera, …)
Gateway (Stand-alone Device / Mobile Phones)
Backend Server & database
Portal
USB, CAN, Zigbee, BT, NFC, WiFi
GSM/GPRS, 3GOther InterfacesBluetooth and USB
Internet2G/GPRS
On-board sensorsMicrophone, Camera
Basic Phone
Smart Phone
6
Sensor Penetration in Indian Mobile Phones
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7
Bluetooth
USB
Edge
GPRS
Wifi
3G
Camera
GPS
Accelarometer
Digital Compass
Basic Phones
0 0.2 0.4 0.6 0.8 1
Bluetooth
USB
Edge
GPRS
Wifi
3G
Camera
GPS
Accelarometer
Digital Compass
Smart Phones
7
Power Consumption using Sensors
Source: Nericell: Rich Monitoring of Road and Traffic Conditions using Mobile SmartphonesPrashant Mohan et. al., Microsoft Research, SenSys 2008, North Carolina, USA
8
Intelligent Transportation Solutions
Use of Sensors on Mobile Phones• Road Condition Monitoring
Internet
Sense Extract Analyze Respond
9
Road Condition Monitoring – Smart Phones
TechnologySense• Accelerometer / GPS in the Smart Phone in CarExtract• Phone-orientation Correction• Feature Extraction /Anomaly DetectionAnalyze• Learning-based Classification• Multi-user FusionRespond• Road Condition Map to municipal authority• Pothole alert to end-user
Use Case• Road Condition Monitoring (Potholes, Bumps, Rough
Roads)
Value-add• Low-power Analytics on mobile phones• Processing at Mobile Phone to reduce Internet Data
Transfer• Privacy Preservation through Identity masking• Enhanced classification Accuracy
10
Road Condition Monitoring – Results
Other Applications• Driving Behavior Analysis for dynamic insurance• Road Condition / Driving Behavior assisted Vehicle
Prognosis• Bridge Condition Monitoring
Implemented in ANDROID Phone
11
11
InternetServer
(Head End)
Energy Distribution
Line
Smart Meter
Television
Washing machine
Refrigerator
Zigbee Coordinator
Home Area Network (HAN)
Home Monitoring Gateway using Set top Box
SubMeter
SubMeter
SubMeter
Thermal / Optical IP Camera
Water Leakage Sensor
WiFi / Ethernet
Sense and Extract
Analyze and Respond
12
Intelligent Home Solution using Home Monitoring Gateway
TechnologySense• Energy (Water) Meter / Sub-meter• Water leakage sensor and Thermal CameraExtract• Noise CancellationAnalyze• Demand-supply response• Anomaly detectionRespond• Aggregated demand forecast to utility company• Historical Consumption / Analytics view to
consumer• Water / Electrical Problem alert to Insurance
company• Remote Electrical Appliance on-off Control
Use Case• Monitor Electricity Consumption, Control
Electrical Appliances, Monitor Water Leakage, Monitor Faulty Electrical Wires
Value-add• Low-cost solution using TV as monitoring screen• Appliance level monitoring and control
13
Application Screen-shots
Energy View Home Page Daily Consumption
Weekly Consumption Configuration
14
Intelligent HMI
Ongoing Work • User context-aware HMI• Kinect based multimodal UI using visual gesture and directional audio• EEG based BCI
Four screens of our life • PC• Television• Mobile• In-car display
15
Conclusion
• Use of Mobile Phones and Television – the two most ubiquitous devices in our life as Internet-of-Things Gateway
• Intelligent Transportation Applications using Mobile Phone as a Gateway
Sensor Penetration in Basic Phones and Smart Phones Power Consumption Considerations Privacy Protection
• Home Monitoring Applications using Set top Box as a Gateway
Gateway Functionality for Energy Monitoring and Surveillance Applications
TV as a display device Appliance level monitoring and control
• Intelligent HMI
