codename: imagination kieve. fyp presentation – the finale! 24.04.08 project team : syed waqas a...
TRANSCRIPT
![Page 1: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/1.jpg)
codename: imaGInation KIeve
![Page 2: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/2.jpg)
FYP Presentation – the Finale!24.04.08
Project Team :Syed Waqas A Burney, 2004185, FCSE (Team Lead)Mutahira Ikram Khan, 2004136, FCSE
Project Advisor :Mr. Badre Munir, FCSE
![Page 3: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/3.jpg)
Agenda :
Core ProgenyProject ObjectiveProject ModularizationThe System
Overview Architecture Module 1 – Motion Detection & Human Activity Monitoring Module 2 – The Decision Making Software Engine Module 3 – Appliance Control Mechanism & Prototype Modeling
Project StatusEnvisioning Ahead
vSmart Demo
![Page 4: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/4.jpg)
Core Progeny
Computer Vision The branch of applied computing that concerns modeling and
developing artificial systems that attain information from images and thereby provide useful functionality and results.
Domotics Study of specific automation requirements for homes and
application of automation techniques for the comfort, convenience and security of the residents
Development Platform :.NET 2.0 Framework (C#) Visual Studio 2005 MS SQL
Server 2005
![Page 5: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/5.jpg)
Objective
Prototyping an integrated system for the smart control of domestic electronic appliances in local environments, based on monitored user presence and activity; thereby achieving multidimensional user-convenience and using modern technology to endow a sustainable environment in our everyday lives.
Applications :User Convenience and Energy Saving Offices (lunch hours, after-office timings, etc) Houses (the ‘Digital Home’ concept)
![Page 6: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/6.jpg)
Modularization (and timeline)
Problem Statement Ideation through innovative techniques/lateral thinking/ brain storming Engineering solutions, and thereby outlining the very FYP definition, field &
scope
Adopting a research based/experimental approach System design
Motion detection and respective human activity monitoring Prototype modeling
Serially interfaced appliance control mechanismDecision taking software engine– a multi-threaded expert
system
Optimization and deployment Completion
No
vJ
un
De
cJ
an
Ma
rA
pr
cod
enam
e: imaG
Inatio
n K
Ieve
![Page 7: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/7.jpg)
System Overview
Module 1 Human Activity Monitoring (Input)
Module 2 The Software Engine
(Processing)
Module 3Appliance Control (Output)
CMOS Webcams
Local Environment
![Page 8: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/8.jpg)
System Architecture
![Page 9: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/9.jpg)
System ArchitectureM
OD
UL
E 1
MO
DU
LE 1
![Page 10: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/10.jpg)
Module 1Motion detection and respective human activity monitoring
System Deployment Multi-Camera Registration & Deployment HotSpot Marking Utility System GUI
System Initialization Motion Detection MER Formation
Multi-Threading
![Page 11: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/11.jpg)
Module 1 (cntd..)Motion detection and respective human activity monitoring
Critical Difficulties Encountered– Camera Zoom [View Angle , Shadows]
Camera Mounted in Room Camera Mounted in the Model
![Page 12: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/12.jpg)
Module 1 (cntd..)Motion detection and respective human activity monitoring
Prototype Environments : Room (Hostel); Model House
Image Capture Devices : CMOS Webcam; 640 x 480 pixels; Frame Rate: 30 fps; View Angle: 54
degrees
Platform : .NET 2.0 based Aforge C# Framework (open source)
Using the AForge.Imaging & AForge.Vision libraries[http://
code.google.com/p/aforge/]
![Page 13: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/13.jpg)
Module 1 (cntd..)Motion detection and respective human activity monitoring
User Detection Approach : Current–Previous, Current–First Algorithm Blob Motion Algorithm
Capturing Results : MER (Minimum Enclosed Rectangle) Drawing (.NET Imaging
Library) Weighted Average, K-Means/K-Means ++ Algorithm
Activity Monitoring : Initial Hotspot outline by the User on the S/W (.NET Imaging
Library) Hotspot & MER Overlap Detection using Crossing Number Method
![Page 14: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/14.jpg)
Module 1 (cntd..)Motion detection and respective human activity monitoring
MER formation for Motion Detection
Hotspot marking by user
![Page 15: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/15.jpg)
Module 1 (cntd..)Motion detection and respective human activity monitoring
Multi-Cam Supportive GUI
User-friendly Camera Registration
Spawning Threads for Concurrent Multi-User Support
![Page 16: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/16.jpg)
System ArchitectureM
OD
UL
E 2
MO
DU
LE 2
![Page 17: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/17.jpg)
Module 2Decision taking software engine – an expert system
Knowledge Base Design
Action Triggering Overlap Calculations Other Parameter Calculations
Reaction Generation
Serial Transmission
![Page 18: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/18.jpg)
Module 2Decision taking software engine – an expert system
The brain of the system– responsible for the actual “monitoring”
Decides when to turn off what
Expert System : Defining classes for rules Having defined facts in a relational database Using inference techniques to judge which rules, based on user activity,
stand, and hence which devices are to be respectively switched off Rules and Facts subject to changes and modifications based on user
behavior
Overview : Small scale expert system with a dynamically adjusting
knowledge base
![Page 19: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/19.jpg)
System ArchitectureM
OD
UL
E 3
MO
DU
LE 3
![Page 20: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/20.jpg)
Module 3Serially interfaced appliance control mechanism
Connection to Devices : Serial port communication via RS232 Microcontroller Interface circuitry Device Model House.
Microcontroller
Interface Electronic Devices
Computer
RS232
![Page 21: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/21.jpg)
Module 3Serially interfaced appliance control mechanism
Trainer Board Circuitry Vero Board Circuitry
![Page 22: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/22.jpg)
Module 3Serially interfaced appliance control mechanism
![Page 23: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/23.jpg)
Module 3Serially interfaced appliance control mechanism
Serial Communication Data is transmitted to the microcontroller via RS-232 standard DB- 9 connector is used to connect to the microcontroller Hardware circuitry ATMEL 89C51 MAX 233 2n222 Transistors Diodes 6 volt relays Capacitors Resistors
![Page 24: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/24.jpg)
Module 3Serially interfaced appliance control mechanism
Circuit : Part I
![Page 25: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/25.jpg)
![Page 26: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/26.jpg)
Module 3Serially interfaced appliance control mechanism
Circuit : Part II (implemented on Veroboard)
![Page 27: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/27.jpg)
![Page 28: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/28.jpg)
Module 3 (cntd..)Serially interfaced appliance control mechanism
Microcontroller ( ATMEL 89C51): Receives data serially from computer port Processes the data Sends data to its port to which devices are connected Turning relays on and off
MAX 233 RS-232 not compatible with today’s microcontrollers Line driver to convert RS-232 signal to TTL logic levels
Interface Circuit : BJT based Relay-Driver (2n222):
It provides sufficient current to drive the relay Diode :
When the relay is switched off, magnetic field generated inside produces a high voltage, which can damage circuit
Diode prevents short circuiting when the relay is switched off
![Page 29: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/29.jpg)
Module 3 (cntd..)Serially interfaced appliance control mechanism
Interface Circuit (cntd..) : Resistor :
It prevents flow of high current from the transistor to the ground on the application of VCC
Relay : Mechanical relay is used to switch device off
![Page 30: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/30.jpg)
Modeling the PrototypeThe Model House (realistic cut-scale)
Model Specifications: 3.5‘ x 3.5‘ x (equivalent height) Two bedroom house (1.5‘ x 1.5') Double-walled structure with the outer walls removable The house is raised 1 feet in height, by supports, for magnet
movements Test Men with magnets are used to depict movements in the household
Outer
Slide-Up-and-Removable
WallsNormal Walls
Wiring concealed in between by the removable Outer Wall
ROOM
![Page 31: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/31.jpg)
Modeling the Prototype (cntd..)The Model House
House Dimensions: 3.5’ x 3.5’ x 2’ Room Dimensions: 1.5’ x 1.5’ x 8”
![Page 32: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/32.jpg)
Modeling the Prototype (cntd..)The Model House with Domestic Appliances Installed
Installed Appliances: Room Lights, Room Fan, Bed-side Lamp & Study-table Lamp
![Page 33: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/33.jpg)
(Work-based) Modular Completion Status
Module 1 : Motion detection and respective human activity monitoring
System Deployment Multi-Camera Registration & Deployment HotSpot Marking Utility System GUI
System Initialization Motion Detection MER Formation
Multi-Threading (debugging issues!)
Module 2 : Decision taking software engine – an expert system Action Triggering
Overlap Calculations Other Parameter Calculations
Knowledge Base Design Reaction Generation Serial Transmission
Module 3 : Serially interfaced appliance control mechanism Trainer/Vero-board Circuit Designing Microcontroller Interpretation Electrical Interfacing of Appliance System Optimization
![Page 34: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/34.jpg)
Envisioning Ahead
Microsoft Imagine Cup 2008
GIKI Participation @ Different Technology Competitions ~ Softec ’08
Submissions on Various Research-based Platforms for Domotics
Video Documentation
![Page 35: Codename: imaGInation KIeve. FYP Presentation – the Finale! 24.04.08 Project Team : Syed Waqas A Burney, 2004185, FCSE (Team Lead) Mutahira Ikram Khan,](https://reader037.vdocuments.mx/reader037/viewer/2022110320/56649cba5503460f9498243d/html5/thumbnails/35.jpg)