[ieee 2011 ieee international conference on pervasive computing and communications workshops (percom...

Download [IEEE 2011 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) - Seattle, WA, USA (2011.03.21-2011.03.25)] 2011 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops) - Home automation and security for mobile devices

Post on 15-Dec-2016




1 download

Embed Size (px)


  • Home Automation

    Somak R. Das*, Silvia Chita

    * Massachusetts Institute of Tec* das@mit.edu, {sch

    AbstractAs mobile devices continue to grow ifunctionality, the demand for advanced ubiquitcations in our daily lives also increases. This papdesign and implementation of HASec, a HomeSecurity system for mobile devices, that leveranology to provide essential security to our homcontrol operations. In particular, with the help HASec operates and controls motion detectors afor remote sensing and surveillance, streamsrecords it for future playback, and finally manahome appliances, such as turning ON/OFF a telwave or altering the intensity of lighting arounproposed home security solution hinges on our of cameras and motion detectors into a mobileinstance, when motion is detected, the camerinitiate recording and the iOS device alerts the hpossible intrusion. HASec has two main compowith each other: the iOS application that execudevice and server-side scripts that run in a clouSec is implemented for Apples iOS devices sucTouch, and iPad, it can be easily ported to oforms. Furthermore, our application is not onlyphones but also can be used by feature phonbrowsers.

    Keywordssmartphone application; iOS appcurity; home automation; mobile cloud computing

    I. INTRODUCTION Mobile phones have become ubiquitous

    Smartphones have wide applications in varioas education, fitness and healthcare, entertnews, and business, due to their easy accessBerry App World, Apples App Store, Googleket, or Windows Marketplace for Mobile. Howof our knowledge, there is no application asmartphones that combines home automation a

    Leveraging the capabilities of smartphonedeveloped, and implemented an iOS applicaSec (shown in Figure 1), that integrates HomeSecurity capability into mobile devices. Our aaccessible through a web browser. The advaproach is twofold: (i) it makes the applicationthe mobile operating system, vendors, and cacan be extended to feature phones that do notpabilities of smartphones but have built-in bro

    Specifically, HASec makes the following cit operates and controls motion detectors anfor remote surveillance through mobile devicstreaming live video from the remote camer

    This work is partially supported by NSF-REU grant II

    n and Security for Mobil, Nina Peterson, Behrooz A. Shirazi, and Medha Bchnology, Washington State University, LewisClark Shita, shirazi, medha}@eecs.wsu.edu, nmpeterson@lcsc.e

    in popularity and tous mobile appli-per deals with the

    e Automation and ages mobile tech-

    mes and associated of mobile devices,

    and video cameras s live video and

    ages operations on levision or micro-nd the house. The

    novel integration e application. For ras automatically homeowner of the onents interacting utes on the mobile ud. Although HA-ch as iPhone, iPod ther mobile plat-

    y limited to smart-nes through their

    lication; home se-g; sensors

    s in our society. us domains such tainment, travel, s through Black-es Android Mar-wever, to the best available yet for and security.

    es, we designed, ation, called HA-e Automation and application is also antage of this ap-n independent of arriers, and (ii) it t have all the ca-


    contributions: (a) nd video cameras ces; (b) it enables as to mobile de-

    vices; (c) it enables recording vidplayback; and (d) it controls and through mobile devices.

    Figure 1. A system overv

    The proposed system HASec mactions and movements (RECORD/STtwo cameras in real time. It can listed in the order of their timestampliances (e.g., television, stereo, cand coffee pot), and control the inthouse. HASec can also detect motmotion is detected, it begins to autsends an alert to the users mobile dlive video feed from the cameras device that is integrated with HASintruder is detected, the user can dnutes of video from a camera for idand thus turn on lights and stereo tis to provide a comprehensive intshelf, widely available electronics toand security with user-friendly instaing to greater user adoption and rete

    HASec incorporates several decloud, and mobile software. It usestion, cameras for remote viewing adata storage and intermediary interfour implementation an iPhone, iPodthe iOS application as the human imented as a clientserver model, inas the client using our application wthe cloud. All external devices, sumotion sensors, are connected to ththe X10 control protocol [8].

    This paper is organized as follosystem overview of HASec. Sectio


    le Devices Bhadkamkar State College edu

    deos on a server for future manages home appliances

    view of HASec.

    manipulates and controls the TOP and PAN/TILT) of up to playback video recordings

    mps, turn ON/OFF small ap-computer monitor, toaster, tensity of lights around the tion through sensors. Once tomatically record and then device. The user can view a

    and remotely control any Sec. For instance, when an ecide to record several mi-dentification of the intruder to deter him. HASecs goal tegration of cheap off-the-o provide home automation allation and interface, lead-ention.

    evices, user interfaces, the s sensors for motion detec-and recording, a server for face, and mobile devices (in d Touch, or iPad) executing interface. HASec is imple-

    n which the iOS device acts while the server is located in uch as cameras, lights, and e server directly or through

    ws. Section II provides the ons III and IV respectively

    1st IEEE PerCom Workshop on Pervasive Communities and Service CloudsU.S. Government work not protected by U.S. copyright 141

  • describe the server and client components, their specific func-tionalities, related challenges, and our proposed solutions. The performance evaluation of our system is presented in Section V, followed by a discussion of related works in Section VI. Concluding remarks are offered in Section VII.

    II. SYSTEM OVERVIEW For home automation, we chose to use X10 power line

    communication (PLC) [1] technology due to its popularity and also ease of installation since it requires no additional wiring. Controllers and controlled modules (lighting and appliances) utilize the existing power line and thus are simply plugged into the existing power outlets.

    HASec is implemented with Apples mobile devices due to their increasing popularity among consumers [7]. However, since we used web technologies to implement the application server, our proposed solution can be easily ported to any smartphone from other vendors, such as Android or Windows Phone. Furthermore, HASec is not only limited to smart-phones but also can be accessed via built-in browsers used by any other mobile devices.

    Figure 2 describes HASecs software architecture, while Figure 3 displays the hardware components and implementa-tion, including the communication between the devices, the server, and the client. As shown in Figure 2, we divide the software architecture into the four layers: application, web server, programs, and data storage. Each of them is further broken down into smaller entities with unidirectional or bidi-rectional communication links.

    We set up an Apache HTTP Server [2] with open-source XAMPP [9] web-server package. Although our application uses web technology, we chose to implement it as a native iOS application rather than a web application. We plan to add con-text-aware features to HASec, and only a native application can access the iOS devices own sensors, like GPS.

    HASec follows the clientserver architecture model. Video is streamed from the server to the client, while commands and controls are sent from the client to the server. When necessary, alerts are sent from the server to the client.


    A. Control of Cameras Since HASec provides the user the flexibility to choose any

    type of video-capture devices (e.g., webcams linked either internally or externally to the server, or IP cameras in the cloud), we had to account for each of their distinct design de-tails and adapt a solution that would seamlessly integrate them into one cohesive application. Of the two types, generic web-cams were more difficult to implement since they presented a unique challenge to allow the user to simultaneously view and record live video. We coded a video-capture program in C++ that responds to RECORD/STOP commands using DirectShow, Microsofts multimedia framework and API [6]. It records video to an AVI file, which is then converted to a playable MP4 file with FFmpegs open-source multimedia converter.

    If the user is only allowed to view live video without the option to also record, as done by other applications, the im-plementation would have been relatively simple. However, our goal was to provide the user with the flexibility to record the stream while viewing it on the mobile device. The problem we encountered was that the stream could not be viewed until the

    Cameras Appliances Recordings

    IP Camera

    Server-Side Scripts and Web Pages

    Motion DetectorC++ Video-Capture

    Program and FFmpeg (open-

    source converter) VLC media player


    X10 ActiveHome Pro SDK

    (COM object)

    iUI (open-source

    UI library)

    Microsoft DirectShow(multimedia framework) Videos

    Video-CaptureDevice/Webcam Lighting & Home


    Application (tabs)

    Web server


    Data storageFigure 3. Communication between hardware components.

    Figure 2. Software architecture of HASec. 142

  • recording had stopped. We overcame this challenge by invok-ing the open-source VLC media player (from the script for controlling cameras) to access the input stream via Direct-Show, duplicate it, and process it in the following two ways:



View more >