mobile and wearable applications at uwf itenwired2015

Mobile and Wearable Applications at University of West Florida

Janusz ChudzynskiiTenWired Summit

October 2015

About MeResearch Associate at University of West FloridaTaught multiple editions of iOS programming course at UWFDeveloper of mobile and web applications for various platforms, including: iOS, Android and BlackberryAuthor two e-books about programming iOS applications

Owner of software development company Izotx LLC.

EducationUniversity of West Florida M.Sc Computer Science Software EngineeringWarsaw University of Technology M.Sc Management and Production Engineering

History

Mobile Presence at UWFMobile Web Native Mobile

Applications

Afghanistan App

+ + = ?

Attendance App

Flashcards

Gamification: FractioThis iPad app was created thanks to combined effort of Academic Technology Center, School of Education, Computer Science Department and North Carolina State University

App helps students (grades 3-6) with learning concepts of fractions. What distincts the app from others is that is aligned with Common Core State Standards for Mathematics.

Teachers and students could use this app for teaching and learning of concept of fractions. It’s currently available on the app store.

iBeacons

iBeaconiBeacon is a name of technology that is enabling new location awareness possibilities for estimation of proximity to a beacon [1] .

Leveraging Bluetooth Low Energy (BLE), a device with iBeacon technology can be used to establish a region around an object. This allows an iOS device to determine when it has entered or left the region, along with an estimating distance to the iBeacon device.

How does it work?

1

2 3

1. User enters the beacon’s region2. App recognizes it and starts

approximating its distance from/to the beacon

3. App identifies an iBeacon, it’s proximity and displays data related to it

iBeacon Use CasesRetailContextualized deals:based on time, location, clientMonitoring Shopping Behaviorstoring and analyzing data about customer’s behaviorIndoor Mapping

EducationContextual learning can be used in libraries, art museums, scavenger hunts, student orientation

HealthcareIdentifying location of patient, doctor.

Social/DatingDetecting users with the same preferences nearby

HospitalityAutomated check in

Supported HardwareAny device capable of connecting with BLE is capable of interacting with the iBeaconsApple:● iPad Mini or later● iPhone 4s or later● iPod Touch 4th generation or later● iPad 3rd generation or later● Mac Book Air, Mac Book Pro, Mac Pro with BLE

Android● Google Nexus 4,5,7,10● Samsung Galaxy

iBeacons are in hundreds of million devices around us!

Projects1. Hospital Notifications. Implemented in Miami’s

Hospital2. Tracking hospital personnel: improving quality of

patient care3. Tracking patients of Senior House Living

iGerm● Deployed in Hospital of

Miami● Available on the AppStore● Shows hand-hygiene

related notifications to triggered by the beacons

● contains database of hand-hygiene questions

Nursing Simulation Lab

System Components

System Components

iBeacons

Tracking Activity

Wearables

Wearable Devices in Education

Pebble Time Steel

EEG Headbands

Jawbone

Google Glass

Wearables - WatchesApplications:● Polling● Quizzes● Notifications● Identifying and tracking students

Glasses: Augmenting RealityDevices:● Google Glass● HoloLensApplications● visualizing work● immersive trainings● collaborationhttps://www.youtube.com/watch?v=xgakdcEzVwg (2.41)

Brain-Computer InterfaceAnother communication and control option in the interaction between users and systems

Applications● Assistive care providing an alternative communicative

medium for whose cannot use a keyboard or mouse● Gaming● Training and education - measuring and training

plasticity of the brain

BCI History● 1924 : Hans Berger, a German neuroscientist, discovers the electrical activity of the human brain with EEG

● 1970: Defense Advanced Research Projects Agency of USA initiates program to explore brain communications

using EEG

● 1976: UCLA’s Brain Computer Interface Laboratory provides evidence that single trial visual evoked potentials

could be used as a communication channel effective enough to control a cursor through a two-dimensional

maze. Profess or Jacques J. Vidal coins the term BCI.

● 1998: First (invasive, non-EEG) implant in the human brain that produces high quality signals

● 1999: BCI is used to aid a quadriplegic for limited hand movement

● 2002: Monkeys are trained to control a computer cursor

● 2003: First BCI game is demonstrated to the public (BrainGate)

● 2005: Monkey brain controls a robotic arm

● 2008: Voiceless phone calls are demonstrated (The Audeo – TI developers conference)

EEG electroencephalogramEEG is a “A test that detects electrical activity in your brain using small, flat metal discs (electrodes) attached to your scalp.” Your brain cells, also known as neurons, communicate via electrical impulses and are active all the time

The average human brain has about 100 billion neurons, an EEG test can track changes in neuron activity that may be useful in diagnosing brain disorders.

It can’t read your mind, but it can tell about your general state.

Raw Data, EEG Band Frequencies An EEG has different “bands”, defined by the frequency of the waves;

● delta (slow) waves are less than 4 Hz; ● theta bands are 4-8 Hz; ● alpha bands range from 8 to 12 Hz; ● beta bands are anywhere from about 14-30 Hz, ● gamma bands range from 30-80 Hz.

Each of these bands are associated with different states of mental activity.

EEG BandsGamma Waves

● Too much: Anxiety, high arousal, stress

● Too little: ADHD, depression, learning disabilities

● Optimal: Binding senses, cognition, information processing, learning, perception, REM sleep

Beta Waves

● Too much: Adrenaline, anxiety, high arousal, inability to relax, stress

● Too little: ADHD, daydreaming, depression, poor cognition

● Optimal: Conscious focus, memory, problem solving

Alpha Waves

● Too much: Daydreaming, inability to focus, too relaxed

● Too little: Anxiety, high stress, insomnia, OCD

● Optimal: Relaxation

Theta Waves

● Too much: ADHD, depression, hyperactivity, impulsivity, inattentiveness

● Too little: Anxiety, poor emotional awareness, stress

● Optimal: Creativity, emotional connection, intuition, relaxation

Delta Waves

● Too much: Brain injuries, learning problems, inability to think, severe ADHD

● Too little: Inability to rejuvenate body, inability to revitalize the brain, poor sleep

● Optimal: Immune system, natural healing, restorative / deep sleep

Neurosky Mobile● It’s one of the cheapest options on the

market. ● It measures:

○ attention ○ meditation○ raw brainwave data.

● It comes with the SDK(Software development kit) which allows developers to create new applications for it.

BCI Applications

Visualizer Mindometer

ChallengesIt’s a future but...● Usability● Quality, reliability of the data● To do more advanced applications requires

training and calibration● Integration with existing systems

Questions?Janusz Chudzynski

Email:janusz@izotx.comjmc@uwf.eduTwitter:@appzzmanPresentation’s URLhttps://docs.google.com/presentation/d/1-o0yey6KQXu5QnNdhiHqBF5tsw41EwQ7I5PbrBySvHw/edit?usp=sharing

References and resources1. https://developer.apple.com/ibeacon/Getting-Started-with-iBeacon.pdf2. http://en.wikipedia.org/wiki/Bluetooth_low_energy3. http://developer.apple.com4. http://www.cdc.gov/handhygiene/Guidelines.html5. http://www.healthit.gov/policy-researchers-implementers/safer/guide/sg0066. http://www.forbes.com/sites/anthonykosner/2013/12/15/the-internet-of-ithings-apples-ibeacon-is-already-in-

almost-200-million-iphones-and-ipads/7. http://www.slideshare.net/TheMarketingDistillery/iot-presentation8. http://postscapes.com/what-exactly-is-the-internet-of-things-infographic9. http://venturebeat.com/2014/06/11/the-6-challenges-of-building-an-ibeacon-app/

10. http://www.bizjournals.com/atlanta/blog/atlantech/2014/09/at-t-says-it-plans-to-serve-10-million-connected.html

11. http://postscapes.com/internet-of-things-resources/12. http://electronicdesign.com/embedded/understanding-protocols-behind-internet-things13. http://lifesciences.ieee.org/articles/114-brain-computer-interfaces-beyond-medical-applications14. http://www.emergingedtech.com/2014/04/imaging-the-classroom-of-2016-empowered-by-wearable-

technology/15. http://keypathedu.com/en/blog/5-ways-wearable-tech-will-be-used-higher-education16. Make a mind controller Arduino Robot Tero Karvinen - Kemmo Karvinen