![Page 1: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/1.jpg)
Amigo in Hindsight
Maddy D. Janse
January 2012
Amigo in Hindsight
Lessons learned
![Page 2: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/2.jpg)
Content
Lessons learned
1. Intelligent home environments
2. Vision and timing
3. User-centered approach
4. Complexity at many levels
5. System and application
Maddy D. Janse, November 2012
5. System and application
developers needs
6. Creating impact
7. Technology moves on
8. Differences in time to market
![Page 3: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/3.jpg)
Lesson 1
Intelligent Home
Environments
Tati
1958
Maddy D. Janse, November 2012
Old concept !!!!!!!!Amigo
2008
![Page 4: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/4.jpg)
Intelligent Home anno 1958
Context
Maddy D. Janse, November 20124
Products
Agents
![Page 5: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/5.jpg)
Lesson 2
Vision and Timing
huge discrepancy
between
Maddy D. Janse, November 2012
research and reality
![Page 6: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/6.jpg)
Future Enabling Applications
User content
User content
Maddy D. Janse, November 20126
CommunicateShare experiencesBe entertained
TV, STB, phone, uWand, AmbX, photo frame,…
Devices
between
![Page 7: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/7.jpg)
Amigo Home Network
Access ControlFirewall
Home Gateway
Internet
Wired backbone(Ethernet)
Wireless infrastructure(WLAN)
Maddy D. Janse, November 2012
Home Gateway
Home Control
(WLAN)
Personal network(Blue tooth)
Home control network(Power line)
![Page 8: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/8.jpg)
Intelligent Home: Reality in 2004
Different Domains - Not Interoperable -
PC domain
Cable or 802.11
Blue tooth
Maddy D. Janse, November 2012
CE domainHome automation
PC domain
Mobile domain
![Page 9: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/9.jpg)
Services: To the Home
• down/up loading content
Maddy D. Janse, November 2012
Not Not withinwithin the homethe home
Not Not betweenbetween homeshomes
• down/up loading content
• Internet
• communication
– email, chat, voice-IP, skype• multi-user gaming
• adaptation of personal content
– photo, video• customization
– ring tones, wallpaper
![Page 10: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/10.jpg)
End-Users
Do not distinguish between the
sharing ambience and activities
Maddy D. Janse, November 2012
Do not distinguish between the
technical Amigo domains
Desire control over the overall
comfort and social integrity of their
home environment
Interoperability is obvious and natural
for users
pictures and text docs
![Page 11: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/11.jpg)
Project Goals
Service oriented architecture for intelligent future home networks,
• use available context information
• use different devices
• provide intelligent and attractive user services
Maddy D. Janse, November 201211
• provide intelligent and attractive user services
• compose and integrate new devices and services
Enable the development of context-aware applications
• provide users with experience sharing, social presence,
and responsive home environments
• extend their home to other homes, car, hotel, office, ….
![Page 12: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/12.jpg)
Amigo ProjectIST-2004-004182
Philips
Maddy D. Janse, November 201212
VTT , Telematica Instituut
Fraunhofer, Microsoft,
Univ. Paderborn, INRIA,
France Telecom, Italdesign
Fagor, Ikerlan, Telefonica
LogicDis, ICCS
42 Months (Sept04 – Feb08)2021 Person months4 Home labs
![Page 13: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/13.jpg)
Lesson 3
User-centered Approach
Maddy D. Janse, November 2012
• field studies
• user needs: caring & sharing
• requirements
• scenarios
• storyboards
• personas
![Page 14: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/14.jpg)
Keep in mind
• ‘‘‘‘You can’t just ask customers what
they want and then try to give that to
Responses
• based on past and current
experiences
• questionable fit for the project
objectives and context
But
• crucial for project team,
Maddy D. Janse, November 2012
they want and then try to give that to
them. By the time you get it built,
they‘ll want something new’’’’
• ‘‘‘‘It's really hard to design products
by focus groups. A lot of times,
people don't know what they want
until you show it to them’’’’
Steve Jobs
– to gain end-user insights
• essential for getting
– user requirements
– evaluation procedures
and criteria
– design iterations
![Page 15: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/15.jpg)
Lesson 4
Complexity at many
levels
Difference in perception
• user needs & requirements
• system requirements &
specs.
• developer visions &
implementations
Maddy D. Janse, November 2012
taming technology
Underestimated challenge
• huge number of variables
• causing an exploratory
explosion of problems
![Page 16: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/16.jpg)
Complexity for User
Maddy D. Janse, November 2012
![Page 17: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/17.jpg)
Complexity for Developers
Building blocks & subsystems Toolkits
Maddy D. Janse, November 201217
![Page 18: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/18.jpg)
Complexity in Communication
Access ControlFirewall
Home Gateway
Internet
Wired backbone(Ethernet)
Home Control
Wireless infrastructure
(WLAN)
Maddy D. Janse, November 201218
Personal network(Blue tooth)
Home control network(Power line)
![Page 19: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/19.jpg)
Middlewarebuilding blocks
Lesson 5
System & application
developers needsdeplo
ym
ent
fram
ew
ork
context-aware applications
Maddy D. Janse, November 2012
Smart homes are dynamic
environments
deplo
ym
ent
fram
ew
ork
base middleware
intelligent user services
• interoperability framework
• service oriented architecture
![Page 20: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/20.jpg)
Base Middleware
• service discovery and interaction
interoperability
• enhanced discovery and service
composition
• domotic infrastructure
Maddy D. Janse, November 2012
• functionality for networked
environment
• Open Source Software• security and privacy
• content distribution / data store /
QoS
![Page 21: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/21.jpg)
Intelligent User
Services
• context management
• broker
• source
• wrapper
• reasoner
• history
• user modeling and profiling
Maddy D. Janse, November 2012
• functionality for ambient environment
• user modeling and profiling
• awareness and notification
• user interface services
• privacy and personal security
![Page 22: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/22.jpg)
Programming &
Deployment
Framework
• reduction of programming effort
• enforcing interoperability
• common set of protocols
– discovery
– remote procedure calls
Maddy D. Janse, November 2012
• no care about underlying
protocols
– remote procedure calls
– asynchronous event delivery
![Page 23: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/23.jpg)
Service Oriented
Architecture
• on demand
– development
discover
client
Maddy D. Janse, November 2012
– development
– delivery
– use
• loosely coupled components
• dynamic configuring of services and devices
• multiple protocols
– discovery: UPnP, SLP, WebServices
– interaction: RMI, SOAP
use
advertise
network
service
![Page 24: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/24.jpg)
Domotic Service
• expose devices as UPnP or Web
API’s, protocols, networks (e.g., BDF)
low level drivers
Maddy D. Janse, November 2012
• expose devices as UPnP or Web
services
• low-level and high-level drivers
are completely decoupled
– depend only on common
specification
UPnP
devices
Web
services
UPnP factory WS Factory
commonspecification
high level drivers
![Page 25: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/25.jpg)
Context
Management
Service
Maddy D. Janse, November 2012
• open infrastructure
• acquires information from various
sources
– physical sensors,
– user activities,
– applications
• abstracts into "context information"
• provides to context aware services
Interpreting low level context
to high level context
![Page 26: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/26.jpg)
Use-it
• training modules and tutorials for
all SW modules
• available on the Amigo website
Example of how to start building an
application:
1. deployment framework,
• discovery mechanism &
ontologies
• context management service
Maddy D. Janse, November 2012
• available on the Amigo website
• easy to build an Amigo service
– ~ 1 day
• understanding the concepts takes
longer
– ~ weeks
2. security & enhanced discovery
• user modeling & profiling service
• awareness & notification service
3. user interface service
• community sharing service
![Page 27: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/27.jpg)
Lesson 6Create Impact
Must have examples
• timely, • relevant • appropriate • easy to understand
Maddy D. Janse, November 2012
Exploit applications & services
Trade-off between stakeholders and developers
• illustrative for showing technical tour de force
• do-able and achievable
• Customized to your client needs!!!!!!!!!!!!!!!!!!
![Page 28: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/28.jpg)
Appliances
Management
• appliances exchange information and communicate via existing power
Maddy D. Janse, November 2012
and communicate via existing power lines
• use case examples:
– programming appliances from mobile devices
– creating scenes like wake-up in the morning and setting the toaster and coffee machine
– holidays settings at home
![Page 29: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/29.jpg)
Daily Life Cycle
Monitor
• monitors the behavior of inhabitants
Maddy D. Janse, November 2012
• monitors the behavior of inhabitants
• data from different sensors and information from Amigo middleware services
• detects deviations from normal behavior and takes appropriate action
• components
– domotic gateway
– history database
– behavior analyzer
– outlier detector
– controler
![Page 30: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/30.jpg)
Food Management
• each user’s
– personal preferences
Maddy D. Janse, November 2012
– personal preferences
– health diets
– burned calories
– weight evolution
• how many people are going to eat and who they are
• available goods in the fridge.
• expiration date of the products
![Page 31: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/31.jpg)
Home Information &
Entertainment
• Amigo Box applications
• Standard protocols: wifi,
Maddy D. Janse, November 2012
• Standard protocols: wifi,
ethernet, UPnP
• applications are web-based
• no need to buy new devices to
connect
• any device with a web browser
will do
• Home agenda
• MyNews
• Media Manager Core
• Multimedia manager
• Context-dependent
personalization
![Page 32: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/32.jpg)
Home-to-HomeUPnP
router
My Home
Maddy D. Janse, November 2012
feel at home
• have access to your services
– applications can use
exported services just like
local services
Your Home
UPnP
router
![Page 33: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/33.jpg)
Away-not-Away
• sharing presence and activities
Maddy D. Janse, November 2012
• independent of location and
devices
– using TV with PC, TV with
hotel-TV, or mobile with TV,
etc.
![Page 34: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/34.jpg)
Lesson 7Technology moves on
Now, but not then
• Sensor network technologies• Web 2.0 • .NET• Social networking
Stay up to speed
Maddy D. Janse, November 2012
Fast
Technology moves onStay up to speed
• Be adaptable and flexible• to R&D community
• to future market needs
• to end-user customers
• to existing situations
![Page 35: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/35.jpg)
Lesson 8Differences in time to market
Middleware and application
elements have different time to
market
Existing infrastructures
• buildings are ‘hard’
• power lines
• different practices • Timing
Maddy D. Janse, November 2012
Stakeholders and their needs
change over time
• energy consumption
• sustainability concerns
• demographic changes
• elderly homes
• home health care
• nursing homes
• No start from ‘scratch’
• Changing application demands
• Take-up of technology is not about technology
![Page 36: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/36.jpg)
Watch it
Iceberg
Intelligent home environmentsVision and concepts
Management
Maddy D. Janse, November 2012
IcebergUser-centered approachComplexity at many levels
Developers needs
TimingCreating impact
Technology moves onDifferences in time to market
![Page 37: Amigo in Hindsight Lessons learnedtozceleb/WAmIi/Maddy Janse.pdf · Lessons learned 1. Intelligent home environments 2. Vision and timing 3. User-centered approach 4. Complexity at](https://reader034.vdocuments.mx/reader034/viewer/2022050202/5f5596f4d5361a666e0c62af/html5/thumbnails/37.jpg)
System concepts
adaptable
be flexible
Key to Amigo
• unified middleware
• across application domains
• across homes and environments
• connects other networks (e.g.,
sensors)
Maddy D. Janse, November 2012
• interoperable – existing
technologies
• intelligence in the middleware
• reusable by thin applications
• generalized use of semantics
• Open Source Software
infrastructure