self-adaptive prototype for seat adaption

42
RESPONSIVE FLEXIBLE COLLABORATING AMBIENT UNIVERSITY OF PAVIA Self-adaptive Prototype for Seat Adaption 2 nd Perada Workshop @ SASO 2010 Budapest, 28 th September 2010 Gian Mario Bertolotti , Andrea Cristiani, Remo Lombardi Marko Ribarić, Nikola Tomašević, Mladen Stanojević University of Pavia - Italy Institute Mihajlo Pupin, University of Belgrade - Serbia

Upload: unionu

Post on 16-Nov-2023

0 views

Category:

Documents


0 download

TRANSCRIPT

RESPONSIVE FLEXIBLE COLLABORATING AMBIENT

UNIVERSITY OF PAVIA

Self-adaptive Prototype for Seat Adaption

2nd Perada Workshop @ SASO 2010Budapest, 28th September 2010

Gian Mario Bertolotti, Andrea Cristiani, Remo Lombardi

Marko Ribarić, Nikola Tomašević, Mladen Stanojević

University of Pavia - Italy

Institute Mihajlo Pupin, University of Belgrade - Serbia

Gian Mario Bertolotti [2]http://reflect.pst.ifi.lmu.de University of Pavia

Outline

Introduction Detecting uncomfortable positionsReflective middlewareSystem design and componentsSeat adaptation reaction rulesConclusions

Gian Mario Bertolotti [3]http://reflect.pst.ifi.lmu.de University of Pavia

INTRODUCTION

Gian Mario Bertolotti [4]http://reflect.pst.ifi.lmu.de University of Pavia

Introduction

The REFLECT project aims at developing new concepts and means for pervasive-adaptive systems.

http://reflect.pst.ifi.lmu.de

REFLECT researches ways of sensing users and their mood and intentions.

REFLECT is a project funded by the EU Seventh Framework Programme, (ICT Thematic Priority, Challenge 8: Future and Emerging Technologies, Objective ICT-2007.8.2: Pervasive adaptation).

Gian Mario Bertolotti [5]http://reflect.pst.ifi.lmu.de University of Pavia

Introduction

Different aspects are taken into account:

• emotional state,• cognitive engagement,• physical conditions and actions.http://reflect.pst.ifi.lmu.de

All these together with human behavioural patterns form the personal awareness of the system.

Additionally, information about the surroundings is gathered and used to establish environmental awareness.

Gian Mario Bertolotti [6]http://reflect.pst.ifi.lmu.de University of Pavia

IntroductionThe Seat adaptation prototype is a system for identifying and possibly enhancing the physical state (comfort) of end users (drivers).

It monitors the postural behaviour of a car driver, detecting whether he/she feels uncomfortable It acts on the car seat in order to help the driver in finding a more comfortable position.

This prototype is based on the REFLECTive middleware proposed and developed within the REFLECT project.

Gian Mario Bertolotti [7]http://reflect.pst.ifi.lmu.de University of Pavia

Introduction

The REFLECTive middleware aims at providing a common approach for the design, development and deployment of the pervasive adaptive systems.

These systems are sensitive to emotional, cognitive, and physicalstates of the users involved in a particular task or situation.

Gian Mario Bertolotti [8]http://reflect.pst.ifi.lmu.de University of Pavia

Introduction

The pervasive adaptive systems developed using the REFLECTive middleware seamlessly integrate in the environment of their user.

They make use of available physical devices• to sense and derive the state of the environment and user, • to detect the user’s current state, • to enhance the efficiency of a user in performing his/her task

by changing the conditions of the environment to allow a user toperform the current tasks more efficiently.

Gian Mario Bertolotti [9]http://reflect.pst.ifi.lmu.de University of Pavia

Introduction

The seat adaptation prototype uses • the Centre of Pressure (COP) speed to identify the physical state of a driver • the number of bumps as an indicator of the state of road.

This information is then combined with • the car settings• the driver’s cognitive and emotional state.

The system determines whether any action should be performed to enhance the comfort of the driver by modifying the shape of the seat.

The logic described is implemented using reaction rules.

Gian Mario Bertolotti [10]http://reflect.pst.ifi.lmu.de University of Pavia

IntroductionThe seat adaptation prototype is based on a top-level car seat (Ferrari California seat).A dedicated electronic control unit is responsible for controlling all the motors and other actuators the seat is equipped with. The driver, before starting the engine, can easily tune the seat position according to his/her preferences, just by pressing the buttons and joysticks available at one side of the seat itself.

Gian Mario Bertolotti [11]http://reflect.pst.ifi.lmu.de University of Pavia

Introduction

Ferrari California seat is provided with a wide range of adjustments (seat and backseat positions, heating, ventilation…), in particular

• four couples of air inflating cushions: - seat cushions

- backseat cushions - lumbar cushions (high)

- lumbar cushions (low)

The Seat adaptation system acts on these cushionsin order to modify the shape of the seat.

Gian Mario Bertolotti [12]http://reflect.pst.ifi.lmu.de University of Pavia

DETECTING UNCOMFORTABLE POSITIONS

Gian Mario Bertolotti [13]http://reflect.pst.ifi.lmu.de University of Pavia

Detecting uncomfortable positions

Sitting is one of the very first motor activities that human beings achieve. Considered a “motor milestone”, it is studied also from one’s earliest childhood, for example to detect development pathologies such as cerebral palsy (Hedberg et al., 2005; Gesell, 2007; Deffeyes et al., 2009).Localized contact stresses are identified as one of the main responsible of sitting discomfort:

prolonged pressures blood flow reduction at the buttock/seat interface discomfort

http://FreeStockPhotos.com

Gian Mario Bertolotti [14]http://reflect.pst.ifi.lmu.de University of Pavia

Detecting uncomfortable positionsThe terms “Fidgeting” or “In-Chair Movement (ICM)” are used to describe the constant slight posture changes that subjects do while sitting.

An increasing of these movements has been directly linked to an increasing of perceived discomfort. (Hermann, 2005).

Gian Mario Bertolotti [15]http://reflect.pst.ifi.lmu.de University of Pavia

Detecting uncomfortable positions

While sitting in a car during driving, the pilot and the passengers are also subjected to vibrations generated by the vehicle and the different types of road surfaces. To compensate for these vibrations, the human body reacts with micromuscle adjustments.This behaviour, combined with the above-mentioned seated-position issues lead to a faster degradation of perceived comfort.

Gian Mario Bertolotti [16]http://reflect.pst.ifi.lmu.de University of Pavia

Detecting uncomfortable positions

Although sitting discomfort has been traditionally studied using subjective rating scales, continuous objective measures have been preferred in recent works, because of sitting discomfort’s dynamic nature.To obtain continuous objective measures electronic instrumentation is used, e.g.:

• optical systems to detect body angles, • pressure sensors systems.

Gian Mario Bertolotti [17]http://reflect.pst.ifi.lmu.de University of Pavia

Detecting uncomfortable positions

Pressure mats are largely used to acquire pressure maps at driver’s buttock/seat and driver’s back/backseat interfaces.The Centre Of Pressure (COP) is one of the most used parameter for the study of human posture, both standing and sitting posture.COP = the point of application of the result of vertical forces acting on the surface of support.

• Pi(t) is the pressure value detected by the ith sensor at time t;

• xi is the ith sensor’s horizontal coordinate;

• yi is the ith sensor’s vertical coordinate.

COP coordinates:( )( )

( )( )∑

∑∑∑

=

=

=

=⋅

=⋅

= n

i i

in

i iCOPn

i i

in

i iCOP

tP

ytPty

tP

xtPtx

1

1

1

1 )(,)(

Gian Mario Bertolotti [18]http://reflect.pst.ifi.lmu.de University of Pavia

Detecting uncomfortable positions

COP speed:

dttdytv

dttdxtv COP

yCOP

x COPCOP

)()(,)()( ==

)()( 22 tvtvv COPCOP yxCOP +=

Gian Mario Bertolotti [19]http://reflect.pst.ifi.lmu.de University of Pavia

Detecting uncomfortable positions

The main efforts of researchers dealing with car sitting comfort seem to aim at helping car manufacturers in designing more comfortable seats.But, since sitting comfort appears not to be a static issue, we suggest a new way to deal with it, through the dynamic modification of the seat itself.The innovation proposed in present project is the loop control system:

• sensors are used to continuously measure the driver’s posture, • according to a proper “seat adaptation strategy” (which could also take into

account other parameters, e.g. information from other REFLECT loops), • actuators integrated in the seat are activated in order to modify the seat’s

shape (and therefore driver’s posture).

Gian Mario Bertolotti [20]http://reflect.pst.ifi.lmu.de University of Pavia

REFLECTIVE MIDDLEWARE

Gian Mario Bertolotti [21]http://reflect.pst.ifi.lmu.de University of Pavia

Reflective middlewareThe REFLECTive middleware for pervasive adaptive systems has been developed using the software components paradigm and implemented in the Java™ programming language on top of OSGI™ environment.Software components are units of software that make their communication capabilities explicit by means of ports (software types that describe the set of messages that can be received or send).The basic feature of developed pervasive-adaptive software framework is to provide an interface for the four basic operations of configuration for component-based systems: creation and removal of components, and connecting and disconnecting component ports.

Gian Mario Bertolotti [22]http://reflect.pst.ifi.lmu.de University of Pavia

SYSTEM DESIGN AND COMPONENTS

Gian Mario Bertolotti [23]http://reflect.pst.ifi.lmu.de University of Pavia

System design

Gian Mario Bertolotti [24]http://reflect.pst.ifi.lmu.de University of Pavia

System design and components

Tangible Layer provides the Reflective Layer with concrete values that can be used in deducing user’s cognitive, emotional and physical states. It also executes commands needed to control the actuator devices.It is capable to execute urgent (safety) actions reflecting the overall system strategy.

Gian Mario Bertolotti [25]http://reflect.pst.ifi.lmu.de University of Pavia

System design and components

Gian Mario Bertolotti [26]http://reflect.pst.ifi.lmu.de University of Pavia

UP seat mat

4 x 5 matrix of Force Sensing Resistors (FSR).conditioning circuit (voltage dividers).

Gian Mario Bertolotti [27]http://reflect.pst.ifi.lmu.de University of Pavia

System design and components

Gian Mario Bertolotti [28]http://reflect.pst.ifi.lmu.de University of Pavia

AccelerometerAn accelerometer mounted on the seat measures vertical accelerations during the driving experience.Data are then used by the UP controller to calculate the number of bumps per minute.

Gian Mario Bertolotti [29]http://reflect.pst.ifi.lmu.de University of Pavia

System design and components

Gian Mario Bertolotti [30]http://reflect.pst.ifi.lmu.de University of Pavia

Actuators

Gian Mario Bertolotti [31]http://reflect.pst.ifi.lmu.de University of Pavia

System design and components

Gian Mario Bertolotti [32]http://reflect.pst.ifi.lmu.de University of Pavia

UP controller

“UP controller” is meant to:

• acquire data from sensors.• perform calculations. • communicate with the REFLECTive

middleware. • act on the actuators when requested.

UP mat

UP controller

REFLECTive middleware

Seat cushions

Accelerometer

- inflate/deflatecommand

- COP speed - Bumps/min-cush. state

Gian Mario Bertolotti [33]http://reflect.pst.ifi.lmu.de University of Pavia

System design and componentsThe sensor data generated by the Accelerometer, Seat Mat and Seat Cushions are collected and processed by the UP Controller.

The Accelerometer measures the vertical acceleration of the car; this information is processed by the UP Controller to count the number of bumps in the given time period (to determine the state of the road).

The Seat Mat sensor sends the information to the UP Controller, which calculates the current Centre of Pressure (COP) and current COP Speed and passes it to the Physical Analysis component.

The Seat Adaptation component sends commands to the Seat Adaptation Service and UP controller to implement seat adaptation.

Gian Mario Bertolotti [34]http://reflect.pst.ifi.lmu.de University of Pavia

System design and components

At REFLECTive Layer:

Cognitive, Emotional, and Physical Analysis components inform the Seat AdaptionManager about the changes of user’s state.

Seat Adaptation component receives the commands from the Seat Adaption Manager when seat adaptation is needed, using the information from the Physical Analysis component to determine which seat adaptation action should be performed.

Gian Mario Bertolotti [35]http://reflect.pst.ifi.lmu.de University of Pavia

System design and components

The Application Layer contains only one component – Seat Adaptation Manager, where the logic of the Seat Adaptation use case is implemented.

Gian Mario Bertolotti [36]http://reflect.pst.ifi.lmu.de University of Pavia

SEAT ADAPTATION REACTION RULES

Gian Mario Bertolotti [37]http://reflect.pst.ifi.lmu.de University of Pavia

Seat adaptation reaction rulesReaction rules used to implement the logic of the seat adaptation prototype are grouped into three groups:

• analysis, • management • adaptation.

In the analysis groups we have two rules using to detect physical discomfort of the driver. The only rule in the management group is used to detect the situation when seat adaptation is actually required.Finally, the rules from the adaptation group are used to inflate or deflate

cushions.

Gian Mario Bertolotti [38]http://reflect.pst.ifi.lmu.de University of Pavia

Seat adaptation reaction rulesTwo time frames are used to provide different seat adaptations depending on the road surface (bumpy, flat).When the number of bumps is high, then COP speed increases and the pilot becomes tired early. Turning on the cushions helps the pilots to compensate vibrations and to feel more comfortable.

Gian Mario Bertolotti [39]http://reflect.pst.ifi.lmu.de University of Pavia

Seat adaptation reaction rulesIf the emotional state of the pilot is not neutral or the cognitive load is high or setting of the car is “sport”, then it is not productive to change the state of the seat.If the road is flat and the driver feels uncomfortable (COP speed is high) we could improve the comfort by changing the state of the cushions.

Gian Mario Bertolotti [40]http://reflect.pst.ifi.lmu.de University of Pavia

CONCLUSIONS

Gian Mario Bertolotti [41]http://reflect.pst.ifi.lmu.de University of Pavia

ConclusionsThe seat adaptation prototype was implemented using a component-based approach of the REFLECTive middleware, where at the Tangible layer we have services that collect information from sensors (car settings, bumps, COP speed, state of cushions) and actuator service that controls seat cushions.All components at the Reflective and Application layers are implemented using the reaction rules, which provide the needed intelligent reactivity of the seat adaptation prototype.Since the prototype has been developed, the next step will be to test it in the real environment and to use the feedback to improve it.

Gian Mario Bertolotti [42]http://reflect.pst.ifi.lmu.de University of Pavia

Thank you!