digital human modelling - unibg...dhm & rehabilitation 1 digital human modelling daniele...

DHM & REHABILITATION

1

DIGITAL HUMAN MODELLINGDANIELE REGAZZONI, UNIVERSITY OF BERGAMO

CONTENTS

THE CONTEXT

THE PROBLEM

EVOLUTION

A TAXONOMY

DESIGN AND MANUFACTURING

WHAT NEXT?


2

SMART COMPONENTS

VIRTUAL/AUGMENTED

REALITY

DIGITAL PLATFORMS FOR

PRODUCT‐SERVICESOLUTIONS

BIG DATA & ANALYTICS

CYBER‐SECURITY

ADDITIVEMANUFACTURING

REFERENCE MODELS

FOR INDUSTRY 4.0

THE HUMAN BEING AS

KEY ISSUE IN THE

DIGITAL FACTORY

SMART MACHINES

……

THE DIGITAL REVOLUTION

HEALTH AND WELL BEING

GLOBALIZATION

SUSTENABILITY

KNOWLEDGE

DIGITALIZATION

VIRTUALIZATION

J.T. Fokkema, Delft University of Technology,“Challenges and answers for competitive engineering” TMCE 2008

MEGA TRENDS

VIRTUALIZATION OFPRODUCT, PROCESSES AND


3

… FROM REAL TO VIRTUAL

PRODUCT DESIGN

MANUFACTURING

THE CONTEXT

HUMAN

BEINGS

WORKER

4.0 &

VIRTU

ALHUMANS

Image Courtesy


4

HUMAN CENTRED DESIGN INVOLVING THE HUMAN PERSPECTIVE IN ALL STEPS OF

THE DESIGN PROCESS

… MOVING TOWARDS A CUSTOM‐BASED DESIGN THAT HAS TO TAKE INTO ACCOUNT

ALONG THE PRODUCT LIFE CYCLE

– USABILITY AND COMFORT

– HUMAN BEHAVIOR (PHYSICAL AND PHYSIOLOGICAL)

– POPULATION AND AGEING

– DIFFERENT CATEGORIES OF USERS

– CULTURAL AND SOCIAL CONTEXTS

– ….

THE PROBLEMDESIGN

Mouthguard

Earplugs

Immobilizationdevice–Xkelet

BMWWorkers’ custom‐fit glove

THE PROBLEMMANUFACTURING

HUMAN CENTRED MANUFACTURING DESIGN MANUFACTURING PROCESS AND

PLANTS TAKING INTO ACCOUNT THE OPERATORS AND THEIR TASKS (MANUAL)

… DESPITE THE INCREASING AUTOMATION OF THE PRODUCTION PROCESSES

THERE STILL THE NEED OF HIGH‐SKILLED OPERATORS FOR COMPLEX MANUAL TASKS BUT ….

THE DESIGN OF MANUAL OPERATIONS IS OFTEN LACKING OR NOT OPTIMIZED WITH RESPECT TO THE PERSON

– HUMAN INTERVENTION IS NOT EVALUATED OVER THE ENTIRE PRODUCT LIFE CYCLE OF THE PRODUCT BUT STOPS AT

THE COMPANY, EXTERNAL OPERATORS AND END USERS OFTEN EXCLUDED

A POOR DESIGN OF MANUAL OPERATIONS CAUSES

– INEFFICIENCIES (ALSO DUE TO EXCESS OF PRECAUTION)

– CHRONIC MUSCULOSKELETAL DISEASES


5

… IN ORDER TO

DESIGN SIMULATE AND EVALUATE PRODUCT‐HUMAN BODY INTERACTION

- DIFFERENT MORPHOLOGIES AND POPULATIONS ACCORDING TO THE APPLICATIVE CONTEXT

ERGONOMICS ASSESSMENT ( ANALYSIS SYSTEMS SUCH AS RULA, NIOSH, ETC.)

EVALUATE THE BODY RESPONSE IN THE INTERACTION WITH THE PRODUCT

- AUXILIARY AND REHABILITATION DEVICES

PRODUCT SIZING ACCORDING TO TARGET POPULATION- ANTHROPOMETRIC CHARACTERIZATION (AUTOMOTIVE, CLOTHING, …)

… IN ORDER TO

MANUFACTURING

SIMULATE AND EVALUATE WORKPLACE (PRODUCTION PLANT) TAKINGINTO ACCOUNT:

- DIFFERENT POPULATIONS, DIFFERENT CULTURES AND HABITS, …

SIMULATE AND EVALUATE POSTURES

ERGONOMICS OCCUPATIONAL MEDICINE

PLAN OPERATIONS

EVALUATE HUMAN‐MACHINE INTERACTION

COLLABORATIVE ROBOTS

…


6

… MAKING (VIRTUAL) HUMANS

THE CENTER OF WORK DESIGN

SYSTEM…

HUMAN CENTEREDDESIGN &

MANUFACTURING

NEW DESIGN PARADIGM

EMBEDDING DHM SIMULATION TOOLS

BETTERPRODUCTS

FOR ANY CATEGORY OF

OPERATORS AND USERS

BETTER DESIGN OF WORKERS’TASKS

IMPROVED EFFICIENCY, SAFETY, RISK PREVENTION

PRODUCT DEVELOPMENT

GUIDELINES

MAN MACHINE

INTERACTION DATA

HUMAN IN THE LOOP

TECHNOLOGIES

DIGITAL HUMAN MODELLING

– STANDARD KINEMATIC

– FROM 3D SCANNERS

– FROM MEDICAL IMAGING

VIRTUAL/AUGMENTED REALITY– HEAD MOUNTED DISPLAY

– HAND TRACKING DEVICES

– HAPTICS DEVICES

– OLFACTORY DEVICES

– …

MOTION CAPTURE SYSTEMS

Impossibile v isualizzare l'immagine.


7

’60s

"Boeing Man"

VIRTUALHUMANS

VIRTUALHUMANS/MANIKINS

FOR CLOTHING

VIRTUAL HUMANS/ MANIKINS FOR

ERGONOMIC

ANALYSIS

DETAILED

BIOMECHANICAL

MODELS

VIRTUALHUMANS/ACTORS –

CROWD

SIMULATOR

HUMAN MODELS

FROM MEDICAL

IMAGING & 3D SCANNING

POSER MASSIIVE

CROWDIT D‐GUY

MOVIES

VIDEOGAMES

EMERGENCY

SITUATIONS

…

OPTITEX

MODARIS

CLO3D MARVELLOUS

KAEMART

AND V&K THALMANN

GARMENT

DESIGN

VIRTUALSHOP

CATWALKS

…

JACK RAMSIS

PTC CREOMANIKIN

HUMANCAD ….

SANTOS DHAIBAWORKS

MADYMO

ANYBODY …

A TAXONOMY

DESIGN DESIGNMANUFACTURING

MIMICS

INVESALIUS AMIRA

OSIRIX

‐‐

DESIGNMANUFACTURING

MESHLAB BLENDER GEOMAGIC

RHYNOCEROS …

DESIGN


8

PRODUCT DESIGNVIRTUAL HUMANS FOR CLOTHING

STANDARD MANNEQUINS

(BASED ON ATHROPOMETRIC DB)

CUSTOMISED VIRUAL HUMANS

FROM BODY SCANNERS CUSTOM FIT GARMENT

Image courtesy Optitex Image courtesywww.zilvostalova.com/

Image courtesy CLO3D

PRODUCT DESIGNVIRTUAL HUMANS FOR CLOTHING ‐ VIRTUAL CATWALKS


9

PRODUCT DESIGNVIRTUAL HUMANS & MOCAP FOR CLOTHING

FROM CUSTOMER BODY ACQUISITION TO CUSTOMISED «ANIMATED» AVATAR

2 3D RIGGING

1 BODY AND GAIT ACQUISITION

3 3D GARMENT MODELLING AND SIMULATION

VIRTUAL MANIKIN: A KINEMATIC CHAIN COMPOSED BY A NUMBER OF RIGID LINKS CONNECTED BY JOINTS

DESIGN REQUIRES THAT A STANDARD POPULATION CAN INTERACT SUCCESSFULLY WITH THE PRODUCT

PRODUCT MUST BE COMPLIANT WITH DIFFERENT SIZES OF MEN AND WOMEN SUPPOSED TO USE IT

VISIBILITY

REACH & GRASP

COMFORT AND POSTURE PREDICTION

TASK EVALUATION AND SAFETY

MULTI‐USERS INTERACTION

….DRIVER’S CAR SEAT REQUIRES A NUMBER OF REGULATION TO COMPLY

WITH REQUIREMENTS FOR: DRIVING: REACHABILITY OF PEDALS, WHEEL, CONTROLLERS VISIBILITY: FRONTAL, LATERAL, DASHBOARD, REAR MIRRORS

SAFETY: SAFETY BELT POSITION, DISTANCE FROM AIR BAGS

COMFORT: LOWER BACK POSTURE, ARMS POSITION,… …

PRODUCT DESIGNVIRTUAL HUMAN FOR ERGONOMICS


10

PRE‐RECORDEDPOSTURES IN JACK

EXAMPLE OF TARGET POPULATION

OF DIFFERENT HEIGHTS AND BMI

PRODUCT DESIGNVIRTUAL HUMANS FOR ERGONOMICS


CATEGORIES OF USERS TARGET POPULATIONS

OPERATORS MAINTENANCE WORKERS CUSTOMERS

CASE STUDY : DESIGN OF A DISPLAY UNIT

VISIBILITY REACHABILITY GRASPING

VISIBILITY REACHABILITY SAFETY POSTURE COMFORT

PREVENTMUSCULOSKELETAL

DISEASES

VISIBILITY REACHABILITY SAFETY


11


CATEGORIES OF USERS

OPERATORS




DISEASES

AS‐IS Female Female Male Male

LOWEST SHELF 5% 50% 50% 95%

% reached 80 85 100 100

Owas class 2 2 4 4

L4L5 (Nm) 25 80 120 125

Spinal

Forces(N)800 1500 2400 2600

Muscle

tension (N)200 520 1100 1100

Static force 390 390 450 430

Cycles 30 30 26 25

Recovery

Time (s) 0,45 0,57 10,16 11,95

L4L5 (Nm) 75 85 125 130

Spinal

Forces (N)1500 1600 2600 2900

Muscle

tension (N)520 600 1200 1250

Static force 410 410 465 470

Cycles 28 28 18 13

Recovery

Time (s) 4,48 4,536 30,28 37,89

RWL(1)

3,88 3,65 3,37 3,65

LI(2)

0,39 0,41 0,45 0,41

CLI(3)

1,393 1,478 1,605 1,478

(1) Reccommended Weight Limit; (2) Lifting Index; (3) Composite Lifting Index

REACHABILITY

POSTURE

F

A

T

I

G

U

E

Load

1 Kg

Lower

Back

analysis

Fatigue ‐

recovery

Load

3 Kg

Lower

Back

analysis

Fatigue ‐

recovery

NIOSH


CATEGORIES OF USERS

OPERATORS




DISEASES

SHORT TERM SOLUTION

NEW AUXILIARY DEVICE OPTIMIZING ERGONOMIC REQUIREMENTS


12


CATEGORIES OF USERS

OPERATORS




DISEASES

LONG TERM SOLUTION

NEW DESIGN CONCEPTS

OPTIMIZING ERGONOMIC REQS

CASE STUDIES

COSTAN LION HF295 N22

JACKOWAS

LBA

JACK

COSTAN ELEPHANT GV

HIGH TEMPERATURE

REFRIGERATOR (0‐4°C) FOR FRESH GOODS

LOW TEMPERATURE

REFRIGERATOR (‐25°C) FOR FROZEN GOODS

CASE 1

CASE 2

PERFORMED ANALYSES

PERFORMED ANALYSES


13

TEST CAMPAIGN

REACHABILITY TESTS

– CASE STUDY 1: WITH DIFFERENT POSTURES ON DIFFERENT SHELVES

– CASE STUDY 2: INTERFERENCES ANALYSIS DUE TO DOORS AND

FRAMES

VISIBILITY TESTS

– CASE STUDY 1: FROM THE AISLE AND CLOSE TO THE DISPLAY UNIT

– CASE STUDY 2: OCCLUSIONS DUE TO DOORS AND FRAMES

REACHABILITY ANALYSIS: CASE STUDY 1Given avatar gender and size dealing with each shelf (from thebase to the 5th) and with eventual different posture for eachshelf (kneeling down, squat, on tiptoe, etc.)

Distance from

back [mm]Rate Distance Rate

Normal standing 37,91 18% 0 100% 1 661

On tiptoe 32,15 30% 0 100% 1 746

On the step 0 100% 0 100% 1 839

Normal standing 14,3 69% 0 100% 2 832

On tiptoe 0 100% 0 100% 2 1080

On the step

Normal standing 0 100% 26 43% 2 1351

On tiptoe

On the step

Normal standing 0 100% 0 100% 3 1831

On tiptoe

Normal standing 0 100% 0 100% 4 2592

Same knee as hand 0 100% 0 100% 4 2662

Opposite knee 0 100% 0 100% 4 3025

Squat 0 100% 0 100% 4 3257

Kneeling two knees 0 100% 0 100% 4 3064

Same knee as hand 13,2 80% 0 100% 4 3168

Opposite knee 0 100% 0 100% 4 3115

Squat 0 100% 0 100% 4 3138

Kneeling two knees 0 100% 65 0% 4 2815

2° shelf

Base shelf

1° shelf

OWAS LBA [N]

5° shelf

4° shelf

3° shelf

Visibility

Posture

Accessibility


14

REACHABILITY RESULTS: CASE STUDY 1

M75

M95

M50

F50

F25

F5


15

REACHABILITY ANALYSIS: CASE STUDY 2

INTERFERENCE BETWEEN AVATARAND DISPLAY UNIT (E.G., DOORSAND FRAMES)

5TH AND 6TH SHELVES ONLY FOR

TALL AVATARS

AVATAR ROTATION AT 4TH SHELF

1TH SHELF KNEELING DOWN

REACHABILITY RESULTS: CASE STUDY 2

H‐S 11

H‐S H‐S H‐S H‐S H‐S H‐D 10

H‐S H‐S H‐S H‐D H‐D H‐D H‐D H‐D 9

H‐S H‐S H‐D H‐D H‐D H‐D 8

H‐D H‐D 7

A‐F H‐D 6

A‐F H‐D 5

A‐F 4

A‐F 3

A‐F A‐F 2

A‐F A‐F 1

14 13 12 11 10 9 8 7 6 5 4 3 2 1

H: headA: armF: frameS: shelfD: door

Shelf divided with a 50x50 mm mesh and analysis on each cellof the mesh

LegendaGray: not reachableRed: colllisionYellow: proximityGreen: good reachability


16

VISIBILITY

WALKING IN THE SUPERMARKET AISLE

STANDING IN THE MIDDLE OF THE AISLE

IN FRONT OF THE SHELVES

1250100012501000

VISIBILITY ANALYSIS: CASE STUDY 1

M75

M95

M50

F50

F25

F5

1000

M75

M95

M50

F50

F25

F5

M75

M95

M50

F50

F25

F5

M75

M95

M50

F50

F25

F5

M75

M95

M50

F50

F25

F5


17


1000

1250

1500

2000

SIDE VIEW

– SHELVES INTERFERENCE

TOP VIEW

– DOOR INTERFERENCE

– FRAME INTERFERENCE

x [mm] 1 2 3 4 5

0 45° 10° 52° 9° 9°

50 41° 11° 55° 9° 10°

100 37° 11° 58° 10° 11°

150 33° 11° 61° 10° 12°

0 44° 9° 50° 9° 11°

50 40° 9° 52° 9° 11°

100 36° 9° 55° 9° 12°

150 33° 9° 57° 10° 13°

y=350

[mm]

y=400

[mm]

x [mm] 1 2 3 4 5

0 45° 10° 52° 9° 9°

50 41° 11° 55° 9° 10°

100 37° 11° 58° 10° 11°

150 33° 11° 61° 10° 12°

0 44° 9° 50° 9° 11°

50 40° 9° 52° 9° 11°

100 36° 9° 55° 9° 12°

150 33° 9° 57° 10° 13°

y=350

[mm]

y=400

[mm]



18

MANUFACTURING

VIRTUAL HUMANS FOR ERGONOMICS

HUMAN FACTORS

– BODY SIZES, MUSCULAR FORCES, MOVEMENT RANGES, SENSES (TOUCH, SIGHT, HEARING, …)

– CULTURE, TALENT, INCLINATION

WORKPLACE ‐MANUFACTURING FACILITIES

– DESIGN SHOP FLOOR TO PROVIDE FUNCTION AND ARRANGEMENT, ASSEMBLY, SERVICING, RELIABILITY, MANUFACTURABILITY

TASK DESIGN

– MANAGEMENT OF TIME, EASE OF USE, INFORMATION OVERLOAD, TASK SCHEDULING

Vukica Jovanovic, M. Tomovic et al., Ergonomic Design of Manual Assembly Workplaces

«FITTING THE WORK TO THE WORKERS»OCCUPATIONAL SAFETY AND HEALTH

MANUFACTURING



19

Image courtesy ESI, data copyright Wolksvagen, Digital Human: RAMSISESI's VR Technical Highlights Video #11 ‐ Evaluating Human Worker Ergonomics

OPTIMIZE MANUAL HANDLING OF MATERIAL, GOODS ANDTOOLS

– MAP AND SIMULATE OPERATORS’ TASKS

FIX INEFFICIENCIES DUE TO LACK OR EXCESS OF PREVENTION

MANUFACTURING


CASE: LIFT ASSIST DEVICE

FRONT GRASPING

STRAIGHT ARMS

WORKER POINT OF VIEW

OWAS OK: level 1

CAMPAIGN OF TASKS SIMULATION


20

CASE: LIFT ASSIST DEVICELOWER BACK ANALYSIS

MANUFACTURING


LAYOUT DESIGN


21

DESIGN AND MANUFACTURING

PRODUCTS

WORKSPACE, TOOLS, PRODUCTION PROCESSES)

DIGITAL HUMAN

MODELS

MOTION CAPTURESYSTEMS

‐ OPTICAL

‐ INERTIAL

… INTEGRATING MOCAP


RGBCAMERA VIEW JOINTS POSITIONS LIFEMODELER AVATAR

PSEYE + IPISOFT + LIFEMODELER


22

KINECT + JACK

DEPTH CAMERA VIEW

JOINTS POSITIONS JACK

Lowestshelf

Middleshelf


BIOMECHANICAL MODELS


23


WEBCAM 1 WEBCAM 2

WEBCAM 4WEBCAM 3 I PASSO


II PASSO III PASSO IV PASSO


24

INTEGRATION WITH VR/AR

Image courtesyGruppo Kaemart, Politecnico di Milano

INTEGRATION WITH VR/AR

INCLUDING

– VISION

– TOUCH

– SMELL

– …


25

MANUFACTURING

HUMAN ROBOT INTERACTION

SIMULATE THE COLLABORATIVE

TASKS BETWEEN HUMANS AND

ROBOTS

SECURE HUMAN TASKS

– BUILDING A HUMAN MODEL ON LINE

DESIGN COOPERATIVE ROBOTS

Carlos Morato, Krishnanand Kaipa, Boxuan Zhao, SatyandraK. Gupta, Safe Human Robot Interaction By Using

Exteroceptive Sensing Based Human Modeling

CROWD SIMULATORS

EVACUATION PLAN

EMERGENCY EXIT


26

HUMAN MODELS

FROM MEDICAL IMAGING AND 3D SCANNERS

DESIGN OF HIGHLY CUSTOMISED PRODUCTS COINCEIVED AROUND THE HUMAN BODY

DETAILED MODEL OF THE HUMAN BODY OR OF INVOLVED ANATOMICAL DISTRICTS

MERGING MODELS FROM DIFFERENT SOURCES

LOWER LIMB PROSTHESIS DESIGN

DESIGN AND TEST OF LOWER LIMB PROSTHESIS IN A VIRTUAL

ENVIRONMENT

REPLACE MANUAL PROCEDURE COMMONLY ADOPTED TO DESIGN AND

MANUFACTURE SOCKET*

Cortesy

image O

ttobock

*

Manual

Digital


27

RESEARCH CONTEXT

NON‐CORRECT SOCKET MAY:– CREATE DISCOMFORT OR PAIN

– LIMIT PROSTHESIS USABILITY

– AFFECT GAIT QUALITY

PROVIDE BETTER SOCKETS BY IMPROVING THE

UNDESTANDING OF SOCKET – RESIDUAL LIMB INTERACTION

PROVIDE TECHNICIANS WITH TOOLS TO ASSESS GAIT

PERFORMANCE

IMPROVE DESIGN ENVIRONMENT

54 10/14/2019

Images cortesy

www.rogerw

olfsonandassociates.co.za/

Bad fitting Bad alignment

BACKGROUND AND APPROACH

55 10/14/2019

COMMON PRACTICESTATE OF THE ART

SOLUTION

GAIT

COM FORT Patient’s InterviewStand alone contact

pressure measurement

Motion tracking and manual data elaboration

Visual observation

NEW PROPOSED SOLUTION

Pressure acquisition (staticand dynamic) and mapping

on DHM

Merging of pressure data and gait analysis data on

patient model


28

METHODOLOGY

THREE MAIN STEPS:

– SCANNING PATIENT’S RESIDUAL LIMB

• WITH AND WITHOUT PRESSURE SENSORS

– PRESSURE ACQUISITION

• IN STANDING POSITION

• DURING GAIT ON A STRAIGHT LINE

– VISUALIZATION OF RESULTS ON 3D MODEL

• COLOR MAP FOR EASY AND QUICK EVALUATION

56 10/14/2019

RESIDUAL LIMB SCANNING

NEED FOR THE CREATION OF A DETAILED PATIENT‐BASED MODEL OF THE RESIDUAL LIMB

57 10/14/2019

Pros : Internal structure

Cons: Flattening due to contact

Pros: Undeformed geometryCons: Only skin geometry

MRIOptical 3D scanner


29

PRESSURE ACQUISITION

TESCAN F‐SOCKET PRESSURE SENSORS

– SENSORS CALIBRATION

– DISPOSITION INSIDE THE SOCKET

– PRESSURE MEASURE

58 10/14/2019

AD‐HOC DEVELOPED TOOL TO DATA FROM

– 3D SCANNING

– PRESSURE ACQUISITION SYSTEM

DEFINE SENSOR STRIPE POSITION

MAP SENSELS POSITION

– COLOR SENSEL ACCORDING

TO PRESSURE VALUE

MAP OF PRESSURE ON 3D MODEL

VISUALIZATION TOOL

59 10/14/2019

Sensor stripe n

Sensel n(i,j)


30

APPLICATION

PATIENT

– MALE, 53 YO, TRANSFEMORAL

SCANNING

– MICROSOFT KINECT V.1

– ARTEC EVA

PRESSURE ACQUISITION

– STATIC (VERTICAL BODY WEIGHT LOAD)

– DYNAMIC (DURING GAIT)

60 10/14/2019

RESULTS ACHIEVED

61 10/14/2019

Static load

Frontal view Side view Rear view

Midstance Toe off MidswingHeel strike

Dynamic load


31

OUTCOMES

PATIENT’S HUMAN MODEL IS USED BOTH AS INPUT DATA FOR SOCKET DESIGN AND AS A

MEANS TO REPRESENT PROSTHESIS PERFORMANCE

– IN STANDING POSITION

– DURING PATIENT’S GAIT

THE METHOD TO VISUALIZE PRESSURE DATA BY A COLOR SCALE ON THE 3D MODEL OF

RESIDUAL LIMB OF AMPUTEE PATIENT ALLOWS

– ANYONE INVOLVED IN THE PROCESS TO UNDERSTAND PRESSURE TREND AND PRESSURE PEAKS AT

THE SOCKET‐RESIDUAL LIMB INTERFACE

– TECHNICIANS TO EASILY EVALUATE THE SOCKET, PROVIDE EVENTUAL CHANGES, AND VALIDATE

THE DESIGN

62 10/14/2019

WHAT’S NEXT?


32

WHAT’S NEXT?

VIRTUAL HUMAN MODEL MORE AND MORE

DETAILEDMULTI‐SCALE MODELS TO REPRODUCEHUMAN BEHAVIOUR

DIGITAL HUMAN MODEL FOR PEOPLE WITH SPECIAL NEEDS

– OLDER PEOPLE

– LIMITED CAPABALITIES

– DISABLED PEOPLE

– …

LOW‐ COST TECHNOLOGIES

SUPPORTING METHODOLOGIES

digital human modelling - unibg...dhm & rehabilitation 1 digital human modelling daniele...

Documents