review flexible and wearable healthcare sensors for visual

33
1 Review Flexible and wearable healthcare sensors for visual reality health-monitoring Yue LI 1,2 , Lu ZHENG 1,2 *, Xuewen WANG 1,2 * 1, MIIT Key Laboratory of Flexible Electronics (KLoFE), Northwestern Polytechnical University, Xi’an, 710072, China. 2, Institute of Flexible Electronics, Northwestern Polytechnical University, Xi’an, 710072, China. *Corresponding author: [email protected][email protected] Abstract Visual reality (VR) health-monitoring by flexible electronics provides a new avenue to remote and wearable medicine. The combination of flexible electronics and VR could makes smart remote disease diagnosis by real-timely monitoring the physiological signals and remote interaction between patient and physician. Flexible healthcare sensor is the most crucial unit in flexible and wearable health-monitoring system, which has attracted much attention in recent years. The paper briefly reviewed the progress in flexible healthcare sensors and VR healthcare devices. The

Upload: others

Post on 11-Jan-2022

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Review Flexible and wearable healthcare sensors for visual

1

Review

Flexible and wearable healthcare sensors for visual reality

health-monitoring

Yue LI1,2

, Lu ZHENG1,2

*, Xuewen WANG1,2

*

1, MIIT Key Laboratory of Flexible Electronics (KLoFE), Northwestern

Polytechnical University, Xi’an, 710072, China.

2, Institute of Flexible Electronics, Northwestern Polytechnical University, Xi’an,

710072, China.

*Corresponding author: [email protected][email protected]

Abstract

Visual reality (VR) health-monitoring by flexible electronics provides a new avenue

to remote and wearable medicine. The combination of flexible electronics and VR

could makes smart remote disease diagnosis by real-timely monitoring the

physiological signals and remote interaction between patient and physician. Flexible

healthcare sensor is the most crucial unit in flexible and wearable health-monitoring

system, which has attracted much attention in recent years. The paper briefly

reviewed the progress in flexible healthcare sensors and VR healthcare devices. The

Page 2: Review Flexible and wearable healthcare sensors for visual

2

flexible healthcare sensor was introduced with the basic flexible materials,

manufacturing techniques, and their applications in health-monitoring (such as

blood/sweat detections and heart rate tracking). The VR healthcare devices for

telemedicine diagnosis have been discussed, and finally the smart remote diagnosis

system by flexible and wearable healthcare sensors and VR device was discussed.

Keywords flexible electronics; flexible healthcare sensors; visual reality;

telemedicine

1 Introduction

Nowadays, aging society requires the medical resources and makes it become

increasingly shortage. The limited medical resources have been prioritized for the

patients who suffering serious disease or urgent needs. Current and traditional medical

methods cannot meet the requirement of patients’ needs timely. Flexible and wearable

health-monitoring provides an revolutionary technology to traditional diagnosis

methods, and put them towards remote, portable, and timely.[1-4]

The flexible

healthcare sensors are crucial units in wearable health-monitoring system, which

could transduce physiological signals of human body to electrical signals for

quantitative analysis and evaluation of body condition. Physiological signals could be

real-timely collected by flexible healthcare sensors, and transferred to the cloud

database by wireless data transmission techniques. Then, those date will be used by

physician to evaluate the body conditions with AI deep learning algorithm.[5-7]

Visual

reality (VR) is a computer simulation system that created a virtual world and provides

Page 3: Review Flexible and wearable healthcare sensors for visual

3

an immersive interactive experience. VR was demonstrated potential applications in

combination of modern medicine, computer graphics, and computer vision to create a

“VR + medical” system that was used by physician to conduct clinical trials.[8-10]

As

assumes in Figure 1, we believe the combination of VR and flexible healthcare

sensors will promote the remote medicine towards smart, accurate, and reliable. The

VR device could help physician connect users in a virtual environment, and obtain the

physiological signals of patients timely and accurately. Then, the professional medical

diagnosis results will be feedback to patients by internet.

There are several review papers that summarized the progress of flexible electronic

devices and their applications in health-monitoring.[11-16]

However, there lacks the

discussion on combination of flexible electronics with VR and artificial intelligence

(AI). This review paper briefly summarized the advance in flexible healthcare sensors

and VR healthcare devices. The flexible materials and manufacturing techniques for

sensors fabrication, and their applications in health-monitoring (such as blood/sweat

detections and heart rate tracking) have been introduced. Finally, we briefly discussed

the VR devices with flexible and wearable healthcare sensors for smart telemedicine

diagnosis system.

2 Flexible healthcare sensors

Currently, various of flexible sensing electronics have been developed for healthcare

applications, such as artificial bionic sensors and smart flexible sensors that could be

used in monitoring of physiological signals. The key factors in flexible sensing

Page 4: Review Flexible and wearable healthcare sensors for visual

4

electronics include materials, manufacturing process, and device configurations,

which refer to the interdisciplinary research that combines the field of materials

science, device physics, chemistry, electronics and computer science. The

characteristics of soft, stretchable and flexible properties enabled those devices could

attachable to skin and wearable to any part of the body for healthcare applications.

Compared to the conventional rigid and fragile sensors, flexible electronics make

those health monitoring applications more comfortable, biocompatible, energy-saving,

and portable. In this part, we summarized the materials, and manufacturing techniques

for flexible electronics, and reviewed several typical applications in

health-monitoring.

2.1 Flexible materials for flexible healthcare sensors

Flexible materials are basic building blocks for flexible healthcare devices. The

intrinsic mechanical flexible and stretchable properties could be observed from the

polymers and rubbers due to their specific molecular structures. The polymers such as

polyimide (PI), polyethylene (PET), polyethylene (PEN) and polydimethylsiloxane

(PDMS) were demonstrated are promising materials that could play as substrate for

flexible electronics.[17-22]

The conducting polymers such as polyaniline (PANI) and

poly(3-hexylthiophene) (P3HT) can be employed as channel materials and electrodes

for flexible transistor and flexible sensors.[23-25]

For example, Stefan C. B. Mannsfeld

et al. reported patterned PDMS as dielectric layers of capacitive sensing device, and

demonstrated highest sensitivity of 0.55 𝑘𝑃𝑎−1 and relaxation times of

millisecond.[26]

Lijia Pan et al. described a type of conductive and elastic

Page 5: Review Flexible and wearable healthcare sensors for visual

5

microstructure polymer consisting hollow-sphere of polypyrrole (PPy) .[27]

The

microstructure polymer has high sensitivity (~56.0 − 133.1 𝑘𝑃𝑎−1 in 30 Pa range)

and excellent stability of sensing features. The intrinsic mechanical properties of

polymers make those materials better to traditional rigid inorganic materials in

wearable applications due to their good attachable and biocompatible property. In

addition, the polymers could be easily for device fabrication with low cost and large

scale. However, hysteresis of polymers put the device with long response time, which

cast shadow on their applications in high frequency vibration detection.

The rigid materials could turn to flexible materials when their size down to micro-

and nano-scale, or constructed them with specific nanostructures. For example, the

bulk silicon wafer and glass slides are rigid and easily broken into pieces. If the

thickness reduced less than 50 μm, silicon wafer and glass slides could be bend and

present mechanical flexibility.[28]

The glass fibers with the diameter ranged in

microscale have high tensile strength, which could elongated to 3 % without

broken.[29]

Network structure composed by nanowires and nanotubes have been

developed for flexible and transparency conducting films.[30, 31]

The most contact

points in network are physical stacking that could be welded into chemical bond.[32]

Therefore, the network structures shown electrical stability and reliability upon

repeated bending, and are promising electrode used in flexible electronics.[33]

The

chemical bonded contact points in networks decreased the contact resist between the

nanowires, and reduced the power consumption in final devices. Low power

consumption is one of the important advantages for wearable devices because it will

Page 6: Review Flexible and wearable healthcare sensors for visual

6

extend the working times and improve the battery life.

Due to the requirement of electrical conductivity, sensing materials usually consist

of inorganic and organic materials which possessing metal and semiconducting

properties. For example, carbon nanotubes and graphene were commonly used in the

flexible and wearable electronic sensors as electrode due to their tunable electrical

conductivity.[22]

Inorganic semiconductors with strong piezoelectricity such as ZnO

have been demonstrated with high performance (high sensitivity and fast response) in

the flexible mechanical sensors and shown potential applications in wearable

health-monitor.[34, 35]

2.2 Micro-manufacturing for flexible healthcare sensor

The micro-manufacturing process is a fundamental step and important driving force

for flexible electronics. This process could fabricate the circuit module on flexible

substrate, and make the device miniaturized and highly integrated. Typically, there are

two main kinds of manufacturing processes: lithography and printing.

Lithography is a widely used technology for fabrication of microelectronic devices

due to its precise manufacturing with high resolution. The resolution of this process

could reaches to microscale and nanoscale if electron beam and the UV light was used

as exposure light. The principle of lithography is based on the photochemical

properties of photoresist, where the photoresist will be modified and showed different

dissolubility when exposure by UV light. Generally lithography contains light

exposure, developing, metal deposition, and lift-off steps. As shows in Figure 2, the

photoresist was spin coated (step 1) onto flexible substrate for solid film, exposured

Page 7: Review Flexible and wearable healthcare sensors for visual

7

(step 2) by UV light and developed (step 3) to form patterned photoresist. Followed

by metal film deposition (step 4) and lift-off (step 5), the conducting electrode

patterns could be fabricated onto target flexible substrate. In this lithography process,

the sample was heated to the temperature of 100-150℃ for solidification of

photoresist, and it also needs immersed into polar solvent such as acetone for lift-off.

Therefore, the manufacturing on flexible substrate requires the substrate materials

should be resist to high temperature and polar solvent. PI, PEN, and PET were the

suitable candidates as the substrate materials for flexible electrode. Lithography on

elastic PDMS substrate is difficult because the swelling effect of PDMS in acetone

solvent and large coefficient of thermal expansion that brings large deviation to

patterning of photoresist and alignment. Thermal expansion of PDMS could be

decreased by changing the composition of materials. There is a few report on PDMS

based flexible lithography device. Because large value of thermal expansion make

sure the material is sensitive to temperature, the temperature sensitive phenomenal

was used to design the new type of flexible temperature sensors. Beside electrode

fabrication, the lithography technology was also employed to fabricate the

semiconductor of channel materials with micro-patterns. For example, Yugang Sun

and John A. Rogers developed the “top-down” approach in which lithographic

patterning and etching techniques create single-crystalline nano-/micro-structures of

semiconductors (Figure 4a).[36]

However, there are some problems still existing in

lithography technology for fabrication of flexible electronics. Thermal expansion of

flexible substrate makes resolution of alignment is difficult reaches to nanoscale. For

Page 8: Review Flexible and wearable healthcare sensors for visual

8

removing of photoresists, the polar solvent will damage the flexible organic electronic

materials, and cast shadow on their electrical properties and performance in final

applications.

Beyond lithography, printing technology is an effective, low cost, large scale

method for fabrication of the flexible electronic devices and large-area integrated

circuits. Another important advantage of printing is that there will avoid the use of

polar solvent and complex manufacturing process. The technology could produce the

dedicated function circuit by inputting the patterned images which could be revised

conveniently. Various and versatile printing inks (such as conducting ink, insulating

polymer ink, and semiconducting ink) have been developed for printed electronics

like FET devices and sensors[37-40]

. Currently, there are several printing methods

including inkjet printing, screen printing and aerosol-jet printing have been used to

fabricate the electronic devices. Since printing technology can print any inky material

to arbitrary target substrate, this technique and printed electronics are compatible and

interlinked with flexible and stretchable electronics such as organic electronics, plastic

electronics, paper-based electronics, transparency electronics, and wearable

electronics. Recent studies have demonstrated the solar cell, touch screen, and

healthcare devices by printing.[41-43]

For example, the surface gate electrode of

traditional crystalline silicon solar cell is prepared by screen-printing with conductive

silver paste.[44]

Organic and perovskite solar cells could use printing to reduce the cost

of manufacturing.[45]

With the development of conducting and sensing materials,

recently, the printed flexible sensing electronics especially healthcare sensors have

Page 9: Review Flexible and wearable healthcare sensors for visual

9

been reported with high sensitivity and multifunctionality. Yuki Yamamoto et al. have

reported the use of printing technology to achieve multifunctional, disposable and

flexible medical sensors.[46]

The low-cost printing process makes the sensor cheap and

disposable which avoided medical cross-infection. Multifunctionality of device could

be realized by the integration of it with modules of monitoring ECG and body

temperature. Recently, Rui Guo et al. achieved a stretchable electronic circuit by

rolling and transfer printing of nickel eutectic gallium-indium alloy semi-liquid metal.

The paper-based devices have stable electrical performance and high durability after

repeating cycles of more than 1000 times, and the stretchable electrodes and strain

sensor can be sustain the strain of 100%(Figure 4b). [47]

Despite lithography and

printing technology are widely used in traditional micro-electronic circuit, the

parameters of process on flexible substrate should be further developed and improved.

How to balance the thermal expansion and resolution is still a challenge problem.

2.3 Applications in monitoring health-related physiological signals

Wearable technology developed rapidly and wearable products emerged endlessly.

Wearable device with flexible healthcare sensors provides a novel and convenient way

for health-monitoring, and puts traditional diagnosis method towards portability and

remote. With the development of novel flexible and soft materials, flexible healthcare

devices performed multifunctionality that could monitor multiple physiological

signals simultaneously. Flexible and wearable healthcare devices will be more

delicate, low-cost, comfortable and durable. As shows in Figure 3, there are some

typical applications of flexible electronics in monitoring health-related physiological

Page 10: Review Flexible and wearable healthcare sensors for visual

10

signals.

2.3.1 Blood sensors

Oxygen saturation, pH value, and glucose concentration in blood are crucial

physiological signals to indicate the physical conditions. Rapid analysis of these

components in the blood plays an important role in clinic operation and available to

evaluate the state of health. However, conventional device is cumbersome and

uncomfortable. For example, monitoring oxygen saturation always adopts finger clip

which limited physical movement. Detection of glucose concentration and pH value

requires destroying skin to collect blood. In view of this situation, flexible blood

sensors were developed for detection of pH value, glucose and blood oxygen

noninvasively. Yasser Khan et al. have invented a kind of blood oxygen sensors which

consists of organic electronics printed on flexible plastic and can be used with

attached to skin (Figure 5a).[48]

The sensor can monitor wound healing in real time. In

contrast to traditional oximetry, the technology uses printed light-emitting diodes and

photodetectors to alternately form an array of sensors that can detect blood oxygen

levels at nine points simultaneously, and can be placed anywhere on the skin. The

sensor uses light reflection to detect oxygen saturation instead of transmitted pulse

oxygen saturation because the traditional device limited to specific tissues (such as

earlobes and fingers) that cannot be transmitted by light. This flexible blood sensors

can be real-timely monitor the blood oxygen for patients who suffering the diabetes

and respiratory, and report the results timely. Monitoring the blood flow is essential to

patients who was under recovery after reconstructive surgeries. Implantable sensors

Page 11: Review Flexible and wearable healthcare sensors for visual

11

for detection of blood flow are commonly used in clinical practice, however, the

process requires medical staff to fix the device in specifically designed position and

brings the risk of infection. Clementine M. Boutry et al. developed a kind of

biocompatible and flexible pressure sensors that can measure arterial blood flow in

contact and non-contact modes. The flexible device was fabricated by bio-degradable

materials based on the configuration of fringe-field capacitor(Figure 5c).[49]

The

advantages of this flexible sensor are noninvasive, fast response, high stability, good

biocompatible, which bring the blood monitoring device towards smart, safety, rapid,

and comfortable.

2.3.2 Sweat Sensors

Body fluids such as interstitial fluid and sweat carry a great deal of vital

information for human body. Sweat is one of the most readily available body fluids,

which contains large amounts of inorganic salt (K+, Na+, Cl-) from metabolism of

human body and is closely related to the state of body. It has been demonstrated that

sodium ions in the blood can be used to detect dehydration, chloride ions to diagnose

cystic fibrosis, and glucose to test diabetes. Different types of sensing units were

integrated into a substrate according to various components in sweat, and the device

was attached to the surface of human skin for physiological analysis. Various kinds of

multi-component sweat analysis system have been designed in recent years. For

example, Amay J. Bandodkar et al. developed a wireless electronic sensor with a

biofuel cell for monitoring lactate, glucose, chloride, pH and sweat rate(Figure 6a).[50]

This small and low-cost sensor could provide a continues monitoring of multiple

Page 12: Review Flexible and wearable healthcare sensors for visual

12

component in sweat. The variation in sweat composition could be observed at

anywhere and anytime. Yongjiu Lei et al. reported a stretchable, wearable, and

modular multifunctional biosensors by MXene/Prussian blue (Ti3C2Tx/PB)

composite(Figure 6b).[51]

The composite can be used for durable and sensitive

detection of biomarkers, such as glucose and lactate. Specially, they developed a

unique modular design with three interface of solid, liquid and gas that allow the

sensor to measure multiple physiochemical signals with high sensitivity

(35.3 μA 𝑚𝑀−1𝑐𝑚−2 for glucose and 11.4 μA 𝑚𝑀−1𝑐𝑚−2 for lactate), and great

repeatability stability. Smith Rachel E. et al. demonstrated a kind of highly conductive

and flexible cotton fiber sensor that is biocompatible and antibacterial.[52]

The sensor

shown high sensitivity and fast detection capability to the sweat pH in the range of 2.0

to 12.0. Recently, Lu Yao et al. prepared intelligent sweat analysis system, which

integrated with micro-supercapacitor and self-power module.[53]

They demoed the

system in detection of accurate sweat signals and remote data sharing, that the signals

were sent to individual mobile phone through wireless transmission technology. The

method break the limitation of bio-enzyme sensor for measuring temperature and

humidity. These devices will promote the remote medicine for pre-diagnosis of

disease such as diabetes screening and kidney status detection.

2.3.3 Respiratory and Heart Rate Sensors

There are two ways to measure heart rate: PPG (photoplethysmography)

photoelectric volume pulse wave and ECG (electrocardiogram) signal measurement.

The method of PPG photoelectric volume wave uses pulsating changes in light

Page 13: Review Flexible and wearable healthcare sensors for visual

13

transmittance in the blood to reflect heart rate. However, the accuracy of the method

is affected by the influence of irregular exercise and sweat.

The patch ECG signal measurement needs several wired electrodes attached to the

chest, ankle and wrist for detection. It is a complex method and restricts physical

movement. Conventional ECG signal collection cannot be conducted with a long

working time, while flexible and wearable sensors shown high sensitivity, fast

response speed, great adhesion, optional stability, good portability and comfort for

detection of heart rate. Sungjun Park et al. invented a self-powered ultra-flexible heart

rate (HR) sensor by patterned ultra-flexible organic solar cell, which can accurately

monitor the heart rate with high signal to noise ratio in real-time(Figure 7a).[54]

The

OPV and OECTs were integrated on the top of ultrathin polymer substrate. In the

manufacturing of OPV, the nanopattern of ZnO maximized the efficiency of OPV and

weaken the reflection of incident light so as to the performance of sensor is not

affected by the light angle. Meanwhile it also exhibited excellent mechanical stability

and durability. Wang Guangming et al. designed a stretchable optical HR sensing

patch system with promising performance (Figure 7b).[55]

The device has been close

contact to skin and obvious HR fluctuation frequency during intensive exercise.

However, the resolution of collected original waveform still need to be improved.

Skin-inspired flexible sensors such as electronic skin are designed to mimic the

human skin for sensing the pressure, strain, stretch, and temperature. Real-time

monitoring the wrist pulse provides a convenient way for detection of HR. There are

several research groups have fabricated the electronic skins by organic

Page 14: Review Flexible and wearable healthcare sensors for visual

14

semiconductors, inorganic nanowires, carbon nanotubes, graphene, metal nanowires,

and microstructure conducting polymers[56-60]

. Electronic skin could be attached to

wrist for detecting wrist pulse due to its high accuracy, sensitivity and resolution in

detection of tiny pressure. In our previous studies, we developed ultra-sensitive

pressure sensors by micropatterned PDMS with carbon nanotube films[3]

. The device

presented high sensitivity and accuracy to the wrist pulse, and capable to distinguish

the wrist pulse from persons with different body conditions.

3 VR technology for health-monitoring

The most prominent feature of VR is that it can provide users a sense of immersive.

VR combines new applications with multi-field technologies, which changes the

service model of the industry and expands the perceptual boundary. Currently, VR

shows potential applications in the fields of computer, medical, military, education,

aerospace, and entertainment. For example, miniature VR goggle, ear wearing

equipment for panoramic sound, lightweight tactile feedback gloves and digital smell

interface have been studied and look forward to serving human life in the near future

[61]. According to the user experience, there are mainly three types of VR hardware

equipment: (i)The PC head-mounted device with high immersion. The shortage of this

device is the limited portability and the high system configuration, which makes it

more suitable for enterprise user; (ii) the portable and mobile VR, such as Google

Cardboard. The advantage of this type of VR including rich VR resources and low

cost; (iii) hybrid and integrated VR system. The system integrate processor and screen

together for the function of display and calculation.

Page 15: Review Flexible and wearable healthcare sensors for visual

15

As shows in Figure 8, new VR applications for healthcare have been designed

based on the rapid development of VR technology. There are mainly two themes for

VR in the area of medicine: remote disease surveillance, rehabilitation training and

physical and mental monitoring.

VR can be used in monitoring health signals by physiological sensors and some

immersive virtual scene. VR health monitoring system contains sensor unit for

detection of individual physiological signals, VR equipment for visual interaction

interface, and software program. Physiological signals varied under different scenes.

For example, heart rate and respiratory rate could be increased by exercise. Different

states of body condition may reflect by indicators of electrophysiological signals.

EEG with different virtual scenes can reflect participants’ concentration, relaxation

and mood[66]

. If the user equipped with VR headset and EEG monitor to carry out

activities, while the system integrated software programs to record the effects of brain

waves in real time. The user could freely adjust posture, and the physician could

obtain a wide variety of EEG samples. VR enhanced the communication between

patient and physician, and enabled the physician comprehensive understanding of

patients' information. VR devices provide a way to monitor health signals in different

scenarios at anytime and anywhere.

3.2 VR for teletherapy

VR equipment is used for remote diagnosis of disease or rehabilitation by vision

therapy VR. Telemedicine surveillance with VR visual scene allows physician to

immerse themselves to practice clinic diagnosis and operation. Shahzad Rasool et al.

Page 16: Review Flexible and wearable healthcare sensors for visual

16

proposed to use 3D simulation and tactile sense interaction to solve the lack of cases,

The virtual lesion modeling scene was used to simulate minimally invasive surgery.[62]

Alessandro De Mauro et al. have achieved an immersive surgery experience by the

combination of tactile force simulator with VR neurosurgical microscopes. Similarly,

Pingjun Xia et al. presented a novel and low-cost approach for image-based virtual

haptic venipuncture simulation, which used 2D actual photos with tactile feedback

and real-time interaction between force feedback and 3D operation screen (Figure

9).[63]

VR technology also has been used for treatment of mental illness, such as anxiety

disorders, traumatic and stress-related disorders (PTSD), obsessive-compulsive and

related disorders (OCD) and schizophrenia spectrum and other psychiatric disorders.

During treatment, the system makes use of computer graphics, physiological signal

sensor and visual imaging technology which enabled patients to immerse themselves

in the scene that provided by VR equipment, to obtain perceptual experience and

emotional response.

3.3 Rehabilitation training

VR could help patients on rehabilitation which including stress management,

autism relief, and stroke treatment. For example, Wendy Powell et al. demonstrated

the potential of VR to ameliorate pain and improve rehabilitation by building a system

of gait rehabilitation.[64]

The VR screen can adjust the patients’ steps signal, then

adjust the frequency of the scene switching and audio rhythm, so as to alleviate the

pain in the rehabilitation process. Moreover, VR can be integrated with multiple kinds

Page 17: Review Flexible and wearable healthcare sensors for visual

17

of sensors for remote medicine. Paul D. Marasco et al. put forward a system of motor

control for prosthetic hands by VR.[65]

In particular, this study combined the

kinesthetic sense, intent and vision to improve the body movement control. These

systems help physician and patients to achieve fast remote detection. In brief, they

have demonstrated the potential of disease cure and healthcare monitoring. At present,

more and more VR products were used in healthcare services. With the development

of VR technology and flexible electronics, the medical industry will take on a new

look in the near future.

4 Conclusion and outlook.

We presented a comprehensive review on the recent advances of technologies and

applications in the field of flexible healthcare sensors and VR healthcare devices.

Several flexible functional materials and typical micro-manufacturing technology

have been described. Beside sensor units, the flexible and wearable healthcare system

also include the power supply unit, integrated circuit for signal process, and wireless

communication units for data transferring. Therefore, the key will be investigating on

novel materials (e.g. flexible energy materials and soft semiconductors) and advanced

manufacturing and integration techniques not only for sensor units, but also for the

whole functional units of flexible healthcare system.

Flexible healthcare sensor and VR technology is considered to be a revolutionary

techniques for healthcare service such as remote disease diagnosis. The techniques

will promote not only the revolution of the next medical instruments towards portable,

Page 18: Review Flexible and wearable healthcare sensors for visual

18

wearable, remote, and timely, but also the change of the conversional diagnose

method in clinical practice. Recently, wearable health-monitoring was demonstrated

by flexible healthcare sensors for telemedicine applications. Health-related

physiological signals could be collected by flexible sensors and transmitted to hospital

and database for analysis. The physician's role is still crucial and irreplaceable, as

patients need physicians’ professional medical advice by analyzing physiological

signals and referring to the results of algorithm. Typically, physiological signals vary

widely from different parts of human body. Patients will obtained various

physiological signals when the flexible healthcare sensors were worn to different parts

of body, which will makes the diagnosis difficult for physicians. VR technology

provides an effective way to connect the physicians and patients. Physicians could use

this technology to ask patients to make the correct placed position for flexible and

wearable healthcare sensors. VR technology could be used to improve the accuracy of

diagnosis by integrity of sensing system which established by the flexible and

wearable healthcare devices. Therefore, the combination of flexible and wearable

healthcare sensor and VR technology will be a potential disruptive technology for

healthcare.

5 Acknowledgement

This work is supported by the funding from “the Fundamental Research Funds for

the Central Universities” (No.3102019PY004), a start-up funding from Northwestern

Polytechnical University.

Page 19: Review Flexible and wearable healthcare sensors for visual

19

Page 20: Review Flexible and wearable healthcare sensors for visual

20

References

[1]. Kim, D.-H., et al., Epidermal Electronics. Science, 2011. 333(6044): p. 838.

[2]. Gao, W., et al., Fully integrated wearable sensor arrays for multiplexed in situ perspiration

analysis. Nature, 2016. 529: p. 509.

[3]. Wang, X., et al., Silk-molded flexible, ultrasensitive, and highly stable electronic skin for

monitoring human physiological signals. Adv Mater, 2014. 26(9): p. 1336-42.

[4]. Sheridan, C., Apple moves on health, drug developers shift into smart gear. Nature

Biotechnology, 2014. 32: p. 965.

[5]. Zang, Y., et al., Advances of Flexible Pressure Sensors toward Artificial

Intelligence and Health Care Applications. Materials Horizons, 2014.

[6]. Zhao, W., et al., Machine Learning: A Crucial Tool for Sensor Design. Algorithms, 2008.

1(2): p. 130-152.

[7]. Vu, C.C. and J. Kim, Human Motion Recognition by Textile Sensors Based on Machine

Learning Algorithms. Sensors (Basel, Switzerland), 2018. 18(9): p. 3109.

[8]. Shortliffe, E.H., The adolescence of AI in medicine: will the field come of age in the '90s?

Artif Intell Med, 1993. 5(2): p. 93-106.

[9]. Horn, W., AI in medicine on its way from knowledge-intensive to data-intensive systems.

Artif Intell Med, 2001. 23(1): p. 5-12.

[10]. Mintz, Y. and R. Brodie, Introduction to artificial intelligence in medicine. Minimally

invasive therapy & allied technologies : MITAT : official journal of the Society for

Minimally Invasive Therapy, 2019. 28(2): p. 73-81.

[11]. Takei, K., et al., Toward Flexible and Wearable Human-Interactive Health-Monitoring

Devices. Advanced Healthcare Materials, 2015. 4(4): p. 487-500.

[12]. Zang, Y., et al., Advances of flexible pressure sensors toward artificial intelligence and

health care applications. Materials Horizons, 2015. 2(2): p. 140-156.

[13]. Lou, Z., L. Wang, and G. Shen, Recent Advances in Smart Wearable Sensing Systems.

Advanced Materials Technologies, 2018. 3(12): p. 1800444.

[14]. Khan, Y., et al., Monitoring of Vital Signs with Flexible and Wearable Medical Devices.

Advanced Materials, 2016. 28(22): p. 4373-4395.

[15]. ZHANG, T., Y. BAI, and F. SUN, Recent advances in flexible self-healing materials and

sensors. SCIENTIA SINICA Informationis, 2018. 48(1674-7267): p. 650.

[16]. Li, T., Y. Li, and T. Zhang, Materials, Structures, and Functions for Flexible and Stretchable

Biomimetic Sensors. Accounts of Chemical Research, 2019. 52(2): p. 288-296.

[17]. Wang, X.L., Z. and T. Zhang, Flexible Sensing Electronics for Wearable/Attachable Health

Monitoring. Small, 2017. 13(25).

[18]. Zeng, K., et al., Studies on organosoluble polyimides based on a series of new

asymmetric and symmetric dianhydrides: Structure/solubility and thermal property

relationships. Macromolecular Research, 2011. 20(1): p. 10-20.

[19]. Sekitani, T., et al., Flexible organic transistors and circuits with extreme bending stability.

Nature Materials, 2010. 9: p. 1015.

[20]. Nomura, K., et al., Room-temperature fabrication of transparent flexible thin-film

transistors using amorphous oxide semiconductors. Nature, 2004. 432(7016): p. 488-492.

Page 21: Review Flexible and wearable healthcare sensors for visual

21

[21]. Kaltenbrunner, M., et al., An ultra-lightweight design for imperceptible plastic electronics.

Nature, 2013. 499: p. 458.

[22]. Lipomi, D.J., et al., Skin-like pressure and strain sensors based on transparent elastic films

of carbon nanotubes. Nature Nanotechnology, 2011. 6: p. 788.

[23]. Laukhina, E., et al., Ultrasensitive Piezoresistive All-Organic Flexible Thin Films. Advanced

Materials, 2010. 22(9): p. 977-981.

[24]. Gburek, B. and V. Wagner, Influence of the semiconductor thickness on the charge

carrier mobility in P3HT organic field-effect transistors in top-gate architecture on

flexible substrates. Organic Electronics, 2010. 11(5): p. 814-819.

[25]. Harada, S., et al., Fully Printed Flexible Fingerprint-like Three-Axis Tactile and Slip Force

and Temperature Sensors for Artificial Skin. ACS Nano, 2014. 8(12): p. 12851-12857.

[26]. Mannsfeld, S.C.B., et al., Highly sensitive flexible pressure sensors with microstructured

rubber dielectric layers. Nature Materials, 2010. 9: p. 859.

[27]. Pan, L., et al., An ultra-sensitive resistive pressure sensor based on hollow-sphere

microstructure induced elasticity in conducting polymer film. Nature Communications,

2014. 5: p. 3002.

[28]. Wang, S., et al., Large-area free-standing ultrathin single-crystal silicon as processable

materials. Nano Lett, 2013. 13(9): p. 4393-8.

[29]. Wang, D., et al., Study on the long-term behaviour of glass fibre in the tensile stress field.

Ceramics International, 2019. 45(9): p. 11578-11583.

[30]. Rathmell, A.R., et al., The growth mechanism of copper nanowires and their properties in

flexible, transparent conducting films. Adv Mater, 2010. 22(32): p. 3558-63.

[31]. Baughman, R.H., A.A. Zakhidov, and W.A. de Heer, Carbon Nanotubes--the Route

Toward Applications. Science, 2002. 297(5582): p. 787.

[32]. Chung, W.-H., S.-H. Kim, and H.-S. Kim, Welding of silver nanowire networks via flash

white light and UV-C irradiation for highly conductive and reliable transparent electrodes.

Scientific Reports, 2016. 6: p. 32086.

[33]. Wu, H., et al., A transparent electrode based on a metal nanotrough network. Nature

Nanotechnology, 2013. 8: p. 421.

[34]. Gullapalli, H., et al., Flexible piezoelectric ZnO-paper nanocomposite strain sensor. Small,

2010. 6(15): p. 1641-6.

[35]. Xiao, X., et al., High-strain sensors based on ZnO nanowire/polystyrene hybridized

flexible films. Adv Mater, 2011. 23(45): p. 5440-4.

[36]. Sun, Y. and J.A. Rogers, Inorganic Semiconductors for Flexible Electronics. Advanced

Materials, 2007. 19(15): p. 1897-1916.

[37]. Pajor-Swierzy, A., et al., Application of metallic inks based on nickel-silver core-shell

nanoparticles for fabrication of conductive films. Nanotechnology, 2019. 30(22): p. 8.

[38]. Joseph, A.M., et al., Screen-Printable Electronic Ink of Ultrathin Boron Nitride Nanosheets.

Acs Omega, 2016. 1(6): p. 1220-1228.

[39]. Kwon, Y.J., Y.D. Park, and W.H. Lee, Inkjet-Printed Organic Transistors Based on Organic

Semiconductor/Insulating Polymer Blends. Materials, 2016. 9(8): p. 16.

[40]. Zhang, F., et al., Inkjet printing of polyimide insulators for the 3D printing of dielectric

materials for microelectronic applications. Journal of Applied Polymer Science, 2016.

133(18): p. 11.

Page 22: Review Flexible and wearable healthcare sensors for visual

22

[41]. Kim, Y.Y., et al., Gravure-Printed Flexible Perovskite Solar Cells: Toward Roll-to-Roll

Manufacturing. Advanced Science, 2019. 6(7): p. 11.

[42]. Ferri, J., et al., Integration of a 2D Touch Sensor with an Electroluminescent Display by

Using a Screen-Printing Technology on Textile Substrate. Sensors, 2018. 18(10): p. 13.

[43]. Khan, S., S. Ali, and A. Bermak, Recent Developments in Printing Flexible and Wearable

Sensing Electronics for Healthcare Applications. Sensors, 2019. 19(5): p. 34.

[44]. Jeffries, A.M., et al., Low-Temperature Drop-on-Demand Reactive Silver Inks for Solar

Cell Front-Grid Metallization. Ieee Journal of Photovoltaics, 2017. 7(1): p. 37-43.

[45]. Uzum, A., et al., Perovskite/Crystalline Silicon Tandem Solar Cells Fabricated by

Non-Vacuum-Process, in 2015 Ieee 42nd Photovoltaic Specialist Conference. 2015, Ieee:

New York.

[46]. Yamamoto, Y., et al., Printed multifunctional flexible device with an integrated motion

sensor for health care monitoring. Science Advances, 2016. 2(11).

[47]. Guo, R., et al., Semi-liquid metal and adhesion-selection enabled rolling and transfer

(SMART) printing: A general method towards fast fabrication of flexible electronics.

Science China Materials, 2019.

[48]. Khan, Y., et al., A flexible organic reflectance oximeter array. Proc Natl Acad Sci U S A,

2018. 115(47): p. E11015-E11024.

[49]. Boutry, C.M., et al., Biodegradable and flexible arterial-pulse sensor for the wireless

monitoring of blood flow. Nature Biomedical Engineering, 2019. 3(1): p. 47-57.

[50]. Bandodkar, A.J., P. Gutruf, and J. Choi, Battery-free, skin-interfaced

microfluidic/electronic systems for simultaneous electrochemical, colorimetric, and

volumetric analysis of sweat. Science Advances 2019. 5(1).

[51]. Lei, Y., et al., A MXene-Based Wearable Biosensor System for High-Performance In Vitro

Perspiration Analysis. Small, 2019: p. e1901190.

[52]. Smith, R.E., et al., Development of a novel highly conductive and flexible cotton yarn for

wearable pH sensor technology. Sensors and Actuators B-Chemical, 2019. 287: p.

338-345.

[53]. Lu, Y., et al., Wearable sweat monitoring system with integrated micro-supercapacitors.

Nano Energy, 2019. 58: p. 624-632.

[54]. Park, S., et al., Self-powered ultra-flexible electronics via nano-grating-patterned

organic photovoltaics. Nature, 2018. 561(7724): p. 516-521.

[55]. Wang, G.M., et al., Stretchable Optical Sensing Patch System Integrated Heart Rate, Pulse

Oxygen Saturation, and Sweat pH Detection. Ieee Transactions on Biomedical

Engineering, 2019. 66(4): p. 1000-1005.

[56]. Wang, N.X., et al., Functionalized Organic Thin Film Transistors for Biosensing. Accounts

of Chemical Research, 2019. 52(2): p. 277-287.

[57]. Liu, Z., et al., Flexible electronics based on inorganic nanowires. Chemical Society Reviews,

2015. 44(1): p. 161-192.

[58]. An, R., et al., Strain-sensitivity conductive MWCNTs composite hydrogel for wearable

device and near-infrared photosensor. Journal of Materials Science, 2019. 54(11): p.

8515-8530.

Page 23: Review Flexible and wearable healthcare sensors for visual

23

[59]. Xu, M.X., et al., Stretchable and multifunctional strain sensors based on 3D graphene

foams for active and adaptive tactile imaging. Science China-Materials, 2019. 62(4): p.

555-565.

[60]. Park, S.H., et al., Flexible galvanic skin response sensor based on vertically aligned silver

nanowires. Sensors and Actuators B-Chemical, 2018. 273: p. 804-808.

[61]. 曹凡, 国内外 VR 技术研发现状综述. 中国科技信息, 2019. 5.

[62]. Rasool, S., et al., Towards Hand-Eye Coordinate Training in Virtual Knee Arthroscopy.

ACM, 2013: p. 10.

[63]. Xia, P. and A. Sourin, Design and Implementation of a Haptics-based Virtual

Venepuncyure Simulation and Training System. ACM, 2012.

[64]. Powell, W., V. Powell, and M. Simmonds, Virtual Reality for Gait Rehabilitation - Promises,

Proofs and Preferences PETRA '14 Proceedings of the 7th International Conference on

PErvasive Technologies Related to Assistive Environments, 2014.

[65]. Marasco, P.D., J.S. Hebert, and J.W. Sensinger, Illusory movement perception improves

motor control for prosthetic hands. Science translational medicine 2018. 10(432).

[66]. 杨晓哲 and 任友群, 虚拟现实与脑电联动系统的开发及其教育研究功能探索. 远程教

育杂志, 2019. 37(1): p. 45-52.

[67]. Gao, W., et al., Fully integrated wearable sensor arrays for multiplexed in situ perspiration

analysis. Nature, 2016. 529(7587): p. 509-514.

[68]. Huang, K.H., et al., A Highly Sensitive Pressure-Sensing Array for Blood Pressure

Estimation Assisted by Machine-Learning Techniques. Sensors (Basel), 2019. 19(4).

[69]. Tao, X., et al., Body Compatible Thermometer Based on Green Electrolytes. ACS Sensors,

2018. 3(7): p. 1338-1346.

[70]. Bihar, E., et al., A Disposable paper breathalyzer with an alcohol sensing organic

electrochemical transistor. Scientific Reports, 2016. 6: p. 27582.

[71]. Oh, S.Y., et al., Skin-Attachable, Stretchable Electrochemical Sweat Sensor for Glucose

and pH Detection. ACS Applied Materials & Interfaces, 2018. 10(16): p. 13729-13740.

[72]. An, X. and G.K. Stylios, A Hybrid Textile Electrode for Electrocardiogram (ECG)

Measurement and Motion Tracking. Materials (Basel), 2018. 11(10).

[73]. Sekine, T., et al., Fully Printed Wearable Vital Sensor for Human Pulse Rate Monitoring

using Ferroelectric Polymer. Scientific reports, 2018. 8(1): p. 4442-4442.

[74]. Benham, S., M. Kang, and N. Grampurohit, Immersive Virtual Reality for the Management

of Pain in Community-Dwelling Older Adults. Otjr-Occupation Participation and Health,

2019. 39(2): p. 90-96.

[75]. Gugenheimer, J., et al., FaceTouch: Touch Interaction for Mobile Virtual Reality, in

Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in

Computing Systems. 2016, ACM: San Jose, California, USA. p. 3679-3682.

[76]. Vega-Medina, L., et al. VR central venous access simulation system for newborns. in 2014

IEEE Virtual Reality (VR). 2014.

[77]. Wang, F., et al. Knot-tying with Visual and Force Feedback for VR Laparoscopic Training.

in 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference. 2005.

[78]. Gerber, S.M., et al., Visuo-acoustic stimulation that helps you to relax: A virtual reality

setup for patients in the intensive care unit. Scientific Reports, 2017. 7(1): p. 13228.

Page 24: Review Flexible and wearable healthcare sensors for visual

24

[79]. Park, H., et al. Development of a VR-based treadmill control interface for gait assessment

of patients with Parkinson's disease. in 2011 IEEE International Conference on

Rehabilitation Robotics. 2011.

Page 25: Review Flexible and wearable healthcare sensors for visual

25

Figure 1. Compared to time-consuming medicine, convenient medicine could promote

the sharing medical resources, make it convenient for patients to access the physician

anytime and anywhere and improve the quality and efficiency of diagnosis.

Page 26: Review Flexible and wearable healthcare sensors for visual

26

Figure 2. The schematic of lithography: 1) resist coating, 2) UV light exposure, 3)

developing, 4) metal film deposition, 5) lift-off.

Page 27: Review Flexible and wearable healthcare sensors for visual

27

Figure 3. The collection of wearable flexible sensors for monitoring physiology

signals. Blood oxygen sensor.[48]

Copyright 2018, Proc Natl Acad Sci U S A. Wireless

sweat sensor.[67]

Copyright 2016, Nature. Blood and pressure sensor.[68]

Copyright

2019, Sensors (Basel). Temperature sensor.[69]

Copyright 2018, ACS Sensors.

Breathalyzer.[70]

Copyright 2016, Scientific Reports. Electrochemical sweat sensor.[71]

Copyright 2018, ACS Applied Materials & Interfaces. ECG chest band.[72]

Copyright

2018, Materials (Basel). HR and diseases sensor.[73]

Copyright 2018, Scientific

reports.

Page 28: Review Flexible and wearable healthcare sensors for visual

28

Figure 4. a) The fabrication of GaAs wires with the method.[36]

Copyright 2007,

Advanced Materials. b) The printed acceleration sensor and circuit diagram.[47]

Copyright 2019, Science China Materials.

Page 29: Review Flexible and wearable healthcare sensors for visual

29

Figure 5. Blood sensors. a) The new sensors, alternating arrays of printed

light-emitting diodes and photodetectors, can detect blood oxygen levels in any part

of the body. The sensor uses light-emitting diodes to emit red and near-infrared light,

penetrating the skin and detecting the proportion of reflected light.[48]

Copyright 2018,

Proc Natl Acad Sci U S A. b) A kind of e-skin for monitoring blood pressure and

temperature. c) The sensor made of biodegradable materials utilizes edge-field

capacitance technology for monitoring arterial blood, and then transmits the data

wirelessly.[49]

Copyright 2019, Nature Biomedical Engineering.

Page 30: Review Flexible and wearable healthcare sensors for visual

30

Figure 6. a) The system of wireless battery-free sweat sensor, the process of detecting

during sweating, and the wireless transmitting and analysis interface of sweat

composition on the smart phone.[50]

Copyright 2019, Science Advances. b) Schematic

diagram of the multi-functional sweat sensor. As shown in b), the wearable

monitoring film connects to an electrochemical analyzer, and transmits data to smart

phone through blue-tooth.[51]

Copyright 2019, Small.

Page 31: Review Flexible and wearable healthcare sensors for visual

31

Figure 7. a) The size of self-powered wearable electronic sensor and the photography

of this sensor attached to the heart of a rat for monitoring heart rate.[54]

Copyright

2018, Nature. b) The smart analysis system of real-time flexible sensor for monitoring

physilological signals during exercise, including , and data collecting from the

sensor.[55]

Copyright 2019, IEEE Transactions on Biomedical Engineering.

Page 32: Review Flexible and wearable healthcare sensors for visual

32

Figure 8. The collection of VR devices for healthcare. Head-mounted VR.[74]

Copyright 2019, Otjr-Occupation Participation and Health. Tactile VR devices.[75]

Copyright 2016, Proceedings of the 2016 CHI Conference Extended Abstracts on

Human Factors in Computing Systems. VR surgery for newborns.[76]

Copyright 2014,

2014 IEEE Virtual Reality (VR). VR laparoscopy simulator.[77]

Copyright 2005, 2005

IEEE Engineering in Medicine and Biology 27th Annual Conference. VR ICU

treatment for reducing patients’ pain.[78]

Copyright 2017, Scientific Reports.

VR-based treadmill for rehabilitation of patients with Parkinson's disease.[79]

Copyright 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

Page 33: Review Flexible and wearable healthcare sensors for visual

33

Figure 9. The haptics-based Virtual Reality training system for Venepuncture.[63]

Copyright 2012, ACM.