real-time operator physiological monitoring to drive human ......human inspired. technology driven....
TRANSCRIPT
![Page 1: Real-Time Operator Physiological Monitoring to Drive Human ......Human Inspired. Technology Driven. 1 Lisa Baraniecki Biomedical Engineer lbaraniecki@atinc.com Real-Time Operator Physiological](https://reader033.vdocuments.mx/reader033/viewer/2022050405/5f8267f8b50a8d74ce39ce5d/html5/thumbnails/1.jpg)
Human Inspired. Technology Driven. 1
Lisa Baraniecki
Biomedical Engineer [email protected]
Real-Time Operator Physiological Monitoring to Drive Human-Robot
Interaction (HRI) Design
8737 Colesville Rd, Ste. L203 Silver Spring, MD 20910
www.atinc.com
![Page 2: Real-Time Operator Physiological Monitoring to Drive Human ......Human Inspired. Technology Driven. 1 Lisa Baraniecki Biomedical Engineer lbaraniecki@atinc.com Real-Time Operator Physiological](https://reader033.vdocuments.mx/reader033/viewer/2022050405/5f8267f8b50a8d74ce39ce5d/html5/thumbnails/2.jpg)
Human Inspired. Technology Driven.
Background
Shared work spaces Shared or dependent tasks Shared “mental models”
Shared situation awareness Affective awareness Kinetic actions
![Page 3: Real-Time Operator Physiological Monitoring to Drive Human ......Human Inspired. Technology Driven. 1 Lisa Baraniecki Biomedical Engineer lbaraniecki@atinc.com Real-Time Operator Physiological](https://reader033.vdocuments.mx/reader033/viewer/2022050405/5f8267f8b50a8d74ce39ce5d/html5/thumbnails/3.jpg)
Human Inspired. Technology Driven.
• The capabilities of robots are constrained by interaction limitations
- Effectiveness of automation is dependent on human control capabilities
- Robot performance is often dictated by operator skill
- Interaction is largely dictated by interface design
Limitations
![Page 4: Real-Time Operator Physiological Monitoring to Drive Human ......Human Inspired. Technology Driven. 1 Lisa Baraniecki Biomedical Engineer lbaraniecki@atinc.com Real-Time Operator Physiological](https://reader033.vdocuments.mx/reader033/viewer/2022050405/5f8267f8b50a8d74ce39ce5d/html5/thumbnails/4.jpg)
Human Inspired. Technology Driven.
• Interface design is currently more of an art than a science
- Often based on engineering principles and robot functionality
- Designers depend on user adaptability
- Significant training time is currently required
Art vs. Science
![Page 5: Real-Time Operator Physiological Monitoring to Drive Human ......Human Inspired. Technology Driven. 1 Lisa Baraniecki Biomedical Engineer lbaraniecki@atinc.com Real-Time Operator Physiological](https://reader033.vdocuments.mx/reader033/viewer/2022050405/5f8267f8b50a8d74ce39ce5d/html5/thumbnails/5.jpg)
Human Inspired. Technology Driven.
Solution
• Interfaces must account for dynamic changes in interaction parameters -Human/Robot/Mission parameters -Environment/Dispositions/SOPs/ROEs
• Effective human-robot team interaction must optimize task allocation -Exploit strengths and capabilities of humans and
machines -Compensate for limitations of humans and
machines
![Page 6: Real-Time Operator Physiological Monitoring to Drive Human ......Human Inspired. Technology Driven. 1 Lisa Baraniecki Biomedical Engineer lbaraniecki@atinc.com Real-Time Operator Physiological](https://reader033.vdocuments.mx/reader033/viewer/2022050405/5f8267f8b50a8d74ce39ce5d/html5/thumbnails/6.jpg)
Human Inspired. Technology Driven.
Efforts in HRI
• DRC Evaluation • Dynamic Robot Operator Interface Design
(DROID) Assessment, Guidance, and Engineering Tool (AGENT)
![Page 7: Real-Time Operator Physiological Monitoring to Drive Human ......Human Inspired. Technology Driven. 1 Lisa Baraniecki Biomedical Engineer lbaraniecki@atinc.com Real-Time Operator Physiological](https://reader033.vdocuments.mx/reader033/viewer/2022050405/5f8267f8b50a8d74ce39ce5d/html5/thumbnails/7.jpg)
Human Inspired. Technology Driven.
Primary Task
![Page 8: Real-Time Operator Physiological Monitoring to Drive Human ......Human Inspired. Technology Driven. 1 Lisa Baraniecki Biomedical Engineer lbaraniecki@atinc.com Real-Time Operator Physiological](https://reader033.vdocuments.mx/reader033/viewer/2022050405/5f8267f8b50a8d74ce39ce5d/html5/thumbnails/8.jpg)
Human Inspired. Technology Driven.
Secondary Task
![Page 9: Real-Time Operator Physiological Monitoring to Drive Human ......Human Inspired. Technology Driven. 1 Lisa Baraniecki Biomedical Engineer lbaraniecki@atinc.com Real-Time Operator Physiological](https://reader033.vdocuments.mx/reader033/viewer/2022050405/5f8267f8b50a8d74ce39ce5d/html5/thumbnails/9.jpg)
Human Inspired. Technology Driven.
Physiological Metrics
• Provide objective assessment of operator state
- Cognitive and affective state detection
- Verbal vs Spatial working memory load
• Can be empirically correlated to performance metrics
- Insight into underlying cognitive/ psychomotor/ affective processes
![Page 10: Real-Time Operator Physiological Monitoring to Drive Human ......Human Inspired. Technology Driven. 1 Lisa Baraniecki Biomedical Engineer lbaraniecki@atinc.com Real-Time Operator Physiological](https://reader033.vdocuments.mx/reader033/viewer/2022050405/5f8267f8b50a8d74ce39ce5d/html5/thumbnails/10.jpg)
Human Inspired. Technology Driven.
Findings
![Page 11: Real-Time Operator Physiological Monitoring to Drive Human ......Human Inspired. Technology Driven. 1 Lisa Baraniecki Biomedical Engineer lbaraniecki@atinc.com Real-Time Operator Physiological](https://reader033.vdocuments.mx/reader033/viewer/2022050405/5f8267f8b50a8d74ce39ce5d/html5/thumbnails/11.jpg)
Human Inspired. Technology Driven.
Adaptable Interfaces
-Support modularity and redundancy - Customizable to specific mission, operator, and
robot configurations -Able to be reconfigured on the fly -Automatically reconfigure in response to:
-Operator state -Robot state -Environmental factors
![Page 12: Real-Time Operator Physiological Monitoring to Drive Human ......Human Inspired. Technology Driven. 1 Lisa Baraniecki Biomedical Engineer lbaraniecki@atinc.com Real-Time Operator Physiological](https://reader033.vdocuments.mx/reader033/viewer/2022050405/5f8267f8b50a8d74ce39ce5d/html5/thumbnails/12.jpg)
Human Inspired. Technology Driven.
HRI Design Ontology
![Page 13: Real-Time Operator Physiological Monitoring to Drive Human ......Human Inspired. Technology Driven. 1 Lisa Baraniecki Biomedical Engineer lbaraniecki@atinc.com Real-Time Operator Physiological](https://reader033.vdocuments.mx/reader033/viewer/2022050405/5f8267f8b50a8d74ce39ce5d/html5/thumbnails/13.jpg)
Human Inspired. Technology Driven.
Design Ontology (Mission) • Ontology relates concepts within underlying taxonomy
- Smart agent software architecture, underlying database and ontology to support automated HRI design guidance
- Formulate ontologies to allow analysis using an autonomous reasoning agent
- Set of relationships are of particular importance for analysis
- Based on scientifically-grounded design principles and validated assessment metrics
![Page 14: Real-Time Operator Physiological Monitoring to Drive Human ......Human Inspired. Technology Driven. 1 Lisa Baraniecki Biomedical Engineer lbaraniecki@atinc.com Real-Time Operator Physiological](https://reader033.vdocuments.mx/reader033/viewer/2022050405/5f8267f8b50a8d74ce39ce5d/html5/thumbnails/14.jpg)
Human Inspired. Technology Driven.
Goal
• Based on Multi-disciplinary HRI design process
- Involve stakeholders early in design process
- Leverage strengths/weaknesses of humans and robots
- Act as a translator between humans and robots
- Mission-centric approach
- Multi-modal and adaptive interfaces
Cognitive Motor Affective
Taxonomy of Human and Robot Skills
![Page 15: Real-Time Operator Physiological Monitoring to Drive Human ......Human Inspired. Technology Driven. 1 Lisa Baraniecki Biomedical Engineer lbaraniecki@atinc.com Real-Time Operator Physiological](https://reader033.vdocuments.mx/reader033/viewer/2022050405/5f8267f8b50a8d74ce39ce5d/html5/thumbnails/15.jpg)
Human Inspired. Technology Driven.
Take Home
• HRI should be considered from the beginning influencing robotic design
• Empirically-based methodology is needed
• Operator physiological monitoring can provide objective and quantifiable data to drive HRI design and assessment
• Real-time physiological measures can be used to drive adaptive interfaces
![Page 16: Real-Time Operator Physiological Monitoring to Drive Human ......Human Inspired. Technology Driven. 1 Lisa Baraniecki Biomedical Engineer lbaraniecki@atinc.com Real-Time Operator Physiological](https://reader033.vdocuments.mx/reader033/viewer/2022050405/5f8267f8b50a8d74ce39ce5d/html5/thumbnails/16.jpg)
Human Inspired. Technology Driven.
Questions?