automation with humans in mind: making complex systems predictable, reliable and humane
TRANSCRIPT
![Page 1: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/1.jpg)
Automation, with Humans
in MindMaking Complex Systems Predictable, Reliable and
Humane
![Page 2: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/2.jpg)
Hi, folks.
![Page 3: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/3.jpg)
I do things to/with computers.
![Page 4: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/4.jpg)
I build real-time systems.
![Page 5: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/5.jpg)
I build fault-tolerant
systems.
![Page 6: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/6.jpg)
The whole survives.
![Page 7: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/7.jpg)
I build critical systems.
![Page 8: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/8.jpg)
Failure is catastrophic.
![Page 9: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/9.jpg)
Complex Systems
![Page 10: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/10.jpg)
Complex Systems
• Non-linear feedback
![Page 11: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/11.jpg)
Complex Systems
• Non-linear feedback
• Coupled to external systems
![Page 12: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/12.jpg)
Complex Systems
• Non-linear feedback
• Coupled to external systems
• Difficult to model, understand
![Page 13: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/13.jpg)
AdRoll
![Page 14: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/14.jpg)
Let’s talk about the future.
![Page 15: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/15.jpg)
Let’s talk automation.
![Page 16: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/16.jpg)
Let’s talk human cooperating with machine.
![Page 17: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/17.jpg)
Apollo 13
![Page 18: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/18.jpg)
A complex craft.
![Page 19: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/19.jpg)
It wasn’t clear how to orient the system.
![Page 20: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/20.jpg)
Rocket with a tin can and some humans on top?
![Page 21: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/21.jpg)
More elaborate rocket plane?
![Page 22: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/22.jpg)
A matter of significant debate.
![Page 23: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/23.jpg)
A balance was struck.
![Page 24: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/24.jpg)
Saturn V was a big, completely automatic rocket.
![Page 25: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/25.jpg)
With a space plane on top.
![Page 26: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/26.jpg)
A wee problem with the Service Module.
![Page 27: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/27.jpg)
No fuel, no O2 and a
dead boat.
![Page 28: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/28.jpg)
What to do?
![Page 29: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/29.jpg)
Improvise.
![Page 30: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/30.jpg)
Mission Control puzzled out new budgets.
![Page 31: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/31.jpg)
Used the Lunar Module rocket for main propulsion.
![Page 32: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/32.jpg)
Bridged incompatible systems with
available materials.
![Page 33: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/33.jpg)
Tools aid experts to overcome
catastrophic failure.
![Page 34: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/34.jpg)
Automation, done right, relieves tedium.
![Page 35: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/35.jpg)
Automation, done right, reduces errors.
![Page 36: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/36.jpg)
Automation, done right, liberates.
![Page 37: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/37.jpg)
Let’s talk human versus machine.
![Page 38: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/38.jpg)
Chernobyl
![Page 39: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/39.jpg)
Graphite-moderated boiled water reactor.
![Page 40: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/40.jpg)
Requires active cooling.
![Page 41: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/41.jpg)
Worse, unstable at low power levels.
![Page 42: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/42.jpg)
Even worse, very high positive void coefficient.
![Page 43: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/43.jpg)
Worst of all, Soviet political dynamics.
![Page 44: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/44.jpg)
During a test of a backup system, the reactor was driven into a failure-prone state.
![Page 45: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/45.jpg)
Warning signs were ignored.
![Page 46: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/46.jpg)
Boom
![Page 47: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/47.jpg)
In the immediate aftermath vital
equipment is not available.
![Page 48: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/48.jpg)
It’s all locked in a safe.
![Page 49: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/49.jpg)
The sole man with a key is
dead, crushed under rubble.
![Page 50: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/50.jpg)
There’s nothing to be done.
![Page 51: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/51.jpg)
The reactor
fails according
to its nature.
![Page 52: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/52.jpg)
Much is irradiated.
![Page 53: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/53.jpg)
Many die. An entire region of Ukraine is abandoned.
![Page 54: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/54.jpg)
Automation, done wrong, mechanizes humans.
![Page 55: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/55.jpg)
Automation, done wrong, misdirects.
![Page 56: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/56.jpg)
Automation, done wrong, entraps.
![Page 57: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/57.jpg)
Every system carries the potential for its own destruction.
![Page 58: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/58.jpg)
“Normal Accidents”
![Page 59: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/59.jpg)
Failure is inevitable.
![Page 60: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/60.jpg)
The design of any system must include
failure as a first class concern.
![Page 61: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/61.jpg)
Otherwise, system failure happens in
completely arbitrary ways.
![Page 62: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/62.jpg)
How do you design for failure?
![Page 63: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/63.jpg)
Cyborg it up a little.
![Page 64: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/64.jpg)
Don’t do it alone.
![Page 65: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/65.jpg)
Have resources you’re willing to sacrifice.
![Page 66: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/66.jpg)
Accept failure. Learn from it.
![Page 67: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/67.jpg)
Study the accidents of others.
![Page 68: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/68.jpg)
Some things aren’t worth building.
![Page 69: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/69.jpg)
Understand what you build.
![Page 70: Automation With Humans in Mind: Making Complex Systems Predictable, Reliable and Humane](https://reader030.vdocuments.mx/reader030/viewer/2022032514/55d578fbbb61eba42f8b45d3/html5/thumbnails/70.jpg)
Thanks!<3
@bltroutwine