M O M O E S T R E L L A

S E N I O R D E S I G N L E A D

INTERACTION DESIGN in the era of AI*

INTERACTION DESIGN our era AI

ARTIFICIAL INTELLIGENCE

AI. Artificial Intelligence. – A term composed by several strands ranging from computer vision, pattern and image recognition, machine learning, natural language processing, to neural networks and many others.

Some of these strands of work have been around for decades. For instance, the Discriminant Analysis method, introduced by Ronald Fisher in 1936 is foundational in what we call Machine Learning. Over the years many of these strands of work have become routine technology; a point in which they stop being considered part of AI. For example: optical character recognition.

AUGMENTED INTELLIGENCE.

But I’m more interested in AI – Augmented Intelligence

Augmented intelligence is about extending the capabilities of humans in a way that feels natural. If the intelligence of our technology feels artificial, it will never stick. And if technology replaces human, it definitely would fail. It’s not about replicating or replacing humans with machines, but designing how machines can serve people.

We must pursuit creating new intelligent products, services, and systems that adapt to people’s individual preferences, and that continually evolve to fundamentally meet human needs.

This paradigm of thinking, in using artificial intelligence to extend human capabilities, fueled the growth of Rise Science, a sleep analytics startup that specializes in applying the science of sleep to enhance elite athlete performance. Rise Science partnered with IDEO to increase stickiness of their service.

The Rise Science team had originally thought that they needed improved data visualizations, but in talking to high performance athletes, we uncovered a key insight: that app stickiness was driven by their coaches’ personalized messages and adaptive alarms, not access to better charts or graphs.

From these discoveries, we built the service to include a scalable chat function and an intelligent alarm clock that adapts to individual athletes. The Rise sleep coaching services seamlessly combines human and digital touchpoints.

The Rise app shows how a player is progressing against such goals as “sleep time,” “recovery,” and “sleep debt,” among others.

The Rise welcome kit for players complete with UV glasses, sleep mask, and bed sensor. The redesigned service helped Rise Science scale the high-touch experience of sleep coaching, to professional sports teams like the Chicago Bulls and Miami Dolphins.

So you see, augmented intelligence combines the best of both worlds: the irreplaceable and nuanced insights borne from human intuition, along with the power of technology.

IT’S OUR DUTY TO BRING HUMANITY TO TECHNOLOGY.

And so, as designers, It’s our duty to bring humanity to technology.

 …to design it to be relevant, empathetic, and soulful, to the human.

FEASIBLEVIABLE

DESIRABLE

And so, as designers, It’s our duty to bring humanity to technology.

Surely, Artificial Intelligence technology will make certain things feasible, but Designing with Augmented Intelligence in mind will make them Desirable, and Viable. This way of thinking will allow us to design solutions that are far more powerful than anything that can be achieved by artificial intelligence alone.

INTERACTION DESIGN our era AI

Now, let’s look at the era in which we as designers are working in.

THERE HAS NEVER BEEN A MORE EXCITING TIME FOR

DESIGNERS.

Our era. For designers, there has never been a more exciting time.

SILOED CREATION

COLLABORATIVE DESIGN

from to

The role of design has shifted from silo-ed creation to collaborative design. If you look at it in a timeline you’ll see how in the past, design played an important role in well defined realms, surrounded with well defined design disciplines. Industrial and Graphic Design ruled the industry. And division of labor had its advantages: Planning, design, production, and distribution had set very well defined boundaries and parameters. However in today’s world, good design thrives on collaboration to meet human needs.

INCORPORATING DATA CAPTURE IN DESIGN

RESEARCH

This doesn’t mean the discipline of design has been challenged, rather it’s been enhanced by new and different ways of work and uses of modern technology to augment our design capabilities to continue to solve problems. For example: incorporating data capture in design research, so we can better understand human needs by studying behavioral data or to identify irrational behaviors at scale…

EMBEDDING DATA SCIENCE INTO INTERACTION DESIGN

…or embedding data science into interaction design, to prototype digital products that sense, act, and learn from consumers.

Essentially, technology has enabled designers to become more collaborative and to cover more ground, at scale and in new and exciting ways.

https://neosensory.com/

This is reflective in the the tools that most of us here, use to communicate, to design, to prototype, to test, and to learn from each other.

As designers we all see technology that was historically exclusive become accessible to everybody.

We experience the rise of powerful technology that aids us to continue creating things. And more importantly…

WE GET TO DESIGN TO AUGMENT THE CAPABILITIES

OF HUMANS.

INTERACTION DESIGN our era AI

In such an era, what is the role of Interaction Design. What is the role of Interaction Designers?

Interaction design is… a line.

It’s a connection between things.

It’s a relationship that exists between people and everything else.

INTERACTION DESIGN LIVES IN PEOPLE’S RELATIONSHIP

WITH THINGS.

–Bill Moggridge, father of interaction design, and co-founder

of

YOUR WORKPLACEConsider, for example – the relationship between you and your workplace.

YOUR WORKPLACE

TRANSPORTATION

Zoom out a bit and consider the relationship between you and your means of transportation to your workplace.

YOUR WORKPLACE

TRANSPORTATION

BUILDING GATE

Between you and the gate in your building.

YOUR WORKPLACE

TRANSPORTATION

BUILDING GATE

APARTMENT DOOR

Between you and the door in your apartment.

YOUR WORKPLACE

TRANSPORTATION

BUILDING GATE

APARTMENT DOOR

BED

Between you and your pillow.

YOUR WORKPLACE

TRANSPORTATION

BUILDING GATE

APARTMENT DOOR

BED

These relationships are opportunities for design.

YOUR WORKPLACE

TRANSPORTATION

BUILDING GATE

APARTMENT DOOR

BED

From designing a smart pillow that helps people sleep better by regulating its firmness, or a bed cover that monitors body signals

YOUR WORKPLACE

TRANSPORTATION

BUILDING GATE

APARTMENT DOOR

BED

to designing a door that can be locked or unlocked remotely

YOUR WORKPLACE

TRANSPORTATION

BUILDING GATE

APARTMENT DOOR

BED

to designing intelligent mobility systems

YOUR WORKPLACE

TRANSPORTATION

BUILDING GATE

APARTMENT DOOR

BED

to designing the tools that empower you in your workplace.

HOW WILL WE CONTINUE DESIGNING FOR A FUTURE OF AUGMENTED INTELLIGENCE?

START WITH TECHNOLOGY

START WITH PEOPLE

Would you start by thinking about the technology you could use, or would you be starting from the human need?

TECHNOLOGY SETS THE

RULES

TECHNOLOGY AIDS THE PERSON

Would you let technology set the rules or would you make technology aid or extend the person? And above it all…

HOW MIGHT WE DESIGN TO AUGMENT HUMAN CAPABILITIES?

AUGMENTED SENSES

AUGMENTED PHYSIQUE

AUGMENTED COGNITION

Consider some of these augmented human capabilities [AUGMENTED SENSES/PHYSIQUE/COGNITION] – How might we design on the relationship between people and these augmented capabilities?

AUGMENTED SENSES

AUGMENTED PHYSIQUE

AUGMENTED COGNITION

How might we design visual, hearing, haptics, or orientation tools to augment our sensorial capabilities? Here are a couple of examples of what’s out there in the world.

https://neosensory.com/

Neosensory is a work in progress on sensory substitution by David Eagleman and his team. Their wearable devices take in information that is not easily accessible — for example, sound (in deaf individuals), light outside the visible spectrum, or information from connected devices — and translate them into patterns of vibrations on the body. With practice, these associations become automatic and a new sense is born.

https://aumcardio.com/

Another example is Aum Cardiovascular – a startup in the US that developed a digital stethoscope that pairs remotely with an artificial-intelligence system to help clinicians analyze acoustic and electrical data for signs of heart problems.

AUGMENTED SENSES

AUGMENTED PHYSIQUE

AUGMENTED COGNITION

How might we design interactive products for strength, speed, accuracy, fitness, and endurance to augment our physical capabilities?

https://eksobionics.com/

This example comes from Ekso Bionics, who is pioneering the field of robotic exoskeletons, or wearable robots, to augment human strength, endurance and mobility. These exoskeletons have a variety of applications in the medical, military, industrial, and consumer markets. It even enables individuals with any amount of extremity weakness, including those who are paralyzed, to stand up and walk.

https://eksobionics.com/

AUGMENTED SENSES

AUGMENTED PHYSIQUE

AUGMENTED COGNITION

Lastly, how might we design better ways to access knowledge, extend brain functions, and improve memory recall to augment our cognitive capabilities?

TED Talk: How AI can enhance our memory, work and social lives | Tom Gruber

How smart can our machines make us? Tom Gruber, co-creator of Siri, wants to make "humanistic AI" that augments and collaborates with us instead of competing with (or replacing) us. I encourage you to find his TED talk online.

TED Talk: How AI can enhance our memory, work and social lives | Tom Gruber

In his TED talk he shares his vision for a future where AI helps us achieve superhuman performance in perception, creativity and cognitive function -- from turbocharging our design skills to helping us remember everything we've ever read and the name of everyone we've ever met.

https://www.frontiersin.org/articles/10.3389/fpsyg.2016.01839/full

Virtual Reality as an Embodied Tool to Enhance Episodic Memory in Elderly

Virtual Reality as an Embodied Tool to Enhance Episodic Memory in Elderly – Basically, the core thing on memory is about hippocampus, which is in charge of both memory and spatial cognition – And VR is a very spatial experience. That’s why we are good at remembering spaces. That’s why VR and Memory can be connected.

https://vcresearch.berkeley.edu/news/sprinkling-neural-dust-opens-door-electroceuticals

Neural Dust

Neural Dust – University of Berkeley engineers have built the first dust-sized, wireless sensors that can be implanted in the body and monitor internal nerves, muscles or organs in real time. Because these batteryless sensors could also be used to stimulate nerves and muscles, the technology also opens the door to “electroceuticals” to treat disorders such as epilepsy or to stimulate the immune system or tamp down inflammation.

With all of this – Imagine the complexities. Imagine the possibilities. Imagine the opportunities! Imagine the future.

OUR FUTURE SITS IN DESIGNER’S CAPACITY TO IMAGINE.

And before I leave, I wanna show you something we put together recently. At IDEO we created a design exhibition called Hyperhuman. It is a speculative design exhibition celebrating the immense potential benefits that intelligent machines can bring to our lives, our work, and our society. IDEO looks at data science and machine learning from a protopian perspective.

HOW WE INTERACT HOW WE CREATE HOW WE GET THINGS DONE HOW WE LEARN

We envisioned a speculative world where familiar machines get an enhanced role that enables us to be better at how we interact, how we create, how we get things done, how we learn, and the surrounding systems that support our new behaviors.

17 designers and data scientists across different IDEO studios worked together on this project. We then built data-driven interactive prototypes and set them up as prompts to start researching what the augmented future might actually feel like. From those prototypes, we iterated into the four machines people saw and interacted with at the exhibition.

The Belief CheckoutLike this machine: The Belief Checkout. What if tomorrow’s supermarkets considered your values and ethics when automatically buying products for you? We outsource more and more tasks to AI. But how do we know that the decisions AI makes on our behalf are aligned with our beliefs and values? How do we impart them to the machine? The Belief Checkout’s shelves are full of products that represent values. Pick the ones that reflect you to help steer the supermarket’s algorithm. Say you value sustainability. While eating red meat may not sound like a sustainable choice, eating an overstocked steak might be. The supermarket can help you make choices that square with your values.

WE LET GO OF CONTROL, BUT OUR BELIEFS STAY INTACT.

The Belief Checkout

The Empathy Writer

The Empathy writer – Our globally connected lives mean we’re frequently brought into contact with people from different cultures and backgrounds. Despite the opportunities these networks present, we often struggle to communicate, as we are not equally fluent in the other’s language and culture. What if you could find just the right words to express your feelings? And nothing got lost in translation? The Empathy Writer helps you convey what you mean in a way that will be easily understood.

EMPATHY IS AMPLIFIED.

The Empathy Writer

The Creativity Mixer

The Creativity Mixer - What if you could describe your personality, and ‘mix’ a visual identity that expresses you? Even with a creative mindset, people often lack confidence and ability to shape and express their ideas at the highest level. What does your brand look like? Turn the dials of the Creativity Mixer to set your personality ("playful," "stubborn") and it calls up images, fonts, and colors for you to use when executing ideas.

When settled with your choices, hit print for your very own brand style guide.  Creativity is latent, tools make it accessible.

CREATIVITY IS LATENT, TOOLS MAKE IT ACCESSIBLE.

Creativity Mixer

The Purpose Compass

And lastly, The Purpose Compass: What if a machine could help you better understand your strengths? What if it could help you succeed in a machine-augmented future? Armies of robots already populate the factory floor and digital lawyers write our contracts. As intelligent machines become a fixture in every aspect of our work and lives, they inevitably start challenging our contribution to society, begging the question, do humans still matter? What is our purpose?

The Purpose Compass helps you determine your unique worth in the future. It understands what you are good at and helps you decide what to focus on to stay relevant, productive, and happy in the long term. Turn towards larger purpose goals—teaching, leading, inventing, or caring—to set a course and learn which skills you'll need to pick up to get there. Over time, many skills will be automated, freeing you up to learn new ones.

PURPOSE IS SHAPED, NOT GIVEN.

The Purpose Compass

INTERACTION DESIGN our era AI

To close, I’d like to send you off with a message. Artificial Intelligence is fundamentally changing the world around us. It’s our duty to bring humanity to the technology. To bring augmented intelligence into our future.

INTERACTION DESIGN our era AI

We all should make sure we design that intelligence in ways that make us — and by us we mean every human being — better. There has never been a more exciting, and necessary time for this.

INTERACTION DESIGN our era AI

With possibilities and opportunities come [IaD] responsibility. We are in the driving seat. So I would encourage you all to do what’s our duty. To bring this spirit to your craft.

To augment people.

To make us better.

To make humans exceptional.

to AUGMENT EVERYBODY and EVERYTHING IN BETWEEN.

M O M O E S T R E L L A

S E N I O R D E S I G N L E A D

INTERACTION DESIGN in the era of AI*

CREDITS

A L I C E H U A N G F O R H E R PA N D A P O W E R S F R O M I D E O : R I TA YA N G , M O L L I E A M K R A U T, D E A N M A L M G R E N , K A M K E S H M I R I , S A LV A E L O R T E G A , TA K A S H I W I C K E S , M AT T V I S C O , D A V E V O N D L E . S P E C I A L T H A N K S T O I D E O + M I T M E D I A L A B ’ S “ A U G M E N T E D H U M A N S ” .

H Y P E R H U M A N S E X H I B I T I O N : A A R O N A B E N T H E U E R | A N D R E A R A B I N E L L I | C H A R L O TA B L U N Á R O V Á | D A R J A W E N D E L | D A V I D S J U N N E S S O N | D E A N M A L M G R E N | F R A N Z B L A C H | G R I S H M A R A O | J U R E M A R T I N E C | J U S T I N M A S S A | K O S TA F R A N T Z I S | L U C A P O N T I C E L L I | M A R C U S PA E S C H K E | M I K E S T R I N G E R | N U S H I N YA Z D A N I | R YA N C R A N F I L L | S U S A N N E D U S W A L D

I L L U S T R AT I O N S B Y J A R R O D R Y H A L , I D E O . P H O T O G R A P H Y F R O M U N S P L A S H . C O M . A L L O T H E R I M A G E S , M O V I E C L I P S , A N D R E F E R E N C E S T O P R O D U C T S A N D S E R V I C E S A R E S H O W N F O R E D U C AT I O N A L P U R P O S E S .

P R E S E N T E D L I V E AT W I R E D C R A F T ’ S U I U X C O N F E R E N C E 2 0 1 8 .

N O T F O R U N A U T H O R I Z E D D I S T R I B U T I O N , M O D I F I C AT I O N , O R T R A N S C R I P T I O N .