software dei using a microwave oven - swarun kumar · cooking is the application of heat to...

81
1

Upload: others

Post on 22-Jun-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

1

Page 2: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Software Defined Cooking (SDC) using a microwave oven

Haojian Jin

Jingxian Wang

Swarun Kumar

Jason Hong

2

Page 3: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Cooking is the application of heat to ingredients to

transform them via chemical and physical reactions Cooking is the application of heat to ingredients to

transform them via chemical and physical reactions

Jeff Potter. Cooking for Geeks: Real Science, Great Hacks, and Good Food. 3

Page 4: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Cooking is the application of heat to ingredients to

transform them via chemical and physical reactions

Jeff Potter. Cooking for Geeks: Real Science, Great Hacks, and Good Food.

SDC = programmable heating

heat the food in a software-defined thermal trajectory (recipe).

4

Page 5: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

https://www.huffpost.com/entry/bacon-mistakes-how-to-cook_n_3111706 5

overcooking the fat,

without burning the meat.

Page 6: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Cooked = Temperature x Time x Space

6

Software-defined Cooking Recipe

Page 7: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

time

temperature

Preheat

Denature myosin

Kill bacteria

Denature actin

Burn fat

50°C

55°C

65.5°C

163°C

7

Software-defined Cooking Recipe

Cooked = Temperature x Time x Space

Page 8: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

time

temperature

Preheat

Denature myosin

Kill bacteria

Denature actin

Burn fat

50°C

55°C

65.5°C

163°C

a fat pixel

8

Software-defined Cooking Recipe

Cooked = Temperature x Time x Space

Page 9: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

9

Software-defined Cooking Recipe

Cooked = Temperature x Time x Space

time

temperature

Preheat

Denature myosin

Kill bacteria

Denature actin

Burn fat

50°C

55°C

65.5°C

163°C

a fat pixel

a meat pixel

Page 10: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

SDC (software-defined cooking): a novel low-cost closed-loop system that can sense and control heating at a fine-grained resolution.

10

Page 11: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

SDC (software-defined cooking): a novel low-cost closed-loop system that can sense and control heating at a fine-grained resolution.

11

We have a demo booth!

Page 12: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Spoiler alert

12

high heat

Page 13: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

13

Spoiler alert

high heat

Page 14: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

14

Spoiler alert

Page 15: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

third most popular domestic heating method (after baking and grilling)

15

Page 16: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

reheating leftovers uneven & unpredictable heating

Today’s Microwave: a blunt heating device

16

Page 17: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Microwave can only heat food blindly

Don’t know how much heat each food pixel has absorbed.

Have no way to actuate heating on a specific food pixel.

17

1

2

Page 18: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Sensing

Actuation

18

A closed-loop system to heat smartly

Don’t know how much heat each food pixel has absorbed.

Have no way to actuate heating on a specific food pixel.

1

2

Page 19: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Sensing

Actuation

19

A closed-loop system to heat smartly

Page 20: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Sensing

Actuation

20

A closed-loop system to heat smartly

Page 21: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Heat Sensing

21

Page 22: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Most electronics & batteries are not microwave-safe.

22

Sensing related work (1)

Page 23: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Microwave Synthesis Workstation

8 temperature sensors

$ 86,000+

23

Sensing related work (2)

Specialized microwave-safe sensors are delicate and expensive.

Page 24: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Neon lights

Electrodes

Glass

Low-pressure Neon gas mixture

24

Page 25: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

25

Low-cost,

wireless,

battery-free,

microwave-safe,

glow in strong EM

Page 26: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Programming EM sensitivity

dark glow -> brighter

EM field strength

burned

26

Page 27: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Programming EM sensitivity

dark glow -> brighter

EM field strength

burned

cannot measure any EM field cannot measure any EM field

can measure the EM field

27

Page 28: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Wires as the antenna for energy harvesting

28 Glowing principles => Paper

Programming EM sensitivity

Page 29: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

dark glow -> brighter burned

dark glow -> brighter burned

dark glow -> brighter

EM field strength

burned

0 mm

7.5 mm

15 mm

29

Programming EM sensitivity

Page 30: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

dark glow -> brighter burned

dark glow -> brighter burned

dark glow -> brighter

EM field strength

burned

0 mm

7.5 mm

15 mm

30

Programming EM sensitivity

Page 31: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Placement of Neon Lights

31

turntable with 32 neon lights cover with 32 neon lights

3cm

Page 32: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

non-line-of-sight neon light signals

Optical fibers

32

Page 33: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

A web cam

33

A thermal cam

Sensors

Page 34: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

A web cam

34

A thermal cam

Sensors Raw data

3D EM field

raw temperature

Page 35: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Temperature P

Gradient P’

A web cam

35

A thermal cam

Sensors Raw data Output

3D EM field

raw temperature ext

en

de

d k

alm

an fi

lte

r

Page 36: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Heat Actuation

36

Page 37: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

turn table for blind rotation

37

Actuation related work

non-uniform and unpredicatable

Page 38: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

A closed-loop turntable

Desired heat patterns from software-defined recipes

Current temperature distribution from Sensors

at time t 38

Page 39: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Desired heat patterns

Current temperature distribution

at time t

Heating gap

39

A closed-loop turntable

Page 40: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Desired heat patterns from Software-defined recipe

Current temperature

distribution ℗

at time t

Heating gap

Realtime heating power (P’)

temperature gradient

40

A closed-loop turntable

Page 41: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Desired heat patterns from Software-defined recipe

Current temperature

distribution ℗

at time t

Heating gap

temperature gradient

Adjust rotation plan

41

A closed-loop turntable

Realtime heating power (P’)

Page 42: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Microwave cannot heat individual pixels independently.

42

Heating patterns from 3D standing waves

Page 43: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Determining the rotation plan

43

Realtime heating power (P’)

Page 44: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Determining the rotation plan

44

Heating gapRealtime heating

power (P’)

=

Page 45: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Determining the rotation plan

45

Heating gapRealtime heating

power (P’)

=a knapsack problem

Optimization details => Paper

Page 46: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

46

Spoiler alert

Page 47: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

47

Spoiler alert

Page 48: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Microwave accessories

Details => Paper 48

Page 49: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

49

patterned microwave susceptor

ensure coverage through SDC

Page 50: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Evaluation

50

Page 51: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Evaluation apparatus

thermal-chromatic

pigment + rice

reusable

turn pink if p > 31°C

51 The room temperature is at 20°C.

Page 52: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

52

Uniform heating

heat the rice in a plate uniformly to 60°C in 2 minutes.

Baselines: microwave oven w/o turntable

Page 53: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Uniform Heating 53

time

hot spots

cold spots

Page 54: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Uniform Heating 54

cold spots

Page 55: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Uniform Heating 55

Page 56: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Uniform Heating 56

Uniform heating

improve the thermal heating uniformity by 633%

compared to microwaves with a blind turntable.

More quantitative results => Paper

Page 57: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Arbitrary Heating 57

50°C

500°C

with a microwave susceptor ring

Arbitrary heating

Page 58: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

58

App: Cooking bacon

Page 59: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

59

Heated meat and fat will shrink.

App: Cooking bacon

Page 60: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

More apps => Paper 60

App: Cooking bacon

Page 61: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

61

1. SDC cooking is slower.

2. Some heating patterns might be infeasible.

3. Not sure if it’s more delicious. :-)

Limitations

Page 62: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

1. 6 DoF turntable

2. Higher frequency microwave + beamforming

3. Replacing neon lights with rectifiers

62

Future work

Page 63: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Software Defined Cooking using a microwave oven

Haojian Jin, Jingxian Wang, Swarun Kumar, Jason Hong, Carnegie Mellon University 63

Page 64: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Why Microwave?

Radiation is most programmable because electromagnetic wave is reflective and stackable.

64

Page 65: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Place thermal camera outside

1. limited resolution (both spatial and temporal)

2. only measure the effect of heating after-the-fact

65 Existing solutions

Why not thermal camera?

Page 66: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Challenges: heat food blindly

Sensing

1. limited resolution (both spatial and temporal)

2. only measure the effect of heating after-the-fact

Actuation

3. blind rotation.

4. limited degree of freedom.

66

Page 67: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Cooking is the application of heat to ingredients to

transform them via chemical and physical reactions

Jeff Potter. Cooking for Geeks: Real Science, Great Hacks, and Good Food.

that improve flavor, reduce chances of food borne illness, and increase nutritional value.

leave this space for professional chefs.

67

Page 68: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

knapsack problemStochastic

The heat pattern is non-static and unpredictable.

68

Many factors can impact heat patterns.

e.g., size, temperature, texture, material types

Page 69: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Solving the Optimization (3)

A greedy approximation algorithm

At each step of the journey, heat at the rotation angle whose temperature gradient is most similar to the current heating gap.

Greedy strategy:

69

Page 70: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Cooking is the application of heat to ingredients to

transform them via chemical and physical reactions

Jeff Potter. Cooking for Geeks: Real Science, Great Hacks, and Good Food.

that improve flavor, reduce chances of food borne illness, and increase nutritional value.

70

Page 71: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Cooked = Temperature x Time

onsen tamago/hot spring eggs/63°C eggs

71

Page 72: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Cooked = Temperature x Time

onsen tamago/hot spring eggs/63°C eggs

set the temperature to 145°F (63°C) and let the eggs cook for anywhere from 45-90 minutes.

Aki Kamozawa and Alex Talbot Ideas in Food: Great Recipes and Why They Work: A Cookbook 72

Page 73: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

The process of protein denature is a function of the temperature & time.

73

Page 74: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Temperatures of common reactions in food

74

Page 75: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

A microwave oven converts a large electrical input (≈1000W) into microwave energy (2.45 GHz) and heats food using microwave radiation.

75

Page 76: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

dielectric heating

https://www.youtube.com/watch?v=kp33ZprO0Ck 76

Page 77: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

https://www.youtube.com/watch?v=kp33ZprO0Ck

standing wave 77

Page 78: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

3D standing wave

Unpredictable cold/hot spots Influenced by the content (shape, surface, temperature, etc.)

78

Page 79: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

Microwave is dangerous

sharp-edged metals (e.g., forks, most sensors, motors)

Microwave-safe plastic

Eggs

….

79

Page 80: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

80

Page 81: Software Dei using a microwave oven - Swarun Kumar · Cooking is the application of heat to ingredients to transform them via chemical and physical reactions Jeff Potter. Cooking

81