designing’a’better’battery’with’ machine’learning ·...

24
Designing a better battery with machine learning Austin D. Sendek, Ekin D. Cubuk, Qian Yang, Gowoon Cheon, Evan R. Antoniuk, KarelAlexander N. Duerloo, Yi Cui, Evan J. Reed MATLAB Expo 2017 Promising candidates Model extrapolation Tested materials Untested materials

Upload: others

Post on 07-Oct-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

Designing  a  better  battery  with  machine  learning

Austin  D.  Sendek,  Ekin D.  Cubuk,  Qian  Yang,  Gowoon Cheon,  Evan  R.  Antoniuk,  Karel-­‐Alexander  N.  Duerloo,  Yi  Cui,  Evan  J.  Reed

MATLAB  Expo  2017

0 1 2 3 4 50

0.2

0.4

0.6

0.8

1

Promising candidates

Model extrapolationTested  materials

Untested  materials

Page 2: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

AutomotiveRenewable grid

Drones/aviation

Mobile electronics

Lithium-­‐ion  batteries  will  enable  major  innovations  in  energy

Page 3: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

Safety

AutomotiveEnergy  density

Renewable grid

Drones/aviation

Mobile electronics

Today’s  lithium-­‐ion  batteries  still  face  many  challenges

Cycle  life

Cost

Page 4: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

AutomotiveAutomotiveRenewable grid

Drones/aviation

Mobile electronics

Graphite, metal Transition metal oxide

Organic solvent + lithium salt

A  major  problem  worth  solving:  liquid  electrolytes

• Volatile  and  flammable• Highly  reactive• Low  density• Non-­‐dendrite  suppressing

Page 5: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

AutomotiveAutomotiveRenewable grid

Drones/aviation

Mobile electronics

Graphite, metal Transition metal oxide

Solid crystal with mobile lithium

A  major  problem  worth  solving:  liquid  electrolytes

Page 6: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

AutomotiveRenewable grid

Drones/aviation

Mobile electronics

Solid  electrolytes  represent  a  promising  route  to  improvement

Cycle  life

Cost

Energy  density

Safety Non-­‐flammable  and  stable

Higher  voltages

Abundant  materials

Dendrite  suppression

Page 7: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

Source:  US  Department  of  Energy  Advanced  Research  Projects  Agency  – Energy  

The  challenge:  trial-­‐and-­‐error  search  for  candidates  satisfying  many  criteria

Page 8: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

Structure Property1970s

present

X1 Y1

X2 Y2

X3 Y3

Xn Yn

X4 Y4

This can be formulated as a supervised learning problem:

f(X) = Yf(structure) = property

Can we learn effectively from the data we’ve already generated?

Existing  discovery  efforts  are  driven  by  trial-­‐and-­‐error

Machine  learning  may  improve  success  rate  beyond  trial-­‐and-­‐error!

Page 9: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’
Page 10: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

We  draw  on  the  wisdom  in  the  literature  for  “hypotheses”

No single feature has strong correlation with

ionic conductivity across the broad spectrum of 40

materials

C=corr(X,Y)

AD  Sendek,  Q  Yang,  ED  Cubuk,  KAN  Duerloo,  Y  Cui,  EJ  Reed.  Ener.  &  Environ.  Sci.,  doi:10.1039/C6EE02697D  (2017)

Page 11: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

We  collect  40  experimental  measurements  of  conductivity  for  solids

• We  adopt  a  binary  classification  strategy  with  a  10-­‐4 S/cm  boundary,  motivated  by  engineering  requirements

• Training  set  includes  11  “good”  conductors,  29  “bad”  conductors

AD  Sendek,  Q  Yang,  ED  Cubuk,  KAN  Duerloo,  Y  Cui,  EJ  Reed.  Ener.  &  Environ.  Sci.,  doi:10.1039/C6EE02697D  (2017)

Page 12: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

Assuming  a  logistic  form,  we  search  for  the  maximally  predictive  set  of  features:

?

We  employ  logistic  regression  (two-­‐class  classifier)

(Looping  through  data  arrays  =  MATLAB’s  wheelhouse!)

Page 13: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

We  employ  logistic  regression  (two-­‐class  classifier)

Candidate  hypotheses  (“features”)

Find  feature  set  that  bestreproduces  the  dataunder  cross-­‐validation

Experimental  data

features=nchoosek(all_feat,n)

RMSE=cross_validate(features)

Page 14: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

Lithium-lithium bond number

Sublatticebond ionicity

Anion frameworkcoordination

Li-anion separationdistance

Li-Li separationdistance

>1  week  with  DFT                                              <  1  s  with  ML

Machine  learning  finds  the  best  Li  conduction  model  for  this  data  set

AD  Sendek,  Q  Yang,  ED  Cubuk,  KAN  Duerloo,  Y  Cui,  EJ  Reed.  Ener.  &  Environ.  Sci.,  doi:10.1039/C6EE02697D  (2017)

Page 15: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

Ionic  conductivity  is  not  all  that  matters!  We  also  screen  on:

• High  stability  against  oxidation• High  stability  against  reduction• Low  electronic  conductivity• High  phase  stability• Low  cost• High  earth  abundance

Gibbs  free  energyPresence  of  transition  metals

Band  gapConvex  hull

Cost  of  raw  elements  involvedAbundance  of  elements  in  Earth’s  crust

All  Li-­‐containing  materials:  >12,000

All requirements met except ionic conductivity: 317

All requirements: 21

We  perform  the  first  holistic  structure  screening  of  all  >12,000  candidates

AD  Sendek,  Q  Yang,  ED  Cubuk,  KAN  Duerloo,  Y  Cui,  EJ  Reed.  Ener.  &  Environ.  Sci.,  doi:10.1039/C6EE02697D  (2017)

Page 16: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

…and  hope  we’re  right

We  publish  21  promising  new  candidates  (without  validation!)

Page 17: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

How  well  does  the  model  do?

Page 18: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

AD  Sendek,  ED  Cubuk,  Y  Cui,  EJ  Reed.  In  preparation.  (2017)

We  discover  ten  new  solids  that  are  superionic  conductors

Unit  cell DFT  MD  @  900KLi  MSD  @  900K  +  attempt  frequency Li  conductivity  @  RT

~  10%&  S/cm

< 10%&  S/cm

~  10%,  S/cm

Page 19: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

Random  success  rate:  ~10%

(melting  cases  excluded)

Name PsuperionicBaLiBS3 58.9%Li5B7S13 89.7%

Sr2LiCBr3N2 100%SrLi(BS2)3 51.8%LiErSe2 54.3%Li2B2S5 99.4%Li3ErCl6 65.5%Li2HIO 65.2%

Li2GePbS4 60.4%LiSO3F 100%LiCl 83.7%

LiSmS2 89.0%Li3InCl6 65.6%CsLi2BS3 81.2%

LiMgB3(H9N)2 100%RbLiS 77.5%LiDyS2 90.1%LiHoS2 89.9%LiErS2 89.9%

LiHo3Ge2(O4F)2 98.4%KLiS 76%

Name PsuperionicLiLa2SbO6 0Li6UO6 7.70%

Li4H3BrO3 43%LiInF4 0.60%LiBiF4 0.20%

CsLi2(HO)3 3.50%Li6Ho(BO3)3 10.10%RbLiB4O7 4%LiU4P3O20 0.10%

Li4Be3As3ClO12 0.30%Li6TeO6 6.40%

... ...

Random  simulations

Model success  rate:  ~35%

(melting  cases  excluded)

We  discover  ten  new  solids  that  are  superionic  conductors

Learning  from  only  40  data  points  =  3x  improvement  over  guesswork

ML-­‐guided  simulations

AD  Sendek,  ED  Cubuk,  Y  Cui,  EJ  Reed.  In  preparation.  (2017)

+  exciting,  new,  potentially  record-­‐setting  material!

Page 20: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

Our  algorithm  outperforms  humans  in  accuracy  and  speed

AD  Sendek,  ED  Cubuk,  G  Cheon,  Y  Cui,  EJ  Reed.  In  preparation.  (2017)

Ph.D.  students

Logistic  regression  trained  on  40  examples

Physics-­‐based  models

Rand

om  gue

ssing  ba

selin

e

Page 21: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

• Our  model  is  ~3x  better  than  random  guessing• Achieved  by  collecting  most  of  the  available  data  and  proposed  wisdom  over  past  four  decades

• We  perform  the  first  holistic  screening  of  all  known  Li  containing  solids  and  discover  several  new  superionic  conducting  structures

• Exciting  new  materials  for  further  development!

We  leverage  machine  learning  to  identify  the  most  promising  solid  electrolytes  106x  faster  than  state-­‐of-­‐the-­‐art

Screening:  AD  Sendek,  Q  Yang,  ED  Cubuk,  KAN  Duerloo,  Y  Cui,  EJ  Reed.  Ener.  &  Environ.  Sci.,  doi:10.1039/C6EE02697D  (2017).DFT  MD:  AD  Sendek,  ED  Cubuk,  Y  Cui,  EJ  Reed.  In  preparation.

Page 22: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

40  data  points  =  3x  improvement  

Imagine  what  we  can  do  with  100,  500,  1000?

Page 23: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

The  value  we  get  from  MATLAB

Quick prototyping• MATLAB is easy and intuitive to use; get a prototype out the door faster

Text file processing• Very easy to scan through directories and read in files

Thorough, up-to-date documentation• Can always get answers quickly

Figure generation• All our figures are made in MATLAB; it is easy and the plots are clean

Page 24: Designing’a’better’battery’with’ machine’learning · Designing’a’better’battery’with’ machine’learning Austin’D.’Sendek, EkinD.’Cubuk,Qian’Yang, GowoonCheon,Evan’

Thank  you!

Austin  SendekEmail:  [email protected]:  stanford.edu/~asendek

Prof.  Evan  Reed:  [email protected]