group m analytics

89
[ GroupM Analy.cs ] Advanced analy+cs training

Upload: datalicious-pty-ltd

Post on 06-May-2015

549 views

Category:

Technology


0 download

DESCRIPTION

The presentation discusses course training on advanced analytics.

TRANSCRIPT

Page 1: Group M Analytics

[  GroupM  Analy.cs  ]  Advanced  analy+cs  training  

Page 2: Group M Analytics

[  Company  history  ]  

§  Datalicious  was  founded  in  2007  §  Strong  Omniture  web  analy+cs  history  §  One-­‐stop  data  agency  with  specialist  team  §  Combina+on  of  analysts  and  developers  § Making  data  accessible  and  ac+onable  §  Evangelizing  smart  data  driven  marke+ng  §  Driving  industry  best  prac+ce  (ADMA)  

August  2010   ©  Datalicious  Pty  Ltd   2  

Page 3: Group M Analytics

[  Smart  data  driven  marke.ng  ]  

August  2010   ©  Datalicious  Pty  Ltd   3  

Media  A=ribu.on  

Op.mise  channel  mix  

Tes.ng  Improve  usability  

$$$  

Targe.ng    Increase  relevance  

Page 4: Group M Analytics

[  Main  business  units  and  services  ]    

August  2010   ©  Datalicious  Pty  Ltd   4  

Data  PlaForms    Data  collec.on  and  processing    Web  analy.cs  solu.ons    Omniture,  Google  Analy.cs,  etc    Tag-­‐less  online  data  capture    End-­‐to-­‐end  data  plaForms    IVR  and  call  center  repor.ng    Single  customer  view  

Insights  Repor.ng    Data  mining  and  modelling    Customised  dashboards    Media  a=ribu.on  models    Market  and  compe.tor  trends    Social  media  monitoring    Online  surveys  and  polls    Customer  profiling  

Ac.on  Applica.ons    Data  usage  and  applica.on    Marke.ng  automa.on    Aprimo,  Trac.on,  Inxmail,  etc    Targe.ng  and  merchandising    Internal  search  op.misa.on    CRM  strategy  and  execu.on    Tes.ng  programs    

Page 5: Group M Analytics

[  Clients  across  all  industries  ]  

August  2010   ©  Datalicious  Pty  Ltd   5  

Page 6: Group M Analytics

[  Course  overview  ]  

101011010010010010101111010010010101010100001011111001010101010100101011001100010100101001101101001101001010100111001010010010101001001010010100100101001111101010100101001001001010  

August  2010   ©  Datalicious  Pty  Ltd   6  

Page 7: Group M Analytics

[  Day  1:  Basic  Analy.cs  ]  

§  Defining  a  metrics  framework  – What  to  report  on,  when  and  why?  – Matching  strategic  and  tac+cal  goals  to  metrics  – Covering  all  major  categories  of  business  goals  

§  Finding  and  developing  the  right  data  – Data  sources  across  channels  and  goals  – Meaningful  trends  vs.  100%  accurate  data  – Human  and  technological  limita+ons  

§  Plus  hands-­‐on  exercises  August  2010   ©  Datalicious  Pty  Ltd   7  

Page 8: Group M Analytics

[  Day  2:  Advanced  Analy.cs  ]  

§  Campaign  flow  and  media  aZribu+on  – Designing  a  campaign  flow  including  metrics  – Omniture  vs.  Google  Analy+cs  capabili+es  

§  How  to  reduce  media  waste  – Tes+ng  and  targe+ng  in  a  media  world  – Media  vs.  content  and  usability  

§  Plus  hands-­‐on  exercises  

August  2010   ©  Datalicious  Pty  Ltd   8  

Page 9: Group M Analytics

[  Training  outcomes  ]  

§  A^er  successful  comple+on  of  the  training  course  par+cipants  will  be  able  to  – Define  a  metrics  framework  for  any  client  –  Incorporate  analy+cs  into  the  planning  process  –  Enable  benchmarking  across  campaigns  –  Iden+fy  data  gaps  and  recommend  solu+ons  – Use  more  than  just  ad  server  data  for  analy+cs  –  Impress  clients  with  insights  not  spreadsheets  –  Know  how  to  extend  op+misa+on  past  media  buy  –  Show  the  true  value  of  digital  media  

August  2010   ©  Datalicious  Pty  Ltd   9  

Page 10: Group M Analytics

Plenty  of  hands  on  exercises  

Page 11: Group M Analytics

[  Prac.ce  session  prepara.on  ]  

§  Organise  client  placorm  logins  – Ad  servers:  DoubleClick,  Atlas,  Eyeblaster,  etc  – Bid  management:  Google  AdWords,  etc  – Web  analy+cs:  Google  Analy+cs,  Omniture,  etc  – Social  media:  Radian6,  S2M,  etc  

§  Plus  any  addi+onal  data  or  logins  – Google  webmaster  tools,  Facebook  fan  pages  – Phone  calls,  retail  sales,  etc  

August  2010   ©  Datalicious  Pty  Ltd   11  

Page 12: Group M Analytics

[  Metrics  framework  ]  

101011010010010010101111010010010101010100001011111001010101010100101011001100010100101001101101001101001010100111001010010010101001001010010100100101001111101010100101001001001010  

August  2010   ©  Datalicious  Pty  Ltd   12  

Page 13: Group M Analytics

Awareness   Interest   Desire   Ac.on   Sa.sfac.on  

[  AIDA  and  AIDAS  formulas  ]  

August  2010   ©  Datalicious  Pty  Ltd   13  

Social  media  

New  media  

Old  media  

Page 14: Group M Analytics

[  Importance  of  social  media  ]  Search  

WOM,  blogs,  reviews,  ra.ngs,  communi.es,  social  networks,  photo  sharing,  video  sharing  

August  2010   ©  Datalicious  Pty  Ltd  

Promo.on  

14  

Company   Consumer  

Page 15: Group M Analytics

[  Social  as  the  new  search  ]  

August  2010   ©  Datalicious  Pty  Ltd   15  

Page 16: Group M Analytics

Reach  (Awareness)  

Engagement  (Interest  &  Desire)  

Conversion  (Ac+on)  

+Buzz  (Sa+sfac+on)  

[  Simplified  AIDAS  funnel  ]  

August  2010   ©  Datalicious  Pty  Ltd   16  

Page 17: Group M Analytics

People  reached  

People  engaged  

People  converted  

People  delighted  

[  Marke.ng  is  about  people  ]  

August  2010   ©  Datalicious  Pty  Ltd   17  

40%   10%   1%  

Page 18: Group M Analytics

People  reached  

People  engaged  

People  converted  

People  delighted  

[  Addi.onal  funnel  breakdowns  ]  

August  2010   ©  Datalicious  Pty  Ltd   18  

40%   10%   1%  

New  prospects  vs.  exis+ng  customers  

Brand  vs.  direct  response  campaign  

Page 19: Group M Analytics

Exercise:  Funnel  breakdowns  

Page 20: Group M Analytics

[  Exercise:  Funnel  breakdowns  ]  

§  List  poten+ally  insighcul  funnel  breakdowns  –  Brand  vs.  direct  response  campaign  – New  prospects  vs.  exis+ng  customers  –  Baseline  vs.  incremental  conversions  –  Compe++ve  ac+vity,  i.e.  none,  a  lot,  etc  –  Segments,  i.e.  age,  loca+on,  influence,  etc  –  Channels,  i.e.  search,  display,  social,  etc  –  Campaigns,  i.e.  this/last  week,  month,  year,  etc  –  Products  and  brands,  i.e.  iphone,  htc,  etc  – Offers,  i.e.  free  minutes,  free  handset,  etc  

August  2010   ©  Datalicious  Pty  Ltd   20  

Page 21: Group M Analytics

Exercise:  Conversion  metrics  

Page 22: Group M Analytics

[  Exercise:  Conversion  metrics  ]  

§  Key  conversion  metrics  differ  by  category  – Commerce  – Lead  genera+on  – Content  publishing  – Customer  service  

August  2010   ©  Datalicious  Pty  Ltd   22  

Page 23: Group M Analytics

[Exercise:  Conversion  metrics  ]  

August  2010   ©  Datalicious  Pty  Ltd   23  

Source:  Omniture  Summit,  MaZ  Belkin,  2007  

Page 24: Group M Analytics

[  Conversion  funnel  1.0  ]  

August  2010  

Conversion  funnel  Product  page,  add  to  shopping  cart,  view  shopping  cart,  cart  checkout,  payment  details,  shipping  informa+on,  order  confirma+on,  etc  

Conversion  event  

Campaign  responses  

©  Datalicious  Pty  Ltd   24  

Page 25: Group M Analytics

[  Conversion  funnel  2.0  ]  

August  2010  

Campaign  responses  (inbound  spokes)  Offline  campaigns,  banner  ads,  email  marke+ng,    referrals,  organic  search,  paid  search,    internal  promo+ons,  etc      

Landing  page  (hub)      

Success  events  (outbound  spokes)  Bounce  rate,  add  to  cart,  cart  checkout,  confirmed  order,    call  back  request,  registra+on,  product  comparison,    product  review,  forward  to  friend,  etc  

©  Datalicious  Pty  Ltd   25  

Page 26: Group M Analytics

[  Addi.onal  success  metrics  ]  

August  2010   ©  Datalicious  Pty  Ltd   26  

Click  Through  

Add  To    Cart  

Click  Through  

Page  Bounce  

Click  Through   $  

Click  Through  

Call  back  request  

Store  Search   ?   $  

$  

$  Cart  Checkout  

Page    Views  

?  

Product    Views  

Page 27: Group M Analytics

[  Atomic  Labs  tag-­‐less  data  capture  ]  

August  2010   ©  Datalicious  Pty  Ltd   27  

§  Keep  all  your  favourite  reports  but  §  Eliminate  tag  maintenance  and  ensure    §  New  pages/content  is  tracked  automa+cally  §  Across  normal  websites,  mobiles  and  apps  

Page 28: Group M Analytics

[  Pion  integra.on  model  ]  

August  2010   ©  Datalicious  Pty  Ltd   28  

§  Single  point  of  data  capture  and  processing  

§  Real-­‐+me  queries  to  enrich  website  data    

§ Mul+ple  data  export  op+ons  for  web  analy+cs  

§  Enriching  single-­‐customer  view  website  behaviour  

Page 29: Group M Analytics

[  Rela.ve  or  calculated  metrics  ]  

§  Bounce  rate  §  Conversion  rate  §  Cost  per  acquisi+on  §  Pages  views  per  visit  §  Product  views  per  visit  §  Cart  abandonment  rate  §  Average  order  value  

August  2010   ©  Datalicious  Pty  Ltd   29  

Page 30: Group M Analytics

[  eMarketer  interac.ve  metrics  ]  

August  2010   ©  Datalicious  Pty  Ltd   30  

Page 31: Group M Analytics

[  Forrester  interac.ve  metrics  ]  

August  2010   ©  Datalicious  Pty  Ltd   31  

Source:  Omniture  Summit,  MaZ  Belkin,  2007  

Different    metrics  should  be  viewed  as  complementary  parts  of  the  measurement  jigsaw.  

Page 32: Group M Analytics

Sen+ment  

Reach  Influence  

[  Measuring  social  media  ]  

August  2010   ©  Datalicious  Pty  Ltd   32  

Page 33: Group M Analytics

Exercise:  Metrics  framework  

Page 34: Group M Analytics

Level   Reach   Engagement   Conversion   +Buzz  

Level  1  People  

Level  2  Strategic  

Level  3  Tac.cal  

[  Exercise:  Metrics  framework  ]  

August  2010   ©  Datalicious  Pty  Ltd   34  

Page 35: Group M Analytics

Level   Reach   Engagement   Conversion   +Buzz  

Level  1  People  

People  reached  

People  engaged  

People  converted  

People  delighted  

Level  2  Strategic  

Search  impressions,  UBs,  etc  

?   ?   ?  

Level  3  Tac.cal  

Click-­‐through  or  interac.on  

rate,  etc  ?   ?   ?  

[  Exercise:  Metrics  framework  ]  

August  2010   ©  Datalicious  Pty  Ltd   35  

Page 36: Group M Analytics

IR −MIMI

= ROMI + BE

[  ROI,  ROMI,  BE,  etc  ]  

August  2010   ©  Datalicious  Pty  Ltd   36  €

IR −MIMI

= ROMI

R − II

= ROI R  Revenue    I  Investment      ROI  Return  on  

 investment    IR  Incremental  

 revenue    MI  Marke+ng  

 investment    ROMI  Return  on  

 marke+ng    investment  

 BE  Brand  equity  

Page 37: Group M Analytics

[  Success:  ROMI  +  BE  ]  

§  Establish  incremental  revenue  (IR)  –  Requires  baseline  revenue  to  calculate  addi+onal    revenue  as  well  as  revenue  from  cost  savings  

§  Establish  marke+ng  investment  (MI)  –  Requires  all  costs  across  technology,  content,  data    and  resources  plus  promo+ons  and  discounts  

§  Establish  brand  equity  contribu+on  (BE)  –  Requires  addi+onal  so^  metrics  to  evaluate  subscriber  percep+ons,  experience,  amtudes  and  word  of  mouth    

August  2010   ©  Datalicious  Pty  Ltd   37  

IR −MIMI

= ROMI + BE

Page 38: Group M Analytics

[  Process  is  key  to  success  ]  

August  2010   ©  Datalicious  Pty  Ltd   38  

Source:  Omniture  Summit,  MaZ  Belkin,  2007  

Page 39: Group M Analytics

[  Recommended  resources  ]  §  200501  WAA  Key  Metrics  &  KPIs  §  200708  WAA  Analy+cs  Defini+ons  Volume  1  §  200805  Forrester  Interac+ve  Marke+ng  Metrics  Guide  §  200612  Omniture  Effec+ve  Measurement  §  200804  Omniture  Calculated  Metrics  White  Paper  §  200702  Omniture  Effec+ve  Segmenta+on  Guide  §  200810  Ronnestam  Online  Adver+sing  And  AIDAS  §  200612  Razorfish  Ac+onable  Analy+cs  Report  §  200708  Enquiro  Search  Engine  Results  2010  §  201004  Al+meter  Social  Marke+ng  Analy+cs  §  201008  CSR  Customer  Sa+sfac+on  Vs  Delight  

August  2010   ©  Datalicious  Pty  Ltd   39  

Page 40: Group M Analytics

[  Data  sources  ]  

101011010010010010101111010010010101010100001011111001010101010100101011001100010100101001101101001101001010100111001010010010101001001010010100100101001111101010100101001001001010  

August  2010   ©  Datalicious  Pty  Ltd   40  

Page 41: Group M Analytics

[  Digital  data  is  plen.ful  and  cheap    ]  

August  2010   ©  Datalicious  Pty  Ltd   41  

Source:  Omniture  Summit,  MaZ  Belkin,  2007  

Page 42: Group M Analytics

[  Digital  data  categories  ]  

August  2010   ©  Datalicious  Pty  Ltd   42  

Source:  Accuracy  Whitepaper  for  web  analy+cs,  Brian  Cli^on,  2008  

+Social  

Page 43: Group M Analytics

[  Customer  data  journey  ]  

August  2010   ©  Datalicious  Pty  Ltd   43  

To  reten.on  messages  To  transac.onal  data  

From  suspect  to   To  customer  

From  behavioural  data   From  awareness  messages  

Time  Time  prospect  

Page 44: Group M Analytics

[  Corporate  data  journey  ]  

August  2010   ©  Datalicious  Pty  Ltd   44  

Time,  Control  

Soph

is+ca+o

n  

Stage  1  

Data  Stage  2  

Insights  Stage  3  Ac.on  

Third  par+es  control  most  data,  ad  hoc  repor+ng  only,  i.e.    what  happened?  

Data  is  being  brought    in-­‐house,  shi^  towards  insights  genera+on  and  data  mining,  i.e.  why  did  it  happen?  

Data  is  fully  owned    in-­‐house,  advanced  predic+ve  modelling  and  trigger  based  marke+ng,  i.e.  what    will  happen  and    making  it  happen!  

Page 45: Group M Analytics

[  What  analy.cs  plaForm  to  use  ]  

August  2010   ©  Datalicious  Pty  Ltd   45  

Time,  Control  

Soph

is+ca+o

n  

Stage  1:  Data   Stage  2:  Insights   Stage  3:  Ac.on  

Third  par+es  control  most  data,  ad  hoc  repor+ng  only,  i.e.    what  happened?  

Data  is  being  brought    in-­‐house,  shi^  towards  insights  genera+on  and  data  mining,  i.e.  why  did  it  happen?  

Data  is  fully  owned    in-­‐house,  advanced  predic+ve  modelling  and  trigger  based  marke+ng,  i.e.  what    will  happen  and    making  it  happen!  

Page 46: Group M Analytics

People  Reached  

People  Engaged  

People  Converted  

People  Delighted  

[  Poten.al  data  sources  ]  

August  2010   ©  Datalicious  Pty  Ltd   46  

40%   10%   1%  

Quan+ta+ve  and  qualita+ve  research  data  

Website,  call  center  and  retail  data  

Social  media  data  

Media  and  search  data  

Social  media  

Page 47: Group M Analytics

[  Google  data  in  Singapore]  

August  2010   ©  Datalicious  Pty  Ltd   47  

Source:  hZp://www.hitwise.com/sg/datacentre  

Page 48: Group M Analytics

[  Search  at  all  stages  ]  

August  2010   ©  Datalicious  Pty  Ltd   48  

Source:  Inside  the  Mind  of  the  Searcher,  Enquiro  2004  

Page 49: Group M Analytics

[  Search  and  brand  strength  ]  

August  2010   ©  Datalicious  Pty  Ltd   49  

Page 50: Group M Analytics

[  Search  and  the  product  lifecycle  ]  

August  2010   ©  Datalicious  Pty  Ltd   50  

Nokia  N-­‐Series  

Apple  iPhone  

Page 51: Group M Analytics

[  Search  and  media  planning  ]  

August  2010   ©  Datalicious  Pty  Ltd   51  

Page 52: Group M Analytics

[  Search  driving  offline  crea.ve  ]  

August  2010   ©  Datalicious  Pty  Ltd   52  

Page 53: Group M Analytics

Exercise:  Search  insights  

Page 54: Group M Analytics

[  Exercise:  Search  insights  ]  §  Iden+fy  key  category  search  terms  –  Data  from  Google  AdWords  Keyword  Tool  –  Search  for  “google  keyword  tool”  – Wordle  and  IBM  Many  Eyes  for  visualiza+ons  –  Search  for  “wordle  word  clouds”  and  “ibm  many  eyes”  

§  Iden+fy  search  term  trends  and  compe+tors  –  Google  Trends  and  Google  Search  Insights  –  Search  for  “google  trends”  and  “google  search  insights”  

§  Search  and  media  planning  –  DoubleClick  Ad  Planner  by  Google  –  Search  for  “google  ad  planner”  

August  2010   ©  Datalicious  Pty  Ltd   54  

Page 55: Group M Analytics

[  Cookie  based  tracking  process  ]  

August  2010   ©  Datalicious  Pty  Ltd   55  

Source:  Google  Analy+cs,  Jus+n  Cutroni,  2007  

What  if:  Someone  deletes  their  cookies?  Or  uses  a  device  that  does  not  support  JavaScript?  Or  uses  two  computers  (work  vs.  home)?  Or  two  people  use  the  same  computer?  

Page 56: Group M Analytics

The  study  examined    data  from  two  of    the  UK’s  busiest    ecommerce    websites,  ASDA  and  William  Hill.    Given  that  more    than  half  of  all  page    impressions  on  these    sites  are  from  logged-­‐in    users,  they  provided  a  robust    sample  to  compare  IP-­‐based  and  cookie-­‐based  analysis  against.  The  results  were  staggering,  for  example  an  IP-­‐based  approach  overes+mated  visitors  by  up  to  7.6  +mes  whilst  a  cookie-­‐based  approach  overes.mated  visitors  by  up  to  2.3  .mes.    

[  Unique  visitor  overes.ma.on  ]  

August  2010   ©  Datalicious  Pty  Ltd   56  

Source:  White  Paper,  RedEye,  2007  

Page 57: Group M Analytics

Datalicious  SuperCookie  Persistent  Flash  cookie  that  cannot  be  deleted  

Page 58: Group M Analytics

[  Maximise  iden.fica.on  points  ]  

20%  

40%  

60%  

80%  

100%  

120%  

140%  

160%  

0   4   8   12   16   20   24   28   32   36   40   44   48  

Weeks  

−−−  Probability  of  iden+fica+on  through  Cookies  

August  2010   58  ©  Datalicious  Pty  Ltd  

Page 59: Group M Analytics

[  De-­‐duplica.on  across  channels  ]  

August  2010   ©  Datalicious  Pty  Ltd   59  

Banner    Ads  

Email    Blast  

Paid    Search  

Organic  Search  

$  Bid    Mgmt  

Ad    Server  

Email  PlaForm  

Google  Analy.cs  

$  

$  

$  

Central  Analy.cs  PlaForm  

$  

$  

$  

Page 60: Group M Analytics

Exercise:  Duplica.on  impact  

Page 61: Group M Analytics

[  Exercise:  Duplica.on  impact  ]  §  Double-­‐coun+ng  of  conversions  across  channels  can  

have  a  significant  impact  on  key  metrics,  especially  CPA  §  Example:  Display  ads  and  paid  search  

–  Total  media  budget  of  $10,000  of  which  50%  is  spend  on  paid  search  and  50%  on  display  ads  

–  Total  of  100  conversions  across  both  channels  with  a  channel  overlap  of  50%,  i.e.  both  channels  claim  100%  of  conversions  based  on  their  own  repor+ng  but  once  de-­‐duplicated  they  each  only  contributed  50%  of  conversions  

–  What  are  the  ini+al  CPA  values  and  what  is  the  true  CPA?  §  Solu+on:  $50  ini+al  CPA  and  $100  true  CPA  

–  $5,000  /  100  =  $50  ini+al  CPA  and  $5,000  /  50  =  $100  true  CPA  (which  represents  a  100%  increase)  

August  2010   ©  Datalicious  Pty  Ltd   61  

Page 62: Group M Analytics

Exercise:  Web  analy.cs  

Page 63: Group M Analytics

TV    audience  

Search  audience  

Banner  audience  

[  Reach  and  channel  overlap  ]  

August  2010   ©  Datalicious  Pty  Ltd   63  

Page 64: Group M Analytics

[  Es.ma.ng  reach  and  overlap  ]  §  Apply  average  unique  visitor  count  per  recorded  unique  user  names  to  all  unique  visitor  figures  in  Google  Analy+cs,  Omniture,  etc  

§  Apply  ra+o  of  total  banner  impressions  to  unique  banner  impressions  from  ad  server  to  paid  and  organic  search  impressions  in  Google  AdWords  and  Google  Webmaster  Tools  

§  Compare  Google  Keyword  Tool  impressions  for  a  specific  search  term  to  reach  for  the  same  term  in  Google  Ad  Planner  

§  Custom  website  entry  survey  and  campaign    stacking  to  establish  channel  overlap  

August  2010   ©  Datalicious  Pty  Ltd   64  

Page 65: Group M Analytics

August  2010   ©  Datalicious  Pty  Ltd   65  

Page 66: Group M Analytics

Sen.ment  analysis:  People  vs.  machine  

Page 67: Group M Analytics

[  Al.meter  social  analy.cs  ]  

August  2010   ©  Datalicious  Pty  Ltd   67  

Social  Marke+ng  Analy+cs  is  the  discipline  that  helps  companies  measure,  assess  and  explain  the  performance  of  social  media  ini+a+ves  in  the  context  of  specific  business  objec+ves.  

Page 68: Group M Analytics

[  Facebook                insights  ]  

August  2010   ©  Datalicious  Pty  Ltd   68  

Using  Facebook  Like  buZons  is  a  free  and  powerful  way  to  gain  addi+onal  insights  into  consumer  preferences  and  enabling  social  sharing  of  content    as  well  as  possibly  influence  organic  search  rankings  in    the  near  future.  

Page 69: Group M Analytics

[  Facebook  Connect  single  sign  on  ]  

August  2010   ©  Datalicious  Pty  Ltd   69  

Facebook  Connect  gives  your  company  the  following  data  and  more  with  just  one  click!    ID,  first  name,  last  name,  middle  name,  picture,  affilia+ons,  last  profile  update,  +me  zone,  religion,  poli+cal  interests,  interests,  sex,  birthday,  aZracted  to  which  sex,  why  they  want  to  meet  someone,  home  town,  rela+onship  status,  current  loca+on,  ac+vi+es,  music  interests,  tv  show  interests,  educa+on  history,  work  history,  family  and  email     Need  anything  else?  

Page 70: Group M Analytics

Appending  social  data  to  customer  profiles  Name,  age,  gender,  occupa.on,  loca.on,  social    profiles  and  influencer  ranking  based  on  email  

(influencers  only)  

(all  contacts)  

Page 71: Group M Analytics

Exercise:  Sta.s.cal  significance  

Page 72: Group M Analytics

How  many  survey  responses  do  you  need    if  you  have  10,000  customers?  

How  many  email  opens  do  you  need  to  test  2  subject  lines  if  your  subscriber  base  is  50,000?  

How  many  orders  do  you  need  to  test  6  banner  execu.ons    if  you  serve  1,000,000  banners  

Google  “nss  sample  size  calculator”  

Page 73: Group M Analytics

How  many  survey  responses  do  you  need    if  you  have  10,000  customers?  

369  for  each  ques.on  or  369  complete  responses  

How  many  email  opens  do  you  need  to  test  2  subject  lines  if  your  subscriber  base  is  50,000?  And  email  sends?  381  per  subject  line  or  381  x  2  =  762  email  opens  

How  many  orders  do  you  need  to  test  6  banner  execu.ons    if  you  serve  1,000,000  banners?  

383  sales  per  banner  execu.on  or  383  x  6  =  2,298  sales  

Google  “nss  sample  size  calculator”  

Page 74: Group M Analytics

[  Addi.onal  success  metrics  ]  

August  2010   ©  Datalicious  Pty  Ltd   74  

Click  Through  

Add  To    Cart  

Click  Through  

Page  Bounce  

Click  Through   $  

Click  Through  

Call  back  request  

Store  Search   ?   $  

$  

$  Cart  Checkout  

Page    Views  

?  

Product    Views  

Page 75: Group M Analytics

[  Importance  of  calendar  events  ]  

August  2010   ©  Datalicious  Pty  Ltd   75  

Traffic  spikes  or  other  data  anomalies  without  context  are  very  hard  to  interpret  and  can  render  data  useless  

Page 76: Group M Analytics

[  Recommended  resources  ]  §  200311  UK  RedEye  Cookie  Case  Study  §  200807  Kaushik  Tracking  Offline  Conversion  §  200906  WOM  Online  The  People  Vs  Machines  Debate  §  201005  Google  Ad  Planner  Data  Wrong  By  Up  To  20%  §  201005  MPI  How  Sta+s+cally  Valid  Is  Your  Survey  §  201005  Wikipedia  Sta+s+cal  Significance  §  201005  Wikipedia  Sta++cal  Validity  §  201005  Omniture  Campaign  Management  §  200910  Eyeblaster  Global  Benchmark  §  200903  Coremetrics  Conversion  Benchmarks  By  Industry  §  201007  WSJ  The  Web's  New  Gold  Mine  Your  Secrets  §  201008  Adver+singAge  Are  Marketers  Really  Spying  On  You  

August  2010   ©  Datalicious  Pty  Ltd   76  

Page 77: Group M Analytics

Summary  

Page 78: Group M Analytics

[  Prac.ce  session  ]  

101011010010010010101111010010010101010100001011111001010101010100101011001100010100101001101101001101001010100111001010010010101001001010010100100101001111101010100101001001001010  

August  2010   ©  Datalicious  Pty  Ltd   78  

Page 79: Group M Analytics

Exercise:  Web  analy.cs  

Page 80: Group M Analytics

[  Web  analy.cs  plaForm  prac.ce  ]  

§  Google  Analy+cs  and  Omniture  SiteCatalyst  – Placorm  basics  and  comparison  – Describing  website  visitors  –  Iden+fying  traffic  sources  (reach)  

§ Campaign  tracking  mechanics  

– Analyzing  content  usage  (engagement)  – Analyzing  conversion  drop-­‐out  (conversion)    – Defining  custom  segments  (funnel  breakdowns)  

August  2010   ©  Datalicious  Pty  Ltd   80  

Page 81: Group M Analytics

[  Top  5  Omniture  usage  .ps]  §  Bookmark  interes+ng  reports  and  frequently  used  report  

semng  right  away  so  they’re  easy  to  find  again  later    §  Use  mul+ple  browser  windows  and  con+nue  browsing  in  

a  new  window  once  you  find  an  interes+ng  report  to  facilitate  comparison  and  data  explora+on  

§  Set  automa+c  email  alerts  for  all  key  metrics  you  come  across  right  away  so  you  are  always  the  first  to  know  about  anomalies  rather  than  the  client  telling  you  

§  Use  short  URLs  next  to  all  graphs  used  in  client  presenta+ons  to  facilitate  naviga+on  to  the  underlying  report  and  to  save  +me  on  poten+al  change  requests  

§  Read  the  ‘200708  Omniture  SiteCatalyst  Report  Descrip+ons’  and  ask  for  the  clients’  Solu+on  Design  

August  2010   ©  Datalicious  Pty  Ltd   81  

Page 82: Group M Analytics

[  Describing  website  visitors  ]  

§  Average  connec+on  speed  §  Plug-­‐in  usage  (i.e.  Flash,  etc)  § Mobile  vs.  normal  computers  §  Geographic  loca+on  of  visitors  §  Time  of  day,  day  of  week  §  Repeat  visita+on  § What  else?  

August  2010   ©  Datalicious  Pty  Ltd   82  

Page 83: Group M Analytics

[  Iden.fying  traffic  sources  ]  

§  Genera+ng  de-­‐duplicated  reports  §  Campaign  tracking  mechanics  – Google  URL  Builder  and  Omniture  SAINT  

§  Conversion  goals  and  success  events  §  Plus  adding  addi+onal  metrics  §  Paid  vs.  organic  traffic  sources  §  Branded  vs.  generic  search  §  Traffic  quan+ty  vs.  quality  

August  2010   ©  Datalicious  Pty  Ltd   83  

Page 84: Group M Analytics

[  Analysing  content  usage  ]  

§  Page  traffic  vs.  engagement  §  Entry  vs.  exit  pages  §  Popular  page  paths  §  Internal  search  terms  

August  2010   ©  Datalicious  Pty  Ltd   84  

Page 85: Group M Analytics

[  Analysing  conversion  drop-­‐out  ]  

§  Defining  conversion  funnels  §  Iden+fying  main  problem  pages  §  Pages  visited  a^er  conversion  barriers  §  Conversion  drop-­‐out  by  segment  

August  2010   ©  Datalicious  Pty  Ltd   85  

Page 86: Group M Analytics

[  Defining  custom  segments  ]  

§  New  vs.  repeat  visitors  §  By  geographic  loca+on  §  By  connec+on  speed  §  By  products  purchased  §  New  vs.  exis+ng  customers  §  Branded  vs.  generic  search  §  By  demographics,  custom  segments  

August  2010   ©  Datalicious  Pty  Ltd   86  

Page 87: Group M Analytics

©  Datalicious  Pty  Ltd  

[  Useful  analy.cs  tools  ]  §  hZp://labs.google.com/sets  §  hZp://www.google.com/trends    §  hZp://www.google.com/insights/search  §  hZp://www.google.com/sktool  §  hZp://bit.ly/googlekeywordtoolexternal  §  hZp://www.google.com/webmasters  §  hZp://www.google.com/adplanner  §  hZp://www.google.com/videotarge+ng  §  hZp://www.keywordspy.com    §  hZp://www.compete.com  June  2010   87  

Page 88: Group M Analytics

©  Datalicious  Pty  Ltd  

[  Useful  analy.cs  tools  ]  

§  hZp://bit.ly/hitwisedatacenter    §  hZp://www.socialmen+on.com  §  hZp://twiZersen+ment.appspot.com  §  hZp://bit.ly/twiZerstreamgraphs  §  hZp://twitrratr.com  §  hZp://bit.ly/listo^ools1    §  hZp://bit.ly/listo^ools2  §  hZp://manyeyes.alphaworks.ibm.com  §  hZp://www.wordle.net  June  2010   88  

Page 89: Group M Analytics

Contact  me  [email protected]  

 Follow  us  

twiZer.com/datalicious    

Learn  more  blog.datalicious.com