spatial statistics presentation - university of manitoba

Upload: umbenavi

Post on 09-Apr-2018

219 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    1/57

    Spatial StatisticalAnalysis of a CellularNetwork

    Presenters: Julian Benavides, Bryan DemianykCourse: STAT 7240Date: December 3, 2010

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    2/57

    Presentation Outline

    Overview

    Objectives

    Methods

    Analysis

    Results

    Conclusion

    Future Work

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    3/57

    Overview (1)

    The Internet Innovation Centre (IIC) research lab at the

    University of Manitoba

    Agent Based Modeling (disease spread)

    Telecommunications

    Demographics

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    4/57

    Overview (2)

    The IIC has recently obtained a very large set of

    information from MTS

    More than 46 million records in total

    Only a duration of 5 days

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    5/57

    Overview (3)

    Data consists of call information1

    Tower ID, tower location (GPS)

    Caller ID, time of call, etc.

    1 This information does NOT contain any personal or confidential information about

    MTS or their customers

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    6/57

    Presentation Outline

    Overview

    Objectives

    Methods

    Analysis

    Results

    Conclusion

    Future Work

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    7/57

    Objectives (1)

    Apply concepts weve learned in class to the data

    we have

    Try to determine if there is any spatial relationshipbetween cellular towers

    Have an interesting, and relative project

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    8/57

    Presentation Outline

    Overview

    Objectives

    Methods

    Analysis

    Results

    Conclusion

    Future Work

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    9/57

    Methods (1)

    Created a database to store all data

    Manage the huge amount of data we have

    Perform queries to get relevant chunks of data

    at a time

    Avoid timeouts for time-consuming queries

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    10/57

    Methods (2)

    We need to refine, organize, and represent the

    data we will be analyzing

    Look only at a 1 day window

    Look only at towers within Winnipeg

    Used the number of calls/tower as our variable

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    11/57

    Methods (3)

    We want to spatially represent the data we have

    Google maps

    Using different icons

    VoronoiThiessen polygons

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    12/57

    Methods (4)

    Google maps

    Plot the precise locations of the towers

    Allow the user to interact with it

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    13/57

    Google Maps (1)

    http://130.179.131.96/stats/map.php

    http://130.179.131.96/stats/map.phphttp://130.179.131.96/stats/map.php
  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    14/57

    Methods (5)

    We have the number of calls/tower, and the

    location of each tower

    We want to partition our coordinate space andassociate a certain area with a single tower

    Voronoi-Thiessen polygons

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    15/57

    Methods (6)

    Created an application to create the Voronoi

    diagram for a given data set of coordinates

    CGAL and Qt 4 libraries

    Allow user to create the Voronoi diagram

    manually, or automatically from a data set

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    16/57

    Voronoi Diagram (1)

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    17/57

    Voronoi Diagram (2)

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    18/57

    Methods (7)

    Need to find out which towers are adjacent to one

    another for our analysis

    Do notwant to do this by hand

    Delaunay Triangulation

    Conveniently, the dual of the Voronoi diagram

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    19/57

    Voronoi-Delaunay (1)

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    20/57

    Voronoi-Delaunay (2)

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    21/57

    Methods (8)

    Determine any autocorrelation using Joins Count

    approach, and Morans I statistic

    Wrote R programs to do this

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    22/57

    Presentation Outline

    Overview

    Objectives

    Methods

    Analysis

    Results

    Conclusion

    Future Work

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    23/57

    Analysis (1)

    Joins Count approach (non-free sampling)

    Let average calls/tower = Calls

    Region Ri = B if # of calls for tower in Ri Calls

    Region Ri

    = W if # of calls for tower in Ri

    < Calls

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    24/57

    Analysis (2)

    Joins Count approach (non-free sampling) contd

    Let null hypothesis H0 state that the spatial

    arrangement of regions with an above averagenumber of calls is random and the alternate

    hypothesis H1 state that the arrangement is

    clustered

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    25/57

    Analysis (3)

    Joins Count approach (non-free sampling) contd

    Calculate ZBW_Obs

    Calculate ZBB_Obs

    Reject H0 if |ZBW_Obs| > Z0.025 or

    |ZBB_Obs

    | > Z0.025

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    26/57

    Analysis (4)

    Joins Count approach (non-free sampling) contd

    Use the Monte Carlo procedure

    Use 10,000 permutations

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    27/57

    Analysis (5)

    Joins Count approach (non-free sampling) contd

    Calculate ZBW_Gen

    Calculate ZBB_Gen

    Reject H0

    if |ZBW_Gen

    | > Z0.025

    or

    |ZBB_Gen| > Z0.025

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    28/57

    Analysis (6)

    Morans I statistic (assumption R)

    Let the null hypothesis H0 state that the

    probability that a tower receiving a certainnumber of calls is the same for each tower and

    the number of calls is fixed independently of all

    the other number of calls for all other towers

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    29/57

    Analysis (7)

    Morans I statistic (assumption R) contd

    Let the alternate hypothesis H1 state that the

    probability that a tower receiving a certainnumber of calls is the same for each tower and

    the number of calls is depends on all the other

    number of calls for all other towers

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    30/57

    Analysis (8)

    Morans I statistic (assumption R) contd

    Calculate ZI_Obs

    Reject H0 if |ZI_Obs| > Z0.025

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    31/57

    Analysis (9)

    Morans I statistic (assumption R) contd

    Use the Monte Carlo procedure

    Use 10,000 permutations

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    32/57

    Analysis (10)

    Morans I statistic (assumption R) contd

    Calculate ZI_Gen

    Reject H0 if |ZI_Gen| > Z0.025

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    33/57

    Analysis (11)

    Semivariogram

    Calculate the observed semivariogram

    Calculate the omnidirectional semivariogram

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    34/57

    Analysis (12)

    Semivariogram contd

    Calculate the empirical semivariogram for the 4

    major compass directions (N/S, E/W, NE/SW,SE/NW)

    Look for any trends or indications of anisotropy

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    35/57

    Presentation Outline

    Overview

    Objectives

    Methods

    Analysis

    Results

    Conclusion

    Future Work

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    36/57

    Results (1)

    Joins Count approach (non-free sampling)

    JBW_Obs = 90

    E(JBW_Obs) = 86.74654, V(JBW_Obs) = 38.57732

    ZBW_Obs = 0.52382

    Since |ZBW_Obs| < 1.96, do not reject H0

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    37/57

    Results (2)

    Joins Count approach (non-free sampling) contd

    JBB_Obs = 25

    E(JBB_Obs) = 25.57911, V(JBB_Obs) = 12.44333

    ZBB_Obs = -0.16417

    Since |ZBB_Obs| < 1.96, do not reject H0

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    38/57

    Results (3)

    Joins Count approach (Monte Carlo)

    JBW_Obs = 90

    E(JBW_Gen) = 86.66820, V(JBW_Gen) = 38.57897 ZBW_Gen = 0.53642

    Since |ZBW_Gen| < 1.96, do not reject H0

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    39/57

    Results (4)

    Joins Count approach (Monte Carlo) contd

    JBB_Obs = 25

    E(JBB_Gen) = 25.57290, V(JBB_Gen) = 12.64095 ZBB_Gen = -0.16113

    Since |ZBB_Gen| < 1.96, do not reject H0

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    40/57

    Results (5)

    Morans I statistic (assumption R)

    IObs = -0.01296

    E(IObs) = -0.01613, V(IObs) = 0.00496 ZI_Obs = 0.04506

    Since |ZI_Obs| < 1.96, do not reject H0

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    41/57

    Results (6)

    Morans I statistic (Monte Carlo)

    IObs = -0.01296

    E(IGen) = -0.01640, V(IGen) = 0.00490 ZI_Gen = 0.04927

    Since |ZI_Gen| < 1.96, do not reject H0

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    42/57

    Results (7)

    Semivariogram

    Plotted the semivariogram

    Plotted the omnidirectional, N/S, E/W, NE/SW,

    SE/NW semivariograms

    The semivariogram looks interesting

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    43/57

    Semivariogram (1)

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    44/57

    Semivariogram - Omni (2)

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    45/57

    Semivariogram N/S (3)

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    46/57

    Semivariogram E/W (4)

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    47/57

    Semivariogram NE/SW (5)

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    48/57

    Semivariogram SE/NW (6)

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    49/57

    Presentation Outline

    Overview

    Objectives

    Methods

    Analysis

    Results

    Conclusion

    Future Work

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    50/57

    Conclusion (1)

    We conducted the statistical analysis on subset of

    the data due to the processing implication that one

    may have analyzing really big sets of information at

    one time

    The Joins Count approach indicated that the spatial

    arrangement of regions with an above average

    number of calls was random

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    51/57

    Conclusion (2)

    Morans I statistic indicated that the number of

    calls a tower received was independent of the

    number of calls received by every other tower

    The semivariograms indicated anisotropy because

    they seemed to change with direction

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    52/57

    Presentation Outline

    Overview

    Objectives

    Methods

    Analysis

    Results

    Conclusion

    Future Work

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    53/57

    Future Work (1)

    Extend our analysis to longer time windows as wereceive more data

    Weeks, months, and maybe even years

    Repeat analysis using a finer grained time window

    Bi-daily, hourly, and maybe even minutely

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    54/57

    Future Work (2)

    Try to extract some demographic information fromthe data and analyze it

    One day be able to extract trajectories of

    individuals from the data

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    55/57

    Demographics (1)

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    56/57

    Demographics (2)

  • 8/8/2019 Spatial Statistics Presentation - University of Manitoba

    57/57

    Questions