![Page 1: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/1.jpg)
Synthetic plots: history and examples David R. Brillinger Statistics Department University of California, Berkeley
www.stat.berkeley.edu/~brill [email protected]
![Page 2: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/2.jpg)
I. Model appraisal methodsII. Synthetic plotsIII. Spatial p.p. – galaxiesIV. Time series – river flowV. Spatial-temporal p.p. - wildfiresVI. Trajectories – seals, elkVII. Summary and discussion?. Explanatories
SECTIONS
![Page 3: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/3.jpg)
I. MODEL APPRAISALScience needs appraisal methods
Cycle:
Model construction <--> model appraisal
Is model compatable with the data?
Classical chi-squared (df correction)
The method of synthetics Neyman et al
![Page 4: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/4.jpg)
II. SYNTHETIC PLOTSSimulate realization of fitted model
Put real and synthetic side by side Assessment
Turing test?
Compute same quantity for each?
![Page 5: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/5.jpg)
III. SPATIAL P. P. - galaxies
Neyman, Scott and Shane (1953) On the spatial distribution of galaxies … Astr J, 117, 92-133
![Page 6: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/6.jpg)
“… Figure 1 was constructed assuming …, the Poisson law ….”
“… it was decided to produce a synthetic plot …”
“When the calculated scheme of distribution was compared with the actual distribution of galaxies recorded in Shane’s photographs of the sky [see page 192], it became apparent that the simple mechanism could not produce a distribution resembling the one we see. In the real universe there is a much more pronounced tendency for galaxies to be grouped in clusters.”
![Page 7: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/7.jpg)
Neyman, Scott & Shane (1954) On the index of clumpiness … Astr. J. Suppl. 1, 269-294.
“In the third paper …, it was shone that the visual appearance of a ‘synthetic’ photographic plate, obtained by means of a large scale sampling experiment conforming exactly with the assumptions of the theory, is very similar to the actual plate. The only difference noticed between the two is concerned with the small-case clumpiness of images of galaxies.”
![Page 8: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/8.jpg)
In summary:
Data {(xj,yj)}, spatial point process
1.Poisson rejected (visually)
2. Clustering (Neyman-Scott process) rejected (visually)
3. More clustering
Detail: counting error, variation in limiting magnitude
![Page 9: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/9.jpg)
Results – Scientific American 1956
Turing test?
![Page 10: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/10.jpg)
Comparison – Scott et al (1953)
![Page 11: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/11.jpg)
IV. TIME SERIES – Saugeen RiverAverage monthly flow 1915 – 1976Walkerton
![Page 12: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/12.jpg)
Data: {y(t)}, time seriesHippel and McLeodPeriodic autoregression (PAR)
Stack years - 62 by 12 matrix (Buys-Ballot)AR(1): Xij = ρjXi,j-1+εij
Nonstationary
Fit, generate synthetic series
![Page 13: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/13.jpg)
Turing test?
![Page 14: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/14.jpg)
Comparison
Spectral ratio
![Page 15: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/15.jpg)
![Page 16: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/16.jpg)
![Page 17: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/17.jpg)
V. SPATIAL-TEMPORAL P. P. - wildfires
![Page 18: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/18.jpg)
![Page 19: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/19.jpg)
Risk analysis
Pixel model, {(xj,yj,tj)}
logit P{Nxyt = 1} = g1(x,y)+g2(<t>)+h[t]
(x,y): location, <t>: day, [t]: year,g1, g2 smooth
Sampled 0’s
![Page 20: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/20.jpg)
![Page 21: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/21.jpg)
Turing test?
Original and Bernoulli simulation
![Page 22: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/22.jpg)
Comparisons
Nearest neighbour distribution
![Page 23: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/23.jpg)
![Page 24: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/24.jpg)
VI. TRAJECTORIES - Hawaiian monk seal, endangered
![Page 25: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/25.jpg)
![Page 26: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/26.jpg)
Foraging, resting, …
![Page 27: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/27.jpg)
DEs. Newtonian motion
Scalar potential function, H
Planar case, location r = (x,y)’, time t
dr(t) = v(t)dt
dv(t) = - β v(t)dt – β grad H(r(t),t)dt
v: velocity β: coefficient of friction
dr = - grad H(r,t)dt = μ(r,t)dt, β >> 0
![Page 28: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/28.jpg)
Examples of H.Point of attraction H(r) = .5*σ2 log r – δ rPoint of repulsion H(r) = C/rAttraction/repulsion H(r) = α(1/r12 – 1/r6)General parametric H(r) = β10x + β01y + β20x2 + β11xy + β02y2
Nonparametric spline expansion
![Page 29: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/29.jpg)
![Page 30: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/30.jpg)
dr(t) = μ(r(t),t)dt + σ(r(t),t)dB(t)
μ: drift, –grad H
σ: diffusion {B(t)}: bivariate Brownian
SDEs.
![Page 31: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/31.jpg)
Data: {(x(tj),y(tj)),tj)}
Solution/approximation.
(r(ti+1)-r(ti))/(ti+1-ti) =
μ(r(ti),ti) + σ(r(ti),ti) Zi+1/√(ti+1-ti)
Euler scheme
Approximate likelihood
Boundary, startup effects
![Page 32: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/32.jpg)
Fitted potential: general parametric attraction & repulsion
![Page 33: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/33.jpg)
Turing test?
Synthetic
![Page 34: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/34.jpg)
Comparison
Bagplot cp. Boxplot centre is bivariate median “bag” contains 50% with greatest depth fence – inflate bag by 3
Rousseuw, Rutts, Tukey (1999)
![Page 35: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/35.jpg)
![Page 36: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/36.jpg)
TRAJECTORIES – elk/wapitiRocky Mountain elk (Cervus elaphus) BanffStarkey Reserve, OregonJoint usage possible?
![Page 37: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/37.jpg)
Data: {(x(tj),y(tj)), tj)}
8 animals, Δt = 2hrForaging, resting, hiding, …
Model. dr = μ(r)dt + σdB(t)
μ smooth – geography
velocity field
![Page 38: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/38.jpg)
![Page 39: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/39.jpg)
Boundary (NZ fence)
dr= μ(r)dt + σ(r)dB(t) +dA(r)
A, support on boundary, keeps particle constrained
Synthetic paths.
If generated point outside, keep pulling back by half til inside
![Page 40: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/40.jpg)
Turing test?
![Page 41: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/41.jpg)
Comparisons
Distribution of distances to “centre”
![Page 42: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/42.jpg)
![Page 43: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/43.jpg)
Synthetic plots: method for appraising complex data-based models via Monte Carlo
Criteria: EDA, formal
Four examples: time series, spatial-temporal p.p., trajectories
Found inadequacies in each case
VII. SUMMARY & DISCUSSION
![Page 44: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/44.jpg)
Corrections like Pearson’s for chi-squared
Difficulties:
land mask irregular times large time differences simulations based on same data
![Page 45: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/45.jpg)
Aager, Littman, Preisler, Stewart
NSF, FS/USDA
Acknowledgements.
![Page 46: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/46.jpg)
REFERENCES
E. Nelson (1967). Dynamical Theories of Brownian Motion. PrincetonH. S. Niwa (1996). Newtonian dynamical approach to fish schooling. J. theor. Biol.
![Page 47: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/47.jpg)
Experiment with explanatorySame 8 animals
ATV days, Δt = 5min
Part B.
![Page 48: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/48.jpg)
![Page 50: Synthetic plots: history and examplesbrill/Papers/BIRSDavidBr...Synthetic plots: method for appraising complex data-based models via Monte Carlo Criteria: EDA, formal Four examples:](https://reader033.vdocuments.mx/reader033/viewer/2022042313/5edcdc44ad6a402d6667b7f5/html5/thumbnails/50.jpg)
Next project