evolution de jdemetra+ - insee.pdfevolution de jdemetra+ paris, 24 octobre 2016 outline • jd+...

24
Evolution de JDemetra+ Paris, 24 octobre 2016

Upload: others

Post on 10-Aug-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

Evolution de JDemetra+Paris, 24 octobre 2016

Page 2: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

Outline

• JD+ releases• JD+ 3.0

• Overview• Common REGARIMA modelling• High-frequency series

• Final remarks

Page 3: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

1. JD+ releases

Versions Schedule

2.0 1/2015

2.1 4/2016

2.2 Q2/2017

3.0 Q4/2018 (?)

Page 4: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

2.1 Towards JD+ 3.0

• IT aspects• Java 8 • WEB services, R interface, batch « language » (?)

• Simplification of the design

• Generalization of extension points• Graphical interface • I/O• Algorithms

Page 5: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

2.1 Towards JD+ 3.0 (and higher)

• Statistical aspects• High-frequency time series

• Weekly, daily, …• Equally spaced observations, random observations (?)

• Seasonal adjustment• Common REGARIMA modelling• Decomposition/filtering

• Extension to high-frequency series• X11: alternative filters

• Structural time series• STL (?)

Page 6: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

2.1 Towards JD+ 3.0

• Statistical/numerical aspects(cont.)• Low-level

• New state space framework• More robust algorithms (-> high-frequency series…)

• High-level• Chain linking (Bundesbank)• Temporal disaggregation and benchmarking (SACE, Jecotrim-like)• Revisions analysis (SACE)• Nowcasting (NBB)

• Detailed statistical documentation

Page 7: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

2.2 Common REGARIMA pre-processingGeneral approach

• Common regression model• Common estimation procedure• Decomposition of the algorithm in independant blocks

• Comparison of Tramo/X13 + alternative implementations• Systematic testing

• Simulated series• Real series

• Overall performance• Criterions (fit, forecasts, residuals, …)

Page 8: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

InitializationSeasonality tests Log/level Regression

(TD, Easter…)

Outliersdetection

Differencing Arma identification

Final estimation

Model checks

2.2 Common REGARIMA pre-processing. Main blocks

Page 9: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

2.2 Common REGARIMA pre-processing(cont.)• Initial seasonality tests

• Systematic analysis of different tests (Ljung-Box, non-parametric, spectral diagnostics, regression-based…)

• Log/level tests• Likelihood-based (handling of outliers?)• Robust tests (range-mean test…)

• Calendar tests• Parsimonious trading days (with automatic identification)• Richer moving holidays variables

Page 10: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

2.2 Common REGARIMA pre-processing(cont.)• Outliers detection

• Approximate approach (Tramo)• Exact approach (X13)• Alternative approach (Kalman smoother)• Extension to other models

• ARIMA identification• Approximate approach (Tramo)• Exact approach (X13)

• Model validation• Tramo-like

Page 11: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

Example:

50%55%60%65%70%75%80%85%90%95%

100%

P Q BP BQ ALL

ARMA Modelling (Tramo/X12)(% identical results, German industrial production, 334 series)

Page 12: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

2.3 High-frequency series

• Adaptation of Tramo-Seats to weekly and daily series• Many challenges

• Theoretical• Technical

• Numerical problems• Performances• Memory constraints

• Presentation

Page 13: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

Births inFrance (daily observations)

• From 1/1/68 to 31/12/2014 (17.168 obs)

Page 14: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

Births inFrance (daily observations)

• From 1/1/68 to 31/12/2014 (17.168 obs)

Page 15: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

Births inFrance (spectral analysis)

• Differenced series

Page 16: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

Births inFrance (spectral analysis)

• Differences at lag 7

Page 17: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

Arima modelling

• = =

• = , =

• Weekly example• Average number of weeks by year: 365.25/7 52.18• = 0.82 0.18

• Daily example• = 0.75 0.25

Page 18: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

Extended airline models for weekly and dailyseries• =• =

• . = ..

• . = ..

• Modified airline:• Better fit• More stable seasonal components

Page 19: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

Properties of the filters

00.10.20.30.40.50.60.70.80.9

1

Squared gain function (modified airline, weekly SA)

Page 20: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

Births inFrance (main components)

1200

1400

1600

1800

2000

2200

2400

2600

2800

3000

01/0

1/19

68

01/0

1/19

69

01/0

1/19

70

01/0

1/19

71

01/0

1/19

72

01/0

1/19

73

01/0

1/19

74

01/0

1/19

75

01/0

1/19

76

01/0

1/19

77

01/0

1/19

78

01/0

1/19

79

01/0

1/19

80

01/0

1/19

81

01/0

1/19

82

01/0

1/19

83

01/0

1/19

84

01/0

1/19

85

01/0

1/19

86

01/0

1/19

87

01/0

1/19

88

01/0

1/19

89

01/0

1/19

90

01/0

1/19

91

01/0

1/19

92

01/0

1/19

93

01/0

1/19

94

01/0

1/19

95

01/0

1/19

96

01/0

1/19

97

01/0

1/19

98

01/0

1/19

99

01/0

1/20

00

01/0

1/20

01

01/0

1/20

02

01/0

1/20

03

01/0

1/20

04

01/0

1/20

05

01/0

1/20

06

01/0

1/20

07

01/0

1/20

08

01/0

1/20

09

01/0

1/20

10

01/0

1/20

11

01/0

1/20

12

01/0

1/20

13

01/0

1/20

14

Y SA T

Page 21: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

Births inFrance (components)

Page 22: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

Births inFrance (components)

Page 23: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

Weekly US claims

Page 24: Evolution de JDemetra+ - INSEE.pdfEvolution de JDemetra+ Paris, 24 octobre 2016 Outline • JD+ releases • JD+ 3.0 • Overview • Common REGARIMA modelling • High-frequency series

Final remarks on JD+ 3.0

• Very significant changes in comparison of JD+ 2.x• Still many challenges• Importance of the JD+ community

• SACE• Github• …