forecasting electricity demand distributions using a

Forecasting electricity demanddistributions using asemiparametric additive model

Rob J Hyndman

Joint work with Shu FanForecasting electricity demand distributions 1

Outline

1 The problem

2 The model

3 Long-term forecasts

4 Short term forecasts

Forecasting electricity demand distributions The problem 2

The problem in 2007

We want to forecast the peak electricitydemand in a half-hour period in ten years time.

We have twelve years of half-hourly electricitydata, temperature data and some economicand demographic data.

The location is South Australia: home to themost volatile electricity demand in the world.

Sounds impossible?

The problem in 2007

Sounds impossible?

The problem in 2007

Sounds impossible?

The problem in 2007

Sounds impossible?

The problem in 2007

Sounds impossible?

South Australian demand data

South Australia state wide demand (winter 09/10)

Jul 09 Aug 09 Sept 09 Apr 10 May 10 June 10

Black Saturday→

South Australia state wide demand (summer 10/11)

Oct 10 Nov 10 Dec 10 Jan 11 Feb 11 Mar 11

South Australia state wide demand (January 2011)

Date in January

1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 3111 13 15 17 19 21

Demand boxplots (Sth Aust)

Temperature data (Sth Aust)

Demand densities (Sth Aust)

Outline

1 The problem

2 The model

Forecasting electricity demand distributions The model 8

Predictorscalendar effectsprevailing and recent weather conditionsclimate changeseconomic and demographic changeschanging technology

Modelling frameworkSemi-parametric additive models withcorrelated errors.Each half-hour period modelled separately foreach season.Variables selected to provide bestout-of-sample predictions using cross-validationon each summer.

Monash Electricity Forecasting Model

log(yt) = hp(t) + fp(w1,t,w2,t) +

J∑j=1

cjzj,t + nt

yt denotes per capita demand (minus offset) at time t(measured in half-hourly intervals) and p denotes thetime of day p = 1, . . . ,48;

hp(t) models all calendar effects;

fp(w1,t,w2,t) models all temperature effects where w1,t isa vector of recent temperatures at location 1 and w2,t isa vector of recent temperatures at location 2;

zj,t is a demographic or economic variable at time t

nt denotes the model error at time t.

J∑j=1

cjzj,t + nt

J∑j=1

cjzj,t + nt

J∑j=1

cjzj,t + nt

J∑j=1

cjzj,t + nt

J∑j=1

cjzj,t + nt

hp(t) includes handle annual, weekly and daily seasonalpatterns as well as public holidays:

hp(t) = `p(t) + αt,p + βt,p + γt,p + δt,p

`p(t) is “time of summer” effect (a regression spline);

αt,p is day of week effect;

βt,p is “holiday” effect;

γt,p New Year’s Eve effect;

δt,p is millennium effect;

J∑j=1

cjzj,t + nt

J∑j=1

cjzj,t + nt

J∑j=1

cjzj,t + nt

J∑j=1

cjzj,t + nt

J∑j=1

cjzj,t + nt

Fitted results (Summer 3pm)

0 50 100 150

Day of summer

Mon Tue Wed Thu Fri Sat Sun

Day of week

Normal Day before Holiday Day after

Holiday

Time: 3:00 pm

J∑j=1

cjzj,t + nt

fp(w1,t,w2,t) =6∑

[fk,p(xt−k) + gk,p(dt−k)

]+ qp(x+

t ) + rp(x−t ) + sp(xt)

+6∑j=1

[Fj,p(xt−48j) + Gj,p(dt−48j)

]xt is ave temp across two sites (Kent Town and AdelaideAirport) at time t;dt is the temp difference between two sites at time t;x+t is max of xt values in past 24 hours;x−t is min of xt values in past 24 hours;xt is ave temp in past seven days.

Each function is smooth & estimated using regression splines.Forecasting electricity demand distributions The model 13

J∑j=1

cjzj,t + nt

fp(w1,t,w2,t) =6∑

]+ qp(x+

t ) + rp(x−t ) + sp(xt)

+6∑j=1

J∑j=1

cjzj,t + nt

fp(w1,t,w2,t) =6∑

]+ qp(x+

t ) + rp(x−t ) + sp(xt)

+6∑j=1

J∑j=1

cjzj,t + nt

fp(w1,t,w2,t) =6∑

]+ qp(x+

t ) + rp(x−t ) + sp(xt)

+6∑j=1

J∑j=1

cjzj,t + nt

fp(w1,t,w2,t) =6∑

]+ qp(x+

t ) + rp(x−t ) + sp(xt)

+6∑j=1

J∑j=1

cjzj,t + nt

fp(w1,t,w2,t) =6∑

]+ qp(x+

t ) + rp(x−t ) + sp(xt)

+6∑j=1

J∑j=1

cjzj,t + nt

fp(w1,t,w2,t) =6∑

]+ qp(x+

t ) + rp(x−t ) + sp(xt)

+6∑j=1

Fitted results (Summer 3pm)

10 20 30 40

Temperature

10 20 30 40

Lag 1 temperature

10 20 30 40

Lag 2 temperature

10 20 30 40

Lag 3 temperature

10 20 30 40

Lag 1 day temperature

10 15 20 25 30

Last week average temp

15 25 35

Previous max temp

10 15 20 25

Previous min temp

Time: 3:00 pm

J∑j=1

cjzj,t + nt

Other variables described by linearrelationships with coefficients c1, . . . , cJ.Estimation based on annual data.

J∑j=1

cjzj,t + nt

Other variables described by linearrelationships with coefficients c1, . . . , cJ.Estimation based on annual data.

Split model

J∑j=1

cjzj,t + nt

log(yt) = log(y∗t ) + log(yi)

log(y∗t ) = hp(t) + fp(w1,t,w2,t) + et

log(yi) =

J∑j=1

cjzj,i + εi

yi is the average demand for year i where t is inyear i.y∗t is the standardized demand for time t.

Split model

Annual model

log(yi) =∑j

cjzj,i + εi

log(yi)− log(yi−1) =∑j

cj(zj,i − zj,i−1) + ε∗i

First differences modelled to avoidnon-stationary variables.Predictors: Per-capita GSP, Price, Summer CDD,Winter HDD.

Annual model

log(yi) =∑j

cjzj,i + εi

Annual model

log(yi) =∑j

cjzj,i + εi

zCDD =∑

summer

max(0, T − 18.5)

T = daily mean

Annual model

log(yi) =∑j

cjzj,i + εi

zHDD =∑

winter

max(0,18.5− T)

T = daily mean

Annual model

Cooling and Heating Degree Days20

1990 1995 2000 2005 2010

Cooling and Heating degree days

Annual model

Variable Coefficient Std. Error t value P value∆gsp.pc 2.02×10−6 5.05×10−6 0.38 0.711∆price −1.67×10−8 6.76×10−9 −2.46 0.026∆scdd 1.11×10−10 2.48×10−11 4.49 0.000∆whdd 2.07×10−11 3.28×10−11 0.63 0.537

GSP needed to stay in the model to allowscenario forecasting.

All other variables led to improved AICC.

Annual model

89/90 91/92 93/94 95/96 97/98 99/00 01/02 03/04 05/06 07/08 09/10

ActualFitted

Half-hourly models

Separate model for each half-hour.Same predictors used for all models.Predictors chosen by cross-validation onsummer of 2007/2008 and 2009/2010.Each model is fitted to the data twice, firstexcluding the summer of 2009/2010 and thenexcluding the summer of 2010/2011. Theaverage out-of-sample MSE is calculated fromthe omitted data for the time periods12noon–8.30pm.

Half-hourly models

Half-hourly modelsx x1 x2 x3 x4 x5 x6 x48 x96 x144 x192 x240 x288 d d1 d2 d3 d4 d5 d6 d48 d96 d144 d192 d240 d288 x+ x− x dow hol dos MSE

1 • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • 1.0372 • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • 1.0343 • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • 1.0314 • • • • • • • • • • • • • • • • • • • • • • • • • • • • • 1.0275 • • • • • • • • • • • • • • • • • • • • • • • • • • • • 1.0256 • • • • • • • • • • • • • • • • • • • • • • • • • • • 1.0207 • • • • • • • • • • • • • • • • • • • • • • • • • • 1.0258 • • • • • • • • • • • • • • • • • • • • • • • • • • 1.0269 • • • • • • • • • • • • • • • • • • • • • • • • • 1.035

10 • • • • • • • • • • • • • • • • • • • • • • • • 1.04411 • • • • • • • • • • • • • • • • • • • • • • • 1.05712 • • • • • • • • • • • • • • • • • • • • • • 1.07613 • • • • • • • • • • • • • • • • • • • • • 1.10214 • • • • • • • • • • • • • • • • • • • • • • • • • • 1.01815 • • • • • • • • • • • • • • • • • • • • • • • • • 1.02116 • • • • • • • • • • • • • • • • • • • • • • • • 1.03717 • • • • • • • • • • • • • • • • • • • • • • • 1.07418 • • • • • • • • • • • • • • • • • • • • • • 1.15219 • • • • • • • • • • • • • • • • • • • • • 1.18020 • • • • • • • • • • • • • • • • • • • • • • • • • 1.02121 • • • • • • • • • • • • • • • • • • • • • • • • 1.02722 • • • • • • • • • • • • • • • • • • • • • • • 1.03823 • • • • • • • • • • • • • • • • • • • • • • 1.05624 • • • • • • • • • • • • • • • • • • • • • 1.08625 • • • • • • • • • • • • • • • • • • • • 1.13526 • • • • • • • • • • • • • • • • • • • • • • • • • 1.00927 • • • • • • • • • • • • • • • • • • • • • • • • • 1.06328 • • • • • • • • • • • • • • • • • • • • • • • • • 1.02829 • • • • • • • • • • • • • • • • • • • • • • • • • 3.52330 • • • • • • • • • • • • • • • • • • • • • • • • • 2.14331 • • • • • • • • • • • • • • • • • • • • • • • • • 1.523

Half-hourly models

R−squared

Time of day

12 midnight 6:00 am 9:00 am 12 noon 3:00 pm 6:00 pm 9:00 pm3:00 am 12 midnight

Half-hourly models

South Australian demand (January 2011)

Date in January

1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31

ActualFitted

Temperatures (January 2011)

Date in January

1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31

Kent TownAirport

Half-hourly models

Adjusted model

Original model

J∑j=1

cjzj,t + nt

Model allowing saturated usage

qt = hp(t) + fp(w1,t,w2,t) +

J∑j=1

cjzj,t + nt

log(yt) =

{qt if qt ≤ τ ;τ + k(qt − τ) if qt > τ .

Adjusted model

Original model

J∑j=1

cjzj,t + nt

Model allowing saturated usage

qt = hp(t) + fp(w1,t,w2,t) +

J∑j=1

cjzj,t + nt

log(yt) =

{qt if qt ≤ τ ;τ + k(qt − τ) if qt > τ .

Outline

1 The problem

2 The model

Forecasting electricity demand distributions Long-term forecasts 26

Peak demand forecasting

qt,p = hp(t) + fp(w1,t,w2,t) +

J∑j=1

cjzj,t + nt

Multiple alternative futures created:hp(t) known;

simulate future temperatures using doubleseasonal block bootstrap with variable blocks(with adjustment for climate change);

use assumed values for GSP, population andprice;

resample residuals using double seasonal blockbootstrap with variable blocks.

J∑j=1

cjzj,t + nt

J∑j=1

cjzj,t + nt

J∑j=1

cjzj,t + nt

Seasonal block bootstrapping

Conventional seasonal block bootstrap

Same as block bootstrap but with whole years as theblocks to preserve seasonality.But we only have about 10–15 years of data, so there is alimited number of possible bootstrap samples.

Double seasonal block bootstrap

Suitable when there are two seasonal periods (here wehave years of 151 days and days of 48 half-hours).Divide each year into blocks of length 48m.Block 1 consists of the first m days of the year, block 2consists of the next m days, and so on.Bootstrap sample consists of a sample of blocks whereeach block may come from a different randomly selectedyear but must be at the correct time of year.

Actual temperatures

0 10 20 30 40 50 60

Bootstrap temperatures (fixed blocks)

0 10 20 30 40 50 60

Bootstrap temperatures (variable blocks)

0 10 20 30 40 50 60

Problems with the double seasonal bootstrapBoundaries between blocks can introduce largejumps. However, only at midnight.Number of values that any given time in year isstill limited to the number of years in the dataset.

Variable length double seasonal blockbootstrap

Blocks allowed to vary in length between m−∆and m + ∆ days where 0 ≤ ∆ < m.Blocks allowed to move up to ∆ days from theiroriginal position.Has little effect on the overall time seriespatterns provided ∆ is relatively small.Use uniform distribution on (m−∆,m + ∆) toselect block length, and independent uniformdistribution on (−∆,∆) to select variation onstarting position for each block.

Actual temperatures

C0 10 20 30 40 50 60

Bootstrap temperatures (fixed blocks)

0 10 20 30 40 50 60

Bootstrap temperatures (variable blocks)

0 10 20 30 40 50 60

J∑j=1

cjzj,t + nt

Multiple alternative futures created:hp(t) known;simulate future temperatures using doubleseasonal block bootstrap with variableblocks (with adjustment for climate change);use assumed values for GSP, population andprice;resample residuals using double seasonal blockbootstrap with variable blocks.

Peak demand backcasting

J∑j=1

cjzj,t + nt

Multiple alternative pasts created:hp(t) known;simulate past temperatures using doubleseasonal block bootstrap with variableblocks;use actual values for GSP, population andprice;resample residuals using double seasonal blockbootstrap with variable blocks.

Estimated historical quantiles

PoE (annual interpretation)

98/99 00/01 02/03 04/05 06/07 08/09 10/11

10 %50 %90 %

●●

● ●

J∑j=1

cjzj,t + nt

Multiple alternative futures created:hp(t) known;simulate future temperatures using doubleseasonal block bootstrap with variableblocks (with adjustment for climate change);use assumed values for GSP, population andprice;resample residuals using double seasonal blockbootstrap with variable blocks.

South Australia GSP

1990 1995 2000 2005 2010 2015 2020

HighBaseLow

South Australia population

1990 1995 2000 2005 2010 2015 2020

HighBaseLow

Average electricity prices

1990 1995 2000 2005 2010 2015 2020

HighBaseLow

Major industrial offset demand

1990 1995 2000 2005 2010 2015 2020

HighBaseLow

Peak demand distribution

PoE (annual interpretation)

98/99 00/01 02/03 04/05 06/07 08/09 10/11

10 %50 %90 %

●●

● ●

Peak demand distribution

Annual POE levels

98/99 00/01 02/03 04/05 06/07 08/09 10/11 12/13 14/15 16/17 18/19 20/21

●●

● ●

●●

1 % POE5 % POE10 % POE50 % POE90 % POEActual annual maximum

2.5 3.0 3.5 4.0 4.5 5.0 5.5

Demand (GW)

2.5 3.0 3.5 4.0 4.5 5.0 5.5

Demand (GW)

2.5 3.0 3.5 4.0 4.5 5.0 5.5

Demand (GW)

2011/20122012/20132013/20142014/20152015/20162016/20172017/20182018/20192019/20202020/2021

Outline

1 The problem

2 The model

Forecasting electricity demand distributions Short term forecasts 39

Short term forecasts

J∑j=1

cjzj,t + nt

Bootstrapping temperatures and residuals is okfor long-term forecasts because short-termdynamics wash out after a few weeks.But short-term forecasts need to take accountof recent temperatures and recent residualsdue to serial correlation.Short-term temperature forecasts are available.Building a separate model for nt is possible, butthere is a simpler approach.

J∑j=1

cjzj,t + nt

J∑j=1

cjzj,t + nt

J∑j=1

cjzj,t + nt

J∑j=1

cjzj,t + nt

Short-term forecasting model

log(yt,p) = hp(t) + fp(w1,t,w2,t) + ap(yt−1) +

J∑j=1

cjzj,t + nt

yt,p denotes per capita demand (minus offset) at time t(measured in half-hourly intervals) during period p,p = 1, . . . ,48;hp(t) models all calendar effects;fp(w1,t,w2,t) models all temperature effects where w1,t isa vector of recent temperatures at location 1 and w2,t isa vector of recent temperatures at location 2;zj,t is a demographic or economic variable at time tnt denotes the model error at time tyt = [yt, yt−1, yt−2, . . . ]ap(yt−1) models effects of recent demands.

J∑j=1

cjzj,t + nt

J∑j=1

cjzj,t + nt

J∑j=1

cjzj,t + nt

J∑j=1

cjzj,t + nt

J∑j=1

cjzj,t + nt

J∑j=1

cjzj,t + nt

ap(yt−1) =n∑

bk,p(yt−k) +m∑j=1

Bj,p(yt−48j)

+ Qp(y+t ) + Rp(y−t ) + Sp(yt)

y+t is maximum of yt values in past 24 hours;

y−t is minimum of yt values in past 24 hours;

yt is average demand in past 7 days

bk,p, Bj,p, Qp, Rp and Sp are estimated usingcubic splines.

ap(yt−1) =n∑

Bj,p(yt−48j)

ap(yt−1) =n∑

Bj,p(yt−48j)

ap(yt−1) =n∑

Bj,p(yt−48j)

References

Hyndman, R.J. and Fan, S. (2010) “Densityforecasting for long-term peak electricitydemand”, IEEE Transactions on Power Systems,25(2), 1142–1153.

Fan, S. and Hyndman, R.J. (2012) “Short-termload forecasting based on a semi-parametricadditive model”. IEEE Transactions on PowerSystems, 27(1), 134–141.

Forecasting electricity demand distributions References 43

forecasting electricity demand distributions using a

Documents