A methodology for comprehensive characterization of errors in wind power forecasting

Mark F. Bielecki, Jason J. Kemper, Tom L Acker

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Wind power forecasting will play a more important role in electrical system planning with the greater wind penetrations of the coming decades. Wind will most likely comprise a larger percentage of the generation mix, and as a result forecasting errors may have more significant effects on balancing operations. The natural uncertainties associated with wind along with limitations in numerical weather prediction (NWP) models lead to these forecasting errors, which play a considerable role in the impacts and costs of utility-scale wind integration. The premise of this project was to examine errors between the actual and commercially forecasted power production data from a typical wind power plant in the Northwestern United States. An exhaustive statistical characterization of the forecast behavior and error trends was undertaken, which allowed the most important metrics for describing wind power forecast errors to be identified. This paper presents only the metrics considered by the authors to be most significant. While basic information about wind forecast accuracy such as the mean absolute error (MAE) is valuable, a more detailed description is useful for system operators or in wind integration studies. System planners have expressed major concern in the area of forecast performance during large wind ramping events. For such reasons, this methodology included the development of a comprehensive ramp identification algorithm to select significant ramp events from the data record, and particular attention was paid to the error analysis during these events. The algorithm allows user input to select ramps of any desired magnitude, and also performs correlation analysis between forecasted ramp events and actual ramp events that coincide within a desired timing window. From this procedure, an investigation of the magnitude and phase of forecast errors was conducted for various forecast horizons. The metrics found to be of most importance for error characterization were selected based on overall impacts, and were ranked in a rudimentary (and perhaps subjective) order of significance. These metrics included: mean absolute error, root mean square error, average magnitude of step changes, standard deviation of step changes, mean bias levels, correlation coefficient of power values, mean temporal bias of ramp events, and others. While these metrics were selected and the methodology was developed for a single dataset, the entire process can be applied generally to any wind power and forecast time series. The implications for such a process include use for generating a synthetic wind power forecast for wind integration studies that will reproduce the same error trends as those found in a real forecast.

Original languageEnglish (US)
Title of host publicationASME 2010 4th International Conference on Energy Sustainability, ES 2010
Pages867-876
Number of pages10
Volume2
DOIs
StatePublished - 2010
EventASME 2010 4th International Conference on Energy Sustainability, ES 2010 - Phoenix, AZ, United States
Duration: May 17 2010May 22 2010

Other

OtherASME 2010 4th International Conference on Energy Sustainability, ES 2010
CountryUnited States
CityPhoenix, AZ
Period5/17/105/22/10

Fingerprint

Wind power
Mean square error
Error analysis
Mathematical operators
Time series
Power plants
Planning

ASJC Scopus subject areas

  • Energy Engineering and Power Technology
  • Renewable Energy, Sustainability and the Environment

Cite this

Bielecki, M. F., Kemper, J. J., & Acker, T. L. (2010). A methodology for comprehensive characterization of errors in wind power forecasting. In ASME 2010 4th International Conference on Energy Sustainability, ES 2010 (Vol. 2, pp. 867-876) https://doi.org/10.1115/ES2010-90381

A methodology for comprehensive characterization of errors in wind power forecasting. / Bielecki, Mark F.; Kemper, Jason J.; Acker, Tom L.

ASME 2010 4th International Conference on Energy Sustainability, ES 2010. Vol. 2 2010. p. 867-876.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Bielecki, MF, Kemper, JJ & Acker, TL 2010, A methodology for comprehensive characterization of errors in wind power forecasting. in ASME 2010 4th International Conference on Energy Sustainability, ES 2010. vol. 2, pp. 867-876, ASME 2010 4th International Conference on Energy Sustainability, ES 2010, Phoenix, AZ, United States, 5/17/10. https://doi.org/10.1115/ES2010-90381
Bielecki MF, Kemper JJ, Acker TL. A methodology for comprehensive characterization of errors in wind power forecasting. In ASME 2010 4th International Conference on Energy Sustainability, ES 2010. Vol. 2. 2010. p. 867-876 https://doi.org/10.1115/ES2010-90381
Bielecki, Mark F. ; Kemper, Jason J. ; Acker, Tom L. / A methodology for comprehensive characterization of errors in wind power forecasting. ASME 2010 4th International Conference on Energy Sustainability, ES 2010. Vol. 2 2010. pp. 867-876
@inproceedings{d30fe3de9d304f01a9ea0bdd2b8722ed,
title = "A methodology for comprehensive characterization of errors in wind power forecasting",
abstract = "Wind power forecasting will play a more important role in electrical system planning with the greater wind penetrations of the coming decades. Wind will most likely comprise a larger percentage of the generation mix, and as a result forecasting errors may have more significant effects on balancing operations. The natural uncertainties associated with wind along with limitations in numerical weather prediction (NWP) models lead to these forecasting errors, which play a considerable role in the impacts and costs of utility-scale wind integration. The premise of this project was to examine errors between the actual and commercially forecasted power production data from a typical wind power plant in the Northwestern United States. An exhaustive statistical characterization of the forecast behavior and error trends was undertaken, which allowed the most important metrics for describing wind power forecast errors to be identified. This paper presents only the metrics considered by the authors to be most significant. While basic information about wind forecast accuracy such as the mean absolute error (MAE) is valuable, a more detailed description is useful for system operators or in wind integration studies. System planners have expressed major concern in the area of forecast performance during large wind ramping events. For such reasons, this methodology included the development of a comprehensive ramp identification algorithm to select significant ramp events from the data record, and particular attention was paid to the error analysis during these events. The algorithm allows user input to select ramps of any desired magnitude, and also performs correlation analysis between forecasted ramp events and actual ramp events that coincide within a desired timing window. From this procedure, an investigation of the magnitude and phase of forecast errors was conducted for various forecast horizons. The metrics found to be of most importance for error characterization were selected based on overall impacts, and were ranked in a rudimentary (and perhaps subjective) order of significance. These metrics included: mean absolute error, root mean square error, average magnitude of step changes, standard deviation of step changes, mean bias levels, correlation coefficient of power values, mean temporal bias of ramp events, and others. While these metrics were selected and the methodology was developed for a single dataset, the entire process can be applied generally to any wind power and forecast time series. The implications for such a process include use for generating a synthetic wind power forecast for wind integration studies that will reproduce the same error trends as those found in a real forecast.",
author = "Bielecki, {Mark F.} and Kemper, {Jason J.} and Acker, {Tom L}",
year = "2010",
doi = "10.1115/ES2010-90381",
language = "English (US)",
isbn = "9780791843949",
volume = "2",
pages = "867--876",
booktitle = "ASME 2010 4th International Conference on Energy Sustainability, ES 2010",

}

TY - GEN

T1 - A methodology for comprehensive characterization of errors in wind power forecasting

AU - Bielecki, Mark F.

AU - Kemper, Jason J.

AU - Acker, Tom L

PY - 2010

Y1 - 2010

N2 - Wind power forecasting will play a more important role in electrical system planning with the greater wind penetrations of the coming decades. Wind will most likely comprise a larger percentage of the generation mix, and as a result forecasting errors may have more significant effects on balancing operations. The natural uncertainties associated with wind along with limitations in numerical weather prediction (NWP) models lead to these forecasting errors, which play a considerable role in the impacts and costs of utility-scale wind integration. The premise of this project was to examine errors between the actual and commercially forecasted power production data from a typical wind power plant in the Northwestern United States. An exhaustive statistical characterization of the forecast behavior and error trends was undertaken, which allowed the most important metrics for describing wind power forecast errors to be identified. This paper presents only the metrics considered by the authors to be most significant. While basic information about wind forecast accuracy such as the mean absolute error (MAE) is valuable, a more detailed description is useful for system operators or in wind integration studies. System planners have expressed major concern in the area of forecast performance during large wind ramping events. For such reasons, this methodology included the development of a comprehensive ramp identification algorithm to select significant ramp events from the data record, and particular attention was paid to the error analysis during these events. The algorithm allows user input to select ramps of any desired magnitude, and also performs correlation analysis between forecasted ramp events and actual ramp events that coincide within a desired timing window. From this procedure, an investigation of the magnitude and phase of forecast errors was conducted for various forecast horizons. The metrics found to be of most importance for error characterization were selected based on overall impacts, and were ranked in a rudimentary (and perhaps subjective) order of significance. These metrics included: mean absolute error, root mean square error, average magnitude of step changes, standard deviation of step changes, mean bias levels, correlation coefficient of power values, mean temporal bias of ramp events, and others. While these metrics were selected and the methodology was developed for a single dataset, the entire process can be applied generally to any wind power and forecast time series. The implications for such a process include use for generating a synthetic wind power forecast for wind integration studies that will reproduce the same error trends as those found in a real forecast.

AB - Wind power forecasting will play a more important role in electrical system planning with the greater wind penetrations of the coming decades. Wind will most likely comprise a larger percentage of the generation mix, and as a result forecasting errors may have more significant effects on balancing operations. The natural uncertainties associated with wind along with limitations in numerical weather prediction (NWP) models lead to these forecasting errors, which play a considerable role in the impacts and costs of utility-scale wind integration. The premise of this project was to examine errors between the actual and commercially forecasted power production data from a typical wind power plant in the Northwestern United States. An exhaustive statistical characterization of the forecast behavior and error trends was undertaken, which allowed the most important metrics for describing wind power forecast errors to be identified. This paper presents only the metrics considered by the authors to be most significant. While basic information about wind forecast accuracy such as the mean absolute error (MAE) is valuable, a more detailed description is useful for system operators or in wind integration studies. System planners have expressed major concern in the area of forecast performance during large wind ramping events. For such reasons, this methodology included the development of a comprehensive ramp identification algorithm to select significant ramp events from the data record, and particular attention was paid to the error analysis during these events. The algorithm allows user input to select ramps of any desired magnitude, and also performs correlation analysis between forecasted ramp events and actual ramp events that coincide within a desired timing window. From this procedure, an investigation of the magnitude and phase of forecast errors was conducted for various forecast horizons. The metrics found to be of most importance for error characterization were selected based on overall impacts, and were ranked in a rudimentary (and perhaps subjective) order of significance. These metrics included: mean absolute error, root mean square error, average magnitude of step changes, standard deviation of step changes, mean bias levels, correlation coefficient of power values, mean temporal bias of ramp events, and others. While these metrics were selected and the methodology was developed for a single dataset, the entire process can be applied generally to any wind power and forecast time series. The implications for such a process include use for generating a synthetic wind power forecast for wind integration studies that will reproduce the same error trends as those found in a real forecast.

UR - http://www.scopus.com/inward/record.url?scp=84860312541&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84860312541&partnerID=8YFLogxK

U2 - 10.1115/ES2010-90381

DO - 10.1115/ES2010-90381

M3 - Conference contribution

SN - 9780791843949

VL - 2

SP - 867

EP - 876

BT - ASME 2010 4th International Conference on Energy Sustainability, ES 2010

ER -