Skip to main content

Data Release for Evaluation of Six Methods for Correcting Bias in Estimates from Ensemble Tree Machine Learning Regression Models

Dates

Publication Date
Time Period
2020

Citation

Belitz, K., Stackelberg, P.E., and Sharpe, J.B., 2021, Data Release for Evaluation of Six Methods for Correcting Bias in Estimates from Ensemble Tree Machine Learning Regression Models: U.S. Geological Survey data release, https://doi.org/10.5066/P9LCTYI2.

Summary

Ensemble-tree machine learning (ML) regression models can be prone to systematic bias: small values are overestimated and large values are underestimated. Additional bias can be introduced if the dependent variable is a transform of the original data. Six methods were evaluated for their ability to correct systematic and introduced bias: (1) empirical distribution matching (EDM); (2) regression of observed on estimated values (ROE); (3) linear transfer function (LTF); (4) linear equation based on Z-score transform (ZZ); (5) second machine learning model used to estimate residuals (ML2-RES); and (6) Duan smearing estimate applied after ROE is implemented (ROE-Duan). The performance of the methods was evaluated using four previously [...]

Contacts

Point of Contact :
Kenneth Belitz
Originator :
Kenneth Belitz, Paul E Stackelberg, Jennifer B Sharpe
Metadata Contact :
Jennifer B Sharpe
Publisher :
U.S. Geological Survey
Distributor :
U.S. Geological Survey - ScienceBase
SDC Data Owner :
Earth System Processes Division
USGS Mission Area :
Water Resources

Attached Files

Click on title to download individual files attached to this item.

Table_9_Coefficients.csv 290 Bytes text/csv
Table_1_Glacial_Training.csv 1.05 MB text/csv
Table_2_Glacial_Holdout.csv 267.83 KB text/csv
Table_3_NACP_Training.csv 254.89 KB text/csv
Table_4_NACP_Holdout.csv 63.76 KB text/csv
Table_5_CV_Training.csv 310.38 KB text/csv
Table_6_CV_Holdout.csv 146.73 KB text/csv
Table_7_MISE_Training.csv 106.59 KB text/csv
Table_8_MISE_Holdout.csv 27.34 KB text/csv

Purpose

The purpose of this paper is to evaluate methods for correcting two types of bias that can be present in values produced by ensemble-tree machine learning (ML) models. One type of bias is systematic: ML models tend to overestimate small values and underestimate large values. The other type of bias is introduced if the dependent variable is a transform of the original data.

Map

Communities

  • National Water-Quality Assessment Project
  • USGS Data Release Products

Tags

Provenance

Additional Information

Identifiers

Type Scheme Key
DOI https://www.sciencebase.gov/vocab/category/item/identifier doi:10.5066/P9LCTYI2

Item Actions

View Item as ...

Save Item as ...

View Item...