Volume 26, Issue 12 pp. 1513-1519
ORIGINAL REPORT

Comparison of the ability of double-robust estimators to correct bias in propensity score matching analysis. A Monte Carlo simulation study

Tri-Long Nguyen

Tri-Long Nguyen

Laboratory of Biostatistics, Epidemiology, Clinical Research and Health Economics, EA2415, Montpellier University, Montpellier, France

Department of Anesthesia, Michael DeGroote School of Medicine, Faculty of Health Sciences, McMaster University, Hamilton, Canada

Department of Clinical Epidemiology and Biostatistics, Michael DeGroote School of Medicine, Faculty of Health Sciences, McMaster University, Hamilton, Canada

Perioperative Research Group, Population Health Research Institute, Hamilton, Canada

Search for more papers by this author
Gary S. Collins

Gary S. Collins

Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, Botnar Research Centre, University of Oxford, Oxford, UK

Search for more papers by this author
Jessica Spence

Jessica Spence

Department of Anesthesia, Michael DeGroote School of Medicine, Faculty of Health Sciences, McMaster University, Hamilton, Canada

Department of Clinical Epidemiology and Biostatistics, Michael DeGroote School of Medicine, Faculty of Health Sciences, McMaster University, Hamilton, Canada

Perioperative Research Group, Population Health Research Institute, Hamilton, Canada

Search for more papers by this author
Philip J. Devereaux

Philip J. Devereaux

Department of Clinical Epidemiology and Biostatistics, Michael DeGroote School of Medicine, Faculty of Health Sciences, McMaster University, Hamilton, Canada

Perioperative Research Group, Population Health Research Institute, Hamilton, Canada

Department of Medicine, Michael DeGroote School of Medicine, Faculty of Health Sciences, McMaster University, Hamilton, Canada

Search for more papers by this author
Jean-Pierre Daurès

Jean-Pierre Daurès

Laboratory of Biostatistics, Epidemiology, Clinical Research and Health Economics, EA2415, Montpellier University, Montpellier, France

Search for more papers by this author
Paul Landais

Paul Landais

Laboratory of Biostatistics, Epidemiology, Clinical Research and Health Economics, EA2415, Montpellier University, Montpellier, France

Search for more papers by this author
Yannick Le Manach

Corresponding Author

Yannick Le Manach

Department of Anesthesia, Michael DeGroote School of Medicine, Faculty of Health Sciences, McMaster University, Hamilton, Canada

Department of Clinical Epidemiology and Biostatistics, Michael DeGroote School of Medicine, Faculty of Health Sciences, McMaster University, Hamilton, Canada

Perioperative Research Group, Population Health Research Institute, Hamilton, Canada

Correspondence

Y. Le Manach, Department of Anesthesia, Michael DeGroote School of Medicine, Faculty of Health Sciences, McMaster University, Hamilton, ON, Canada.

Email: [email protected]

Search for more papers by this author
First published: 06 October 2017
Citations: 21

Abstract

Objective

As covariates are not always adequately balanced after propensity score matching and double- adjustment can be used to remove residual confounding, we compared the performance of several double-robust estimators in different scenarios.

Methods

We conducted a series of Monte Carlo simulations on virtual observational studies. After estimating the propensity scores by logistic regression, we performed 1:1 optimal, nearest-neighbor, and caliper matching. We used 4 estimators on each matched sample: (1) a crude estimator without double-adjustment, (2) double-adjustment for the propensity scores, (3) double-adjustment for the unweighted unbalanced covariates, and (4) double-adjustment for the unbalanced covariates, weighted by their strength of association with the outcome.

Results

The crude estimator led to highest bias in all tested scenarios. Double-adjustment for the propensity scores effectively removed confounding only when the propensity score models were correctly specified. Double-adjustment for the unbalanced covariates was more robust to misspecification. Double-adjustment for the weighted unbalanced covariates outperformed the other approaches in every scenario and using any matching algorithm, as measured by the mean squared error.

Conclusion

Double-adjustment can be used to remove residual confounding after propensity score matching. The unbalanced covariates with the strongest confounding effects should be adjusted.

The full text of this article hosted at iucr.org is unavailable due to technical difficulties.