Tags

Type your tag names separated by a space and hit enter

Statistical power in parallel group point exposure studies with time-to-event outcomes: an empirical comparison of the performance of randomized controlled trials and the inverse probability of treatment weighting (IPTW) approach.
BMC Med Res Methodol. 2015 Oct 15; 15:87.BM

Abstract

BACKGROUND

Estimating statistical power is an important component of the design of both randomized controlled trials (RCTs) and observational studies. Methods for estimating statistical power in RCTs have been well described and can be implemented simply. In observational studies, statistical methods must be used to remove the effects of confounding that can occur due to non-random treatment assignment. Inverse probability of treatment weighting (IPTW) using the propensity score is an attractive method for estimating the effects of treatment using observational data. However, sample size and power calculations have not been adequately described for these methods.

METHODS

We used an extensive series of Monte Carlo simulations to compare the statistical power of an IPTW analysis of an observational study with time-to-event outcomes with that of an analysis of a similarly-structured RCT. We examined the impact of four factors on the statistical power function: number of observed events, prevalence of treatment, the marginal hazard ratio, and the strength of the treatment-selection process.

RESULTS

We found that, on average, an IPTW analysis had lower statistical power compared to an analysis of a similarly-structured RCT. The difference in statistical power increased as the magnitude of the treatment-selection model increased.

CONCLUSIONS

The statistical power of an IPTW analysis tended to be lower than the statistical power of a similarly-structured RCT.

Authors+Show Affiliations

Institute for Clinical Evaluative Sciences, G106, 2075 Bayview Avenue, M4N 3M5, Toronto, ON, Canada. peter.austin@ices.on.ca. Institute of Health Management, Policy and Evaluation, University of Toronto, Toronto, Canada. peter.austin@ices.on.ca. Schulich Heart Research Program, Sunnybrook Research Institute, Toronto, Canada. peter.austin@ices.on.ca.Clinical Epidemiology and Biostatistics Unit and Melbourne Children's Trial Centre, Murdoch Children's Research Institute, Royal Children's Hospital, Parkville, VIC, Australia. tibor.schuster@mcri.edu.au. Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montreal, Canada. tibor.schuster@mcri.edu.au. Department of Paediatrics, University of Melbourne, Melbourne, Australia. tibor.schuster@mcri.edu.au.Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montreal, Canada. Robert.platt@mcgill.ca. Department of Pediatrics, McGill University, Montreal, Canada. Robert.platt@mcgill.ca.

Pub Type(s)

Comparative Study
Journal Article
Research Support, Non-U.S. Gov't

Language

eng

PubMed ID

26472109

Citation

Austin, Peter C., et al. "Statistical Power in Parallel Group Point Exposure Studies With Time-to-event Outcomes: an Empirical Comparison of the Performance of Randomized Controlled Trials and the Inverse Probability of Treatment Weighting (IPTW) Approach." BMC Medical Research Methodology, vol. 15, 2015, p. 87.
Austin PC, Schuster T, Platt RW. Statistical power in parallel group point exposure studies with time-to-event outcomes: an empirical comparison of the performance of randomized controlled trials and the inverse probability of treatment weighting (IPTW) approach. BMC Med Res Methodol. 2015;15:87.
Austin, P. C., Schuster, T., & Platt, R. W. (2015). Statistical power in parallel group point exposure studies with time-to-event outcomes: an empirical comparison of the performance of randomized controlled trials and the inverse probability of treatment weighting (IPTW) approach. BMC Medical Research Methodology, 15, 87. https://doi.org/10.1186/s12874-015-0081-3
Austin PC, Schuster T, Platt RW. Statistical Power in Parallel Group Point Exposure Studies With Time-to-event Outcomes: an Empirical Comparison of the Performance of Randomized Controlled Trials and the Inverse Probability of Treatment Weighting (IPTW) Approach. BMC Med Res Methodol. 2015 Oct 15;15:87. PubMed PMID: 26472109.
* Article titles in AMA citation format should be in sentence-case
TY - JOUR T1 - Statistical power in parallel group point exposure studies with time-to-event outcomes: an empirical comparison of the performance of randomized controlled trials and the inverse probability of treatment weighting (IPTW) approach. AU - Austin,Peter C, AU - Schuster,Tibor, AU - Platt,Robert W, Y1 - 2015/10/15/ PY - 2015/03/11/received PY - 2015/10/05/accepted PY - 2015/10/17/entrez PY - 2015/10/17/pubmed PY - 2016/7/23/medline SP - 87 EP - 87 JF - BMC medical research methodology JO - BMC Med Res Methodol VL - 15 N2 - BACKGROUND: Estimating statistical power is an important component of the design of both randomized controlled trials (RCTs) and observational studies. Methods for estimating statistical power in RCTs have been well described and can be implemented simply. In observational studies, statistical methods must be used to remove the effects of confounding that can occur due to non-random treatment assignment. Inverse probability of treatment weighting (IPTW) using the propensity score is an attractive method for estimating the effects of treatment using observational data. However, sample size and power calculations have not been adequately described for these methods. METHODS: We used an extensive series of Monte Carlo simulations to compare the statistical power of an IPTW analysis of an observational study with time-to-event outcomes with that of an analysis of a similarly-structured RCT. We examined the impact of four factors on the statistical power function: number of observed events, prevalence of treatment, the marginal hazard ratio, and the strength of the treatment-selection process. RESULTS: We found that, on average, an IPTW analysis had lower statistical power compared to an analysis of a similarly-structured RCT. The difference in statistical power increased as the magnitude of the treatment-selection model increased. CONCLUSIONS: The statistical power of an IPTW analysis tended to be lower than the statistical power of a similarly-structured RCT. SN - 1471-2288 UR - https://www.unboundmedicine.com/medline/citation/26472109/Statistical_power_in_parallel_group_point_exposure_studies_with_time_to_event_outcomes:_an_empirical_comparison_of_the_performance_of_randomized_controlled_trials_and_the_inverse_probability_of_treatment_weighting__IPTW__approach_ L2 - https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874-015-0081-3 DB - PRIME DP - Unbound Medicine ER -