Comparison of data analysis strategies for assessing treatment effectiveness in in pre-test-post-test designs with substantial dropout rates
-
Altmetric Citations
Salim, Agus; Mackinnon, Andrew; Christensen, Helen; Griffiths, Kathleen
Description
The pre-test-post-test design (PPD) is predominant in trials of psychotherapeutic treatments. Missing data due to withdrawals present an even bigger challenge in assessing treatment effectiveness under the PPD than under designs with more observations since dropout implies an absence of information about response to treatment. When confronted with missing data, often it is reasonable to assume that the mechanism underlying missingness is related to observed but not to unobserved outcomes...[Show more]
dc.contributor.author | Salim, Agus | |
---|---|---|
dc.contributor.author | Mackinnon, Andrew | |
dc.contributor.author | Christensen, Helen | |
dc.contributor.author | Griffiths, Kathleen | |
dc.date.accessioned | 2015-12-08T22:43:27Z | |
dc.identifier.issn | 0165-1781 | |
dc.identifier.uri | http://hdl.handle.net/1885/37290 | |
dc.description.abstract | The pre-test-post-test design (PPD) is predominant in trials of psychotherapeutic treatments. Missing data due to withdrawals present an even bigger challenge in assessing treatment effectiveness under the PPD than under designs with more observations since dropout implies an absence of information about response to treatment. When confronted with missing data, often it is reasonable to assume that the mechanism underlying missingness is related to observed but not to unobserved outcomes (missing at random, MAR). Previous simulation and theoretical studies have shown that, under MAR, modern techniques such as maximum-likelihood (ML) based methods and multiple imputation (MI) can be used to produce unbiased estimates of treatment effects. In practice, however, ad hoc methods such as last observation carried forward (LOCF) imputation and complete-case (CC) analysis continue to be used. In order to better understand the behaviour of these methods in the PPD, we compare the performance of traditional approaches (LOCF, CC) and theoretically sound techniques (MI, ML), under various MAR mechanisms. We show that the LOCF method is seriously biased and conclude that its use should be abandoned. Complete-case analysis produces unbiased estimates only when the dropout mechanism does not depend on pre-test values even when dropout is related to fixed covariates including treatment group (covariate-dependent: CD). However, CC analysis is generally biased under MAR. The magnitude of the bias is largest when the correlation of post- and pre-test is relatively low. | |
dc.publisher | Elsevier | |
dc.source | Psychiatry Research | |
dc.subject | Keywords: article; comparative study; covariance; data analysis; maximum likelihood method; priority journal; psychotherapy; simulation; technique; theoretical study; treatment response; Bias (Epidemiology); Clinical Trials as Topic; Evaluation Studies as Topic; Hu Bias; Intention to treat (ITT); Mixed models; Multiple imputation; Trials of psychotherapies | |
dc.title | Comparison of data analysis strategies for assessing treatment effectiveness in in pre-test-post-test designs with substantial dropout rates | |
dc.type | Journal article | |
local.description.notes | Imported from ARIES | |
local.identifier.citationvolume | 160 | |
dc.date.issued | 2008 | |
local.identifier.absfor | 111714 - Mental Health | |
local.identifier.ariespublication | U4146231xPUB147 | |
local.type.status | Published Version | |
local.contributor.affiliation | Salim, Agus, College of Medicine, Biology and Environment, ANU | |
local.contributor.affiliation | Mackinnon, Andrew, College of Medicine, Biology and Environment, ANU | |
local.contributor.affiliation | Christensen, Helen, College of Medicine, Biology and Environment, ANU | |
local.contributor.affiliation | Griffiths, Kathleen, College of Medicine, Biology and Environment, ANU | |
local.description.embargo | 2037-12-31 | |
local.bibliographicCitation.issue | 3 | |
local.bibliographicCitation.startpage | 335 | |
local.bibliographicCitation.lastpage | 345 | |
local.identifier.doi | 10.1016/j.psychres.2007.08.005 | |
dc.date.updated | 2015-12-08T10:41:09Z | |
local.identifier.scopusID | 2-s2.0-50449104090 | |
local.identifier.thomsonID | 000260061800012 | |
Collections | ANU Research Publications |
Download
File | Description | Size | Format | Image |
---|---|---|---|---|
01_Salim_Comparison_of_data_analysis_2008.pdf | 190.93 kB | Adobe PDF | Request a copy | |
02_Salim_Comparison_of_data_analysis_2008.pdf | 658.89 kB | Adobe PDF | Request a copy |
Items in Open Research are protected by copyright, with all rights reserved, unless otherwise indicated.
Updated: 17 November 2022/ Responsible Officer: University Librarian/ Page Contact: Library Systems & Web Coordinator