TY - JOUR
T1 - Addressing participant validity in a small internet health survey (the restore study)
T2 - Protocol and recommendations for survey response validation
AU - Dewitt, James
AU - Capistrant, Benjamin D
AU - Kohli, Nidhi
AU - Rosser, B. R. Simon
AU - Mitteldorf, Darryl
AU - Merengwa, Enyinnaya
AU - West, William G
N1 - Publisher Copyright:
© James Dewitt, Benjamin Capistrant, Nidhi Kohli, B R Simon Rosser, Darryl Mitteldorf, Enyinnaya Merengwa, William West.
PY - 2018/4
Y1 - 2018/4
N2 - Background: While deduplication and cross-validation protocols have been recommended for large Web-based studies, protocols for survey response validation of smaller studies have not been published. Objective: This paper reports the challenges of survey validation inherent in a small Web-based health survey research. Methods: The subject population was North American, gay and bisexual, prostate cancer survivors, who represent an under-researched, hidden, difficult-to-recruit, minority-within-a-minority population. In 2015-2016, advertising on a large Web-based cancer survivor support network, using email and social media, yielded 478 completed surveys. Results: Our manual deduplication and cross-validation protocol identified 289 survey submissions (289/478, 60.4%) as likely spam, most stemming from advertising on social media. The basic components of this deduplication and validation protocol are detailed. An unexpected challenge encountered was invalid survey responses evolving across the study period. This necessitated the static detection protocol be augmented with a dynamic one. Conclusions: Five recommendations for validation of Web-based samples, especially with smaller difficult-to-recruit populations, are detailed.
AB - Background: While deduplication and cross-validation protocols have been recommended for large Web-based studies, protocols for survey response validation of smaller studies have not been published. Objective: This paper reports the challenges of survey validation inherent in a small Web-based health survey research. Methods: The subject population was North American, gay and bisexual, prostate cancer survivors, who represent an under-researched, hidden, difficult-to-recruit, minority-within-a-minority population. In 2015-2016, advertising on a large Web-based cancer survivor support network, using email and social media, yielded 478 completed surveys. Results: Our manual deduplication and cross-validation protocol identified 289 survey submissions (289/478, 60.4%) as likely spam, most stemming from advertising on social media. The basic components of this deduplication and validation protocol are detailed. An unexpected challenge encountered was invalid survey responses evolving across the study period. This necessitated the static detection protocol be augmented with a dynamic one. Conclusions: Five recommendations for validation of Web-based samples, especially with smaller difficult-to-recruit populations, are detailed.
KW - Data accuracy
KW - Data analysis
KW - Design
KW - Fraudulent data
KW - Research
KW - Research activities
UR - http://www.scopus.com/inward/record.url?scp=85097322704&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85097322704&partnerID=8YFLogxK
U2 - 10.2196/resprot.7655
DO - 10.2196/resprot.7655
M3 - Article
C2 - 29691203
AN - SCOPUS:85097322704
SN - 1929-0748
VL - 20
JO - JMIR Research Protocols
JF - JMIR Research Protocols
IS - 4
M1 - e96
ER -