Collecting outcome data of a text messaging smoking cessation intervention with in-program text assessments

How reliable are the results?

Johannes Thrul, Judith A. Mendel, Samuel J. Simmens, Lorien C. Abroms

Research output: Contribution to journalArticle

Abstract

Background: Text messaging interventions have shown promise in helping people quit smoking. Texting programs periodically survey participants about their smoking status. This study examined the consistency of participant self-reported smoking between external surveys and internal program text message assessments. Methods: Participants in Text2Quit program were surveyed about their past 7-day smoking at one, three, and six months post-enrollment using different survey modes (external surveys and internal program text message assessments) and responses were compared for consistency. The first set of analyses was conducted for participants responding on both modes (n = 45 at one month; n = 50 at three months; n = 42 at six months). Additional analyses, assuming missing = smoking, were conducted with the full sample of 262 smokers (68.7% female, mean age = 35.8 years) and compared to saliva-confirmed abstinence rates. Results: Participants responding to both modes consistently reported smoking status at one (88.9%), three (88.0%) and six (88.1%) months post-enrollment, with fair to substantial levels of agreement (one month: κ = 0.24; three months: κ = 0.63; six months: κ = 0.66). Participants responding to both modes reported high rates of abstinence. In missing = smoking analyses, significant differences in abstinence rates reported across modes were detected at each timepoint (one month: external = 30.5%, internal = 16.4%; three months: external = 33.2%, internal = 16.0%; six months: external = 31.7%, internal = 12.2%; all p <.001). Moderate levels of agreement were found between the two modes. At 6 months, abstinence rates obtained via internal data were closer to those biochemically verified (15.7%) compared to external surveys. Conclusions: Results provide initial support for the use of internal program assessments in text messaging programs with missing = smoking assumptions in order to gather outcome data on smoking behavior.

Original languageEnglish (US)
Pages (from-to)31-37
Number of pages7
JournalAddictive Behaviors
Volume85
DOIs
StatePublished - Oct 1 2018

Fingerprint

Text messaging
Text Messaging
Smoking Cessation
Smoking
Saliva
Surveys and Questionnaires

Keywords

  • Assessment
  • mHealth
  • Outcomes
  • Smoking cessation
  • Text messaging

ASJC Scopus subject areas

  • Medicine (miscellaneous)
  • Toxicology
  • Clinical Psychology
  • Psychiatry and Mental health

Cite this

Collecting outcome data of a text messaging smoking cessation intervention with in-program text assessments : How reliable are the results? / Thrul, Johannes; Mendel, Judith A.; Simmens, Samuel J.; Abroms, Lorien C.

In: Addictive Behaviors, Vol. 85, 01.10.2018, p. 31-37.

Research output: Contribution to journalArticle

@article{879abbfab5f84b4ea6c540f932cdabda,
title = "Collecting outcome data of a text messaging smoking cessation intervention with in-program text assessments: How reliable are the results?",
abstract = "Background: Text messaging interventions have shown promise in helping people quit smoking. Texting programs periodically survey participants about their smoking status. This study examined the consistency of participant self-reported smoking between external surveys and internal program text message assessments. Methods: Participants in Text2Quit program were surveyed about their past 7-day smoking at one, three, and six months post-enrollment using different survey modes (external surveys and internal program text message assessments) and responses were compared for consistency. The first set of analyses was conducted for participants responding on both modes (n = 45 at one month; n = 50 at three months; n = 42 at six months). Additional analyses, assuming missing = smoking, were conducted with the full sample of 262 smokers (68.7{\%} female, mean age = 35.8 years) and compared to saliva-confirmed abstinence rates. Results: Participants responding to both modes consistently reported smoking status at one (88.9{\%}), three (88.0{\%}) and six (88.1{\%}) months post-enrollment, with fair to substantial levels of agreement (one month: κ = 0.24; three months: κ = 0.63; six months: κ = 0.66). Participants responding to both modes reported high rates of abstinence. In missing = smoking analyses, significant differences in abstinence rates reported across modes were detected at each timepoint (one month: external = 30.5{\%}, internal = 16.4{\%}; three months: external = 33.2{\%}, internal = 16.0{\%}; six months: external = 31.7{\%}, internal = 12.2{\%}; all p <.001). Moderate levels of agreement were found between the two modes. At 6 months, abstinence rates obtained via internal data were closer to those biochemically verified (15.7{\%}) compared to external surveys. Conclusions: Results provide initial support for the use of internal program assessments in text messaging programs with missing = smoking assumptions in order to gather outcome data on smoking behavior.",
keywords = "Assessment, mHealth, Outcomes, Smoking cessation, Text messaging",
author = "Johannes Thrul and Mendel, {Judith A.} and Simmens, {Samuel J.} and Abroms, {Lorien C.}",
year = "2018",
month = "10",
day = "1",
doi = "10.1016/j.addbeh.2018.05.012",
language = "English (US)",
volume = "85",
pages = "31--37",
journal = "Addictive Behaviors",
issn = "0306-4603",
publisher = "Elsevier Limited",

}

TY - JOUR

T1 - Collecting outcome data of a text messaging smoking cessation intervention with in-program text assessments

T2 - How reliable are the results?

AU - Thrul, Johannes

AU - Mendel, Judith A.

AU - Simmens, Samuel J.

AU - Abroms, Lorien C.

PY - 2018/10/1

Y1 - 2018/10/1

N2 - Background: Text messaging interventions have shown promise in helping people quit smoking. Texting programs periodically survey participants about their smoking status. This study examined the consistency of participant self-reported smoking between external surveys and internal program text message assessments. Methods: Participants in Text2Quit program were surveyed about their past 7-day smoking at one, three, and six months post-enrollment using different survey modes (external surveys and internal program text message assessments) and responses were compared for consistency. The first set of analyses was conducted for participants responding on both modes (n = 45 at one month; n = 50 at three months; n = 42 at six months). Additional analyses, assuming missing = smoking, were conducted with the full sample of 262 smokers (68.7% female, mean age = 35.8 years) and compared to saliva-confirmed abstinence rates. Results: Participants responding to both modes consistently reported smoking status at one (88.9%), three (88.0%) and six (88.1%) months post-enrollment, with fair to substantial levels of agreement (one month: κ = 0.24; three months: κ = 0.63; six months: κ = 0.66). Participants responding to both modes reported high rates of abstinence. In missing = smoking analyses, significant differences in abstinence rates reported across modes were detected at each timepoint (one month: external = 30.5%, internal = 16.4%; three months: external = 33.2%, internal = 16.0%; six months: external = 31.7%, internal = 12.2%; all p <.001). Moderate levels of agreement were found between the two modes. At 6 months, abstinence rates obtained via internal data were closer to those biochemically verified (15.7%) compared to external surveys. Conclusions: Results provide initial support for the use of internal program assessments in text messaging programs with missing = smoking assumptions in order to gather outcome data on smoking behavior.

AB - Background: Text messaging interventions have shown promise in helping people quit smoking. Texting programs periodically survey participants about their smoking status. This study examined the consistency of participant self-reported smoking between external surveys and internal program text message assessments. Methods: Participants in Text2Quit program were surveyed about their past 7-day smoking at one, three, and six months post-enrollment using different survey modes (external surveys and internal program text message assessments) and responses were compared for consistency. The first set of analyses was conducted for participants responding on both modes (n = 45 at one month; n = 50 at three months; n = 42 at six months). Additional analyses, assuming missing = smoking, were conducted with the full sample of 262 smokers (68.7% female, mean age = 35.8 years) and compared to saliva-confirmed abstinence rates. Results: Participants responding to both modes consistently reported smoking status at one (88.9%), three (88.0%) and six (88.1%) months post-enrollment, with fair to substantial levels of agreement (one month: κ = 0.24; three months: κ = 0.63; six months: κ = 0.66). Participants responding to both modes reported high rates of abstinence. In missing = smoking analyses, significant differences in abstinence rates reported across modes were detected at each timepoint (one month: external = 30.5%, internal = 16.4%; three months: external = 33.2%, internal = 16.0%; six months: external = 31.7%, internal = 12.2%; all p <.001). Moderate levels of agreement were found between the two modes. At 6 months, abstinence rates obtained via internal data were closer to those biochemically verified (15.7%) compared to external surveys. Conclusions: Results provide initial support for the use of internal program assessments in text messaging programs with missing = smoking assumptions in order to gather outcome data on smoking behavior.

KW - Assessment

KW - mHealth

KW - Outcomes

KW - Smoking cessation

KW - Text messaging

UR - http://www.scopus.com/inward/record.url?scp=85047473983&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85047473983&partnerID=8YFLogxK

U2 - 10.1016/j.addbeh.2018.05.012

DO - 10.1016/j.addbeh.2018.05.012

M3 - Article

VL - 85

SP - 31

EP - 37

JO - Addictive Behaviors

JF - Addictive Behaviors

SN - 0306-4603

ER -