2019Chronobiology InternationalRequires access

Performance assessment of new-generation Fitbit technology in deriving sleep parameters and stages

Shahab Haghayegh, Sepideh Khoshnevis, Michael H. Smolensky, Kenneth R. Diller, Richard J. Castriotta

Open publisher page 77 citations

Abstract

We compared performance in deriving sleep variables by both Fitbit Charge 2™, which couples body movement (accelerometry) and heart rate variability (HRV) in combination with its proprietary interpretative algorithm (IA), and standard actigraphy (Motionlogger® Micro Watch Actigraph: MMWA), which relies solely on accelerometry in combination with its best performing 'Sadeh' IA, to electroencephalography (EEG: Zmachine® Insight+ and its proprietary IA) used as reference. We conducted home sleep studies on 35 healthy adults, 33 of whom provided complete datasets of the three simultaneously assessed technologies. Relative to the Zmachine EEG method, Fitbit showed an overall Kappa agreement of 54% in distinguishing wake/sleep epochs and sensitivity of 95% and specificity of 57% in detecting sleep epochs. Fitbit, relative to EEG, underestimated sleep onset latency (SOL) by ~11 min and overestimated sleep efficiency (SE) by ~4%. There was no statistically significant difference between Fitbit and EEG methods in measuring wake after sleep onset (WASO) and total sleep time (TST). Fitbit showed substantial agreement with EEG in detecting rapid eye movement and deep sleep, but only moderate agreement in detecting light sleep. The MMWA method showed 51% overall Kappa agreement with the EEG one in detecting wake/sleep epochs, with sensitivity of 94% and specificity of 53% in detecting sleep epochs. MMWA, relative to EEG, underestimated SOL by ~10 min. There was no significant difference between Fitbit and MMWA methods in amount of bias in estimating SOL, WASO, TST, and SE; however, the minimum detectable change (MDC) per sleep variable with Fitbit was better (smaller) than with MMWA, respectively, by ~10 min, ~16 min, ~22 min, and ~8%. Overall, performance of Fitbit accelerometry and HRV technology in conjunction with its proprietary IA to detect sleep vs. wake episodes is slightly better than wrist actigraphy that relies solely on accelerometry and best performing Sadeh IA. Moreover, the smaller MDC of Fitbit technology in deriving sleep parameters in comparison to wrist actigraphy makes it a suitable option for assessing changes in sleep quality over time, longitudinally, and/or in response to interventions.

About this research paper

What this paper is about

We compared performance in deriving sleep variables by both Fitbit Charge 2™, which couples body movement (accelerometry) and heart rate variability (HRV) in combination with its proprietary interpretative algorithm (IA), and standard actigraphy (Motionlogger® Micro Watch Actigraph: MMWA), which relies solely on accelerometry in combination with its best performing 'Sadeh' IA, to electroencephalography (EEG: Zmachine® Insight+ and its proprietary IA) used as reference. We conducted home sleep studies on 35 healthy adults, 33 of whom provided complete datasets of the three simultaneously assessed technologies. Relative to the Zmachine EEG method, Fitbit showed an overall Kappa agreement of 54% in distinguishing wake/sleep epochs and sensitivity of 95% and specificity of 57% in detecting sleep epochs. Fitbit, relative to EEG, underestimated sleep onset latency (SOL) by ~11 min and overestimated sleep efficiency (SE) by ~4%. There was no statistically significant difference between Fitbit and EEG methods in measuring wake after sleep onset (WASO) and total sleep time (TST). Fitbit showed substantial agreement with EEG in detecting rapid eye movement and deep sleep, but only moderate agreement in detecting light sleep. The MMWA method showed 51% overall Kappa agreement with the EEG one in detecting wake/sleep epochs, with sensitivity of 94% and specificity of 53% in detecting sleep epochs. MMWA, relative to EEG, underestimated SOL by ~10 min. There was no significant difference between Fitbit and MMWA methods in amount of bias in estimating SOL, WASO, TST, and SE; however, the minimum detectable change (MDC) per sleep variable with Fitbit was better (smaller) than with MMWA, respectively, by ~10 min, ~16 min, ~22 min, and ~8%. Overall, performance of Fitbit accelerometry and HRV technology in conjunction with its proprietary IA to detect sleep vs. wake episodes is slightly better than wrist actigraphy that relies solely on accelerometry and best performing Sadeh IA. Moreover, the smaller MDC of Fitbit technology in deriving sleep parameters in comparison to wrist actigraphy makes it a suitable option for assessing changes in sleep quality over time, longitudinally, and/or in response to interventions.

Why it matters

OpenAlex reports 77 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

We compared performance in deriving sleep variables by both Fitbit Charge 2™, which couples body movement (accelerometry) and heart rate variability (HRV) in combination with its proprietary interpretative algorithm (IA), and standard actigraphy (Motionlogger® Micro Watch Actigraph: MMWA), which relies solely on accelerometry in combination with its best performing 'Sadeh' IA, to electroencephalography (EEG: Zmachine® Insight+ and its proprietary IA) used as reference. We conducted home sleep studies on 35 healthy adults, 33 of whom provided complete datasets of the three simultaneously assessed technologies. Relative to the Zmachine EEG method, Fitbit showed an overall Kappa agreement of 54% in distinguishing wake/sleep epochs and sensitivity of 95% and specificity of 57% in detecting sleep epochs. Fitbit, relative to EEG, underestimated sleep onset latency (SOL) by ~11 min and overestimated sleep efficiency (SE) by ~4%. There was no statistically significant difference between Fitbit and EEG methods in measuring wake after sleep onset (WASO) and total sleep time (TST). Fitbit showed substantial agreement with EEG in detecting rapid eye movement and deep sleep, but only moderate agreement in detecting light sleep. The MMWA method showed 51% overall Kappa agreement with the EEG one in detecting wake/sleep epochs, with sensitivity of 94% and specificity of 53% in detecting sleep epochs. MMWA, relative to EEG, underestimated SOL by ~10 min. There was no significant difference between Fitbit and MMWA methods in amount of bias in estimating SOL, WASO, TST, and SE; however, the minimum detectable change (MDC) per sleep variable with Fitbit was better (smaller) than with MMWA, respectively, by ~10 min, ~16 min, ~22 min, and ~8%. Overall, performance of Fitbit accelerometry and HRV technology in conjunction with its proprietary IA to detect sleep vs. wake episodes is slightly better than wrist actigraphy that relies solely on accelerometry and best performing Sadeh IA. Moreover, the smaller MDC of Fitbit technology in deriving sleep parameters in comparison to wrist actigraphy makes it a suitable option for assessing changes in sleep quality over time, longitudinally, and/or in response to interventions.

Key concepts: Actigraphy, Sleep onset latency, Electroencephalography, Sleep onset, Sleep (system call), Sleep Stages, Audiology, Polysomnography

Related papers

Back to paper searchBrowse research topicsOriginal source
Performance assessment of new-generation Fitbit technology in deriving sleep parameters and stages — Research Paper | ScholarLens