Digital Phenotyping and Mental Health: Evaluating the Reliability of Passive Smartphone Behavioral Features Using a Public Beiwe Dataset
DOI:
https://doi.org/10.58445/rars.4293Keywords:
digital phenotyping, Mental health, Smartphone Technology, Beiwe, GPS, mobility, behavioral features, privacy, measurement reliability, Machine LearningAbstract
Background/Objective: Digital phenotyping is the use of data collected from personal digital devices to study patterns in human behavior over time. It has become useful in mental-health research because smartphones can collect information in everyday settings. The objective of this research is to examine how reliable several commonly used smartphone-based behavioral features are. Methods: I used a publicly available dataset from the Beiwe digital phenotyping platform. The data included six participants and 49 participant-days from March 2022. I added Gaussian noise to the GPS coordinates at eight levels, with standard deviations of 0-800 meters in each direction. Results: Added GPS noise greatly increased total distance and mean speed. Time at home fell to 39% of baseline at 100 meters of noise and 1% at 800 meters. Radius of gyration remained within 1-7% of baseline through 200 meters. Changes in time at home and radius of gyration matched the values calculated from the amount of noise. Location entropy and number of significant places were less predictable because both depend on clustering. For 33 participant-days, GPS-based and self-reported time at home had a weak correlation in hours, which increased when expressed as proportions. However, day-to-day agreement within individuals was negligible. Conclusions: Behavioral features can respond very differently to the same sensor error. This study does not test psychiatric diagnoses. Instead, it checks how reliable smartphone measurements are before they are used in mental-health research. Keywords: digital phenotyping, mental health, smartphone sensing, Beiwe, GPS, mobility, behavioral features, privacy, measurement reliability, machine learningReferences
M. Solmi, J. Radua, M. Olivola, E. Croce, L. Soardo, G. Salazar de Pablo, J. I. Shin, J. B. Kirkbride, P. Jones, J. H. Kim, J. Y. Kim, A. F. Carvalho, M. V. Seeman, C. U. Correll, P. Fusar-Poli. Age at onset of mental disorders worldwide: large-scale meta-analysis of 192 epidemiological studies. Molecular Psychiatry. Vol. 27, pg. 281–295, 2022, https://doi.org/10.1038/s41380-021-01161-7.
J. Torous, M. V. Kiang, J. Lorme, J.-P. Onnela. New tools for new research in psychiatry: a scalable and customizable platform to empower data-driven smartphone research. JMIR Mental Health. Vol. 3, pg. e16, 2016, https://doi.org/10.2196/mental.5165.
A. Oudin, R. Maatoug, A. Bourla, F. Ferreri, O. Bonnot, B. Millet, F. Schoeller, S. Mouchabac, V. Adrien. Digital phenotyping: data-driven psychiatry to redefine mental health. Journal of Medical Internet Research. Vol. 25, pg. e44502, 2023, https://doi.org/10.2196/44502.
S. Saeb, M. Zhang, C. J. Karr, S. M. Schueller, M. E. Corden, K. P. Kording, D. C. Mohr. Mobile phone sensor correlates of depressive symptom severity in daily-life behavior: an exploratory study. Journal of Medical Internet Research. Vol. 17, pg. e175, 2015, https://doi.org/10.2196/jmir.4273.
I. Barnett, J. Torous, P. Staples, L. Sandoval, M. Keshavan, J.-P. Onnela. Relapse prediction in schizophrenia through digital phenotyping: a pilot study. Neuropsychopharmacology. Vol. 43, pg. 1660–1666, 2018, https://doi.org/10.1038/s41386-018-0030-z.
F. Matcham, C. Barattieri di San Pietro, V. Bulgari, G. de Girolamo, R. Dobson, H. Eriksson, A. A. Folarin, J. M. Haro, M. Kerz, F. Lamers, Q. Li, N. V. Manyakov, D. C. Mohr, I. Myin-Germeys, V. Narayan, B. W. J. H. Penninx, Y. Ranjan, Z. Rashid, A. Rintala, S. Siddi, S. Simblett, T. Wykes, M. Hotopf, RADAR-CNS consortium. Remote assessment of disease and relapse in major depressive disorder (RADAR-MDD): a multi-centre prospective cohort study protocol. BMC Psychiatry. Vol. 19, pg. 72, 2019, https://doi.org/10.1186/s12888-019-2049-z.
D. J. Cote, I. Barnett, J.-P. Onnela, T. R. Smith. Digital phenotyping in patients with spine disease: a novel approach to quantifying mobility and quality of life. World Neurosurgery. Vol. 126, pg. e241–e249, 2019, https://doi.org/10.1016/j.wneu.2019.01.297.
I. R. Galatzer-Levy, J.-P. Onnela. Machine learning and the digital measurement of psychological health. Annual Review of Clinical Psychology. Vol. 19, pg. 133–154, 2023, https://doi.org/10.1146/annurev-clinpsy-080921-073212.
J.-P. Onnela, C. Dixon, K. Griffin, T. Jaenicke, L. Minowada, S. Esterkin, A. Siu, J. Zagorsky, E. Jones. Beiwe: a data collection platform for high-throughput digital phenotyping. Journal of Open Source Software. Vol. 6, pg. 3417, 2021, https://doi.org/10.21105/joss.03417.
Beiwe Service Center, Harvard T.H. Chan School of Public Health. Technology. https://hsph.harvard.edu/research-resource/beiwe/technology/, accessed September 5, 2026.
P. Emedom-Nnamdi, K. W. Carlson, Z. Clement, M. Karas, M. Straczkiewicz, J.-P. Onnela. Sample Beiwe dataset. Zenodo. 2022, https://doi.org/10.5281/zenodo.6471045.
X. Wang, N. Vouk, C. Heaukulani, T. Buddhika, W. Martanto, J. Lee, R. J. T. Morris. HOPES: an integrative digital phenotyping platform for data collection, monitoring, and machine learning. Journal of Medical Internet Research. Vol. 23, pg. e23984, 2021, https://doi.org/10.2196/23984.
S. Saeb, E. G. Lattie, S. M. Schueller, K. P. Kording, D. C. Mohr. The relationship between mobile phone location sensor data and depressive symptom severity. PeerJ. Vol. 4, pg. e2537, 2016, https://doi.org/10.7717/peerj.2537.
Y.-A. de Montjoye, C. A. Hidalgo, M. Verleysen, V. D. Blondel. Unique in the crowd: the privacy bounds of human mobility. Scientific Reports. Vol. 3, pg. 1376, 2013, https://doi.org/10.1038/srep01376.
J. Z. Bakdash, L. R. Marusich. Repeated measures correlation. Frontiers in Psychology. Vol. 8, pg. 456, 2017, https://doi.org/10.3389/fpsyg.2017.00456.
X. K. Lee, N. I. Y. N. Chee, J. L. Ong, T. B. Teo, E. van Rijn, J. C. Lo, M. W. L. Chee. Validation of a consumer sleep wearable device with actigraphy and polysomnography in adolescents across sleep opportunity manipulations. Journal of Clinical Sleep Medicine. Vol. 15, pg. 1337–1346, 2019, https://doi.org/10.5664/jcsm.7932.
Downloads
Posted
Categories
License
Copyright (c) 2026 Research Archive of Rising Scholars

This work is licensed under a Creative Commons Attribution 4.0 International License.