Unmasking Nuances Affecting Loneliness: Using Digital Behavioural Markers to Understand Social and Emotional Loneliness in College Students
Abstract
:1. Introduction
- Can behavioural features extracted from passively sensed data differentiate between socially and Emotionally Lonely students?
- Can behavioural features help to classify social and emotional loneliness?
- What behavioural features are most important for predictive models in classifying loneliness and its types?
2. Methods
2.1. Dataset
2.2. Data Preprocessing
2.3. Categorizing Social and Emotional Loneliness
- Participants with a social_score of above 10 and an emotional_score of 10 and below were labelled as ‘Socially Lonely’.
- Participants with an emotional_score of above 10 and social_score of 10 and below were labelled as ‘Emotionally Lonely’.
- Participants scoring above 10 on both scales were considered ‘both socially and Emotionally Lonely’.
- Finally, those scoring 10 or below on both scales were categorized as ‘not lonely’.
2.4. Differentiating Social and Emotional Loneliness
2.5. Predictive Modelling for Loneliness Classification
2.6. Feature Importance Analysis
3. Results
3.1. Overview of Loneliness in Participants
3.2. Statistical Differences for Social and Emotional Loneliness
3.3. Predictive Power of Behavioural Features in Loneliness Categories
3.4. Important Features for Loneliness Classification
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Abbreviations
EL | Emotionally Lonely |
MI | Mutual Information |
RAPIDS | Reproducible Analysis Pipeline for Data Streams |
SHAP | Shapley Additive exPlanations |
SL | Socially Lonely |
SMOTE | Synthetic Minority Oversampling Technique |
UCLA | University of California Los Angeles |
References
- U.S. Surgeon General’s Advisory. Our Epidemic of Loneliness and Isolation. Available online: https://www.hhs.gov/sites/default/files/surgeon-general-social-connection-advisory.pdf (accessed on 26 October 2024).
- Campbell, M. Loneliness, social anxiety and bullying victimization in young people: A literature review. Psychol. Educ. 2013, 50, 1–10. [Google Scholar]
- Hawkley, L.C.; Thisted, R.A.; Masi, C.M.; Cacioppo, J.T. Loneliness predicts increased blood pressure: 5-year cross-lagged analyses in middle-aged and older adults. Psychol. Aging 2010, 25, 132. [Google Scholar] [CrossRef] [PubMed]
- Cacioppo, J.T.; Cacioppo, S. Social relationships and health: The toxic effects of perceived social isolation. Soc. Personal. Psychol. Compass 2014, 8, 58–72. [Google Scholar] [CrossRef] [PubMed]
- Wei, M.; Russell, D.W.; Zakalik, R.A. Adult attachment, social self-efficacy, self-disclosure, loneliness, and subsequent depression for freshman college students: A longitudinal study. J. Couns. Psychol. 2005, 52, 602. [Google Scholar] [CrossRef]
- Weis, R.S. The Experience of Emotional and Social Isolation; The MIT Press: Cambridge, MA, USA, 1973. [Google Scholar]
- Russell, D.; Cutrona, C.E.; Rose, J.; Yurko, K. Social and emotional loneliness: An examination of Weiss’s typology of loneliness. J. Personal. Soc. Psychol. 1984, 46, 1313. [Google Scholar] [CrossRef]
- Vaux, A. Social and emotional loneliness: The role of social and personal characteristics. Personal. Soc. Psychol. Bull. 1988, 14, 722–734. [Google Scholar] [CrossRef]
- Maes, M.; Vanhalst, J.; Van den Noortgate, W.; Goossens, L. Intimate and relational loneliness in adolescence. J. Child Fam. Stud. 2017, 26, 2059–2069. [Google Scholar] [CrossRef]
- Qualter, P.; Munn, P. The separateness of social and emotional loneliness in childhood. J. Child Psychol. Psychiatry 2002, 43, 233–244. [Google Scholar] [CrossRef]
- Lasgaard, M.; Goossens, L.; Bramsen, R.H.; Trillingsgaard, T.; Elklit, A. Different sources of loneliness are associated with different forms of psychopathology in adolescence. J. Res. Personal. 2011, 45, 233–237. [Google Scholar] [CrossRef]
- Rokach, A. The Psychological Journey to and from Loneliness: Development, Causes, and Effects of Social and Emotional Isolation; Academic Press: Cambridge, MA, USA, 2019. [Google Scholar]
- Knight, R.G.; Chisholm, B.J.; Marsh, N.V.; Godfrey, H.P.D. Some normative, reliability, and factor analytic data for the revised UCLA Loneliness Scale. J. Clin. Psychol. 1988, 44, 203–206. [Google Scholar] [CrossRef]
- Von Soest, T.; Luhmann, M.; Hansen, T.; Gerstorf, D. Development of loneliness in midlife and old age: Its nature and correlates. J. Personal. Soc. Psychol. 2020, 118, 388. [Google Scholar] [CrossRef]
- McAlpine, K.J. Depression, Anxiety, Loneliness Are Peaking in College Students. Brink. 2021. Available online: https://www.bu.edu/articles/2021/depression-anxiety-loneliness-are-peaking-in-college-students/ (accessed on 30 January 2025).
- Torous, J.; Onnela, J.P.; Keshavan, M. New dimensions and new tools to realize the potential of RDoC: Digital phenotyping via smartphones and connected devices. Transl. Psychiatry 2017, 7, e1053. [Google Scholar] [CrossRef]
- Qirtas, M.M.; Zafeiridi, E.; Pesch, D.; White, E.B. Loneliness and social isolation detection using passive sensing techniques: Scoping review. Jmir Mhealth Uhealth 2022, 10, e34638. [Google Scholar] [CrossRef] [PubMed]
- Qirtas, M.M.; White, E.B.; Zafeiridi, E.; Pesch, D. Personalizing loneliness detection through behavioral grouping of passive sensing data from college students. IEEE Access 2023, 11, 88841–88851. [Google Scholar] [CrossRef]
- Jafarlou, S.; Azimi, I.; Lai, J.; Wang, Y.; Labbaf, S.; Nguyen, B.; Qureshi, H.; Marcotullio, C.; Borelli, J.L.; Dutt, N.D.; et al. Objective monitoring of loneliness levels using smart devices: A multi-device approach for mental health applications. PLoS ONE 2024, 19, e0298949. [Google Scholar] [CrossRef] [PubMed]
- Holmén, K.; Ericsson, K.; Winblad, B. Social and emotional loneliness among non-demented and demented elderly people. Arch. Gerontol. Geriatr. 2000, 31, 177–192. [Google Scholar] [CrossRef]
- Drennan, J.; Treacy, M.; Butler, M.; Byrne, A.; Fealy, G.; Frazer, K.; Irving, K. The experience of social and emotional loneliness among older people in Ireland. Ageing Soc. 2008, 28, 1113–1132. [Google Scholar] [CrossRef]
- Dahlberg, L.; McKee, K.J. Correlates of social and emotional loneliness in older people: Evidence from an English community study. Aging Ment. Health 2014, 18, 504–514. [Google Scholar] [CrossRef]
- Xu, X.; Zhang, H.; Sefidgar, Y.; Ren, Y.; Liu, X.; Seo, W.; Brown, J.; Kuehn, K.; Merrill, M.; Nurius, P.; et al. GLOBEM Dataset: Multi-Year Datasets for Longitudinal Human Behaviour Modelling Generalization. Adv. Neural Inf. Process. Syst. 2022, 35, 24655–24692. [Google Scholar]
- Ferreira, D.; Kostakos, V.; Dey, A.K. AWARE: Mobile context instrumentation framework. Front. Ict 2015, 2, 6. [Google Scholar] [CrossRef]
- Vega, J.; Li, M.; Aguillera, K.; Goel, N.; Joshi, E.; Durica, K.C.; Kunta, A.R.; Low, C.A. RAPIDS: Reproducible analysis pipeline for data streams collected with mobile devices. J. Med. Internet Res. Prepr. 2020. Available online: https://preprints.jmir.org/preprint/23246 (accessed on 18 August 2020).
- RAPIDS. RAPIDS [Online]. 2021. Available online: https://www.rapids.science (accessed on 21 February 2021).
- Maes, M.; Qualter, P.; Lodder, G.M.A.; Mund, M. How (not) to measure loneliness: A review of the eight most commonly used scales. Int. J. Environ. Res. Public Health 2022, 19, 10816. [Google Scholar] [CrossRef]
- Borges, Á.; Prieto, P.; Ricchetti, G.; Hernández-Jorge, C.; Rodríguez-Naveiras, E. Validación cruzada de la factorización del Test UCLA de Soledad. Psicothema 2008, 20, 924–927. [Google Scholar] [PubMed]
- Vergara, J.R.; Estévez, P.A. A review of feature selection methods based on Mutual Information. Neural Comput. Appl. 2014, 24, 175–186. [Google Scholar] [CrossRef]
- Royston, J.P. Some techniques for assessing multivariate normality based on the Shapiro-Wilk W. J. R. Stat. Soc. Ser. Appl. Stat. 1983, 32, 121–133. [Google Scholar]
- Cohen, J. Statistical Power Analysis for the Behavioral Sciences, 2nd ed.; Routledge: New York, NY, USA, 1988. [Google Scholar]
- Cortes, C.; Vapnik, V. Support-vector networks. Mach. Learn. 1995, 20, 273–297. [Google Scholar] [CrossRef]
- Chen, T.; Guestrin, C. XGBoost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 13–17 August 2016; pp. 785–794. [Google Scholar]
- Breiman, L. Random Forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef]
- Cover, T.; Hart, P. Nearest neighbor pattern classification. IEEE Trans. Inf. Theory 1967, 13, 21–27. [Google Scholar] [CrossRef]
- Garcia-Ceja, E.; Riegler, M.; Nordgreen, T.; Jakobsen, P.; Oedegaard, K.J.; Tørresen, J. Mental health monitoring with multimodal sensing and machine learning: A survey. Pervasive Mob. Comput. 2018, 51, 1–26. [Google Scholar] [CrossRef]
- Wu, C.; Barczyk, A.N.; Craddock, R.C.; Harari, G.M.; Thomaz, E.; Shumake, J.D.; Beevers, C.G.; Gosling, S.D.; Schnyer, D.M. Improving prediction of real-time loneliness and companionship type using geosocial features of personal smartphone data. Smart Health 2021, 20, 100180. [Google Scholar] [CrossRef]
- Jacobson, N.C.; Summers, B.; Wilhelm, S. Digital biomarkers of social anxiety severity: Digital phenotyping using passive smartphone sensors. J. Med Internet Res. 2020, 22, e16875. [Google Scholar] [CrossRef]
- Elmer, T.; Lodder, G. Modelling social interaction dynamics measured with smartphone sensors: An ambulatory assessment study on social interactions and loneliness. J. Soc. Pers. Relationships 2023, 40, 654–669. [Google Scholar] [CrossRef]
- Lundberg, S.M.; Erion, G.; Chen, H.; DeGrave, A.; Prutkin, J.M.; Nair, B.; Katz, R.; Himmelfarb, J.; Bansal, N.; Lee, S.-I. From local explanations to global understanding with explainable AI for trees. Nat. Mach. Intell. 2020, 2, 56–67. [Google Scholar] [CrossRef]
- Reis, H.T. Gender effects in social participation: Intimacy, loneliness, and the conduct of social interaction. In The Emerging Field of Personal Relationships; Routledge: New York, NY, USA, 2021; pp. 91–105. [Google Scholar]
- Burger, J.M. Individual differences in preference for solitude. J. Res. Personal. 1995, 29, 85–108. [Google Scholar] [CrossRef]
- Diehl, K.; Jansen, C.; Ishchanova, K.; Hilger-Kolb, J. Loneliness at universities: Determinants of emotional and social loneliness among students. Int. J. Environ. Res. Public Health 2018, 15, 1865. [Google Scholar] [CrossRef] [PubMed]
- Labrague, L.J.; De los Santos, J.A.A.; Falguera, C. Social and emotional loneliness among college students during the COVID-19 pandemic: The predictive role of coping behaviours, social support, and personal resilience. Perspect. Psychiatr. Care 2021, 57, 1578–1584. [Google Scholar] [CrossRef] [PubMed]
- Martín-Rodríguez, A.; Tornero-Aguilera, J.F.; López-Pérez, P.J.; Clemente-Suárez, V.J. The effect of loneliness in psychological and behavioral profile among high school students in Spain. Sustainability 2021, 14, 168. [Google Scholar] [CrossRef]
- Hemberg, J.; Östman, L.; Korzhina, Y.; Groundstroem, H.; Nyström, L.; Nyman-Kurkiala, P. Loneliness as experienced by adolescents and young adults: An explorative qualitative study. Int. J. Adolesc. Youth 2022, 27, 362–384. [Google Scholar] [CrossRef]
- Valkenburg, P.M.; Peter, J. Online communication and adolescent well-being: Testing the stimulation versus the displacement hypothesis. J.-Comput.-Mediat. Commun. 2007, 12, 1169–1182. [Google Scholar] [CrossRef]
- Weiss, R. Loneliness: The Experience of Emotional and Social Isolation; MIT Press: Cambridge, MA, USA, 1975. [Google Scholar]
- de Jong-Gierveld, J. Personal relationships, social support, and loneliness. J. Soc. Pers. Relationships 1989, 6, 197–221. [Google Scholar] [CrossRef]
- Shovestul, B.; Han, J.; Germine, L.; Dodell-Feder, D. Risk factors for loneliness: The high relative importance of age versus other factors. PLoS ONE 2020, 15, e0229087. [Google Scholar] [CrossRef] [PubMed]
- Lim, M.H.; Eres, R.; Vasan, S. Understanding loneliness in the twenty-first century: An update on correlates, risk factors, and potential solutions. Soc. Psychiatry Psychiatr. Epidemiol. 2020, 55, 793–810. [Google Scholar] [CrossRef] [PubMed]
- Hayes, S.; Carlyle, M.; Haslam, S.A.; Haslam, C.; Dingle, G. Exploring links between social identity, emotion regulation, and loneliness in those with and without a history of mental illness. Br. J. Clin. Psychol. 2022, 61, 701–734. [Google Scholar] [CrossRef] [PubMed]
Category | Data |
---|---|
Participants | Total: 218 |
Gender: F 111, M 107 | |
Ethnicity: A 102, B 6, H 10, N 2, PI 1, W 70, | |
A&B 1, A&W 16, H&W 2, B&W 2, | |
A&H&W 1, B&H&W 1, H&N&W 1, NA 3 | |
Ground Truth | Pre-study 10-items UCLA scale |
Post-study 10-items UCLA scale | |
Sensor Data | Bluetooth, Wi-Fi, Call Logs, Location, Phone Usage, Physical Activity, Sleep |
Category | Derived Sensed-Behaviours |
---|---|
Wi-Fi | Number of scans, unique devices, and scans of the most connected device measured over different time segments (day, morning, afternoon, evening, night). |
Bluetooth | Number of scans, unique devices, mean and standard deviation of scans per device; most and least frequent device scans within segments, across segments and across the entire dataset. |
Location | Total distance traveled, radius of gyration, maximum diameter, maximum distance from home, significant locations visited, flight lengths and durations (mean and standard deviation), fraction of day in a pause, Shannon entropy, circadian routine, weekday/weekend routine comparison, location variance, total distance using haversine formula, average and variance of speed during movement, transitions between locations, time spent at top locations, moving to static ratio, time in non-significant clusters, time spent at specific places. |
Phone Usage | Total, longest, shortest, average, and standard deviation of unlock duration, number of unlock episodes, time until first unlock, and these metrics for specific places (living, exercise, study, greens). |
Call | Number of calls, distinct contacts, mean, sum, minimum, maximum, standard deviation, mode, and entropy of call durations, time of first and last call, calls with the most frequent contact. |
Physical Activity | Maximum, minimum, average, median, and standard deviation of daily steps, total steps; number and duration (total, max, min, average, standard deviation) of sedentary and active bouts. |
Sleep | Number, total, longest, shortest, average, median, and standard deviation of awake/asleep episodes (main, nap, all), first and last wake/bedtimes, sleep efficiency, total and average duration to fall asleep, asleep, awake, in bed, and after wakeup for each sleep type. |
Type | Questions |
---|---|
Emotional Loneliness | 1. How often do you feel that no one really knows you well? |
2. How often do you feel close to other people? (R) | |
3. How often do you feel that there are people who really understand you? (R) | |
4. How often do you feel that there are people you can turn to? (R) | |
5. How often do you feel that people are around you but not with you? | |
Social Loneliness | 1. How often do you feel that you have a lot in common with the people around you? (R) |
2. How often do you feel that you feel left out? | |
3. How often do you feel isolated from others? | |
4. How often do you feel that there are people you can talk to? (R) | |
5. How often do you feel that you lack companionship? |
Features | SL Group | EL Group | MDiff | Effect Size (Cohen’s d) |
---|---|---|---|---|
Location | ||||
LogLocationVariance(evening) | 2.301 (1.864, 2.875) | 3.751 (3.284, 4.324) | −1.452 | −0.715 (−0.964, −0.514) |
NumberOfSignificantPlaces | 1.504 (1.67, 2.53) | 2.167 (1.675, 2.602) | −0.663 | −0.327 (−0.529, −0.264) |
NumberOfLocationTransitions | 5.463 (4.174, 6.732) | 7.374 (5.638, 9.532) | −1.911 | −0.780 (−0.957, −0.604) |
NormalizedLocationEntropy | 0.451 (0.403, 0.546) | 0.323 (0.253, 0.350) | 0.128 | 0.640 (0.549, 0.732) |
Phone Usage | ||||
SumDuration | 400.204 (384.163, 416.432) | 495.535 (480.862, 510.303) | −95.331 | −0.535 [−0.758, −0.313] |
CountEpisode | 30.104 (25.562, 35.942) | 40.645 (35.074, 45.521) | −10.541 | −0.647 [−0.855, −0.439] |
FirstUseAfter | 28.745 [24.389, 33.867] | 45.067 [41.483, 48.965] | −16.322 | −0.578 [−0.739, −0.418] |
MaxDuration | 7.683 (6.422, 8.955) | 18.073 (17.534, 19.131) | −10.390 | −0.756 [−0.910, −0.603] |
Bluetooth | ||||
UniqueDevices | 3.701 (2.485, 4.933) | 5.516 (4.433, 6.597) | −1.815 | −0.238 (−0.302, −0.175) |
CountScans | 13.231 (11.630, 14.842) | 19.096 (17.751, 20.448) | −5.865 | −0.277 (−0.452, −0.102) |
Steps | ||||
MaxSumSteps | 5800.553 (5400.705, 6200.321) | 6300.878 (5900.205, 6700.426) | −500.325 | −0.518 (−0.604, −0.433) |
AvgSumSteps | 4800.335 (4500.634, 5100.074) | 5300.745 (5000.832, 5600.642) | −500.410 | −0.237 (−0.374, −0.128) |
Sleep | ||||
AvgDurationAwake | 60.320 (48.294, 72.041) | 88.385 (78.037, 102.181) | −28.065 | −0.451 (−0.647, −0.255) |
AvgDurationaSleep | 510.047 (405.378, 610.582) | 407.731 (385.284, 433.539) | 102.316 | 0.404 (0.308, 0.501) |
Model | Acc | Socially Lonely | Emotionally Lonely | Both Lonely | Not Lonely | ||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Prec | Rec | F1 | Prec | Sens | F1 | Prec | Rec | F1 | Prec | Sens | F1 | ||
BL1: MC | 42.54 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 42.54 | 100.00 | 59.59 | 0.00 | 0.00 | 0.00 |
BL2: DT | 45.49 | 20.45 | 25.87 | 22.84 | 18.38 | 21.44 | 19.18 | 55.46 | 65.32 | 60.50 | 35.20 | 38.39 | 36.54 |
BL3: RWC | 35.47 | 11.65 | 24.58 | 15.24 | 9.18 | 19.43 | 12.54 | 40.94 | 85.34 | 54.65 | 37.28 | 38.22 | 37.59 |
SVM | 70.10 | 60.00 | 50.55 | 55.74 | 65.28 | 60.74 | 62.63 | 75.18 | 80.11 | 77.67 | 70.39 | 65.54 | 67.10 |
RF | 75.58 | 65.43 | 55.74 | 60.54 | 70.15 | 65.24 | 67.08 | 80.84 | 85.72 | 82.41 | 75.94 | 70.86 | 72.76 |
KNN | 65.53 | 55.11 | 45.69 | 50.64 | 60.48 | 55.00 | 57.06 | 70.15 | 75.75 | 72.38 | 65.57 | 60.92 | 62.14 |
XGBoost | 78.48 | 68.37 | 58.59 | 63.62 | 68.63 | 73.27 | 70.49 | 88.07 | 83.13 | 85.44 | 73.58 | 78.52 | 75.27 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Qirtas, M.M.; Zafeiridi, E.; White, E.B.; Pesch, D. Unmasking Nuances Affecting Loneliness: Using Digital Behavioural Markers to Understand Social and Emotional Loneliness in College Students. Sensors 2025, 25, 1903. https://doi.org/10.3390/s25061903
Qirtas MM, Zafeiridi E, White EB, Pesch D. Unmasking Nuances Affecting Loneliness: Using Digital Behavioural Markers to Understand Social and Emotional Loneliness in College Students. Sensors. 2025; 25(6):1903. https://doi.org/10.3390/s25061903
Chicago/Turabian StyleQirtas, Malik Muhammad, Evi Zafeiridi, Eleanor Bantry White, and Dirk Pesch. 2025. "Unmasking Nuances Affecting Loneliness: Using Digital Behavioural Markers to Understand Social and Emotional Loneliness in College Students" Sensors 25, no. 6: 1903. https://doi.org/10.3390/s25061903
APA StyleQirtas, M. M., Zafeiridi, E., White, E. B., & Pesch, D. (2025). Unmasking Nuances Affecting Loneliness: Using Digital Behavioural Markers to Understand Social and Emotional Loneliness in College Students. Sensors, 25(6), 1903. https://doi.org/10.3390/s25061903