Next Article in Journal
A Bi-Objective Home Health Care Routing and Scheduling Problem under Uncertainty
Previous Article in Journal
Examining the Impacts of the COVID-19 Pandemic on Iraqi Refugees in Canada
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Evolution of Primary Research Studies in Digital Interventions for Mental Well-Being Promotion from 2004 to 2023: A Bibliometric Analysis of Studies on the Web of Science

by
Maria Armaou
1,*,
Matthew Pears
1,
Stathis Th. Konstantinidis
1 and
Holly Blake
1,2
1
School of Health Sciences, University of Nottingham, Nottingham NG7 2UH, UK
2
NIHR Nottingham Biomedical Research Centre, Nottingham NG7 2UH, UK
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2024, 21(3), 375; https://doi.org/10.3390/ijerph21030375
Submission received: 29 February 2024 / Revised: 11 March 2024 / Accepted: 19 March 2024 / Published: 21 March 2024

Abstract

:
Research into digital interventions for mental well-being promotion has grown in recent years, fuelled by the need to improve mental health prevention strategies and respond to challenges arising from the coronavirus (COVID-19) pandemic. This bibliometric analysis provides a structured overview of publication trends and themes in primary research studies reporting an array of digital interventions indexed at WoS from 2004 to 2023. Bibliometric data were collected on a sample of 1117 documents and analysed using the Biblioshiny package. Supplemental network visualisation analysis was conducted using VosViewer. The study, based on Web of Science and Scopus databases, indicates a marked increase in publications post-2020. There were seven groups of research themes clustered around “Mindfulness”, “Anxiety”, “COVID-19”, “Acceptance and Commitment Therapy”, “Depression”, “Web-based”, and “Positive Psychology”. Further, results demonstrated the growth of specific themes (e.g., mindfulness, mhealth), the defining impact of COVID-19 studies, and the importance of both randomised controlled trials and formative research. Overall, research in the field is still early in its development and is expected to continue to grow. Findings highlight the field’s dynamic response to societal and technological changes, suggesting a future trajectory that leans increasingly on digital platforms for mental health promotion and intervention. Finally, study limitations and implications for future studies are discussed.

1. Introduction

Common mental disorders (CMDs) (e.g., depressive and anxiety disorders) account for a significant portion of the impact of mental disorders on global disease burden [1]. In 2019, depressive and anxiety disorders ranked, respectively, as the 13th and 24th leading causes of poor health worldwide, with 80.6% of the burden occurring among working-age individuals (age 16–65) [2]. In high-income countries, the prevalence rate of mental disorders remains high despite increases in the provision of treatment; this further highlights the importance of implementing quality preventive strategies for the onset of common mental disorders [3].
Preventive interventions entail a large spectrum of interventions across the lifespan that aim to reduce symptoms, reduce individual-level risk factors, and strengthen protective factors to hinder the development and severity of mental disorders [4]. Such interventions are typically classified as universal, selective, or indicated preventive measures for mental illness [4,5]. Universal preventive interventions are offered to the general population and can be beneficial across different population sub-groups. Selective interventions are directed specifically to individuals that have an elevated risk of developing mental disorders, and indicated preventive interventions are specifically directed towards those who have developed minor but observable symptomatology [4]. Mental well-being promotion is advocated as a protective factor that could prevent the onset of CMDs [6,7]. Reviews have highlighted numerous issues associated with the study of preventive interventions across different areas of research focus. For example, mindfulness courses and mindfulness-informed interventions have increased in popularity, especially in high-income countries. However, meta-analytic data demonstrate there is inconclusive evidence regarding their effectiveness within some populations, seemingly being beneficial for some more than others (e.g., students). Due to the studies’ heterogeneity, findings are often not generalisable across different intervention settings [8,9]. Furthermore, cultural and social differences may account for any observed effects. Yet, mindfulness interventions have been shown to be equal in effectiveness to other mental health promotion interventions, and they are consistently more efficacious among those already at elevated risk for mental health problems [8,9,10].
Digital tools and technologies have the potential to improve the scalability and reachability of psychological interventions [11]. Interventions may be either guided (delivered via a trained professional) or self-guided (users working through the intervention on their own). Guided interventions are more frequently used for selective and indicated prevention, whereas self-guided ones are more frequently associated with universal prevention [12,13,14,15]. Self-guided internet- and mobile-based interventions based on common psychotherapeutic techniques can have small positive effects in reducing depression and smaller effects in reducing anxiety [13]. Without distinguishing between interventions that are self-guided and those that are minimally facilitated by expert personnel, moderate-in-magnitude effects on depression and anxiety have been found for internet and mobile-based interventions delivered to adults with chronic physical conditions [16]. Yet, studies are characterised by an overreliance on symptom measures, the limited assessment of comorbidities, and the relatively less frequent assessment of risk reduction and protective factors, which make the distinction between the three types of preventive approaches less clear [13]. Further, when intervention effects have been compared with those of rigorous control conditions, the effects can be weaker [17]. Finally, digital mental health interventions may be a better choice than ‘doing nothing’, but there are persistent uncertainties with regard to intervention effects [18].
Nevertheless, in recent years, enthusiasm for digital interventions aimed at preventing and treating mental health issues has surged significantly, a development propelled by the challenges introduced by the coronavirus (COVID-19) pandemic. Illustratively, the Digital Mental Health section within Frontiers in Digital Health published an editorial in 2021/2022 that spotlighted highly engaging articles, emphasising the critical role of digital technologies in mitigating the impacts of the COVID-19 pandemic [19].
The literature, though, surrounding mental health prevention points to the complexity of assessing risk and protective factors for mental health, which is also echoed in discussions regarding the implications of evidence describing mental illness and positive mental health as two interrelated but distinct continua [20]. For this reason, it is imperative to overview the current state of knowledge production in studies reporting digital interventions for mental well-being promotion. This will identify the main drivers of research activity and highlight areas for future research.
The overarching aim of this study is twofold: (1) to comprehensively map the overall landscape of primary research studies in digital interventions for mental well-being, and (2) to identify the most impactful knowledge contributions in this domain. By analysing publication trends and citation patterns, the study sought to outline the evolution and current state of the field. A further aim was to pinpoint influential authors, institutions, and geographical regions that have significantly shaped the trajectory of research in digital interventions targeting mental well-being. For this reason, the study’s objectives were as follows:
(1)
To identify the most impactful contributors to the knowledge area;
(2)
To explore influential patterns of research interests that have driven knowledge production;
(3)
To identify foundational, established, emerging, and niche themes within this knowledge area;
(4)
To explore shifts in research themes over time.

2. Materials and Methods

This bibliometric analysis is reported based on the guidelines on methodological transparency and robust quantitative approaches advocated advocated from a recently developed framework named BIBLIO [21], along with more detailed guidance on scientific mapping [22,23] and the adoption of expansive and inclusive practices for the selection of bibliometric indicators [24]. This enabled us to present our data transparently, facilitating replication and comprehension of the review’s breadth, and ensured the analysis remained responsible and reflective of the multifaceted nature of this research domain.
We employed bibliometric analysis because it offers a structured, quantitative method to synthesise a wide array of publications within the evolving field of digital health interventions. This approach can not only capture the extensive data available but also allows for the identification of research trends, influential works, and key thematic shifts over time. Alternative methods like narrative reviews or expert opinion syntheses, while valuable, do not offer the same level of objective, data-driven insight, particularly in our expansive and multifaceted domain. Hence, bibliometrics was the most fitting approach to provide a broad, unbiased, and transparent overview of the field’s progressions and knowledge networks. Bibliometric analysis provided a transparent, replicable framework that supports the examination of intellectual output and impact, thus making it an ideal tool to disseminate the intellectual landscape of digital mental health research comprehensively.

2.1. Search Engines

The bibliometric analysis utilised the Web of Science (WoS) and was complimented by further searches in Scopus. Research has established that, while Scopus has greater breadth in its inclusion of academic journals, WoS is known for its greater keyword sensitivity and a historically extensive volume of references [25,26]. However, differences in the indexing of the articles within each database often mean that the citation patterns differ between them. To bridge these discrepancies, additional manual searches were conducted on WoS for specific titles found on Scopus.

2.2. Search Strategy

Searches using combinations of keywords related to ‘digital interventions’ and ‘mental wellbeing’ were conducted in the title, abstract, and keywords sections of the articles for the period from 2004 to 2023. Boolean operators like “AND” and “OR” were used to combine search terms effectively. The timeframe, starting in 2004—the first year with multiple relevant papers in WoS—reflects the rise of digital interventions for mental well-being from the early 2000s. The WoS search string was as follows:
(digital or online or on-line or internet-based or internet* or web-based or web* or computer-based or app* or mobile* or computer* or wearable or virtual or chatbot) (Title) and (psychological well-being or psychological well-being or resilience or stress* or mental well-being or mental well-being) (Topic) and (e-learning or training or stress prevention or positive psychology or stress management or problem solving or problem-solving or self-help or acceptance or self-help or CBT or compassion* or self-compassion or self-compassion or mindfulness or mindfulness-based or cognitive behav* therapy) (Abstract) and Article or Proceeding Paper or Early Access or Meeting Abstract (Document Types) and Book Chapters or Review Article or Editorial Material or Retracted Publication or Book Review or Correction or Letter or Item Withdrawal or Retraction or Withdrawn Publication or Data Paper (Exclude—Document Types) and Chapter (Exclude—Search within all fields) and Protocol (Exclude—Search within all fields) and Meta-analysis (Exclude—Search within all fields) and Systematic Review (Exclude—Search within all fields) and Disorder (Exclude—Search within all fields)
The Scopus search string was as follows:
(TITLE (digital OR e-learning OR online OR on-line OR internet-based OR internet* OR web-based OR web* OR computer-based OR app* OR mobile* OR computer* OR wearable OR virtual OR chatbot) AND TITLE-ABS-KEY (psychological AND well-being OR resilience OR stress* OR mental AND well-being OR mental AND health) AND NOT TITLE-ABS-KEY (meta-analysis OR systematic AND review OR scoping AND review) AND NOT TITLE-ABS-KEY (disorders OR disorder) AND NOT TITLE-ABS-KEY (protocol)) AND PUBYEAR > 2003 AND (LIMIT-TO (DOCTYPE, “ar”) OR LIMIT-TO (DOCTYPE, “cp”))

2.3. Eligibility Criteria

Titles and abstracts were screened applying the following inclusion criteria: study population (any), study design (any), intervention (digital psychological or educational interventions), outcomes (psychological/psychosocial outcomes). Included papers could be as follows: Article or Proceeding Paper or Early Access or Meeting Abstract. Papers were excluded if they were any of the following: Book Chapters or Review or Editorial, Retracted Publication or Book Review or Correction or Item Withdrawal or Retraction or Withdrawn Publication or Data Paper. Documents were excluded if they reported interventions focused on the treatment of psychiatric disorders or did not target specific psychological or psychosocial outcomes. No restrictions to language were applied. Review papers, meta-analyses, protocols, and theoretical pieces were excluded. In cases where it was unclear from the abstract if the intervention was digitally delivered, the full paper was then retrieved.

2.4. Data Selection Procedure and Dataset Refinement

Documents that matched the inclusion and exclusion criteria were marked on the researcher’s WoS and Scopus accounts (Figure 1). A total of 11,388 documents were identified in the WoS and 4384 in Scopus, published between 2004 and 2023. Based on the study inclusion and exclusion criteria, 392 eligible documents were identified in Scopus and, initially, about more than 900 documents were identified at the WoS Core Collection. Subsequently, manual searches were conducted at WoS to retrieve the documents already identified on Scopus. In the WoS Core library, 89% Scopus documents (n = 349) were identified. Twenty-one additional duplicate entries were identified following manual searches using the document’s title or author’s name (previously retrieved by Scopus). On certain occasions (n = 7), documents were identified after searches to all the databases in the WoS, and nineteen documents were not indexed at the WoS databases at all. Finally, 1131 documents were generally identified through the WoS, of which 1124 belonged to the WoS Core Collection and were downloaded for further analysis.

2.5. Analysis

The final dataset used for this study was downloaded directly from the WoS in .txt format. Two independent researchers performed the data analysis, subsequently engaging in iterative discussions to reconcile discrepancies and achieve consensus on the findings. This collaborative approach ensured a reliable and accurate representation of the data. The analysis was conducted using Biblioshiny 4.1, available within the Bibliometrix package in RStudio 1 [27]. This open-source software provides a suite of statistical tools and functions for bibliometric analysis. It facilitates detailed productivity analysis, including publication and citation rates, as well as identifying key contributors to the field. Its tools can give an assessment of the h-index, m-index, and g-index, which are bibliometric indicators used to evaluate a researcher’s publication impact and productivity. The h-index reflects the number of publications (h) with at least h citations each, balancing productivity with citation impact. The m-index, calculated by dividing the h-index by the number of years since the first publication, adjusts for career length, offering insight into sustained impact. The g-index addresses the h-index’s limitation by emphasising highly cited papers, defined as the largest number (g) where the top g articles have collectively received at least g2 citations. Interpretation of these indices varies across disciplines, with low, moderate, and high benchmarks generally considered as follows: an h-index of 0–10, 10–20, and 20+, respectively; an m-index below 1, between 1–2, and above 2; and a g-index that closely follows, significantly exceeds, or doubles the h-index for low, moderate, and high categories.
Moreover, it supports comprehensive science mapping through citation analysis, keyword co-occurrence analysis, and co-authorship analysis, enabling a deeper understanding of the research landscape. Combined with network analysis, science mapping can illustrate the bibliometric and intellectual structure of different areas of research focus [22,23]. Additional network maps were produced on VosViewer (V. 1.6.19) to explore the characteristics of emergent themes.

3. Results

3.1. Output of General Information and Annual Information

Source .txt data were uploaded on Biblioshiny 4.1. and following the review of their general information, 1117 documents were included in the final analysis. Seven records were excluded for the purpose of generating the quantitative analysis in accordance with the study’s inclusion criteria. The records excluded were either reported in a letter, an editorial, or a book chapter, or they were counted as being published in 2024. Descriptive information regarding the overall dataset included the following: DATA INFORMATION (Journals: 489, Documents: 1117, Document Average Age: 4.47, Average citations per doc 16.44); DOCUMENT CONTENTS (Keywords Plus: 1575, Author’s Keywords: 2189); AUTHORS (Authors: 4969, Authors of single-authored documents: 34); AUTHORS COLLABORATION (Single-authored docs: 34, Co-Authors per doc: 5.46, International co-authorships: 20.23%); DOCUMENT TYPES (articles: 948, article early access: 37, article; were proceedings papers: 5, meeting abstracts: 58, proceedings papers: 69).

3.2. Performance Analysis

Figure 2 shows that publication rates increased after 2012, with 2014 being the first year that had more than 20 publications in the field. Subsequently, publication rates consistently rose until 2020. A significant surge in publications occurred from 2020 to 2022, being the first possible indicator of the effect of the COVID-19 pandemic on this research landscape. Further, 52% of all publications were generated between 2020 and 2023. The figure also highlights variations in citation rates, identifying peaks in 2005 and 2013, yet a decrease in citations as the annual production increases.

3.2.1. Authors

Table 1 shows the authors who had the highest number of publications in the field. Overall, most of the documents were written in English by authors affiliated with institutions in high-income countries. R. Lappalainen emerges as the most prolific, authoring 17 articles with a collaborative score indicating a significant partnership in research. P. Lappalainen follows with 15 articles, demonstrating similar networking. D. Lehr and D.D. Ebert contribute likewise with 15 and 14 articles, respectively. T. Berger and M.E. Levin each have 13 articles to their names, with Levin’s higher collaborative score suggesting more extensive co-authorship. K. Kaipainen, with 11 articles, alongside G. Andersson, H. Christensen, and P. Cuijpers, each contributing 10 articles, display active and still high engagement. Total citation amounts are similar for all but T. Bergen and K. Kaipeainen, with less than half TC counts.

Authors’ Production over Time

In 2016, D. Lehr and D.D. Ebert each published two articles, garnering 189 citations, averaging an annual impact of 21 citations. That same year, P. Lappalainen and R. Lappalainen also contributed two articles, achieving 164 citations, at an average of 18.22 citations per year. M.E. Levin’s 2017 publication received 125 citations, translating to 15.63 citations annually. Fast forward to 2018, D. Lehr’s work saw a total of 170 citations across four articles, while D.D. Ebert’s three articles earned 166 citations, and P. Cuijpers’s single work received 115 citations. In 2020, H. Christensen’s research secured 66 citations, averaging 13.2 per year. Yet trends started to change as, throughout 2021 and into 2022, R. Lappalainen published on ACT, with articles cited up to 11 times, paralleled by D. Lehr and D.D. Ebert, who expanded on web-based stress interventions and depression prevention. By 2023, the focus shifted towards adolescent mental health amidst COVID-19, with R. Lappalainen’s article receiving five citations, indicating evolving research directions and emerging impacts.
Figure 3 shows the bibliographical coupling of authors with more than five documents and more than five citations within our sample. This refers to the intellectual similarity between authors as manifested by their citations in other documents. The red cluster consists of nine authors whose work is mostly associated with digitally delivered mindfulness interventions. The green cluster also includes nine authors with outputs focusing on digital mental health interventions, often based on cognitive behavioural therapy. The blue cluster of authors includes eight authors with outputs focusing on interventions based on acceptance and commitment therapy. The yellow cluster includes seven authors whose work focuses on web-based interventions, often for depression and stress reduction. Finally, the purple cluster includes seven authors whose work focuses on digitally delivered interventions for mental health prevention and treatment.

Most Local Cited Authors

This analysis revealed the local citation impact of several authors within their research community. R. Lappalainen leads with 90 citations, indicating the strongest influence in the field. Close behind, M.E. Levin has collected 78 citations. K. Cavanagh follows with 75 citations. C. Strauss, with 72 citations, and P. Lappalainen, with 70 citations, both exhibit noteworthy influence. As demonstrated in the network analysis in the subsequent sections. F. Jones, with 63 citations, D. Lehr, with 62 citations, and H. Riper, with 61 citations, each have made impactful contributions. D.D. Ebert and M. Berking conclude the list with 60 and 58 citations, respectively, underscoring their roles as influential figures in their research community. There was no significant gap between authors in terms of their citation counts, highlighting a competitive and collaborative environment.

Most Relevant Sources

The productivity of journals was ranked using the Bradford law, which ranks documents in zones of productivity, where the first zone includes a core group of the most productive journals (Table 2). The bibliometric analysis identified the Journal of Medical Internet Research as the top source for articles, contributing 62 articles to the dataset. Following closely, JMIR Formative Research and JMIR Mental Health supply 50 and 43 articles, respectively, indicating a strong focus on digital health research. Mindfulness and Frontiers in Psychology contribute 37 and 36 articles, respectively, pointing to an interest in psychological and mindfulness-based interventions. JMIR mHealth and uHealth adds 28 articles, highlighting the growing importance of mobile health technologies. The International Journal of Environmental Research and Public Health provides 27 articles. Internet Interventions-The Application of Information Technology in Mental and Behavioural Health contributed 23 articles, highlighting the role of digital interventions in mental health. Annals of Behavioral Medicine and Psycho-Oncology offer 18 and 17 articles, respectively. The Journal of Medical Internet Research had the highest total citation number of 1864, followed by JMIR mHealth and uHealth with 1054. This distribution of sources and articles showcases a broad spectrum of research interests within the field, ranging from digital health innovations to environmental health research and psychological interventions. The JMIR Formative Research is a journal that showed the most recent growth with relevant publications beginning in 2020.

Sources Local Impact

The bibliometric indicators for a selection of journals reveal significant insights into their impact and contributions to their respective fields. The Journal of Medical Internet Research stands out with an h-index of 22 and a g-index of 42, reflecting a strong influence within the medical internet research community, as demonstrated by a total citation (TC) count of 1864 from 62 published articles since 2005. Its m-index of 1.10 suggests a consistent output of impactful research over time. JMIR Mental Health, with an h-index of 20 and a g-index of 29, shows a notable impact in mental health research, particularly since its inception in 2016. It has accrued 891 citations from 43 articles, with a high m-index of 2.222, indicating rapid recognition in its field. JMIR mHealth and uHealth presented an h-index of 17 and a g-index of 28, evidence of its significance in mobile health research. Since 2013, it has garnered 1054 citations from 28 articles, with an m-index of 1.417, underscoring its growing influence in health technology. Mindfulness, with an h-index of 15 and a g-index of 26, has amassed 701 citations from 37 articles since 2014. Its m-index of 1.36 indicates steady academic contribution and influence. Internet Interventions-The Application of Information Technology in Mental and Behavioural Health, although newer with a start year of 2017, shows a promising start with an h-index of 11 and a g-index of 15, totalling 244 citations from 23 articles. Its m-index of 1.37 suggests a rapidly establishing presence in its niche. Frontiers in Psychology, with an h-index of 10 and a g-index of 19 since 2016, has accumulated 401 citations from 36 articles. Its m-index of 1.11 indicates solid performance in the psychology field, reflecting its role in advancing psychological research.
As Figure 4 shows most of the documents were published in open-access journals. Among the top 13 most relevant sources, only 5 journals (Mindfulness, Annals of Behavioral Medicine, Psycho-oncology, Journal of Contextual Behavioral Science, and Behaviour Research and Therapy) offer both an open-access and subscription options. Publication fees for open-access publications in the top 13 most relevant sources are over USD 2000 ranging up to USD 4940.

3.2.2. Most Relevant Affiliations

The analysis identifies the top academic institutions by their contribution to the dataset, with Harvard University, the University of New South Wales Sydney, and Vrije Universiteit Amsterdam leading, each contributing 37 articles. Close behind are the University of London and the University of Sydney, each with 36 articles, followed by the University of Melbourne with 34 articles, and the University of California System with 33 articles. Seoul National University (SNU) contributed 31 articles, while University College London provided 27 articles. Monash University and Karolinska Institutet contributed 22 and 21 articles, respectively. All other affiliations, beyond those highlighted, contributed to 20 or fewer articles, indicating a concentration of research output within these leading institutions.

Affiliations’ Production over Time

The production of articles over time by leading affiliations demonstrates a dynamic and growing contribution to scholarly work. Vrije Universiteit Amsterdam, the University of New South Wales Sydney, and Harvard University exhibit a consistent increase in their output, each peaking at 37 articles by 2023. The University of Sydney and the University of London also made significant contributions, with both institutions reporting 36 articles by 2023. The data reveals a progressive increase in the University of Sydney’s output from 22 articles in 2018 to 36 articles by 2023, illustrating a 63% upward trend in research productivity. Vrije Universiteit Amsterdam’s output has risen 37% from 27 articles in both 2018 and 2019, reaching 37 articles by 2023 and 2024. Similarly, the University of New South Wales Sydney and Harvard University have shown a marked increase in their outputs, moving from lower figures in earlier years to reaching their peak by 2023. This upward trajectory in article production across these prestigious institutions not only underscores their significant role in advancing research but also highlights the increasing momentum of academic contributions over time, with each institution demonstrating a commitment to expanding their research footprint and impact in their respective fields.

Scientific Production across Countries

The cumulative number of article contributions for each country, based on the data processed, is as follows:
The bibliometric data presents a comprehensive overview of 17,632 articles produced over the studied time frame, with the United States leading the count at 5237 articles (30%). The United Kingdom follows with a substantial output of 3345 articles (19%), while Australia ranks third with 2225 articles (12%). The Netherlands and Germany also show high productivity, with 1323 (7.5%) and 924 articles (5%), respectively. With less than 5% contributions, Sweden contributes 737 articles (4%), evidencing robust research activity, and Canada’s contribution of 641 (3%) articles underscores its role in the academic landscape. China’s scholarly output is noted at 613 articles, while Finland demonstrates considerable research contributions with 546 articles. Switzerland and Japan have produced 387 and 348 articles, respectively, indicating their active participation in research. Ireland, with 312 articles, Spain with 257, and Italy with 231, also feature prominently in the dataset. New Zealand’s output stands at 206 articles, followed by Korea with 189 and India with 111, reflecting the global spread of research contributions in the field. These figures highlight not only the volume of research emanating from these countries but also uncover that the breadth of international engagement in academic discourse is narrower when considering production over location.

Most Cited Countries

In terms of citations, the United States again stands out with a total of 5237 citations, averaging 16.30 citations per article, indicating the broad impact of its research. The United Kingdom follows, with average article citations of 30.10, reflecting the high quality and influence of its research outputs. Australia’s contributions are also notable, with 2225 citations at an average of 22.50 citations per article, showcasing the significant impact of its scientific work. The Netherlands exhibits the strongest metric as well, with an average of 25.00, highlighting the influence of their research contributions. Germany, Sweden, Canada, China, and Finland also show similar significant impacts.

Collaboration Network

The analysis of international research collaborations highlights significant partnerships across the globe. Germany and the Netherlands lead with 14 collaborations, evidencing strong European research ties. Equally notable are the connections between Australia and the United Kingdom, and between the USA and both Canada and the United Kingdom, each registering 13 collaborations. The USA’s collaboration with China (12 instances) underscores its global research connectivity. Additional key partnerships include the USA’s collaborations with Australia, the Netherlands, and Norway, and the regional Nordic cooperation between Sweden and Finland, each showcasing the USA’s central role and the importance of regional and transatlantic partnerships in fostering a globally interconnected research community. Figure 5 shows a collaboration map of the affiliations of the correspondent authors. Harvard University was the only USA-based institution with collaborations with both European and Asian universities. The collaboration map demonstrates that many collaborations were defined by the geographical proximity of institutions, such as collaborations between European institutions or between Australian institutions.

3.2.3. Most Globally Cited Documents

Table 3 presents the top 10 highly cited research papers, spotlighting their influence through total citations, yearly citation rates, and adjusted citation impacts. Leading this distinguished group, an article by Blake H. in the International Journal of Environmental Research and Public Health from 2020 stands out for its notable citation metrics, illustrating its substantial global impact shortly after publication. Other significant contributions include works by Gilbody S. in the BMJ: British Medical Journal, Cavanagh K. in Behaviour Research and Therapy, Clarke G. in the Journal of Medical Internet Research, and Inkster B. in JMIR mHealth and uHealth, each demonstrating considerable influence through their citation figures and rates. Additional important studies from journals like the Journal of Happiness Studies, JAMA Psychiatry, and the Journal of Occupational Health Psychology further exemplify the breadth of impactful research across various domains.

3.2.4. Most Locally Cited References

The dataset highlights foundational references within the research domain, marked by their significant citation counts. Cohen et al’s 1983 study on health and social behaviour [38] leads with 174 citations, emphasising its seminal role. Cohen J.’s 1988 work [39] on statistical power analysis in behavioural sciences follows with 108 citations, showcasing its critical methodological influence. Articles by Brown K.W. et al. and Kabat-Zinn J. from 2003 [40,41], each focusing on mindfulness and its psychological applications, gather 91 and 85 citations, respectively, reflecting their impact. Spijkerman M.P.J. et al. 2016 clinical review [42] and works by Braun V. and Kroenke K. from 2006 [43,44], each earning 75 citations, contribute significantly to psychological interventions and symptom assessment. Publications by Spitzer R.L. in 2006 [45] and Christensen H. in 2009 [46], with 69 and 66 citations, highlight the importance of internet-based mental health interventions. Baer R.A.’s 2006 [47] article on mindfulness-based practice assessment has 64 citations, underscoring its relevance. These references serve as cornerstones in health, psychology, and behavioural sciences, demonstrating their foundational influence and enduring relevance.

3.3. Concept Mapping

Assessing authors’ keyword frequency can describe the main research themes in the field. A co-occurrence network of the top 250 authors’ keywords demonstrated seven main research themes (Table 4). Cluster 1 was the theme with the most frequent keywords of mindfulness (n = 220), mental health (n = 168), and stress (n = 146). The second cluster had the largest number of keywords, including anxiety (n = 90) and mhealth (n = 58). The keyword with the highest frequency for cluster three was ‘COVID-19’ (n = 102), for cluster four was ‘acceptance and commitment therapy’ (n = 61), and for cluster five, it was ‘depression’ (n = 126). The sixth cluster had two main keywords, ‘web-based’ (n = 24) and ‘college student’ (n = 19), and cluster seven had one main keyword, ‘positive psychology’ (n = 19).
An analysis of the bibliometric features of keyword clusters can provide insights into the development and cohesion of different areas of research activity. Each research theme can be described in terms of importance (or centrality) and density. Its centrality is defined by the extent of its relationships with other research themes/keywords, and its density refers to the total number of documents that include the same keyword [48]. A network analysis can examine those key features of different research themes by placing them within four quadrants that refer to a differing degree of development of research themes [49]:
  • Upper-right quadrant: core or mainstream themes; the motor themes, which are both important and well-developed. They have maximum density and centrality and represent a large portion of the research during a specific time-period.
  • Lower-right quadrant: developed but isolated themes; basic themes that are important but not yet well developed. They demonstrate centrality, but they are not yet mature, although they have the potential to grow.
  • Upper-left quadrant: established niches of research. They exhibit low centrality, and they appear separate from the overall focus of research in the field.
  • Lower-left quadrant: emerging or declining themes. They are themes of low importance and low development that are either emerging or declining themes within a specific research field.
A thematic mapping of the studies’ research themes was completed to explore their degree of development (Figure 6).

3.3.1. Motor Themes

Two clusters of themes are shown to be pertinent to the research development of the field. The most well-developed one involves research in depression, anxiety, and mhealth, followed by a smaller cluster of themes focusing on quality of life, cancer, positive psychology, and psychological distress. Finally, the research cluster with a focus on adolescents, randomised controlled trial designs, psychological flexibility, and adherence placed them near the centre of the two axes, standing right between niche and motor themes.

3.3.2. Basic Themes

The themes of mindfulness, mental health, stress, and COVID-19 have the highest level of density in the sample, which means that they consistently co-occurred as keywords in other documents. However, they still lack development as they are low in centrality, which means that they exhibit little relationship with other clusters of themes within the thematic network. A cluster whose content appears to be closer to becoming a motor theme involves research focused on acceptance and commitment therapy, online intervention, self-help, and university students. Finally, the lowest in centrality but with overall good degree of density was the cluster of themes focusing on stress management, virtual reality, and mindfulness meditation.

3.3.3. Niche Themes

There were two clusters of themes that represented niche themes of research activity. One cluster included the theme of usability, and the other included the themes of engagement and health promotion. Both of those clusters appeared to be close to one another and exhibited low density but good centrality. This means that they had little coverage overall across the documents but were associated with other thematic clusters.

3.3.4. Emerging or Declining Themes

There were also two clusters of themes representing emerging or declining areas of research focus, and those were e-health and chronic pain. Among those, chronic pain was the one closest to the centre of the two axes. Finally, research associated with web-based interventions had a relatively low density but was right between the two quadrants of niche and declining or emerging themes. Their development status and interrelationships with other themes were further explored by the network analysis produced on VosViewer, which will be presented further below.

3.4. Concept Evolution

The period of review, 2004–2023, was divided into three sub-periods: 2004–2015, 2016–2020, and 2021–2023. This way, a separate bibliometric strategic map was developed for each of these three periods. These cut-offs were selected as they match the time-points at which the most noticeable changes in the publication rates were observed (Figure 1). The first period (2004–2015) is the longest one because a sufficient volume of publications is required to complete the identification of the structural characteristics of a research field and map their subsequent evolution over time. The second and third periods (2016–2020, 2021–2023) are shorter, as they are mostly focusing on emerging or declining trends and areas of future research growth. Overall, 134 documents were analysed for the first period, 402 for the second period, and 581 for the third one. The output from RStudio’s Biblioshiny is used to portray the concept evolution for each of the time periods (Figure 5).
Figure 7 demonstrates the considerable increase in research focus on mindfulness in recent years. Furthermore, it illustrates the growth of mHealth as a dominant research theme and the central role that studies associated with the COVID-19 pandemic played in the development of the research. Finally, acceptance and commitment therapy appears to be consistently the most relevant intervention approach, even following the shifts that occurred in research development following the emergence of COVID-19 studies.

3.4.1. Period 2004–2015

Figure 8 shows five clusters of motor themes. The themes with the highest density were research on depression and internet interventions. Furthermore, cognitive-behavioural therapy and e-learning were significant motor themes that exhibited slightly higher centrality and lower density. Finally, in the cluster of themes focusing on randomised controlled trial designs and cost effectiveness, the motor theme had the least density but was still significantly important for overall research development. During this time, acceptance and commitment therapy was a basic theme that was not well developed and exhibited low centrality. Mindfulness, along with resilience, was almost at the centre of the two axes but tilted towards the basic themes’ quadrant. At the same time, the cluster involving references to family caregivers and computers was the smallest one with the lowest levels of centrality and density research themes, while the other cluster, classified as emergent or in decline, grew in maturity in later years.

3.4.2. Period 2016–2020

Figure 9 shows two clearly well-established themes during this period. Research focusing on burnout and mobile applications and college/university students signify the most well-developed areas of enquiry. Those were followed by research focusing on ehealth and cancer and cognitive behavioural therapy. For the first time, a psychological outcome such as burnout and a reference to mhealth (i.e., mobile applications) are the motor themes with the highest centrality. The larger cluster of themes that were most frequently mentioned in other studies’ keywords involved were ehealth and cancer, although not fully reaching motor-theme status. This is a research period characterised by research associated with the COVID-19 pandemic quickly at the centre of research importance, followed by psychoeducation and web-based intervention. Mindfulness and well-being, which have been among the most widely reported areas of research, appeared to still be not well-developed, while virtual reality appeared to be a rapidly growing research area. On the other hand, positive psychology interventions and psychological well-being were classified as niche themes along with internet-based interventions. At the same time, psychological stress, psychological distress, and online intervention were classified as emerging or declining themes.

3.4.3. Period 2021–2023

This period spots two well-established cluster themes, namely e-health and chronic pain, as well as mhealth and mobile, with the first two demonstrating higher centrality. Mhealth/mobile phones represent the most frequent area of study (Figure 10). Similarly to the previous period, mindfulness research had the highest density but was less central to the overall research focus. Acceptance and commitment therapy appeared to have increased in maturity, although it was not fully developed as a motor theme. Other areas that are expected to continue to grow are research on the adolescent population, qualitative research, and loneliness. Two new niche themes during that period were technology and biofeedback, with cognitive behavioural therapy also being classified as a niche theme. Research in mental well-being and stress reduction was classified as an emerging research theme based on the growth in articles during this time, which further signals a shift in research interests.

3.5. Emergent Themes’ Characteristics

The VosViewer output of the authors’ keyword network analysis was to examine the characteristics of emergent themes and indicate the ones that appear to be in decline. The network analysis (Figure 11) shows the associations between themes that were classified as declining or emergent, along with their average publication years. It is evident that e-health, chronic pain, web-based interventions, meditation, and virtual reality are research themes that have continued to grow. On the other hand, “computer” and “family caregivers”, which were the earliest occurring research themes with an average publication year of 2015.00 and 2018.50, respectively, did not follow the same development trajectory.
“Psychological distress” (Avg. pub. year: 2021.06) and “mental wellbeing (Avg. pub. year: 2021.60) were the most recently emerged targeted outcomes of digital interventions and demonstrate multiple links with other emergent themes. At the same time, there appears to be a shift in relevant targeted outcomes of digital interventions that is reflected in “psychological stress” (Avg. pub. year: 2018.31) having the fewest links with the other keywords in this group.
Finally, Figure 12a–f show the associations that were specifically relevant to quality of life (Avg. pub. year: 2019.78), psychological distress (Avg. pub. year: 2021.06), loneliness (Avg. pub. year: 2021.67), mental wellbeing (Avg. pub. year: 2021.60), psychological wellbeing 2020.24, and wellbeing (Avg. pub. year: 2020.63). Except for quality of life, which was already a well-developed theme before the beginning of the pandemic, the research development of the rest of the themes seems to be interlinked with the research production triggered by the COVID-19 pandemic.

4. Discussion

The objective of this study was to examine the international contours of primary studies reporting on digital interventions for mental well-being promotion as indexed in the WoS. Bibliometric data were collated from the WoS for studies published between 2004 and 2023. Bibliometrix and Biblioshiny were used to describe in detail the main knowledge contributors in the field and identify the key trends that have shaped the literature in the field and the ways in which research themes have evolved. The visual aids of Vosviewer mapped the characteristics of emerging research themes.

4.1. Research Contributors’ Impact

The key knowledge contributors were assessed in terms of productivity rates and impact, citation rates, and collaboration patterns. The publication rate of studies has increasingly progressed since 2004, with some of the most productive authors beginning to contribute to the field between 2013 and 2015. A distinctive increase in research productivity, though, was observed early on in 2020 with the beginning of the COVID-19 pandemic, which was followed by a surge in publications reporting on preventive digital mental health interventions, reflecting the fast-track submission processes that were adopted by academic journals to speed up knowledge dissemination. The Journal of Medical Internet Research was the leading and most influential source of publications, which also ranked first in a previous bibliometric analysis of research production in technology and psychotherapeutic interventions [50]. JMIR Formative Research ranked second, further highlighting the surge in interest in developing and, thus, piloting and evaluating novel interventions during the last three years. Overall, the USA, Australia, and the UK had the largest number of studies, while the affiliations with the largest number of contributions were the Vrije Universiteit Amsterdam, the University of New South Wales Sydney, and Harvard University. A closer examination of the collaboration networks between affiliations across countries also revealed how knowledge production was mostly driven by a combination of <10 international partnerships and strong regional ones. Overall, most of the work focused on was produced by authors with institution affiliations in high-income countries with open-access publications driving research publications. This means that the studies’ insights may be less relevant to resource-poor settings, especially low- and middle-income countries. The key research interests of the most relevant authors included digitally delivered mindfulness-based interventions, interventions based on acceptance and commitment therapy, and digitally delivered interventions for mental health prevention.

4.2. Influential Patterns of Research: Concepts’ Development and Shifts

The diagrams of concept mapping and the concept evolution of themes as described by the authors’ keywords illustrated which aspects of intervention research have shaped research progress, highlighting notable challenges that have also occurred over time. Some of those themes have consistently driven research activity, while the centrality and the density of other themes vary. The only themes relevant to specific research designs involved randomised controlled trials, which was also among the most important keywords, and qualitative research that gained more traction within the last two years. The centrality of RCTs is an expected finding, as most of the included studies reported on the effectiveness of the interventions. At the same time, references to qualitative research within a cluster of more recent publications that also included loneliness highlight the growing impact of research themes that were developed through studies that were conducted during the COVID-19 pandemic. Furthermore, it coincides with niche themes such as engagement and usability (also associated with feasibility and acceptability) and their associations with a broader range of research designs (e.g., participatory design), which were all in all less frequently represented in the data. This diversification in research methodologies reflects a broader shift towards a more holistic understanding of mental health interventions, recognising the importance of both quantitative outcomes and qualitative insights to address complex psychological phenomena exacerbated by global crises like the COVID-19 pandemic [51,52,53,54].
Specific population groups or contexts included adolescent populations and college students, the workplace, and individuals affected by chronic pain. Such findings are in accordance with the extensive literature reporting on interventions delivered to such participant groups as universal, selective, or indicated mental prevention measures [55,56,57,58,59,60,61,62,63]. Research in the context of COVID-19 was a central driver of research activity. In our sample, research associated with the COVID-19 pandemic was the fifth most frequent research theme. As a result, the cluster of themes about web-based intervention, psychoeducation, and COVID-19 appeared to be the central driver of research development for the whole period 2016–2020, and their positioning demonstrated high importance and continued growth. That was also indicated by the fact that the most highly cited paper within our sample described (and provided links to) the development and evaluation of an open-access digital package providing evidence-based guidance and support for the psychological well-being of healthcare employees, which was widely accessed across the world (over 77,800 users within the first pandemic year) [28]. Epidemiologic data have shown that the COVID-19 pandemic exacerbated the prevalence and burden of depression and anxiety, with geographical variations in impact [64]. Between 2020 and 2021, several reviews were written to inform the implementation of remote solutions for both the treatment and prevention of mental health conditions [65,66]. This research activity was followed by a surge in digital interventions driven by the need to reach population groups whose mental health was at risk the most using remote delivery methods, which had value during regional and national lockdowns and through periods of social distancing measures [67,68,69].
The scientific mapping of the themes produced based on the authors’ keywords produced seven clusters of themes, each referring to at least one of the following intervention characteristics: (a) prevention outcomes, (b) intervention delivery methods, (c) target populations, and/or (d) intervention approaches. The first two clusters were the largest clusters of themes that dominated research production. The first cluster included the most frequently studied psychological outcomes: mental health, stress, well-being, mindfulness, and self-compassion. Within this cluster, the keywords describing interventions’ approaches were “self-help”, “stress management”, and “meditation training”. Intervention delivery within this cluster was most frequently described as online and, in some cases, via virtual reality. References to the target population were “university students” and “adolescents”. The results also showed that although those themes are expected to continue to grow, they are also characterised by low centrality, and they do not appear to have yet become motor themes for research development in the field. A recent umbrella review on the effectiveness of digital mental health interventions for university students also determined that, although web-based interventions and online skills training are at least partially effective in reducing anxiety, stress, and depression, the evidence is inconclusive for the effectiveness of interventions using virtual interventions and relaxation [70]. Such findings highlight the need to establish more systematic approaches to the evaluation of digital mental health interventions [70]. Moreover, mindfulness, which was the most researched theme in our sample, continued to grow after the beginning of the COVID-19 pandemic, but it is still not a well-developed theme.
This occurrence has been frequently explored in reviews examining the effectiveness of digital mindfulness-based interventions and includes implementation obstacles, low quality of evidence, and the emergence of evidence supporting non-digital mindfulness-based interventions as more effective than their digitally delivered counterparts. This highlights a pivotal challenge for digital mental health research: balancing the rapid development and deployment of digital interventions with the rigorous, long-term evaluation necessary to validate their effectiveness and optimise their design for diverse populations [71,72,73].
The second thematic cluster included a larger number of keywords, which, in their majority, were terms referring to technology-enabled interventions. The main characteristic of this group of themes was its multiple references to mobile-delivered interventions. It also included anxiety, which was shown to be among the motor themes of research, and psychological distress, which was more frequently reported in more recent publications. Furthermore, the intervention approach within this cluster was cognitive behavioural therapy, while “workplace” was included as a specific intervention context. Previous reviews have shown that app-delivered interventions that are based on behaviour change strategies across diverse populations, especially those developed for specific populations, can be effective in reducing depression symptoms, anxiety, and stress levels [74].
The third cluster was dominated by studies focusing on the COVID-19 pandemic, with prevention measures focusing on resilience, burnout, well-being, and psychological well-being. Those themes appear to be still early in their development, but they have a great potential for growth, possibly fuelled by a greater variation in discussions and approaches to mental health prevention driven by the COVID-19 impact and the challenges posed for sustainable healthcare in the future [75,76,77].
The fourth cluster features references to online interventions, and its dominant keyword was acceptance and commitment therapy, followed by references to cancer and chronic pain research. Furthermore, it is a cluster that is also defined by randomised controlled trial designs, which highlights the centrality of research studies focusing on acceptance and commitment therapy [61,78,79].
The fifth cluster focused on prevention measures for depression and quality of life, with references to e-health and qualitative research. Overall, depression was among the most frequently reported outcomes, but over time, its centrality as a targeted outcome of preventive interventions appeared to diminish. One reason may be that as research in digital interventions matured, digital interventions focusing on depression began to examine explicitly their effects in the clinical treatment of depression [80,81]. At the same time, a broader range of outcomes (e.g., empirical domains of good mental health) have become more frequently discussed as suitable targets for mental health prevention strategies [6].
The other two clusters included frequently identified research themes (web-based delivery and college students; and positive psychology), with their overall influence on research development more evident through their associations with other research themes (e.g., well-being, self-help).

4.3. Limitations

The study had several limitations that need to be acknowledged. First, the final article sampling consisted of articles included only in the WoS database. This means that citations indexed in other databases are not included in this study’s productivity analysis. The advantage of this approach was that the analysis was completed with consistent bibliometric data across one dataset, but as it also became clear during the process of data searches and refinement, there is a small percentage of studies in Scopus that are not indexed in the WoS Core Collection. This may not have had a significant impact on the overall observations regarding the evolution of the main drivers of research activity, but it may have reduced some insights on recent niche concepts representing research work presented in recent conferences. Furthermore, it was also observed that for articles where there was a title available both in English and another language, Scopus indexed both, whereas WoS indexed only the English title or did not index the title or the source at all. Such observations may potentially lead to overall counts of bibliometric data being slightly skewed towards English-speaking entries. An associated limitation of this study was that the sample of documents was dominated by studies conducted in high-income countries, despite the absence of language restrictions in our searches. Furthermore, discrepancies in the data due to missing values, different spellings of the authors’ full names, or differences in affiliations’ names within the source data can all lead to variations in the results of the performance analysis [26]. Moreover, the exclusion of reviews, meta-analyses, and editorial pieces means their contribution to the overall evaluation of knowledge production. Another limitation that generally applies to bibliometric analyses is that research themes are defined by the choice of authors’ keywords, not the actual content of a study; thus, only citations provide an estimate of the importance of specific studies within a field. At the same time, the different spellings of keywords referring to the same concept (e.g., ehealth, e-health, mobile app, apps, etc.) mean that the full scope of a theme becomes easily fragmented. Finally, the concept mapping and evolution diagrams on Biblioshiny were based on the analysis of the clusters for the 250 most frequently used authors’ keywords with a minimum of 10 words per cluster. That approach reduced the nuanced description of the concepts but allowed for a comprehensive depiction of the themes and their key changes across the set time-points.

4.4. Implications for Future Research

This study provided a comprehensive overview of the research trends in digital mental well-being promotion. Future research will need to explore how some trends may have had more impact than others in mental health prevention/promotion research. Future systematic reviews and empirical studies should aim to more frequently report implementation outcomes, especially in relation to mindfulness interventions. Future evidence reviews could aim to map the progress of niche areas of research using data from the Scopus dataset and, if required, grey literature to explore research development internationally, aiming to include and evaluate the content of knowledge contributors in languages other than English. Future research will need to specifically target reviewing research outputs produced by authors in low- and middle-income countries, which would require the inclusion of searches in Google Scholar and grey literature. What is more, scoping review techniques can be implemented to conduct searches focusing on specific criteria (e.g., socio-demographic characteristics, health conditions, and contexts). Such an approach can allow a better understanding of the impact of the observed research trends on digital interventions. Finally, future studies should aim to evaluate the accumulation of evidence related to mental health prevention since the emergence of the COVID-19 pandemic as a starting point, considering both its long-term impact and the intersections of that impact with chronic conditions [82,83,84].

5. Conclusions

This is the first study to explore the evolution of the research area associated with digital mental well-being promotion and the substantial effect on knowledge production that has occurred since the beginning of the COVID-19 pandemic. It is evident that the pandemic accelerated the pace of research in mental health prevention, with well-being becoming the eighth most frequently reported research theme and mindfulness ranking first in authors’ keywords. Randomised controlled trials are still driving research development. The results indicate that RCTs of digital interventions delivering acceptance and commitment therapy, often to support the well-being of patient populations, have increased the outputs and importance of that intervention approach. At the same time, increased research activity in formative research, with user engagement and usability being classified as niche themes and qualitative research appearing to be a growing area of research, appears to be associated with an increase in interest in a greater range of outcomes within intervention research.

Author Contributions

Conceptualisation: H.B. and M.A.; methodology: S.T.K., H.B., M.A. and M.P.; formal analysis, M.A. and M.P. writing—original draft preparation, M.A.; writing—review and editing, M.A., M.P., S.T.K. and H.B.; supervision, H.B. and S.T.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The original contributions presented in the study are included in the article; further inquiries can be directed to the corresponding author.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. WHO. Depression and Other Common Mental Disorders: Global Health Estimates; WHO: Geneva, Switzerland, 2017; p. 24. [Google Scholar]
  2. GBD 2019 Mental Disorders Collaborators. Global, regional, and national burden of 12 mental disorders in 204 countries and territories, 1990–2019: A systematic analysis for the Global Burden of Disease Study 2019. Lancet Psychiatry 2022, 9, 137–150. [Google Scholar] [CrossRef] [PubMed]
  3. Jorm, A.F.; Patten, S.B.; Brugha, T.S.; Mojtabai, R. Has increased provision of treatment reduced the prevalence of common mental disorders? Review of the evidence from four countries. World Psychiatry 2017, 16, 90–99. [Google Scholar] [CrossRef] [PubMed]
  4. Singh, V.; Kumar, A.; Gupta, S. Mental health prevention and promotion—A narrative review. Front. Psychiatry 2022, 13, 898009. [Google Scholar] [CrossRef] [PubMed]
  5. Patricia, J.; Mrazek, R.J.H. Reducing Risks for Mental Disorders: Frontiers for Preventive Intervention Research; National Academies Press (US): Washington, DC, USA, 1994. [Google Scholar]
  6. Fusar-Poli, P.; de Pablo, G.S.; De Micheli, A.; Nieman, D.H.; Correll, C.U.; Kessing, L.V.; Pfennig, A.; Bechdolf, A.; Borgwardt, S.; Arango, C. What is good mental health? A scoping review. Eur. Neuropsychopharmacol. 2020, 31, 33–46. [Google Scholar] [CrossRef] [PubMed]
  7. Santini, Z.I.; Ekholm, O.; Koyanagi, A.; Stewart-Brown, S.; Meilstrup, C.; Nielsen, L.; Fusar-Poli, P.; Koushede, V.; Thygesen, L.C. Higher levels of mental wellbeing predict lower risk of common mental disorders in the Danish general population. Ment. Health Prev. 2022, 26, 200233. [Google Scholar] [CrossRef]
  8. Ma, L.; Zhang, Y.; Cui, Z. Mindfulness-based interventions for prevention of depressive symptoms in university students: A meta-analytic review. Mindfulness 2019, 10, 2209–2224. [Google Scholar] [CrossRef]
  9. Galante, J.; Friedrich, C.; Dawson, A.F.; Modrego-Alarcón, M.; Gebbing, P.; Delgado-Suárez, I.; Gupta, R.; Dean, L.; Dalgleish, T.; White, I.R. Mindfulness-based programmes for mental health promotion in adults in nonclinical settings: A systematic review and meta-analysis of randomised controlled trials. PLoS Med. 2021, 18, e1003481. [Google Scholar] [CrossRef]
  10. Li, S.Y.H.; Bressington, D. The effects of mindfulness-based stress reduction on depression, anxiety, and stress in older adults: A systematic review and meta-analysis. Int. J. Ment. Health Nurs. 2019, 28, 635–656. [Google Scholar] [CrossRef]
  11. D’Adamo, L.; Paraboschi, L.; Grammer, A.C.; Fennig, M.; Graham, A.K.; Yaeger, L.H.; Newman, M.G.; Wilfley, D.E.; Taylor, C.B.; Eisenberg, D. Reach and uptake of digital mental health interventions based on cognitive-behavioral therapy for college students: A systematic review. J. Behav. Cogn. Ther. 2023, 2, 97–117. [Google Scholar] [CrossRef] [PubMed]
  12. Ebert, D.D.; Cuijpers, P.; Muñoz, R.F.; Baumeister, H. Prevention of mental health disorders using internet-and mobile-based interventions: A narrative review and recommendations for future research. Front. Psychiatry 2017, 8, 116. [Google Scholar] [CrossRef] [PubMed]
  13. Edge, D.; Watkins, E.R.; Limmond, J.; Mugadza, J. The efficacy of self-guided internet and mobile-based interventions for preventing anxiety and depression–A systematic review and meta-analysis. Behav. Res. Ther. 2023, 164, 104292. [Google Scholar] [CrossRef]
  14. Ko, E.; Wongvibul, T.; Rose, K.M.; Jun, J. The Effects of Self-Guided Interventions on Stress, Burden, and Mental Health in Caregivers of People Living with Dementia: A Systematic Review. Int. J. Nurs. Stud. Adv. 2023, 5, 100141. [Google Scholar] [CrossRef]
  15. Rith-Najarian, L.R.; Chorpita, B.F.; Gong-Guy, E.; Hammons, H.R.; Chavira, D.A. Feasibility of a web-based program for universal prevention of anxiety and depression in university students: An open trial. J. Am. Coll. Health 2022, 70, 2519–2526. [Google Scholar] [CrossRef]
  16. Johnson, E.; Corrick, S.; Isley, S.; Vandermeer, B.; Dolgoy, N.; Bates, J.; Godfrey, E.; Soltys, C.; Muir, C.; Vohra, S. Mind-body internet and mobile-based interventions for depression and anxiety in adults with chronic physical conditions: A systematic review of RCTs. PLoS Digit. Health 2024, 3, e0000435. [Google Scholar] [CrossRef] [PubMed]
  17. Goldberg, S.B.; Lam, S.U.; Simonsson, O.; Torous, J.; Sun, S. Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials. PLoS Digit. Health 2022, 1, e0000002. [Google Scholar] [CrossRef]
  18. Gega, L.; Jankovic, D.; Saramago, P.; Marshall, D.; Dawson, S.; Brabyn, S.; Nikolaidis, G.F.; Melton, H.; Churchill, R.; Bojke, L. Digital interventions in mental health: Evidence syntheses and economic modelling. Health Technol. Assess. (Winch. Engl.) 2022, 26, 1. [Google Scholar] [CrossRef]
  19. la Rosa-Gómez, D.; Waldherr, K. Highlights in digital mental health 2021/22. Front. Digit. Health 2023, 4, 1093375. [Google Scholar] [CrossRef] [PubMed]
  20. Iasiello, M.; Van Agteren, J. Mental health and/or mental illness: A scoping review of the evidence and implications of the dual-continua model of mental health. Evid. Base A J. Evid. Rev. Key Policy Areas 2020, 1, 1–45. [Google Scholar] [CrossRef]
  21. Montazeri, A.; Mohammadi, S.; Hesari, P.M.; Ghaemi, M.; Riazi, H.; Sheikhi-Mobarakeh, Z. Preliminary guideline for reporting bibliometric reviews of the biomedical literature (BIBLIO): A minimum requirements. Syst. Rev. 2023, 12, 239. [Google Scholar] [CrossRef] [PubMed]
  22. Gutiérrez-Salcedo, M.; Martínez, M.Á.; Moral-Munoz, J.A.; Herrera-Viedma, E.; Cobo, M.J. Some bibliometric procedures for analyzing and evaluating research fields. Appl. Intell. 2018, 48, 1275–1287. [Google Scholar] [CrossRef]
  23. Donthu, N.; Kumar, S.; Mukherjee, D.; Pandey, N.; Lim, W.M. How to conduct a bibliometric analysis: An overview and guidelines. J. Bus. Res. 2021, 133, 285–296. [Google Scholar] [CrossRef]
  24. Cabezas-Clavijo, Á.; Torres-Salinas, D. Bibliometric reports for institutions: Best practices in a responsible metrics scenario. Front. Res. Metr. Anal. 2021, 6, 696470. [Google Scholar] [CrossRef]
  25. Gusenbauer, M. Search where you will find most: Comparing the disciplinary coverage of 56 bibliographic databases. Scientometr. 2022, 127, 2683–2745. [Google Scholar] [CrossRef]
  26. Pranckutė, R. Web of Science (WoS) and Scopus: The titans of bibliographic information in today’s academic world. Publications 2021, 9, 12. [Google Scholar] [CrossRef]
  27. Aria, M.; Cuccurullo, C. bibliometrix: An R-tool for comprehensive science mapping analysis. J. Informetr. 2017, 11, 959–975. [Google Scholar] [CrossRef]
  28. Blake, H.; Bermingham, F.; Johnson, G.; Tabner, A. Mitigating the psychological impact of COVID-19 on healthcare workers: A digital learning package. Int. J. Environ. Res. Public Health 2020, 17, 2997. [Google Scholar] [CrossRef]
  29. Gilbody, S.; Littlewood, E.; Hewitt, C.; Brierley, G.; Tharmanathan, P.; Araya, R.; Barkham, M.; Bower, P.; Cooper, C.; Gask, L. Computerised cognitive behaviour therapy (cCBT) as treatment for depression in primary care (REEACT trial): Large scale pragmatic randomised controlled trial. Bmj 2015, 351, h5627. [Google Scholar] [CrossRef]
  30. Cavanagh, K.; Strauss, C.; Cicconi, F.; Griffiths, N.; Wyper, A.; Jones, F. A randomised controlled trial of a brief online mindfulness-based intervention. Behav. Res. Ther. 2013, 51, 573–578. [Google Scholar] [CrossRef]
  31. Clarke, G.; Eubanks, D.; Reid, E.; Kelleher, C.; O’connor, E.; DeBar, L.L.; Lynch, F.; Nunley, S.; Gullion, C. Overcoming Depression on the Internet (ODIN)(2): A randomized trial of a self-help depression skills program with reminders. J. Med. Internet Res. 2005, 7, e412. [Google Scholar] [CrossRef] [PubMed]
  32. Inkster, B.; Sarda, S.; Subramanian, V. An empathy-driven, conversational artificial intelligence agent (Wysa) for digital mental well-being: Real-world data evaluation mixed-methods study. JMIR Mhealth Uhealth 2018, 6, e12106. [Google Scholar] [CrossRef] [PubMed]
  33. Howells, A.; Ivtzan, I.; Eiroa-Orosa, F.J. Putting the ‘app’in happiness: A randomised controlled trial of a smartphone-based mindfulness intervention to enhance wellbeing. J. Happiness Stud. 2016, 17, 163–185. [Google Scholar] [CrossRef]
  34. Espie, C.A.; Emsley, R.; Kyle, S.D.; Gordon, C.; Drake, C.L.; Siriwardena, A.N.; Cape, J.; Ong, J.C.; Sheaves, B.; Foster, R. Effect of digital cognitive behavioral therapy for insomnia on health, psychological well-being, and sleep-related quality of life: A randomized clinical trial. JAMA Psychiatry 2019, 76, 21–30. [Google Scholar] [CrossRef]
  35. Morris, M.E.; Kathawala, Q.; Leen, T.K.; Gorenstein, E.E.; Guilak, F.; DeLeeuw, W.; Labhard, M. Mobile therapy: Case study evaluations of a cell phone application for emotional self-awareness. J. Med. Internet Res. 2010, 12, e1371. [Google Scholar] [CrossRef]
  36. Proudfoot, J.; Clarke, J.; Birch, M.-R.; Whitton, A.E.; Parker, G.; Manicavasagar, V.; Harrison, V.; Christensen, H.; Hadzi-Pavlovic, D. Impact of a mobile phone and web program on symptom and functional outcomes for people with mild-to-moderate depression, anxiety and stress: A randomised controlled trial. BMC Psychiatry 2013, 13, 1–12. [Google Scholar] [CrossRef]
  37. Bostock, S.; Crosswell, A.D.; Prather, A.A.; Steptoe, A. Mindfulness on-the-go: Effects of a mindfulness meditation app on work stress and well-being. J. Occup. Health Psychol. 2019, 24, 127. [Google Scholar] [CrossRef]
  38. Cohen, S.; Kamarck, T.; Mermelstein, R. A global measure of perceived stress. J. Health Soc. Behav. 1983, 24, 385–396. [Google Scholar] [CrossRef]
  39. Cohen, J. Set correlation and contingency tables. Appl. Psychol. Meas. 1988, 12, 425–434. [Google Scholar] [CrossRef]
  40. Brown, K.W.; Ryan, R.M. The benefits of being present: Mindfulness and its role in psychological well-being. J. Personal. Soc. Psychol. 2003, 84, 822. [Google Scholar] [CrossRef] [PubMed]
  41. Kabat-Zinn, J. Mindfulness-based interventions in context: Past, present, and future. Clin. Psychol. Sci. Pract. 2003, 10, 144–156. [Google Scholar] [CrossRef]
  42. Spijkerman, M.; Pots, W.T.M.; Bohlmeijer, E. Effectiveness of online mindfulness-based interventions in improving mental health: A review and meta-analysis of randomised controlled trials. Clin. Psychol. Rev. 2016, 45, 102–114. [Google Scholar] [CrossRef] [PubMed]
  43. Kroenke, K. Physical symptom disorder: A simpler diagnostic category for somatization-spectrum conditions. J. Psychosom. Res. 2006, 60, 335–339. [Google Scholar] [CrossRef] [PubMed]
  44. Braun, V.; Clarke, V. Using thematic analysis in psychology. Qual. Res. Psychol. 2006, 3, 77–101. [Google Scholar] [CrossRef]
  45. Spitzer, R.L.; Kroenke, K.; Williams, J.B.; Löwe, B. A brief measure for assessing generalized anxiety disorder: The GAD-7. Arch. Intern. Med. 2006, 166, 1092–1097. [Google Scholar] [CrossRef] [PubMed]
  46. Christensen, H.; Griffiths, K.M.; Farrer, L. Adherence in internet interventions for anxiety and depression: Systematic review. J. Med. Internet Res. 2009, 11, e1194. [Google Scholar] [CrossRef] [PubMed]
  47. Baer, R.A.; Smith, G.T.; Hopkins, J.; Krietemeyer, J.; Toney, L. Using self-report assessment methods to explore facets of mindfulness. Assess. 2006, 13, 27–45. [Google Scholar] [CrossRef] [PubMed]
  48. Janik, A.; Ryszko, A.; Szafraniec, M. Exploring the social innovation research field based on a comprehensive bibliometric analysis. J. Open Innov. Technol. Mark. Complex. 2021, 7, 226. [Google Scholar] [CrossRef]
  49. Thangavel, P.; Chandra, B. Two decades of M-commerce consumer research: A bibliometric analysis using R biblioshiny. Sustainability 2023, 15, 11835. [Google Scholar] [CrossRef]
  50. Zale, A.; Lasecke, M.; Baeza-Hernandez, K.; Testerman, A.; Aghakhani, S.; Muñoz, R.F.; Bunge, E.L. Technology and psychotherapeutic interventions: Bibliometric analysis of the past four decades. Internet Interv. 2021, 25, 100425. [Google Scholar] [CrossRef]
  51. Patel, S.; Akhtar, A.; Malins, S.; Wright, N.; Rowley, E.; Young, E.; Sampson, S.; Morriss, R. The acceptability and usability of digital health interventions for adults with depression, anxiety, and somatoform disorders: Qualitative systematic review and meta-synthesis. J. Med. Internet Res. 2020, 22, e16228. [Google Scholar] [CrossRef]
  52. Schäfer, S.K.; von Boros, L.; Schaubruch, L.M.; Kunzler, A.M.; Lindner, S.; Koehler, F.; Werner, T.; Zappalà, F.; Helmreich, I.; Wessa, M. Digital interventions to promote psychological resilience: A systematic review and meta-analysis. NPJ Digit. Med. 2024, 7, 30. [Google Scholar] [CrossRef]
  53. Loveys, K.; Sagar, M.; Pickering, I.; Broadbent, E. A digital human for delivering a remote loneliness and stress intervention to at-risk younger and older adults during the COVID-19 pandemic: Randomized pilot trial. JMIR Ment. Health 2021, 8, e31586. [Google Scholar] [CrossRef] [PubMed]
  54. Hewitt, R.M.; Ploszajski, M.; Purcell, C.; Pattinson, R.; Jones, B.; Wren, G.H.; Hughes, O.; Ridd, M.J.; Thompson, A.R.; Bundy, C. A mixed methods systematic review of digital interventions to support the psychological health and well-being of people living with dermatological conditions. Front. Med. 2022, 9, 3195. [Google Scholar] [CrossRef] [PubMed]
  55. Bergin, A.D.; Vallejos, E.P.; Davies, E.B.; Daley, D.; Ford, T.; Harold, G.; Hetrick, S.; Kidner, M.; Long, Y.; Merry, S. Preventive digital mental health interventions for children and young people: A review of the design and reporting of research. NPJ Digit. Med. 2020, 3, 133. [Google Scholar] [CrossRef] [PubMed]
  56. Noh, D.; Kim, H. Effectiveness of online interventions for the universal and selective prevention of mental health problems among adolescents: A systematic review and meta-analysis. Prev. Sci. 2023, 24, 353–364. [Google Scholar] [CrossRef] [PubMed]
  57. de Pablo, G.S.; De Micheli, A.; Nieman, D.H.; Correll, C.U.; Kessing, L.V.; Pfennig, A.; Bechdolf, A.; Borgwardt, S.; Arango, C.; Van Amelsvoort, T. Universal and selective interventions to promote good mental health in young people: Systematic review and meta-analysis. Eur. Neuropsychopharmacol. 2020, 41, 28–39. [Google Scholar] [CrossRef] [PubMed]
  58. De Pablo, G.S.; De Micheli, A.; Solmi, M.; Oliver, D.; Catalan, A.; Verdino, V.; Di Maggio, L.; Bonoldi, I.; Radua, J.; Boy, O.B. Universal and selective interventions to prevent poor mental health outcomes in young people: Systematic review and meta-analysis. Harv. Rev. Psychiatry 2021, 29, 196–215. [Google Scholar] [CrossRef] [PubMed]
  59. Van Doorn, M.; Nijhuis, L.A.; Egeler, M.D.; Daams, J.G.; Popma, A.; van Amelsvoort, T.; McEnery, C.; Gleeson, J.F.; Öry, F.G.; Avis, K.A. Online indicated preventive mental health interventions for youth: A scoping review. Front. Psychiatry 2021, 12, 580843. [Google Scholar] [CrossRef]
  60. Stratton, E.; Jones, N.; Peters, S.E.; Torous, J.; Glozier, N. Digital mHealth interventions for employees: Systematic review and meta-analysis of their effects on workplace outcomes. J. Occup. Environ. Med. 2021, 63, e512–e525. [Google Scholar] [CrossRef]
  61. Trindade, I.A.; Guiomar, R.; Carvalho, S.A.; Duarte, J.; Lapa, T.; Menezes, P.; Nogueira, M.R.; Patrao, B.; Pinto-Gouveia, J.; Castilho, P. Efficacy of online-based acceptance and commitment therapy for chronic pain: A systematic review and meta-analysis. J. Pain 2021, 22, 1328–1342. [Google Scholar] [CrossRef]
  62. De Witte, N.A.; Joris, S.; Van Assche, E.; Van Daele, T. Technological and digital interventions for mental health and wellbeing: An overview of systematic reviews. Front. Digit. Health 2021, 3, 754337. [Google Scholar] [CrossRef]
  63. Deady, M.; Choi, I.; Calvo, R.; Glozier, N.; Christensen, H.; Harvey, S. eHealth interventions for the prevention of depression and anxiety in the general population: A systematic review and meta-analysis. BMC Psychiatry 2017, 17, 310. [Google Scholar] [CrossRef]
  64. Santomauro, D.F.; Herrera, A.M.M.; Shadid, J.; Zheng, P.; Ashbaugh, C.; Pigott, D.M.; Abbafati, C.; Adolph, C.; Amlag, J.O.; Aravkin, A.Y. Global prevalence and burden of depressive and anxiety disorders in 204 countries and territories in 2020 due to the COVID-19 pandemic. Lancet 2021, 398, 1700–1712. [Google Scholar] [CrossRef] [PubMed]
  65. Rauschenberg, C.; Schick, A.; Hirjak, D.; Seidler, A.; Paetzold, I.; Apfelbacher, C.; Riedel-Heller, S.G.; Reininghaus, U. Evidence synthesis of digital interventions to mitigate the negative impact of the COVID-19 pandemic on public mental health: Rapid meta-review. J. Med. Internet Res. 2021, 23, e23365. [Google Scholar] [CrossRef] [PubMed]
  66. Riboldi, I.; Cavaleri, D.; Calabrese, A.; Capogrosso, C.A.; Piacenti, S.; Bartoli, F.; Crocamo, C.; Carrà, G. Digital mental health interventions for anxiety and depressive symptoms in university students during the COVID-19 pandemic: A systematic review of randomized controlled trials. Rev. De Psiquiatr. Y Salud Ment. 2023, 16, 47–58. [Google Scholar] [CrossRef]
  67. Pandey, N.; Pal, A. Impact of digital surge during COVID-19 pandemic: A viewpoint on research and practice. Int. J. Inf. Manag. 2020, 55, 102171. [Google Scholar]
  68. Hutchings, R. The impact of COVID-19 on the use of digital technology in the NHS. Nuffield Trust. 2020, 27, 2002–2008. [Google Scholar]
  69. Gorenko, J.A.; Moran, C.; Flynn, M.; Dobson, K.; Konnert, C. Social isolation and psychological distress among older adults related to COVID-19: A narrative review of remotely-delivered interventions and recommendations. J. Appl. Gerontol. 2021, 40, 3–13. [Google Scholar] [CrossRef] [PubMed]
  70. Harith, S.; Backhaus, I.; Mohbin, N.; Ngo, H.T.; Khoo, S. Effectiveness of digital mental health interventions for university students: An umbrella review. PeerJ 2022, 10, e13111. [Google Scholar] [CrossRef] [PubMed]
  71. Bégin, C.; Berthod, J.; Martinez, L.Z.; Truchon, M. Use of Mobile Apps and Online Programs of Mindfulness and Self-Compassion Training in Workers: A Scoping Review. J. Technol. Behav. Sci. 2022, 7, 477–515. [Google Scholar] [CrossRef]
  72. Linardon, J. Can acceptance, mindfulness, and self-compassion be learned by smartphone apps? A systematic and meta-analytic review of randomized controlled trials. Behav. Ther. 2020, 51, 646–658. [Google Scholar] [CrossRef]
  73. Taylor, H.; Strauss, C.; Cavanagh, K. Can a little bit of mindfulness do you good? A systematic review and meta-analyses of unguided mindfulness-based self-help interventions. Clin. Psychol. Rev. 2021, 89, 102078. [Google Scholar] [CrossRef]
  74. Khademian, F.; Aslani, A.; Bastani, P. The effects of mobile apps on stress, anxiety, and depression: Overview of systematic reviews. Int. J. Technol. Assess. Health Care 2021, 37, e4. [Google Scholar] [CrossRef]
  75. Maulik, P.K.; Thornicroft, G.; Saxena, S. Roadmap to strengthen global mental health systems to tackle the impact of the COVID-19 pandemic. Int. J. Ment. Health Syst. 2020, 14, 57. [Google Scholar] [CrossRef]
  76. Boden, M.; Zimmerman, L.; Azevedo, K.J.; Ruzek, J.I.; Gala, S.; Magid, H.S.A.; Cohen, N.; Walser, R.; Mahtani, N.D.; Hoggatt, K.J. Addressing the mental health impact of COVID-19 through population health. Clin. Psychol. Rev. 2021, 85, 102006. [Google Scholar] [CrossRef]
  77. Laprise, C. It’s time to take a sustainable approach to health care in the face of the challenges of the 21st century. One Health 2023, 16, 100510. [Google Scholar] [CrossRef]
  78. Thompson, E.M.; Destree, L.; Albertella, L.; Fontenelle, L.F. Internet-based acceptance and commitment therapy: A transdiagnostic systematic review and meta-analysis for mental health outcomes. Behav. Ther. 2021, 52, 492–507. [Google Scholar] [CrossRef] [PubMed]
  79. Gloster, A.T.; Walder, N.; Levin, M.E.; Twohig, M.P.; Karekla, M. The empirical status of acceptance and commitment therapy: A review of meta-analyses. J. Context. Behav. Sci. 2020, 18, 181–192. [Google Scholar] [CrossRef]
  80. Moshe, I.; Terhorst, Y.; Philippi, P.; Domhardt, M.; Cuijpers, P.; Cristea, I.; Pulkki-Råback, L.; Baumeister, H.; Sander, L.B. Digital interventions for the treatment of depression: A meta-analytic review. Psychol. Bull. 2021, 147, 749. [Google Scholar] [CrossRef] [PubMed]
  81. Himle, J.A.; Weaver, A.; Zhang, A.; Xiang, X. Digital mental health interventions for depression. Cogn. Behav. Pract. 2022, 29, 50–59. [Google Scholar] [CrossRef]
  82. Goodman, M.L.; Molldrem, S.; Elliott, A.; Robertson, D.; Keiser, P. Long COVID and mental health correlates: A new chronic condition fits existing patterns. Health Psychol. Behav. Med. 2023, 11, 2164498. [Google Scholar] [CrossRef]
  83. Guillen-Burgos, H.F.; Galvez-Florez, J.F.; Moreno-Lopez, S.; Gonzalez, I.; Guillen, M.; Anaya, J.-M. Factors associated with mental health outcomes after COVID-19: A 24-month follow-up longitudinal study. Gen. Hosp. Psychiatry 2023, 84, 241–249. [Google Scholar] [CrossRef] [PubMed]
  84. Saqib, K.; Qureshi, A.S.; Butt, Z.A. COVID-19, Mental Health, and Chronic Illnesses: A Syndemic Perspective. Int. J. Environ. Res. Public Health 2023, 20, 3262. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Screening strategy for included documents.
Figure 1. Screening strategy for included documents.
Ijerph 21 00375 g001
Figure 2. Scientific production rate between 2004–2023.
Figure 2. Scientific production rate between 2004–2023.
Ijerph 21 00375 g002
Figure 3. Bibliographical coupling of the most relevant authors.
Figure 3. Bibliographical coupling of the most relevant authors.
Ijerph 21 00375 g003
Figure 4. Types of open-access publications.
Figure 4. Types of open-access publications.
Ijerph 21 00375 g004
Figure 5. Collaboration networks of correspondent authors’ affiliations.
Figure 5. Collaboration networks of correspondent authors’ affiliations.
Ijerph 21 00375 g005
Figure 6. Thematic mapping of main research themes.
Figure 6. Thematic mapping of main research themes.
Ijerph 21 00375 g006
Figure 7. Concept evolution.
Figure 7. Concept evolution.
Ijerph 21 00375 g007
Figure 8. Concept mapping for 2004–2015.
Figure 8. Concept mapping for 2004–2015.
Ijerph 21 00375 g008
Figure 9. Concept mapping for 2016–2020.
Figure 9. Concept mapping for 2016–2020.
Ijerph 21 00375 g009
Figure 10. Concept mapping for 2021–2023.
Figure 10. Concept mapping for 2021–2023.
Ijerph 21 00375 g010
Figure 11. Network analysis of emergent themes.
Figure 11. Network analysis of emergent themes.
Ijerph 21 00375 g011
Figure 12. Keywords’ associations for most recently studied psychological/psychosocial outcomes: (a) quality of life; (b) psychological distress; (c) loneliness; (d) mental well-being; (e) psychological well-being; (f) well-being.
Figure 12. Keywords’ associations for most recently studied psychological/psychosocial outcomes: (a) quality of life; (b) psychological distress; (c) loneliness; (d) mental well-being; (e) psychological well-being; (f) well-being.
Ijerph 21 00375 g012aIjerph 21 00375 g012bIjerph 21 00375 g012cIjerph 21 00375 g012d
Table 1. Most productive authors in digital mental health research: productivity and impact metrics.
Table 1. Most productive authors in digital mental health research: productivity and impact metrics.
AuthorsArticlesArticles Fractionalisedh-IndexTCPY StartInstitution
Lappalainen Raimo172.71104822013University of Jyväskylä
Lappalainen Päivi152.5583802014University of Jyväskylä
Lehr Dirk152.3395092014Leuphana University
Ebert David Daniel142.0284962014Technical University Munich
Berger Thomas131.8661362014University of Bern
Levin Michael E.133.13114522014Utah State University
Kirsikka Kaipainen111.8561852013Tampere University
TC: total citation count.
Table 2. Most relevant journals (journals ranking based on Bradford’s law: Zone 1 articles).
Table 2. Most relevant journals (journals ranking based on Bradford’s law: Zone 1 articles).
SourcesRankArticlesh-Indexg-Indexm-IndexTCPY Start
Journal of Medical Internet Research16222421.1018642005
JMIR Formative Research250681.201312020
JMIR Mental Health34320292.228912016
Mindfulness43715261.367012014
Frontiers in Psychology53610191.114012016
JMIR mHealth and uHealth62817281.4110542013
International Journal of Environmental Research and Public Health72710221.665242019
Internet Interventions-The Application of IT in Mental and Behavioural Health82311151.372442017
Annals of Behavioral Medicine9183140.201992010
Psycho-Oncology10175120.451492014
Journal of Contextual Behavioral Science11138101.001172017
Behaviour Research and Therapy12109100.607712010
Frontiers in Psychiatry1310450.80362010
Table 3. Top 10 most cited papers.
Table 3. Top 10 most cited papers.
DocumentsJournalsTitlesTC
Blake et al. (2020) [28]International Journal of Environmental Research and Public HealthMitigating the Psychological Impact of COVID-19 on Healthcare Workers: A Digital Learning Package321
Gilbody et al. (2015) [29]BMJComputerised cognitive behaviour therapy (cCBT) as treatment for depression in primary care (REEACT trial): large scale pragmatic randomised controlled trial284
Cavanagh et al. (2013) [30]Behaviour Research and TherapyA randomised controlled trial of a brief online mindfulness-based intervention283
Clarke et al. (2005) [31]Journal of Medical Internet ResearchOvercoming Depression on the Internet (ODIN) (2): A Randomized Trial of a Self-Help Depression Skills Program with Reminders269
Inkster et al. (2018) [32]JMIR Mhealth UhealthAn Empathy-Driven, Conversational Artificial Intelligence Agent (Wysa) for Digital Mental Well-Being: Real-World Data Evaluation Mixed-Methods Study241
Howells et al. (2016) [33]Journal of Happiness StudiesPutting the ‘app’ in Happiness: A Randomised Controlled Trial of a Smartphone-Based Mindfulness Intervention to Enhance Wellbeing208
Espie et al. (2019) [34]JAMA PsychiatryEffect of Digital Cognitive Behavioral Therapy for Insomnia on Health, Psychological Well-being, and Sleep-Related Quality of Life: A Randomized Clinical Trial202
Morris et al. (2010) [35]Journal of Medical Internet ResearchMobile Therapy: Case Study Evaluations of a Cell Phone Application for Emotional Self-Awareness201
Proudfoot et al. (2013) [36]BMC PsychiatryImpact of a mobile phone and web program on symptom and functional outcomes for people with mild-to-moderate depression, anxiety and stress: a randomised controlled trial182
Bostock et al. (2019) [37]Journal of Occupational Health PsychologyMindfulness on-the-go: Effects of a mindfulness meditation app on work stress and well-being173
Table 4. Thematic clusters based on authors’ keywords co-occurrence network.
Table 4. Thematic clusters based on authors’ keywords co-occurrence network.
Cluster 1NCluster 2NCluster 3NCluster 4NCluster 5NCluster 6NCluster 7N
Mindfulness220Anxiety90COVID-19102Acceptance and Commitment Therapy61Depression126Web-based24Positive Psychology19
Mental Health168mhealth58Resilience44Randomised controlled trial57Quality of life27College students19
Stress146Mobile phone41Intervention40Internet44Prevention20
Well-being60Cognitive behavioural therapy30Burnout36Internet-based intervention20E-health18
Stress management52Digital health25pandemic18cancer20Qualitative Research18
Online44Mobile health24wellbeing18rct17
Meditation43Mobile apps19Psychological wellbeing17Chronic pain17
Online intervention41workplace19
Self-compassion39Mobile app18
Virtual reality36ehealth18
University students27app17
Self-help27Psychological distress17
Adolescents23feasibility16
Digital intervention16
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Armaou, M.; Pears, M.; Konstantinidis, S.T.; Blake, H. Evolution of Primary Research Studies in Digital Interventions for Mental Well-Being Promotion from 2004 to 2023: A Bibliometric Analysis of Studies on the Web of Science. Int. J. Environ. Res. Public Health 2024, 21, 375. https://doi.org/10.3390/ijerph21030375

AMA Style

Armaou M, Pears M, Konstantinidis ST, Blake H. Evolution of Primary Research Studies in Digital Interventions for Mental Well-Being Promotion from 2004 to 2023: A Bibliometric Analysis of Studies on the Web of Science. International Journal of Environmental Research and Public Health. 2024; 21(3):375. https://doi.org/10.3390/ijerph21030375

Chicago/Turabian Style

Armaou, Maria, Matthew Pears, Stathis Th. Konstantinidis, and Holly Blake. 2024. "Evolution of Primary Research Studies in Digital Interventions for Mental Well-Being Promotion from 2004 to 2023: A Bibliometric Analysis of Studies on the Web of Science" International Journal of Environmental Research and Public Health 21, no. 3: 375. https://doi.org/10.3390/ijerph21030375

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop