Next Article in Journal
Protecting Innovation Sustainability: R&D Manipulation and Effective Regulation Based on a Two-Scenario Evolutionary Game Perspective
Next Article in Special Issue
Self-Management Predicts Lower Post-Traumatic Symptoms and Greater Post-Traumatic Growth among Older Adults in Residential Care Homes in the Wake of the COVID-19 Pandemic
Previous Article in Journal
A Resource Nexus Analysis Methodology for Quantifying Synergies and Trade-Offs in the Agricultural Sector and Revealing Implications of a Legume Production Paradigm Shift
Previous Article in Special Issue
Effects of Evidence-Based Intervention on Teachers’ Mental Health Literacy: Systematic Review and a Meta-Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Systematic Review

A Systematic Review and Meta-Analysis of the Effectiveness of Non-Face-to-Face Coaching

Counselling and Coaching Department, Graduate School, Dongguk University-Seoul, 30, Pildong-ro 1 gil, Jung-gu, Seoul 04620, Republic of Korea
*
Author to whom correspondence should be addressed.
Sustainability 2023, 15(12), 9727; https://doi.org/10.3390/su15129727
Submission received: 30 March 2023 / Revised: 7 June 2023 / Accepted: 16 June 2023 / Published: 18 June 2023

Abstract

:
This study examined the effectiveness of non-face-to-face coaching in South Korea in order to present alternatives in the post-COVID-19 environment. The research collected domestic studies on non-face-to-face coaching in South Korea and analysed the studies through a systematic literature review and meta-analysis. Among 1081 papers retrieved from the database, we selected ten papers for meta-analysis. Using the random effect model to measure effect size, the total effect size of non-face-to-face coaching was 0.77. When we divided the effect of non-face-to-face coaching into psychological, cognitive, and physical effects, the cognitive effects were the largest. In addition, examining non-face-to-face coaching by type resulted in a larger effect size of web-based online coaching in comparison to telephone coaching. By contrast, the effect sizes of non-face-to-face coaching by subject had the largest effect size on subjects with the highest level of vulnerability. This study found that non-face-to-face coaching had a large effect, with relatively large cognitive and psychological effects. Future investigations should supplement the present research through follow-up studies on non-face-to-face coaching.

1. Introduction

Due to the COVID-19 pandemic, many face-to-face activities have been converted into non-face-to-face activities. Non-face-to-face is a term applied in various fields, including education and counselling [1], with a meaning of not being restrictive in multiple aspects, including the characteristic of ‘not facing’. In addition to education and counselling, coaching has also been converted into a non-face-to-face activity. Coaching is a process that maximizes clients’ potential so they can fulfil their goals. Although non-face-to-face coaching already occurred prior to the COVID-19 pandemic [2,3], interest in non-face-to-face coaching has been continuously increasing due to COVID-19.
Non-face-to-face coaching is similar to e-coaching: the coach does not meet clients in person but engages through distance, telephone, online, remote, virtual, and digital coaching. Non-face-to-face coaching also includes meeting clients through electronic means such as telephone, emails, and audiovisual or video meetings [3,4]. While non-face-to-face coaching has various terms, it refers to coaching clients using electronic media with no restrictions on time and place [5]. Thus, non-face-to-face coaching benefits clients because it has no limits on time and place [6]. Consequently, we see non-face-to-face coaching gradually replacing face-to-face coaching thanks to the internet [7].
In a study examining the effect of non-face-to-face coaching, Dwinger et al. [8] carried out telephone-based health coaching (TBHC). They found that non-face-to-face coaching helped patients to learn about their diseases and how to improve their condition. It also gave them the confidence to participate in treatment and to reach their targeted health goals. In addition, some studies indicate that e-coaching effectively reduces cardiovascular risks for ten years [9].
Another study [10] found digital text message coaching effective for personality change. In other research, Kettunen et al. [11] examined the effectiveness of digital coaching in promoting physical activities with the young elderly (65–75 years old). They learned that digital coaching positively affected self-efficacy, but stated that the study subjects recognized that it should be easy to use and attractive in order to fit the subjects.
Recently, as interest in non-face-to-face coaching has increased, scholars have conducted comprehensive studies on its effectiveness. For example, Akinosun et al. [12] stated that using digital technologies such as mobile phones, the internet, software applications, wearables, etc., is effective for patients with cardiovascular disease. Moreover, Gershkowitz et al. [13] indicated that digital health coaching’s effects are similar to face-to-face or telephone coaching for preventing and maintaining long-term type 2 diabetes. However, Bevilacqua et al. [14] systematically analysed the effectiveness of health coaching for older people using digital technologies. They obtained a result indicating that coaching with technology integration rather than general treatment can benefit health. However, they could not get sufficient grounds for methods to maintain the advantage and permanence of the behavioural change due to the short-term intervention.
The research subjects In non-face-to-face coaching range from vulnerable people to those looking for prevention. For instance, Lambert and colleagues [15] researched the effectiveness of web-based stress management programs in vulnerable subjects, such as adults with cardiovascular disease. In addition, Thielecke et al. [16] have shown that telephone coaching prevents depression in farmers. Non-face-to-face coaching has also proven effective for traditional coaches and clients, and it is helpful in teachers’ professional development relating to children’s education [17].
While various studies on non-face-to-face coaching exist, scholars have conducted studies on non-face-to-face coaching in South Korea since 2008, despite the introduction of coaching having been more than 20 years ago [18,19]. For example, Kyoung Kim [20] developed a non-face-to-face coaching-based leadership program, which proved effective in career decision-making, self-efficacy, and resilience. Further, Choi and colleagues [21] showed the positive effect of non-face-to-face coaching on parenting. In addition, Lee and colleagues [22] identified six types through a study on college students’ perceptions of non-face-to-face coaching.
Although there are some studies on non-face-to-face coaching in South Korea, there is no systematic literature review or meta-analysis [1]. Meta-analysis is a statistical method synthesizing a pooled estimate by combining estimates from two or more individual studies. In other words, it is a statistical technique used to evaluate effectiveness and efficiency by quantitatively calculating an integrated summary estimate of the results presented in studies [23].
Since non-face-to-face coaching is highly likely to be beneficial, it is important to examine its effectiveness in general and present ways for it to develop. Therefore, this study examines the effectiveness of non-face-to-face coaching and suggests how customers can continue to develop their lives. The study also demonstrates that non-face-to-face coaching can be a sustainable tool for individual development. We explore non-face-to-face coaching’s effectiveness and how it can develop in a new environment that seeks more effective coaching. Hence, this study asks the following questions.
What is the size of the effect of non-face-to-face coaching?
What are the sizes of the effects of non-face-to-face coaching by type (cognitive, psychological, physical)?
What are the effect sizes of each type of non-face-to-face coaching (web-based online coaching, telephone coaching)?
What are the sizes of the effects of non-face-to-face coaching by subject and age?
What are the sizes of the effects of non-face-to-face coaching by operation (number of times, time)?

2. Method

2.1. Study Subjects

This study collected and analysed research related to non-face-to-face coaching in South Korea. Achieving this study’s purpose involved setting the population, intervention, comparison, outcomes, and study design (PICOS) in structured questions to clarify the critical concepts of the topic of the study [24].

2.1.1. Inclusion Criteria

The inclusion criteria for PICOS for research papers in this study included the following. The study subjects (P) were those receiving non-face-to-face coaching, and the intervention program (I) was non-face-to-face coaching. The control group included those not treated with non-face-to-face coaching. Thus, we could compare (C) the two populations. The effect of the relevant intervention (O) is the effectiveness of non-face-to-face coaching, and the study design (S) is the design of the pretest and posttest of the control group.

2.1.2. Exclusion Criteria

This research excluded low-quality study results from meta-analyses, and we conducted meta-analyses on papers published in journals listed in KCI. However, we included dissertations to supplement the representativeness of study results.
This study excluded the following: (1) papers and works in which the topic was not non-face-to-face coaching, (2) papers and works that did not contain the effect of non-face-to-face coaching, (3) papers that did not present sufficient data showing the effect of non-face-to-face coaching, and (4) qualitative study papers that did not show the quantitative effects of non-face-to-face coaching.

2.1.3. Search Strategy

This study followed the PRISMA guidelines for systematic literature review. PRISMA stands for “Reporting Items for Systematic Reviews and Meta-Analyses.” We collected data through the following stages: literature verification, literature selection, selection criteria review, and final selection [25]. Regarding non-face-to-face coaching, we retrieved related data using the search engine RISS (Research Information Sharing Service) of the Korea Education & Research Information Service, the National Assembly Library of Korea, and KISS. Our target papers were those published from 2000 to 2021. Our search topics included: text coaching, telephone coaching, online coaching, digital coaching, web coaching, mobile coaching, artificial intelligence (AI) coaching, metaverse coaching, and non-face-to-face coaching. Our search retrieved 1081 papers—996 from RISS, 51 from the National Assembly Library, and 34 from KISS. Figure 1 illustrates the process of data review in our research. In this study, two researchers independently performed the procedure shown in Figure 1. In the event of objections in reviewing and selecting studies, the researchers resolved the objections through a continuous consultation and agreement process. Our systematic review protocol was registered in the International Prospective Register of Systematic Reviews (registration number: CRD42023429447).
Among the 1081 papers retrieved through the database, we excluded 782 papers, consisting of 304 papers, 453 books, and 25 research papers, by reviewing types and titles. Next, we excluded 270 topics unrelated to non-face-to-face coaching and five overlapping papers. Then, by re-reviewing the details of the papers, we excluded 14 with insufficient data and those containing qualitative research. Finally, we selected ten papers for the meta-analysis.

2.1.4. Data Extraction and Study Quality Assessment

We coded through the following procedure to collect papers related to non-face-to-face coaching and analyse the effect sizes. First, we recorded the paper’s basic information (title, publication year, sample size), study design (independent and dependent variables, measurement tools), and relevant variables. Then, a researcher with experience in meta-analysis studies did the coding. After completing the coding, the co-researcher reviewed the codes. After the review, the researchers discussed and revised the categories of individual variables. The process was continuous between the researchers in order to reach a final agreement.
We assessed the qualities of individual studies to examine the studies’ validities regarding how well their results measured the actual effects and internal validity related to minimizing bias [26]. The assessment details concerning the quality of the target papers are as follows. We gave one point for each criterion if the study was affirmative to the following questions:
  • Was the sample frame appropriate to address the target population?
  • Were study participants recruited appropriately?
  • Was the sample size adequate?
  • Were the study subjects and setting described in detail?
  • Was data analysis conducted with sufficient coverage of the identified sample?
  • Were valid methods used for the identification of the condition?
  • Was the condition measured in a standard, reliable way for all participants?
  • Was there an appropriate statistical analysis?
  • Was the response rate adequate, and if not, was the low response rate managed appropriately?
We evaluated each target paper with the above qualitative assessment questions, and Supplementary Table S2 (Quality Assessment) contains the details. In addition, Table 1 presents the effect sizes, subject types, and coaching compositions of the studies included in this study according to the above criteria.

2.2. Effect Size Calculation

Effect size is a common unit for aggregating individual study results for integrated comparison. Commonly used effect sizes include standardised mean value, correlation coefficient I, odds ratio, etc. In this study, we compared and analysed effect sizes using the standardised mean change difference between the group that received non-face-to-face coaching and those that did not receive non-face-to-face coaching. The standardised mean difference is the standardised mean difference between the posttest and pretest in the experimental and control groups [36]. We interpreted the meaning of the study results based on the effect sizes. An effect size smaller than 0.2 is a ‘small effect,’ an effect size around 0.5 is a ‘medium effect,’ and an effect size of 0.8 or greater is a ‘large effect’ [37]. In this study, we analysed the effect sizes using the CMA (Comprehensive Meta-Analysis) 3.0 program.

2.3. Publication Bias Verification

We verified publication bias because study results that are positive and statistically significant are more likely to be published than those that are not positive and statistically significant [38]. In the absence of publication bias, studies will symmetrically distribute around the aggregated effect size, and in the presence of publication bias, studies will concentrate on the other side.
In Figure 2, the x-axis represents the effect size, and the y-axis represents the number of samples. Examining the funnel plot in Figure 2 for publication bias, we find that the left and right sides are not approximately symmetrical.
To verify publication bias, we estimated the influence of the excluded studies using the trim and fill method [39], as shown in Table 2. According to the result, the influence was not large enough to hinder the validity of the estimation of the effect of coaching. The funnel plot is not a proof of error but a tool for raising the possibility of bias [40]. Therefore, these results indicate that the publication bias is not severe.

2.4. Analysis Model and Homogeneity Test

In a meta-analysis, computational models for calculating the average effect size include fixed and random effect models [30]. The fixed-effect model estimates the effect size of the same population, whereas random-effect models estimate the average effect size of distributions of different populations.
We conducted a homogeneity test to determine whether the results of individual studies were from the same population. Homogeneity tests evaluate whether the effect sizes extracted from individual studies are from the same population. We can use a fixed-effect model if individual studies are homogeneous, i.e., extracted from the same population through a homogeneity test. On the other hand, if a homogeneity test produces a statistically significant result, we would use a random-effect model to measure effect size, assuming that individual study results came from different populations.
The null hypothesis in a homogeneity test examines whether the effect sizes are homogeneous and if they are homogeneous, then we can regard them as extracted from the same population. In Table 3, Q-value means the observed variance of each effect size, and df (degrees of freedom) is the value of the expected variance when assuming all the effect sizes of the populations of individual studies are the same. If the value obtained by subtracting the expected variance (df) from the total observed variance (Q-value)—that is, the degree of variance based on the actual effect difference between studies—is Q > df, then the effect sizes of the populations of individual studies are different from each other.
In this study, since the Q-value, 151.698, is larger than df 54, the effect sizes of populations are different. In addition, since the significance probability (p-value) of the homogeneity test was smaller than 0.10, the heterogeneity of the effect sizes is significant. Therefore, using the random-effect model is appropriate. When the I-squared value representing the ratio of actual variance to total variance is 25%, the heterogeneity is small; when the I-squared value is 50%, the heterogeneity is medium; when the value is 75%, the heterogeneity is very large. This study’s I-squared value was 64.401, indicating heterogeneous effect sizes.
Since all of the studies’ subjects, intervention methods, periods, etc., are different, the effect sizes of the studies’ populations also differ. Therefore, we used the random-effect model to calculate the average effect size in this study.

2.5. Effect Sizes by Research Type

The effect sizes by research paper type are in Table 4. The effect size of journal papers (d = 0.809) was larger than that of dissertations (d = 0.670).

3. Results

3.1. Overall Effect Size

In this study, since the Q-value, 151.698, is larger than df 54, the effect sizes of populations are different. In addition, the I-squared value was 64.401, indicating heterogeneous effect sizes, as following Table 4. We used the random effect model to verify the overall effect size. Table 5 shows that the effect size for 55 effect size cases was 0.775, and the 95% confidence interval for the overall effect was 0.611–0.939. Although the effect size is slightly smaller than 0.8, Cohen’s [28] standard indicates that this result is significant for the non-face-to-face coaching effect.

3.2. Non-Face-to-Face Coaching Effect Size

We divided the effect sizes by treatment effect of the non-face-to-face coaching effects into psychological, cognitive, and physical effects; Table 6 contains the details. Among the non-face-to-face coaching effects, cognitive effects (d = 1.494) were the largest, followed by psychological effects (d = 0.943), and physical effects (d = 0.428). In the three categories of effect sizes, the largest effect sizes were in psychological health (d = 128), cognitive function (d = 1.792), and physical health (d = 0.551).

3.3. Effect Sizes by Coaching Type

The effect sizes of non-face-to-face coaching by coaching type are in Table 7. The effect size of online coaching using Zoom (d = 0.914) in non-face-to-face coaching was larger than that of telephone coaching (d = 0.744).

3.4. Effect Size by Coachee

The effect sizes of non-face-to-face coaching by coachee are in Table 8. Among the non-face-to-face coaching effects, those with a high level of vulnerability (d = 1.041) were the largest, followed by those with a low level of vulnerability (d = 0.586), and a medium level of vulnerability (d = 0.389). Among the effects on persons with a high level of vulnerability, those with diabetes (d = 1.481) were the largest, followed by older females (d = 0.461), with the largest effect size in the medium vulnerability group. Among those with a low level of vulnerability, college students (d = 0.896) showed the largest effect size.

3.5. Effect Sizes by Coaching Period and Time

The sizes of the effects of non-face-to-face coaching by period and time are in Table 9. The effect sizes by coaching period were the largest when the coaching period was 12 weeks (d = 1.545). The effect sizes by the number of coaching sessions were the largest when coaching was 0.160 times per week (d = 1.545). The effect sizes by the total number of coaching sessions were the largest when the total number of sessions was two (d = 1.545). While this effect size was the largest, Park [31] conducted two sessions after the client had already received two prior coaching sessions. The effect sizes by the time spent per coaching session were the largest when the time spent per coaching session was 80 min (d = 0.896).

4. Discussion

This study analysed the effect sizes of non-face-to-face coaching through meta-analysis. It aggregated the results of previous studies on non-face-to-face coaching, examining effect size correlations to compare individual effects. The analysis results of ten papers related to non-face-to-face coaching are as follows.
First, we measured effect sizes with a random effect model to obtain the effect sizes in the meta-analysis, resulting in 0.77 as the overall effect size of non-face-to-face coaching. Concerning the effect size, according to Cohen [28], researchers can interpret the effect size to be close to a large effect size, making it possible to suggest that non-face-to-face coaching is effective. This study examined papers on the effects of non-face-to-face coaching in South Korea, finding results similar to those of various overseas studies showing the effectiveness of non-face-to-face coaching [9,41].
However, some overseas studies have suggested that non-face-to-face coaching cannot obtain sufficient effects alone. For example, in a study by Jones et al. [42], some participants said phone and internet-based coaching had advantages over face-to-face coaching. However, they suggested that the prospect of a mixture of non-face-to-face and face-to-face coaching using technologies was bright. In addition, a systematic review by van Veen [43] indicated that basic e-coaching was ineffective for patient rehabilitation.
The methods of non-face-to-face coaching in studies in South Korea, the subjects of the current analysis, were as simple as online and telephone coaching. There were no mixed studies and insufficient studies to compare non-face-to-face and face-to-face coaching. Therefore, experimental studies on more diverse non-face-to-face coaching methods are necessary to vitalize non-face-to-face coaching in South Korea. In particular, Zhang et al. [44] studied speech effects in the metaverse. Thus, we need research to apply this metaverse to coaching and develop non-face-to-face coaching.
Second, cognitive effects were the largest when we examined the psychological, cognitive, and physical effects of non-face-to-face coaching. For instance, Schouten et al. [45] found meaningful results supporting cognitive learning through digital coaching for low-literate individuals. In addition, psychological effects were significant, but physical effects were not large when compared to other areas. Therefore, face-to-face coaching could help increase physical effects. Furthermore, coaches should determine the coaching methods based on the coaching purpose and include the complementary activity of face-to-face coaching according to the client’s needs. This approach will vitalize more effective non-face-to-face coaching.
Third, when we examined the effect sizes of non-face-to-face coaching by type, we found the effect size of web-based online coaching was larger than telephone coaching. In telephone coaching, among the types of non-face-to-face coaching, communications can be limited because the other party cannot see non-verbal elements, such as facial expressions and gestures. Thus, web-based online coaching is more effective for communication because the parties can see each other’s facial expressions and gestures [46].
In addition, based on our analysis, although the division of ages is unclear, except in the study conducted by Hong [34], studies involving web-based online coaching were only in studies with subjects in their 20 s–40 s. This effect of online coaching in subjects in relatively young age groups indicates their capability to handle online technology. Therefore, although media can enable smooth communication with clients in non-face-to-face coaching, selecting the medium requires consideration of the ages of clients.
Fourth, the effects of non-face-to-face coaching by coachee were largest in persons with a high level of vulnerability. This study’s subjects with a high level of vulnerability included persons with diabetes, ischemic stroke patients, and the physically weak elderly, and all received telephone coaching. Therefore, non-face-to-face coaching using telephones is effective for persons with a high level of vulnerability. In addition, Kettunen et al. [11] showed that digital coaching motivates young older people towards physical activities, which aligns with our study’s results.
Yousuf [9] found severe limitations when e-coaching older people using web-based tools. Moreover, Mahdaria and Restuaji [47] showed that the effectiveness of online coaching depends on the reliability of the internet connection, suggesting a need for various platforms that can adapt to technical problems. In addition, while analysing two papers in a systematic literature review of digital health coaching programs for retired seniors to become re-employed in the community, Stara et al. [48] proposed a user-centred design approach for older adults. The studies show that for non-face-to-face coaching to be more suitable for the subject, the subject must be able to use the method easily. Therefore, to vitalize non-face-to-face coaching in South Korea, coaches should prepare various platforms according to the subject’s ability to handle individual skills.
Fifth, in this study, the effect sizes of non-face-to-face coaching by coaching period were the largest when the coaching period was 12 weeks, followed by a coaching period of 48 weeks. However, the effect size when the coaching period was 16 weeks was small. In studies implementing a coaching period of 16 weeks [33,35], non-face-to-face coaching lasted 15 to 20 min per session. This length is characteristic of other studies in which coaching lasted 30 to 60 min. In addition, the total effect size was largest when there were two coaching sessions, followed by 16 sessions. However, it is difficult to comprehend two as the most effective number of sessions because Park [31] first conducted face-to-face coaching and then non-face-to-face coaching, but studied only the effectiveness of non-face-to-face coaching. Therefore, based on the results of this study, the effect size increases to some extent as the number of coaching sessions increases.
Our results align with those of Theeboom et al. [49], indicating that as the coaching period and the number of coaching sessions increase, we see larger effects in the results at the individual level, such as goal achievement, self-efficacy, and quality of life. Regarding the coaching period, a study by Grant [50] compared participants who received coaching for 16 weeks with those who received coaching for 32 weeks. The study’s results indicated that participants coaching for 32 weeks saw higher effects on goal achievement and mental health. Therefore, coaching effects increase along with the coaching period.
On the other hand, when we examined the coaching period in our study, there was no significant difference in the effect between 12 weeks and 48 weeks, but the effect for 48 weeks was smaller than for 12 weeks. Therefore, although the coaching period should be sufficiently continuous and long, there might be a reduced effect in cases where the coaching period is excessively long. The preceding shows the importance of conducting non-face-to-face coaching appropriately and consistently. In cases where a client wishes to achieve goals through coaching, coaches should adequately adjust the period and number of non-face-to-face coaching sessions to obtain effective results.

5. Limitation

Despite the recent application of various non-face-to-face coaching methods, the present study reviewed research on non-face-to-face coaching in South Korea. However, since studies related to non-face-to-face coaching in South Korea are insufficient, there may be limitations in generalizing the results of the meta-analysis of studies to non-face-to-face coaching. Therefore, future investigations should supplement the present research through follow-up studies as more studies on non-face-to-face coaching accumulate. In addition, this study’s qualitative analysis of the literature was narrow. Hence, future research should conduct a qualitative analysis of the study subjects. Finally, regarding the effects of non-face-to-face coaching, future research should add a meta-analysis of qualitative studies with only qualitative research papers, thereby adding various meta-studies related to non-face-to-face coaching.

6. Conclusions

This study obtained the following conclusions through meta-analyses of the effects of non-face-to-face coaching. First, even though the meta-analyses showed that the effect size of non-face-to-face coaching was large, various experimental studies on additional non-face-to-face coaching are needed. Second, the meta-analyses showed that in non-face-to-face coaching, cognitive and psychological effects were relatively higher than physical effects. Third, the effects were different depending on the types of non-face-to-face coaching. Web-based online coaching showed a higher effect size than telephone coaching. Fourth, the meta-analyses showed that the effect size of non-face-to-face coaching was relatively large for subjects with a high level of vulnerability. Fifth, the meta-analyses showed that the period and number of sessions of non-face-to-face coaching affected the size of the effect of coaching.
We expect the results of this study to provide meaningful data for the vitalization of non-face-to-face coaching in South Korea. Coaching relies heavily on various forms of communication and technology, and coaching places and forms can apply coaching methods differently from traditional ones, thus, coaching skills and methods are innovative [51]. Furthermore, as non-face-to-face activities inevitably increased due to COVID-19, coaching is also progressing considerably by using the non-face-to-face method. Therefore, researchers should continuously study and develop coaching to pursue innovation according to change, while remaining faithful to the basics, to solve the complexity of individuals and relationships.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/su15129727/s1, Table S1: PRISMA Checklist, Table S2: Quality assessment.

Author Contributions

Data curation, Y.K.; formal analysis, S.L.; methodology, Y.K.; validation, S.L.; writing—original draft, Y.K. and S.L.; writing—review & editing, Y.K. and S.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data from the study are available upon request.

Conflicts of Interest

The authors declare no conflict of interest.

Pre-Registration

We prospectively registered a protocol of our meta-analysis in the International Prospective Register of Systematic Reviews CRD42023429447 on 5 June 2023.

References

  1. Kim, J.Y.; Lee, Y.H. The trend and issues on untact counseling and psychotherapy: Focusing on journal papers (2010–2020.6). J. Learn. Cent. Curric. Instr. 2021, 21, 775–805. [Google Scholar] [CrossRef]
  2. Bennett, H.D.; Coleman, E.A.; Parry, C.; Bodenheimer, T.; Chen, E.H. Health coaching for patients with chronic illness. Fam. Pract. Manag. 2010, 17, 24–29. [Google Scholar]
  3. Berry, R.M.; Ashby, J.S.; Gnilka, P.B.; Matheny, K.B. A comparison of face-to-face and distance coaching practices: Coaches’ perceptions of the role of the working alliance in problem resolution. Consult. Psychol. J. Pract. Res. 2011, 63, 243. [Google Scholar] [CrossRef]
  4. Geissler, H.; Hasenbein, M.; Kanatouri, S.; Wegener, R. E-coaching: Conceptual and empirical findings of a virtual coaching programme. Int. J. Evid.-Based Coach. Mentor. 2014, 12, 165–187. [Google Scholar]
  5. Geißler, H. E-coaching: An overview. In International Handbook of Evidence-Based Coaching: Theory, Research and Practice; Springer: Berlin/Heidelberg, Germany, 2022; pp. 269–280. [Google Scholar]
  6. Ribbers, A.; Waringa, A. E-Coaching: Theory and Practice for a New Online Approach to Coaching; Routledge: Oxfordshire, UK, 2015. [Google Scholar]
  7. Drake, L.M. Two Kinds of Presence: A Comparative Analysis of Face-to-Face and Technology-Based Mediated Communication Methods and the Executive Coaching Experience. Doctoral Dissertation, Fielding Graduate University, Santa Barbara, CA, USA, 2015. [Google Scholar]
  8. Dwinger, S.; Dirmaier, J.; Herbarth, L.; König, H.-H.; Eckardt, M.; Kriston, L.; Bermejo, I.; Härter, M. Telephone-based health coaching for chronically ill patients: Study protocol for a randomized controlled trial. Trials 2013, 14, 337. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  9. Yousuf, H.; Reintjens, R.; Slipszenko, E.; Blok, S.; Somsen, G.A.; Tulevski, I.I.; Hofstra, L. Effectiveness of web-based personalised e-coaching lifestyle interventions. Neth. Heart J. 2019, 27, 24–29. [Google Scholar] [CrossRef] [Green Version]
  10. Allemand, M.; Flückiger, C. Personality change through digital-coaching interventions. Curr. Dir. Psychol. Sci. 2022, 31, 41–48. [Google Scholar] [CrossRef]
  11. Kettunen, E.; Kari, T.; Frank, L. Digital coaching motivating young elderly people towards physical activity. Sustainability 2022, 14, 7718. [Google Scholar] [CrossRef]
  12. Akinosun, A.S.; Polson, R.; Diaz-Skeete, Y.; De Kock, J.H.; Carragher, L.; Leslie, S.; Grindle, M.; Gorely, T. Digital technology interventions for risk factor modification in patients with cardiovascular disease: Systematic review and meta-analysis. JMIR mHealth uHealth 2021, 9, e21061. [Google Scholar] [CrossRef]
  13. Gershkowitz, B.D.; Hillert, C.J.; Crotty, B.H. Digital coaching strategies to facilitate behavioural change in type 2 diabetes: A systematic review. J. Clin. Endocrinol. Metab. 2021, 106, e1513–e1520. [Google Scholar] [CrossRef]
  14. Bevilacqua, R.; Casaccia, S.; Cortellessa, G.; Astell, A.; Lattanzio, F.; Corsonello, A.; Maranesi, E. Coaching through technology: A systematic review into efficacy and effectiveness for the ageing population. Int. J. Environ. Res. Public Health 2020, 17, 5930. [Google Scholar] [CrossRef]
  15. Lambert, S.D.; Grover, S.; Laizner, A.M.; McCusker, J.; Belzile, E.; Moodie, E.E.; Kayser, J.W.; Lowensteyn, I.; Vallis, M.; de Raad, M. Adaptive web-based stress management programs among adults with a cardiovascular disease: A pilot sequential multiple assignment randomized trial (SMART). Patient Educ. Couns. 2022, 105, 1587–1597. [Google Scholar] [CrossRef] [PubMed]
  16. Thielecke, J.; Buntrock, C.; Titzler, I.; Braun, L.; Freund, J.; Berking, M.; Baumeister, H.; Ebert, D.D. Telephone coaching for the prevention of depression in farmers: Results from a pragmatic randomized controlled trial. J. Telemed. Telecare 2022. [Google Scholar] [CrossRef]
  17. Yang, W.; Huang, R.; Su, Y.; Zhu, J.; Hsieh, W.; Li, H. Coaching early childhood teachers: A systematic review of its effects on teacher instruction and child development. Rev. Educ. 2022, 10, e3343. [Google Scholar] [CrossRef]
  18. Kim, Y.C. Domestic Coaching Performance and Challenges: An Exploratory Study. J. Korean Coach. Res. 2020, 13, 49–68. [Google Scholar] [CrossRef]
  19. Kim, S.H.; Lee, J.H.; Koh, K.W.; Ha, H.B. Effects of low intensity exercise program with telephone coaching on physical fitness in the elderly served home visiting nursing care. Korean Acad. Fundam. Nurs. 2008, 15, 457–466. [Google Scholar]
  20. Kim, K.A. Development and Effectiveness of Non-face-to-face Coaching-based University Extracurricular Programs—Focusing on S Women’s University. Korean J. Gen. Educ. 2022, 16, 405–420. [Google Scholar] [CrossRef]
  21. Choi, H.; Sunwoo, H.; Kim, J. A study on the experience on non-face-to-face parenting coaching for mothers based on child-directed interaction skills on parent-child interaction therapy. J. Humanit. Soc. Sci. 2021, 12, 715–729. [Google Scholar]
  22. Lee, S.Y.; Shim, T.E.; Yoo, Y.E. Perceptions of experience of online coaching for college students’ career planning. Stud. Educ. Eval. 2022, 75, 101201. [Google Scholar] [CrossRef]
  23. Kang, H. Statistical considerations in meta-analysis. Hanyang Med. Rev. 2015, 35, 23–32. [Google Scholar] [CrossRef] [Green Version]
  24. Cooper, H. Research Synthesis and Meta-Analysis: A Step-by-Step Approach; Sage Publications: New York, NY, USA, 2016; Volume 2. [Google Scholar]
  25. Moher, D.; Liberati, A.; Tetzlaff, J.; Altman, D.G. The PRISMA Group, Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLos Med. 2009, 6, e1000097. [Google Scholar] [CrossRef] [Green Version]
  26. Santabarbara, J.; Idoiaga, N.; Ozamiz–Etxebarria, N.; Bueno–Notivol, J. Prevalence of anxiety in dental students during the COVID-19 outbreak: A meta-analysis. Int. J. Environ. Res. Public Health 2021, 18, 10978. [Google Scholar] [CrossRef]
  27. Cho, Y.Y. The Effects of Online Academic Coaching Program for Undergraduate Student on Self-Directed Learning, Academic Motivation and Time Management. Master’s Thesis, Chung-Ang University, Seoul, Republic of Korea, 2021. [Google Scholar]
  28. You, S.W. The Effectiveness of Smart Media-Based Coaching to Improve Smartphone Overdependence. J. Korean Coach. Res. 2021, 14, 127–156. [Google Scholar] [CrossRef]
  29. Kim, H.Y.; Goh, S.H.; Yang, S.J.; Yoon, B.W.; Tak, J.K. The Effects of Online Coaching Program on Improving Eating Habit Behaviours. Korean J. Coach. Psychol. 2021, 5, 1–32. [Google Scholar] [CrossRef]
  30. Lee, A.K.; Kim, E.J.; Oh, K.H.; Kim, S.M.; Park, S.M.; Tak, J.K. The Effects of Online Coaching Program on Improving Procrastination Habit Behaviours. Locality Glob. Korean J. Soc. Sci. 2021, 45, 33–62. [Google Scholar]
  31. Park, H.E. The effects of snack control education and telephone coaching on self- management, social support, self-efficacy, and blood glucose in diabetes patients. J. Korean Diabetes 2021, 22, 274–283. [Google Scholar] [CrossRef]
  32. Oh, E.Y. Effectiveness of Early Cognitive Training and Tailored Telephone Coaching Program for Ischemic Stroke. J. Digit. Converg. 2020, 18, 195–205. [Google Scholar]
  33. Lee, J.H.; Kim, S.H. The effects of low intensity exercise program with telephone coaching on physical fitness and physiological index in the elderly women in home visiting health program. Korean Acad. Soc. Nurs. Educ. 2016, 22, 345–354. [Google Scholar] [CrossRef] [Green Version]
  34. Hong, S.Y. A Study on the Effects of a Telephone-Based Health Coaching Program on Mothers of Children with Atopic Dermatitis. Master’s Thesis, Ajou University, Suwon, Republic of Korea, 2016. [Google Scholar]
  35. Kim, Y.J.; Lee, J.H. The effects of a physical activity promotion programs with telecoaching negotiation on physical fitness and quality of life in the frail elderly. Korean Acad. Community Health Nurs. 2009, 20, 391–402. [Google Scholar]
  36. Becker, B.J. Synthesizing standardized mean-change measures. Br. J. Math. Stat. Psychol. 1988, 41, 257–278. [Google Scholar] [CrossRef]
  37. Cohen, J. Statistical Power Analysis for the Behavioural Sciences, 2nd ed.; Erlbaum: Hillsdale, NJ, USA, 1988. [Google Scholar]
  38. Shim, S.; Bae, J.M.; Shin, I.S. Intervention meta-analysis using STATA software. J. Health Inform. Stat. 2016, 41, 123–134. [Google Scholar] [CrossRef]
  39. Duval, S.; Tweedie, R. Trim and fill: A simple funnel-plot–based method of testing and adjusting for publication bias in meta-analysis. Biometrics 2000, 56, 455–463. [Google Scholar] [CrossRef] [PubMed]
  40. Hwang, S.D. Meta-Analysis Using R; Hakjisa: Seoul, Republic of Korea, 2019. [Google Scholar]
  41. Lo, J.; Ballurkar, K.; Fox, S.; Tynan, K.; Luu, N.; Boyer, M.; Murali–Ganesh, R. A digital coaching intervention for cancer survivors with job loss: Retrospective study. JMIR Cancer 2021, 7, e31966. [Google Scholar] [CrossRef]
  42. Jones, R.J.; Woods, S.A.; Guillaume, Y.R. The effectiveness of workplace coaching: A meta-analysis of learning and performance outcomes from coaching. J. Occup. Organ. Psychol. 2016, 89, 249–277. [Google Scholar] [CrossRef]
  43. van Veen, E.; Bovendeert, J.F.; Backx, F.J.; Huisstede, B.M. E-coaching: New future for cardiac rehabilitation? A systematic review. Patient Educ. Couns. 2017, 100, 2218–2230. [Google Scholar] [CrossRef]
  44. Zhang, X.X.; Xulong, X.X. MetaSpeech: Speech effects switch along with environment for metaverse. arXiv 2022, arXiv:2210.13811. [Google Scholar]
  45. Schouten, D.G.; Massink, P.; Donker, S.F.; Neerincx, M.A.; Cremers, A.H. Using scaffolding to formalize digital coach support for low-literate learners. User Model. User-Adapt. Interact. 2021, 31, 183–223. [Google Scholar] [CrossRef]
  46. Norcross, J.C.; Wampold, B.E. Evidence-based therapy relationships: Research conclusions and clinical practices. Psychotherapy 2011, 48, 98–102. [Google Scholar] [CrossRef]
  47. Mahdaria, S.; Restuaji, T.A. The effectiveness of online coaching through social networking site: A case study of coach potato Indonesia. ELS J. Interdiscip. Stud. Humanit. 2021, 4, 178–187. [Google Scholar] [CrossRef]
  48. Stara, V.; Santini, S.; Kropf, J.; D’Amen, B. Digital health coaching programs among older employees in transition to retirement: Systematic literature review. J. Med. Internet Res. 2020, 22, e17809. [Google Scholar] [CrossRef]
  49. Theeboom, T.; Beersma, B.; van Vianen, A.E. Does coaching work? A meta-analysis on the effects of coaching on individual level outcomes in an organizational context. J. Posit. Psychol. 2014, 9, 1–18. [Google Scholar] [CrossRef]
  50. Grant, A.M. The impact of life coaching on goal attainment, metacognition and mental health. Soc. Behav. Personal. Int. J. 2003, 31, 253–263. [Google Scholar] [CrossRef]
  51. Abravanel, M.; Gavin, J. Exploring the evolution of coaching through the lens of innovation. Int. J. Evid. Based Coach. Mentor. 2017, 15, 24. [Google Scholar]
Figure 1. Process to select papers for research: PRISMA flow diagram.
Figure 1. Process to select papers for research: PRISMA flow diagram.
Sustainability 15 09727 g001
Figure 2. Funnel plot of standard error by Fisher’s Z.
Figure 2. Funnel plot of standard error by Fisher’s Z.
Sustainability 15 09727 g002
Table 1. Studies’ details.
Table 1. Studies’ details.
No.ResearcherEffect SizePaper TypeLeading VariableDependent VariableSubjectAge of Subject (Years)Experimental GroupControl GroupCoaching PeriodNumber of Times in CoachingType
1Cho, Y.Y. (2021) [27]0.896DissertationOnline Coaching (Web-Based)
Self-Management
Motivation
College Student20 s7977One-on-one online
2Ryu, S.W. (2021) [28]0.769Journal PaperTelephone Coaching
Self-Management
Ordinary Person20 s–60 s202088Utilizing a VR headset, smart band
3H.Y. Kim et al. (2021) [29]0.803Journal PaperOnline Coaching (Web-Based)
Self-Management
Self-Efficacy
Life Satisfaction
Physical Health
Ordinary Person20 s~40 s8988One-on-one online
4A.K. Lee et al. (2021) [30]1.367Journal PaperOnline Coaching (Web-Based)
Self-Efficacy
Self-Management
Life Satisfaction
Ordinary Person20 s~40 s10688One-on-one online
5Park, H.E. (2021) [31]1.545Journal PaperTelephone Coaching
Self-Management
Psychological Health
Self-Efficacy
Physical Health
Type 2 Diabetic 60 s2828122One-on-one phone call
6Oh, E.Y. (2020) [32]1.367Journal PaperTelephone Coaching
Psychological Health
Cognitive Function
Executive Function
Patient with Ischemic Stroke 60 s~70 s15134816One-on-one phone call
7Lee, J.H. & Kim, S.H. (2016) [33]0.461Journal PaperTelephone Coaching
Physical Strength
Physical Health
Elderly Woman 60 s or older16221611One-on-one phone call
8Hong, S.Y. (2016) [34]0.313DissertationTelephone Coaching
Psychological Health
Self-Efficacy
Self-Management
Female 30 s~40 s3537108One-on-one phone call
9Kim, Y.J. & Lee, J.H. (2009) [35]0.644Journal PaperTelephone Coaching
Physical Strength
Psychological Health
Physically Weak Elderly 60 s or older2726108One-on-one phone call
10S.H. Kim et al. (2008) [19]0.320Journal PaperTelephone Coaching
Physical Strength
Ordinary Person60 s or older16271610One-on-one phone call
Table 2. Duval and Tweedie’s trim and fill.
Table 2. Duval and Tweedie’s trim and fill.
Fixed EffectsRandom EffectsQ Value
Studies TrimmedPoint EstimateLower LimitUpper LimitPoint EstimateLower LimitUpper Limit
Observed Values 0.698660.603670.793650.775200.611230.93918151.68911
Adjusted Values30.738870.646210.831530.814490.651670.97731165.89359
Table 3. Homogeneity test.
Table 3. Homogeneity test.
ModelQ-Valuedf (Q)p-ValueI-Squared
Fixed151.698540.00064.401
Table 4. Effect sizes by paper type.
Table 4. Effect sizes by paper type.
DivisionkdSE95% CI
LLUL
Journal Paper480.8090.0930.6260.992
Dissertation 70.6700.0740.5250.816
Notes: k, number of samples; d, Cohen’s d effect size; SE, standard error; 95% CI; 95% confidence interval; LL, lower limit; UL, upper limit.
Table 5. Overall effect size, random effects analysis.
Table 5. Overall effect size, random effects analysis.
kES95% CIQ-Valuedfp-ValueI2
LowerUpper
550.7750.61110.939151.639540.00064.401
Note: k, number of cases of effect sizes; ES, effect size; Q, observed variance of each effect size; df, degree of freedom; I2, heterogeneity (ratio of actual variance to total variance).
Table 6. Non-face-to-face coaching effect size.
Table 6. Non-face-to-face coaching effect size.
DivisionkdSE95% CI
LLUL
Psychological Effect240.9430.1330.6821.205
Psychological Health
41.1280.4560.2342.022
Motivation
20.6060.364−0.1081.320
Life Satisfaction
20.6150.579−0.5191.749
Self-Management
120.8410.1310.5851.097
Self-Efficacy
41.0890.4970.1152.063
Cognitive Effect81.4940.3150.2910.565
Cognitive Function
61.7920.3661.0762.509
Executive Function
20.6560.2760.1161.197
Physical Effect230.4280.0700.2910.565
Physical Health
60.5510.2370.0861.016
Physical Strength
170.3770.0780.2230.531
Notes: k, number of samples; d, Cohen’s d effect size; SE, standard error; 95% CI; 95% confidence interval; LL, lower limit; UL, upper limit.
Table 7. Effect size by type of coaching.
Table 7. Effect size by type of coaching.
DivisionkdSE95% CI
LLUL
Online (Web-Based) Coaching130.9140.1700.5811.247
Telephone Coaching420.7440.0940.5590.929
Notes: k, number of samples; d, Cohen’s d effect size; SE, standard error; 95% CI; 95% confidence interval; LL, lower limit; UL, upper limit.
Table 8. Effect sizes by the level of vulnerability coachees.
Table 8. Effect sizes by the level of vulnerability coachees.
Division kdSE95% CI
LLUL
High Vulnerability181.0410.0810.8821.199
Persons with Diabetes
41.4810.1531.1811.782
Persons with Ischemic Stroke
91.2210.1420.9421.501
Physically Weak Elderly
50.5880.1280.3370.838
Medium Vulnerability120.3890.0950.2030.576
Child Patient’s Mother
30.3130.1370.0440.581
Female Elderly
90.4610.1330.2010.721
Low Vulnerability250.5860.0780.4320.740
Ordinary Person
210.5570.0820.3960.718
College Student
40.8960.2660.3751.4162
Notes: k, number of samples; d, Cohen’s d effect size; SE, standard error; 95% CI; 95% confidence interval; LL, lower limit; UL, upper limit.
Table 9. Effect size by coaching period and time.
Table 9. Effect size by coaching period and time.
DivisionkdSE95% CI
LLUL
Coaching Period (weeks)
Seven Weeks
40.8960.22603751.416
Eight Weeks
130.8430.1390.5711.115
Ten Weeks
80.5020.1630.1830.822
12 Weeks
41.5450.3220.9132.178
16 Weeks
170.3790.0860.2110.547
48 Weeks
91.3670.2960.7861.949
Number of Times Per Week
0.160 Times
41.5450.3220.9132.178
0.330 Times
91.3670.2960.7861.949
0.620 Times
80.3200.1120.1000.541
0.680 Times
90.4610.1330.2010.721
0.800 Times
80.5020.1630.1830.822
1.000 Times
170.8420.1120.6221.062
Total Number of Times
Two Times
41.5450.3220.9132.178
Seven Times
40.8960.2660.3751.416
Eight Times
80.3200.1120.1000.541
Ten Times
90.4610.1330.2010.721
11 Times
90.4610.1330.2010.721
16 Times
91.3670.2960.7861.949
Time Per Session
15 min
50.6440.2790.0981.190
20 min
90.4610.1330.2010.721
30 min
240.8790.1470.5901.167
60 min
130.8430.1390.5711.115
80 min
40.8960.2660.3751.416
Notes: k, number of samples; d, Cohen’s d effect size; SE, standard error; 95% CI; 95% confidence interval; LL, lower limit; UL, upper limit.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Kim, Y.; Lee, S. A Systematic Review and Meta-Analysis of the Effectiveness of Non-Face-to-Face Coaching. Sustainability 2023, 15, 9727. https://doi.org/10.3390/su15129727

AMA Style

Kim Y, Lee S. A Systematic Review and Meta-Analysis of the Effectiveness of Non-Face-to-Face Coaching. Sustainability. 2023; 15(12):9727. https://doi.org/10.3390/su15129727

Chicago/Turabian Style

Kim, Yucheon, and Songyi Lee. 2023. "A Systematic Review and Meta-Analysis of the Effectiveness of Non-Face-to-Face Coaching" Sustainability 15, no. 12: 9727. https://doi.org/10.3390/su15129727

APA Style

Kim, Y., & Lee, S. (2023). A Systematic Review and Meta-Analysis of the Effectiveness of Non-Face-to-Face Coaching. Sustainability, 15(12), 9727. https://doi.org/10.3390/su15129727

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop