A Prototype for Monitoring the Continuing Education of Indigenous Health Professionals: A Study with the Indigenous Health Secretariat of the Brazilian Ministry of Health

Abstract

This study proposes a prototype (Business Intelligence) for monitoring the continuing education of indigenous health professionals in the Secretariat of Indigenous Health (SESAI) of Brazil’s Ministry of Health (MS). The prototype builds on SESAI/MS staff knowledge and takes into account the characteristics and demands of the 34 Special Indigenous Health Districts (DSEIs). The prototype provides information for managing SESAI/MS continuing education in order to meet strategic goals. By improving the effectiveness and efficiency of the continuing education of professionals who serve Brazil’s indigenous population, we will be acting directly on access issues and improving the quality of life of the indigenous population.

1. Introduction

Staff continuing education is a permanent demand in public organizations and is fundamental for keeping healthcare professionals qualified, motivated, and well-supported, which directly impacts the health sector performance [1,2]. But continuing education can be complex and involve different demands, such as improving services, keeping up with new procedures and technologies, or simply training new personnel [3]. If health training is complex enough, then imagine the challenge of training professionals who work in indigenous healthcare, which involves different languages, cultures, rituals, and traditions, and where ancient indigenous knowledge of healthcare practices needs to be harmonized with conventional medical practices [4,5,6].

Given these unique features and challenges, it is essential to maintain continuing education for these professionals in order to increase the effectiveness of the services provided in terms of indigenous healthcare. This requires integrating universal healthcare knowledge with indigenous customs and knowledge [7]. While improvements in indigenous peoples’ healthcare indicators have been observed in Brazil [8], many obstacles still need to be overcome, such as communication and training for healthcare professionals [9], among other aspects. Professionals need to gain qualifications and participate in continuing education activities to overcome the difficulties encountered in healthcare for indigenous peoples [10].

Previous studies point out the relevance of cultural knowledge in healthcare [11,12]. The prominence of this issue is also a reality in Brazil, considering that indigenous people possess a significant social diversity, comprising 305 ethnic groups who speak 274 languages [13]. This underscores the need for specialized healthcare training that respects indigenous peoples’ ethnic, cultural, and linguistic specificities [14,15]. Both the Federal Constitution of Brazil [16] and the 2008 United Nations Declaration [17] establish that these original peoples have the right to access all healthcare services without suffering discrimination. To achieve this, it is essential to recognize these populations’ specificities and to adapt the healthcare system to these needs [18].

Brazil has the Secretariat of Indigenous Health (SESAI), linked to the Ministry of Health (MS), which is responsible for coordinating and executing the National Healthcare Policy for Indigenous Peoples, and for managing the Indigenous Healthcare Subsystem (SasiSUS) within the Unified Health System (SUS). To address this breadth and diversity, Brazil possesses decentralized management units, i.e., 34 Special Indigenous Health Districts (DSEIs). Each of the 34 DSEIs has local and district councils formed by managers with a central role in implementing indigenous healthcare policies and services [19,20]. Brazil has approximately 1.7 million indigenous people [21], and the DSEIs collectively delivered more than 53.7 million healthcare procedures to this population between 2019 and 2022, which underscores their importance [22]. SESAI/MS has over 22,000 healthcare professionals, 52% of whom are indigenous. It is responsible for providing continuing education to healthcare professionals and for enabling healthcare services to take place in a participatory and differentiated manner, respecting these peoples’ epidemiological and sociocultural specificities [23].

Considering these specificities, indigenous healthcare management requires continuing education monitoring models that are more holistic from the planning stage. These models should consider staff training needs regarding local cultural diversity [24]. The complexity of educational processes with different cultural values becomes a management challenge, requiring the improvement of training instruments in DSEIs across Brazil [25]. To provide answers to this problem, this study proposes a prototype Business Intelligence (BI) system for monitoring the continuing education of indigenous health professionals in the Secretariat of Indigenous Health (SESAI) of Brazil’s Ministry of Health. BI systems have become management tools that address the complexity of human capital within organizations, standing out primarily for their ability to analyze vast datasets and uncover patterns and insights related to professional profiles and work performance [26]. Several studies have adopted BI as a tool for obtaining up-to-date, real-time data, optimizing decision-making across various aspects. It can also be used as an interface for health applications that provide continuous feedback [27,28]. BI integrates operational data with analytical tools to produce relevant information for managers, business executives, and planners [29,30,31]. Its main goal is to improve the timeliness and quality of data used in decision-making processes. BI tools continue to evolve, incorporating advanced analytics such as machine learning and artificial intelligence. Currently, the focus is on generating real-time information, with increasing integration of cloud computing [29,31].

Previous studies reveal that the informational efficiency and timeliness promoted by BI have the potential to transform and optimize healthcare services by generating rapid information; preventing adverse events; predicting treatment outcomes; and providing personalized, evidence-based care [27,32]. The efficiency promoted by BI is confirmed in public health by providing information that ensures equity and quality in services. This is made possible through integrated, trained teams with well-defined workflows, promoted by continuous education [33,34]. In public health, many factors must be considered, including ensuring quality care, which is achieved through continuous education in healthcare. This promotes the training of professionals in their workplace, helping to provide specialized care according to the specific needs of each population, thereby ensuring better workplace management [33].

This prototype is expected to establish a tool that provides indicators to manage continuing education at SESAI/MS in order to meet the strategic goals established. To that end, we resorted to previous literature that shows that using BI techniques can be a viable solution for complex management problems, a solution that has brought beneficial results in several areas, including healthcare. The use of BI can contribute to operational efficiency, resource optimization, and management improvements [26,27] as it facilitates overcoming the challenges faced by indigenous communities. Therefore, by proposing to monitor the continuing education of healthcare professionals who serve Brazil’s indigenous population, we will be dealing directly with aspects that can reduce health inequalities, such as a greater understanding of indigenous culture, which improves indigenous healthcare [28].

2. Materials and Methods

This is a case study, guided by the Consolidated Criteria for Reporting Qualitative Research [29].

2.1. Breadth of Business Intelligence

Continuing Education in Health (PEH) is a process of ongoing training for health professionals, established as a state policy in Brazil in 2004. PEH is essential for improving the work of health professionals but faces challenges such as a lack of resources and inadequate planning [29]. Planning can be enhanced with automated management mechanisms, such as BI.

Business Intelligence (BI) can assist in managing continuing education in health by enabling the collection and analysis of data on the training needs of professionals and by identifying gaps and opportunities for improvement in the educational process [30]. With data-driven insights, managers can optimize resources and plan more effective PEH) strategies, aligned with the actual demands of services and the population.

This study proposes the development of a prototype based on the knowledge of SESAI staff and takes into account the characteristics and demands of the DSEIs, Indigenous Health Support Houses (CASAIs), and the Work Management and Health Education Division (DIGED). It was designed for national-level application, aiming to serve the 34 DSEIs, which are strategically divided across the Brazilian territory, considering the geographic distribution of indigenous communities, as highlighted in colors in Figure 1. It is important to emphasize that the 34 districts represent the total number of units in the country that will use the proposed model, which has been validated by the senior management of the Ministry of Health.

2.2. Participants

The activities conducted from 1 January 2024 to 12 July 2024 at the Ministry of Health’s Secretariat of Indigenous Health (SESAI/MS) were aimed at improving the monitoring of training and continuing education provided to SESAI/MS personnel. The team who created the prototype is made up of 4 researchers from a Brazilian federal university and 4 employees from the Ministry of Health. The employees from the Ministry of Health SESAI/MS are training area managers, professionals responsible for organizing, responding to demands, and offering continuing education courses for the 22,000 health professionals working across the country. The university’s researchers, who are experts in management and technology and work in continuing education programs in health, are responsible for managing courses for the Ministry of Health.

Documents relating to courses already offered to staff were also used to scale the components and metrics for creating the prototype (BI). These participants were strategically selected due to their skills, and they are directly involved in the monitoring process and continuing education.

2.3. Data Base and Process

The prototype development process used information from meetings with those responsible for the continuing education process as well as document analysis (strategic goals, course sheets, etc.) and interviews with managers. The prototype building process consists of 3 stages: (1) goal-setting, (2) development, and (3) validation. The first stage (goal-setting) used brainstorming with SESAI/MS managers to understand the problems and receive course demands. The second stage (prototype development) was carried out to build a BI prototype. Meetings were held between the university’s research team and SESAI/MS managers to build and validate the dashboard structure, and BI usability tests were also carried out. There was considerable feedback and several adjustments at this stage. The third stage (prototype validation) involved presenting the adjusted dashboards and validating the prototype along with the DIGED managers and the CGPROJ team.

Two interviews were also conducted with the managers responsible for the prototype development process at SESAI/MS. The interviews helped to understand how BI can meet the monitoring requirements of continuing education and thus be useful in decision-making. The interviews allowed capturing problems and improvement opportunities from the interviewees. They also enabled the validation of the prototype during its building process. As a result, the interviews generated important feedback, which allowed for improvements to the prototype.

3. Results and Discussion

The study developed a BI prototype for monitoring continuing education for SESAI/MS. The prototype was designed to improve healthcare managers’ work and assist in monitoring and evaluating the continuing education of indigenous health professionals. The prototype was developed in three macro stages as presented below.

3.1. Stage 1—Goal-Setting

In this stage, brainstorming, collective meetings, and document analysis were conducted in addition to interviews with managers to identify the motivations for building the prototype. As a result, demand was found to arise from several aspects, such as: staff turnover, cultural diversity, lack of systematized training management, a need for qualitative information on the results achieved through the training provided, the unique characteristics of the services provided to the indigenous population, financial responsibility, among others. For illustration purposes, we transcribed some excerpts from the interviews with managers about the motivations for building the BI. The interviewees state that having a space to integrate information is important:

INTERVIEW 1: “…we already have listening time, there’s space for that already, but we don’t have a tool that guarantees that we can see where we need alignment…”

INTERVIEW 2: “… I think that a tool that centralizes, categorizes, and standardizes can help SESAI find this direction and even standardize it…”

The interviewees also express their concern about cultural specificities, which are relevant considerations:

INTERVIEW 1: “…The indigenous population has a great uniqueness and cultural wealth. So, any and all training must take that into account…. listen to these people, because we would add much more effectiveness to our training, because they have a cultural wealth and knowledge that will add a lot to us….”

INTERVIEW 2: “…the main difference is precisely the cultural aspect in terms of understanding indigenous medicine. What we understand as traditional medicine and the practices of this medicine, care practices, and indigenous medicine. So, this understanding is relevant for training management…”

Interviewees also point out aspects like skills mapping and turnover problems as relevant topics that should be better managed:

INTERVIEW 1: “…mapping the necessary skills and abilities, we need to map this and have it in one place… the matrices of skills and abilities that we’ll be able to develop…” “…turnover gets in the way and increasingly demands that we can have better training in what was received in initial training and continuing its processes through a training path…

INTERVIEW 2: “…our biggest problem is this, because we’re not following up, not monitoring, we don’t know who’s been trained, what type of training was done, what the goal was in order to understand results and impact and then see whether turnover’s a problem or not.”

Considering these motivations and based on the concepts discussed with the SESAI management group about the form and content of a monitoring platform, this study built a monitoring prototype based on a business intelligence platform. A BI approach was chosen in order to improve the management and allocation of resources for the training of healthcare professionals, corroborating the findings of [27].

3.2. Stage 2—Prototype Development

The prototype was developed through a process structured in two phases: 1st—data input, and 2nd—dashboard processing and creation, as shown in Figure 2. In the Data Input phase, internal documents (course monitoring spreadsheet, people registration spreadsheet, and training evaluation response spreadsheet) with data on the training of health professionals were analyzed.

The second phase was carried out by the dedicated team and included treating and creating the dashboard. The tasks consist of treating the data, creating the dashboards, a validation process with the SESAI/MS team and, finally, sharing. The prototype presented here was developed through a process structured in two phases, as described below in Figure 2.

The dashboards allow both quantitative (

Table 1. Dashboards structure—quantitative data.

Dashboard 1—Quantitative
Indicator	Usefulness/Justification
Training quantity	Allows quickly viewing the number of training courses executed and planned.
Number of completers	Allows quickly identifying the reach that the project is having and, consequently, the number of people certified.
Number of training courses by modality	Allows checking whether the designed strategy is being carried out (achieved).
Completers by modality	Shows the number of completers by course type (face-to-face, synchronous, and asynchronous courses).
List of courses (target, enrollees, and completers)	Allows quickly viewing the courses and topics already offered or planned, and courses that have been completed, by showing the number of enrollees and completers.
List of courses with interactive details (date, workload, % completion, modality, teachers, and content)	The details allow understanding the course breadth (hours and content). It also shows the proportion of people who enroll and do not complete a course, allowing for timely corrective actions.
Participants by target audience	Allows analysis of whether only the central administration is being trained or whether the training also covers operational employees (DSEIs). Also, given the variety of activities carried out by DSEIs, this indicator shows whether all these different functions are being covered.
Participants in training by DSEI	Shows the level (e.g., district, region, or national) that courses are reaching.
Filter	Usefulness/Justification
Course	Allows filtering all information about a given course, such as target audience, region of the country, course modality, number of participants, completers, and content, etc.
Target	Allows filtering all information about a given target, such as courses linked to this goal, target audience, region of the country, course modality, number of participants, completers, and content, etc.
Modality	Allows filtering information by type of course (face-to-face, synchronous, and asynchronous).

and Figure 2) and qualitative (

Table 2. Dashboard structure—quantitative data.

Dashboard 2—Qualitative
Indicator	Usefulness/Justification
Number of reviews	Allows viewing whether participants are voluntarily evaluating courses in order to generate feedback.
Number of courses evaluated	Shows the number of training courses completed and generates a list of evaluations by course.
Average score for evaluations of trainers, teaching resources, content, and facility	Each average score card allows identifying the general quality of each analysis construct and evaluating the quality/excellence achieved by the course, while also identifying correction aspects if the averages are not at the expected performance.
Average score for general results	In the same way as the other cards, the average score of the general results aims to identify numerically (a score from 0 to 10) the quality of training. However, this card summarizes participants’ perception in relation to the other constructs evaluated.
List of training evaluations (course and average score by question)	This table identifies the average scores by question evaluated, thus allowing specific analysis of which question may have pushed the average (up or down). For example, if the facility received poor ratings, it is necessary to understand whether it was due to its lighting, air conditioning, or another aspect.
Word cloud	The word cloud provides an idea of whether participants are bringing more positive or negative words in relation to the general perception of courses.
Assessment questions	Allows viewing each (qualitative) evaluation question answered by course participants.
Filter	Usefulness/Justification
Course	Allows filtering all information about course punctuality, such as the average score a course obtained and what set of words describe it.
Target	Allows filtering all information by course target, subdivided by targets that can be translated into themes.
Modality	Allows analysis of how course quality is received and perceived in relation to the modality offered (face-to-face, synchronous, and asynchronous).
Race/color	Allows filtering all information by the race/color of trained professionals.

and Figure 3) monitoring and provide additional data (Figure 4 and Figure 5). This allows monitoring of information about the continuing education carried out at SESAI/MS.

Since it is an interactive dashboard, users can enhance information, either by applying filters (course, goal, and modality) or by fixing the cursor on a list of courses where a window opens with detailed information (e.g., start and end date, percentage of completers, modality, total course hours, teacher, and content) (Table 2 and Figure 4).

The dashboard also allows monitoring of trained students’ evaluation using scores by course, in terms of content, format, methodological approach, time, period (morning/afternoon/evening), and frequency, among other information (Figure 5).

3.3. Stage 3—Prototype Validation

Given the need to improve the evaluation of courses offered, a module can be adopted for issuing specific periodic reports in order to monitor and evaluate course performance. At the end of the prototype construction process, validation steps were carried out with the SESAI/MS team to identify the reach, adherence, and contribution of the prototype to the demands for continuing education. Initial interviews and tests indicate that the model is both usable and relevant. First, it gives continuing education managers a systemic vision by centralizing information about demands, courses already offered, people trained, and topics of interest to the indigenous population. This information is crucial for decision-making at SESAI/MS, as described by the area managers:

INTERVIEW 1: “…we use a government platform, but there’s still a quantitative issue… it’s based on the question of the aggregate population number… but from a qualitative point of view, we don’t have it… so it’s from this perspective that we think BI can help us work on this qualitative issue…”

INTERVIEW 2: “…the tool has the potential to centralize information about training and qualification, because currently it is dispersed, both within DSEIs and internally at SESAI…”

“…I think that a tool that centralizes, categorizes, and standardizes helps SESAI to have this direction and even better standardize the entire training process that must be carried out by SESAI. No matter what we hire an institution to do, the content decision has to be made by SESAI…”

It also expands managers’ knowledge about assertiveness in training according to the indigenous population itself, where issues of culture and tradition often surpass the scientific rules dealt with in conventional medicine. For example, excerpts 3 and 4 of the interview with the SESAI/MS manager demonstrate the concern with addressing the sociocultural issues of the indigenous population:

INTERVIEW 1: ”…It’s very rich when they are involved,… They have ancient wisdom, you see there a person with philosophy and such a significant capacity for life, training can help in re-signifying traditional issues from the indigenous culture…

INTERVIEW 2: “…that the main difference is precisely the cultural issue in the sense of understanding indigenous medicine. What we understand as traditional medicine and the practices of this medicine, care practices and indigenous medicine. So, this understanding of what something is and the importance of bringing this to the indigenous population, so that it is easy to understand and, not only understand, but also execute…”

“…we are very focused sometimes on certification, on the scientific viability of a certain issue and, for them, other factors are involved. So, how to articulate one thing with another, I think this is one of the main factors…”

Finally, it is possible to observe in the interviews that BI can bring productivity gains, as it is possible to know the demands in advance as well as monitor the results achieved. This can also contribute to the development of public policies that are suitable for the continuing education of indigenous health professionals.

INTERVIEW 1: ”… the tool allows us to have this from a qualitative point of view…

INTERVIEW 2: “…this tool can bring management to training, management in the sense of understanding this, of us being able to understand if we are achieving the result we want with training, if we are training sufficient numbers, if the issue of turnover is a problem or not, so that we can have a program, a specific policy, the characterization of this problem and have a policy specifically aimed at it…”

Therefore, the prototype (BI) developed for monitoring the continuing education of indigenous health professionals allows integrating technologies, improves operational and strategic training processes, provides a replicable model for analyzing and monitoring performance indicators, and assists in formulating public policies.

4. Conclusions

The present study proposes a Business Intelligence (BI) prototype for monitoring the continuing education of indigenous health professionals at the Secretariat of Indigenous Health (SESAI) of the Brazilian Ministry of Health. This proposal is based on previous literature that reveals a positive connection between the application of BI and the improvement of services and informational agility in the healthcare sector [27,32,33]. Additionally, continuing education is identified as a relevant factor in ensuring efficiency, agility, and commitment from healthcare professionals [33,34].

The results revealed that continuing education for SESAI/MS professionals is complex and requires constant updating. This corroborates the findings of [10] when revealing that continuing education is important for health professionals to be able to provide assistance in a transcultural manner, understanding the health-disease process, but respecting the cultural diversity and customs of the indigenous population.

Practical contributions involve the use of information generated from the proposed Power BI dashboard, which allows a systemic visualization of performance indicators. This facilitates the decision-making process of managers, in addition to ensuring that continuing education and training courses are directed in a more efficient and effective way. The use of Power BI proved to be a friendly and efficient tool in identifying needs and trends linked to health, as identified in previous studies [31,32], and especially those related to training and continuing education [33].

Among the limitations, we can highlight the prototype’s application in a single sector and unique context (indigenous health). By concentrating the study on SESAI/MS, this allows us to acquire in-depth knowledge of continuing education; however, it requires caution as to the generalization of results. Future studies can apply the methodology to validate it in other sectors and contexts, which is essential for providing greater external validity to the proposed prototype (BI). The study also carried out interviews (two) with managers in the area of continuing education in indigenous health, the collected information being perceptions (self-reports). Future research can analyze the perceptions of other managers responsible for continuing education, which includes the perceptions of the professionals taking the courses (students) and those responsible for training them (teachers). It is also recommended to develop follow-up studies that could provide a more comprehensive understanding of the research implications over time.