Next Article in Journal
Parents’ and Early Childhood Educators’ Perceptions on Movement and Learning Program Implementation
Next Article in Special Issue
Enhancing Public Participation in Public Health Offerings: Patient Preferences for Facilities in the Western Cape Province Using a Discrete Choice Experiment
Previous Article in Journal
Spatiotemporal Changes of Chemical Fertilizer Application and Its Environmental Risks in China from 2000 to 2019
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 18
Issue 22
10.3390/ijerph182211912
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Expectations for the Development of Health Technology Assessment in Brazil

by
Julia Simões Corrêa Galendi
1,*,
Carlos Antonio Caramori
2,
Clarissa Lemmen
1,
Dirk Müller
1 and
Stephanie Stock
1
1
Institute for Health Economics and Clinical Epidemiology (IGKE), Faculty of Medicine and University Hospital Cologne, University of Cologne, 50935 Cologne, Germany
2
Department of Internal Medicine, Medical School, São Paulo State University (UNESP), 18618687 Botucatu, Brazil
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(22), 11912; https://doi.org/10.3390/ijerph182211912
Submission received: 15 September 2021 / Revised: 8 November 2021 / Accepted: 11 November 2021 / Published: 13 November 2021
(This article belongs to the Special Issue The Role of Health Technology Assessment in Redesigning Chronic Disease Services)
Browse Figure
Review Reports Versions Notes

Abstract

:
The implementation of health technology assessment (HTA) in emerging countries depends on the characteristics of the health care system and the needs of public health care. The objective of this survey was to investigate experts’ expectations for the development of HTA in Brazil and to derive measures to strengthen the impact of HTA in Brazil on health care decisions. Based on a scoping literature review, a questionnaire was developed proposing eight theses for seven domains of HTA: (i) capacity building, (ii) public involvement, (iii) role of cost-effectiveness analysis (CEA), (iv) institutional framework, (v) scope of HTA studies, (vi) methodology of HTA, and (vii) HTA as the basis for jurisdiction. Thirty experts responded in full to the survey and agreed to five of the eight theses proposed. Experts suggested several measures to promote HTA within the scope of each domain, thus addressing capacity building related to HTA, availability, and reliability of population data, and legal endowment of the HTA system. Finally, HTA processes in Brazil should also address public health issues (e.g., appraisal of interventions directed at chronic diseases).

1. Introduction

Health technology assessment (HTA) is a multidisciplinary process that aims to systematically assess the value of a health technology including, but not limited to, clinical, epidemiological, and health economic evidence [1]. The increase in medical expenditures and the limited resources available in most health systems have claimed for decisions to be guided by evidence and sound rationales [2]. HTA has been an important input to health policy formulation and implementation in different settings, especially when applied to inform decision making with regard to coverage and pricing of new medical technologies and to promote best clinical practices [3].
The trajectories and organizational structures of HTA have focused on the assessment of evidence on drugs and clinical issues, whereas it can also be applied to public health interventions such as the prevention and treatment of chronic diseases [4]. In low- and middle-income countries, chronic diseases represent a growing burden, accounting for more than 80 percent of global cardiovascular, respiratory, and related chronic disorder disability-adjusted life years (DALYs) and deaths, respectively [5]. In light of unprecedented technological innovation, population aging, and economic concerns in emerging countries, HTA has to consider (i) how to prioritize interventions that are aimed at preventing, diagnosing, and treating chronic diseases, and (ii) how to account for the social, ethical and legal implications of increasingly expensive and complex interventions [6]. Thus, the implementation of an HTA body may be an essential pillar for a growing national health system.
The implementation of HTA depends on characteristics of the health care system, cultural and social preferences, availability of resources, and institutional capacity [7]. However, there are many overarching efforts that encompass region-wide HTA initiatives in Latin America, and stand-out experiences from selected countries on how to implement HTA at a national level [8]. Latin America faces significant challenges in consolidating the influence of HTA on decision making and tackling the right-to-health litigation issue, the latter being a clear consequence of the perceived inadequate access to health services [8].
As the largest country in Latin America, Brazil can be considered exemplary for emerging countries. Health care in Brazil is guaranteed by a decentralized, universal public health system (SUS), which is funded by tax revenues and contributions from federal, state, and municipal governments [9]. The implementation of HTA in Brazil has been advancing fast since the Policy of Health Technology Management, enacted in 2009, when a centralized structure was implemented to inform the decision-making process [10].
By inquiring Brazilian experts from different fields, the objective of this survey was (i) to anticipate the development of HTA in Brazil for the next 10 years and (ii) to identify potential measures to stimulate HTA in Brazil.

2. Materials and Methods

To guide the expansion of HTA, it is important to consider different perspectives on the potentialities and the current challenges [7]. Hence, an e-survey with Brazilian experts was conducted from 31 May to 13 June 2019 using an online tool (Survey Monkey Inc., San Mateo, CA, USA).

2.1. Development of the Questionnaire

A scoping literature review was performed in Medline and Virtual Health Library (BIREME) to identify potential barriers for the HTA implementation in Brazil and Latin America. For the scoping review, an iterative process similar to that of Arksey and Malley was followed: (i) identifying the research question, (ii) identifying relevant studies, (iii) study selection, (iv) charting the data, and (v) consultation exercise with two experts [11]. Two experts who did not participate in the survey provided additional references about potential studies to include in the review, as well as valuable insights about issues relating to HTA in Brazil. Data charting was performed based on a standard form that included the publication identifiers (i.e., author, year, and title), setting, design, main objective, and key findings [11]. Eligible were publications addressing the Brazilian health policies for the establishment of an HTA system, assessments of institutions, or of HTA reports in Brazil. The literature search comprised the time span from January 2009 to January 2019 (i.e., because the current structure for HTA was established in Brazil in 2009). Articles in Portuguese, Spanish, and English were included. Grey literature was searched by revising the citations of included articles and reports from conferences focused on HTA (i.e., Latin American Policy Forum from HTAi) and websites of relevant institutions (i.e., CONITEC, Brazil; IECS, Colombia; Pan American Health Organization (PAHO)). The search strategy comprised the terms “Health technology Assessment”, “Brazil”, and “Latin America” and can be found in full on the Supplementary Materials (Table S1).
A total of 29 studies identified through the literature review guided the development of the questionnaire [8,10,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38]. Six studies addressed the right-to-health litigation issue in Brazil [12,13,14,23,28,37], five studies discussed the role of cost-effectiveness analysis in decision making in Brazil [29,30,32,33,35], three studies addressed the public involvement on HTA processes in Brazil [17,21,34]. In addition, 15 studies offered a comprehensive assessment of HTA in Brazil. Specifically, two studies were based on surveys with Brazilian experts about the HTA implementation in Brazil [19,31], five studies were opinion pieces presenting a critical appraisal on the current HTA institutions in Brazil [8,10,24,25,36], seven were reviews of the Brazilian HTA reports [15,16,18,20,26,27,38], and one study was a literature review addressing the use of real-world data on Latin America [22].
Based on the barriers identified in the literature review, the questionnaire addressed seven domains: (i) capacity building (i.e., how individuals achieve skills, experience, and knowledge to interpret and conduct HTA studies) [39], (ii) public involvement, (iii) role of cost-effectiveness analysis (CEA), (iv) institutional framework, (v) scope of HTA studies, (vi) methodology of HTA, and (vii) HTA as the basis for jurisdiction.
For each domain, the questionnaire was structured, as shown in Figure 1. First, a thesis projecting a possible situation was stated. Then, the experts should rate how possible the proposed thesis in a 10-year time frame is (from very possible to very impossible). Second, measures to address each domain were stated, and experts should rate them from strongly disagree to strongly agree. Lastly, open-ended questions allowed participants to justify their answers, as well as to suggest other measures not provided in the questionnaire.
All responses were rated on a 4-point Likert scale with no option of a neutral response. The questionnaire contained one thesis for each of the domains: “Education in HTA”, “public involvement”, “role of CEA”, “scope of HTA studies”, “methodology of HTA” and “HTA as basis for jurisdiction”. For “institutional framework”, two theses were proposed. The rationale behind each of the eight theses is outlined in Tables S2 and S3 (Supplementary Materials), and the full version of the questionnaire is provided.
The questionnaire was written in Portuguese language and was pre-tested for comprehensibility with three Brazilian academics who did not participate in the survey. Results of the survey are reported in accordance with the CHERRIES checklist for reporting results of e-surveys [40].

2.2. Selection of Participants

In Brazil, a centralized HTA structure was created to assist the Ministry of Health. The National Commission for Incorporation of Technologies (CONITEC) operates mainly by issuing reports to inform coverage decisions, and both methodological guidelines and national disease-management guidelines to support integral health care [41]. In addition to the centralized HTA process in Brazil, the Nuclei of Health Technology Assessment (NATS) were established in high complexity hospitals and universities. The NATS compose a network of hospital-based HTA, whose aim is to promote the HTA rationale across the country [41].
Participants were selected mainly through purposive sampling [42]. Invitations were sent to all members of the plenary of CONITEC, employees of the Department of Science and Technology (DECIT) of the Ministry of Health, and coordinators from NATS. Experts of the pharmaceutical industry were invited if they had at least 10 years of experience in HTA or had published relevant articles on HTA. The invited experts were informed about the aim of the study and the subsequent data processing (i.e., anonymous participation and data privacy). The experts who agreed to participate signed informed consent and received the link to the survey by e-mail. Reminders were sent out every two weeks twice if necessary.

2.3. Data Analysis

The data of Likert scales were analyzed by descriptive statistics as mean, standard deviation (SD), mode, and frequencies. A calculation was performed by attributing a code to each alternative: strongly agree (very likely): 4, agree (likely): 3, disagree (unlikely): 2, and strongly disagree (very unlikely): 1. Text generated in open-ended questions were analyzed step-by-step by reading thorough all responses in order to become familiar with the data, followed by identifying codes and themes. Finally, themes were reviewed and mapped according to recurrence [43].

3. Results

In total, 36 responses were submitted from 31 May to 13 June 2019 (response rate: 29 percent). Thirty complete responses were included in the final analysis (83%). Overall, 63% of participants were representatives of NATS, 16% of regulatory agencies (i.e., CONITEC and DECIT), and 20% of pharmaceutical industries. Table 1 describes the participants according to their background.

3.1. Agreement to the Theses

At least 70% (mean ≥2.7) of the experts estimated that five of the eight theses will be developed in ten years (i.e., for the domains “capacity building”, “role of CEA”, “scope of HTA studies”, “methodology of HTA”, and “HTA as basis for jurisdiction”). Lack of funding and the current insufficient technical capacity in Brazil were most frequently cited as challenges to the achievement of the projections. Table 2 comprises the expectations of experts on how possible the proposed theses are and what challenges may impact their achievement.
At least 70% (mean ≥2.7) of the experts estimated that five of the eight theses will be developed in ten years (i.e., for the domains “capacity building”, “role of CEA”, “scope of HTA studies”, “methodology of HTA”, and “HTA as basis for jurisdiction”). Lack of funding and the current insufficient technical capacity in Brazil were most frequently cited as challenges to the achievement of the projections. Table 2 comprises the expectations of experts on how possible the proposed theses are and what challenges may impact their achievement.
Experts’ expectations differed in three of the eight theses (i.e., for the domains “public involvement” and “institutional framework”). According to the experts, there are two challenges for increasing public participation. First, in Brazil, patient representatives or collaborative networks exist for a few groups of diseases (cited by six experts). Second, conflict of interest could compromise the technical quality of the HTA process because of financial support from the industry to patient advocates (cited by eight experts). For “institutional framework”, experts perceive that one major barrier to merging private and public HTA appraisals is that private and public insurances in Brazil operate from different perspectives and, therefore, have different interests (cited by seven experts).

3.2. Measures to Enhance HTA in Brazil

Experts suggested several measures to strengthen HTA in Brazil, which are summarized according to the respective domains (i.e., i–vii). Table 3 shows in full the measures, upon which at least 70% of experts agreed or strongly agreed (mean ≥2.7), and measures suggested as free text.
i.
Capacity Building
Experts agreed to several types of educational programs (i.e., post- and graduate programs, project-based programs, online and in-class traditional courses) and on institutions potentially responsible for their implementation (i.e., public universities or institutions, international collaborations, private universities, or public–private partnerships). It was recurrent in our sample that students frequently lack basic skills (i.e., evidence-based medicine, English language), which are not the focus of postgraduate programs.
ii.
Public Involvement
Measures to enhance public participation include advertising the current mechanism of public consultation (i.e., the appraisal of CONITEC is currently made available online for a short period of time when any stakeholder of the society can submit comments or counterarguments. After the public consultation is closed, the contributions are evaluated by the plenary before issuing the final report). In addition, promoting both informative and educative interventions directed to patients’ representatives should improve the quality of these contributions.
iii.
Role of Cost-Effectiveness Analysis (CEA)
More than 70% of experts agreed that a CET should be used as a reference for the interpretation of the results of the CEA, and a CET should be based on a standard value to be developed considering budget availability. However, a CET should be applied as one criterion among others (such as ethical, evidence of medical benefit, health care priority, etc.).
iv.
Institutional Framework
Experts agreed that expanding capacities of the NATS and the CONITEC would fasten the timeframe of HTA processes. Experts also agreed to increase the participation of the National Regulatory Agency for Private Health Insurance (ANS for its acronym in Portuguese) in the plenaries of CONITEC.
v.
Scope and vi. Methodology of HTA
To address the domain “scope of HTA”, a simplified appraisal procedure could be applied to medical technologies with low budget impact. Moreover, experts suggested that HTA should prioritize technologies aimed at primary health care. For “Methodology of HTA”, experts agreed to five measures that aimed at improving data availability and promoting technical capacity (i.e., training of researchers, financial support to independent researchers from public and private universities, improvement of data collection, and amelioration of the accessibility of DATASUS and investment on integrated electronic databases).
vi.
HTA as the Basis for Jurisdiction
Experts agreed upon three measures to address this domain. First, to establish expert groups to advise the law courts, and to expand initiatives such as the NAT JUS (i.e., nuclei of Health Technology Assessment that were established exclusively to support the Judiciary regarding lawsuits concerning health coverage). Second, to implement an early awareness system (or horizon scanning) for identifying innovative medical technologies with the potential to become a target of lawsuits. Third, to bind an HTA appraisal by CONITEC to authorization to enter the market—which in Brazil is issued by the Brazilian Health Regulatory Agency (ANVISA for its acronym in Portuguese)—to ensure timely reports.

4. Discussion

In addition to international recommendations for good practice on HTA in Latin America [7,44,45,46], to guide the implementation or expansion of HTA processes, the specific national context (i.e., the state of HTA development in each country, the resources available, and the characteristics of the health care system and decision-making process) have to be considered [7]. Hence, this paper explored how the development of HTA in Brazil is perceived by a sample of national experts.
A questionnaire was built upon seven domains that reflect current discussions on HTA in Brazil. Experts agreed to five of the eight theses proposed but differed with regard to the three theses proposed for the domains “public involvement” and “institutional framework”. Notably, the promotion of functional capacities (i.e., methodological expertise and timeliness of reports) was considered essential for an HTA body.
For most low and middle-income countries, capacity building related to HTA is a major challenge, which hinders HTA on many levels [35,38,47]. For instance, it has been previously reported that a shortage of qualified personnel in Brazil compromises the methodological quality of HTA reports, resulting in a low number of reports finished in time [48]. Results of our survey suggest that, in the view of experts, capacity building stands out as a challenge, preventing the application of CEAs for coverage decisions and the enforcement of HTA as the basis for jurisdiction. Nevertheless, international initiatives and cooperation that are aimed at capacity building have shown to be able to mitigate these hazards (e.g., by stimulating collaboration between stakeholders and international partners) [48,49].
Experiences from developed countries, which count on a more structured HTA system, anticipate that HTA is still focused on tackling “one-dimensional” health issues, while health problems with higher complexity are omitted. As shown for France, The Netherlands, Sweden, and the United Kingdom, HTA assessments are often limited to a single technology, which can be defined with reasonable clarity, suitable studies/data are available or at least can be commissioned easily and is of immediate relevance [4]. However, in the long term, systematic evaluations of health programs for chronic diseases may reduce mortality and morbidity on a larger scale, thus saving costs for the health care system [50]. In line with this rationale, some experts suggested prioritizing technologies for the primary health sector.
Due to the increased complexity of health care resulting from chronic diseases, the impact of HTA on policy, organization, community, and individual levels should be systematically assessed. These assessments should include effects on several intermediate outcomes, and how these effects are mediated through multiple causal pathways. Due to its complex nature, risk-reducing strategies (e.g., the development of vaccines or genetic-based screening for breast cancer) and treatments (e.g., multidisciplinary care for chronic diseases such as diabetes) require sufficient evidence as well as a conceptual openness for methodological pluralism [6]. By including social, ethical, and economic issues, HTA may be a valuable tool for emerging countries for the improvement of health care for chronic diseases.
Notwithstanding, in emerging countries such as Brazil, the expansion of the HTA structure to address public health issues may be hampered by financial constraints and a lack of population data [22,51]. While funding remains a challenge, measures that aim at improving the availability and reliability of data were elicited in our survey (i.e., improving data collection and accessibility of DATASUS, implementation of electronic integrated databases in hospitals and primary health care) and may contribute to improvements of HTA reports. Currently, Latin American countries heavily depend on evidence from other countries to produce HTA reports and guide decision making in healthcare [31]. However, the transferability of results may be limited and misguide decision making [52].
Moreover, although not addressed in our survey, there is a growing interest in patient aspects of health policy research and consumer expectations in developed countries. However, most HTA agencies neither use and nor invest in scientific methods to generate knowledge and evidence about the patient’s perception of a technology [53]. For newly developed HTA structures such as those to be developed for Brazil, it would be useful to include these patient-centered elements immediately.
A previous survey conducted in 2015 discussed the preferred status of HTA in 10 years in Brazil, among other Latin American countries [31]. Nevertheless, our survey was directed to the Brazilian health care system and included other domains considered to be relevant to Brazil. Moreover, our survey also identified several subjective aspects that may influence HTA in Brazil in a subtle manner such as the mistrust between the judiciary and its technical advisors or, pharmaceutical companies could corrupt and take public participation to their advantage.
Several limitations of our survey have to be addressed. First, the low response rate, which might have resulted from the length of the questionnaire. Second, our sample of experts cannot be considered representative for all groups of stakeholders involved in HTA decisions, i.e., agents from regulatory institutions and the industry were underrepresented, while patients were not involved at all. The patients’ perceptions of these domains should be investigated in future research. Lastly, the application of Likert scales does not allow inferring preferences of experts among the measures proposed.
This survey reflects the expectations of a selected group of Brazilian stakeholders that can prompt further discussion in Brazil and other Latin American countries. As different stakeholders usually have different perceptions of the health care system and its needs, HTA systems have to show considerations for these perspectives [54]. By providing the perspectives of Brazilian stakeholders in a structured manner with regard to specific domains, the results of this survey can support health policies aiming at promoting HTA in Brazil. While the results of the present survey reflect specificities of the Brazilian context, it contributes to the international knowledge on the development of HTA systems. These findings may suit countries with comparable health care systems and encourage the development of their own national HTA strategy [8,54]. Moreover, initiatives for international cooperation to tackle common challenges on HTA implementation should be promoted.

5. Conclusions

The implementation and expansion of HTA processes have to be in accordance with the characteristics of the countries’ health care systems and the availability of resources. This survey identified both expectations of a sample of experts regarding the development of HTA and the potential acceptance of selected measures for strengthening HTA in Brazil. HTA structures should increasingly support public health issues and how to appraise evidence on interventions directed at chronic diseases. HTA bodies in Brazil and other emerging countries have to be supplied with appropriate human resources and equipment.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/ijerph182211912/s1, Table S1: Search strategy for literature review on critical issues in the Brazilian HTA system; Table S2: Theses and rationales, Table S3: Complete version of the questionnaire.

Author Contributions

Study conception, All authors; questionnaire design and conception, C.L., J.S.C.G., collection and assembly of data, J.S.C.G., C.A.C.; data analysis and interpretation, J.S.C.G., S.S. and D.M; manuscript writing: J.S.C.G., S.S. and D.M. All authors have read and agreed to the published version of the manuscript.

Funding

The German Chancellor Fellowship from the Alexander from Humboldt Foundation supported Julia Simoes Correa Galendi during the conduction of this study.

Institutional Review Board Statement

Ethical review and approval were waived for this study, because public opinion surveys with unidentified participants (experts) without any intervention are exempted from submission and approval by the Ethics Committee, according to Resolution CNS/CONEP 510/2016, Brazil.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

All data generated during the conduction of this study are reported in the main manuscript and Supplementary Materials.

Acknowledgments

The authors wish to acknowledge and thank Clarissa Petramale and Denizar Vianna Araújo and all the experts who participated in and contributed to this study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. International Network of Agencies for HealthTechnology Assessment. HTAglossary. Available online: http://htaglossary.net/healthþtechnologyþassessmentþ%28HTA (accessed on 1 September 2019).
  2. Daniels, N.; Porteny, T.; Urritia, J. Expanded HTA: Enhancing Fairness and Legitimacy. Int. J. Health Policy Manag. 2015, 5, 1–3. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Hailey, D.; Werkö, S.; Rosén, M.; Macpherson, K.; Myles, S.; Gallegos Rivero, V.; Hipólito-Olivares, C.; Sihvo, S.; Pwu, J.; Yang, W.W.; et al. Influence of Health Technology Assessment and its Measurement. Int. J. Technol. Assess. Health Care 2016, 32, 376–384. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Holland, W.W. Health technology assessment and public health: A commentary. Int. J. Technol. Assess. Health Care 2004, 20, 77–80. [Google Scholar] [CrossRef] [Green Version]
  5. Global Burden of Diseases, Injuries, and Risk Factors Study. Available online: http://www.healthdata.org/gbd (accessed on 15 July 2021).
  6. Battista, R.N.; Lafortune, L. Health technology assessment and public health: A time for convergence. Eur. J. Public Health 2009, 19, 227. [Google Scholar] [CrossRef] [PubMed]
  7. Pichon-Riviere, A.; Soto, N.C.; Augustovski, F.A.; Garcia Marti, S.; Sampietro-Colom, L. Health Technology Assessment for decision-making in Latin America: Good practice principles. Rev. Panam. Salud. Publica. 2018, 19, e138. [Google Scholar] [CrossRef] [Green Version]
  8. Augustovski, F.; Alcaraz, A.; Caporale, J.; García, M.S.; Pichon, R.A. Institutionalizing health technology assessment for priority setting and health policy in Latin America: From regional endeavors to national experiences. Expert Rev. Pharm. Outcomes Res. 2015, 15, 9–12. [Google Scholar] [CrossRef] [Green Version]
  9. Paim, J.; Travassos, C.; Almeida, C.; Bahia, L.; Macinko, J. The Brazilian health system: History, advances, and challenges. Lancet 2011, 377, 1778–1797. [Google Scholar] [CrossRef]
  10. Kuchenbecker, R.; Polanczyk, C.A. Institutionalizing Health Technology Assessment in Brazil: Challenges Ahead. Value Health Reg. Issues 2012, 1, 257–261. [Google Scholar] [CrossRef] [Green Version]
  11. Arksey, H.; O'Malley, L. Scoping studies: Towards a methodological framework. Int. J. Soc. Res. Methodol. 2005, 8, 19–32. [Google Scholar] [CrossRef] [Green Version]
  12. Afonso da, S.V.; Vargas, T.F. Claiming the Right to Health in Brazilian Courts: The Exclusion of the Already Excluded. Law Soc. Inq. 2008, 36. [Google Scholar] [CrossRef]
  13. Biehl, J.; Amon, J.J.; Socal, M.P.; Socal Mp Fau-Petryna, A.; Petryna, A. Between the Court and the Clinic: Lawsuits for Medicines and the Right to Health in Brazil. Available online: https://spia.princeton.edu/system/files/research/documents/biehl_between_the_court_and_the_clinic.pdf (accessed on 21 January 2019).
  14. Borges, D.d.C.L. Individual Health Care Litigation in Brazil through a Different Lens: Strengthening Health Technology Assessment and New Models of Health Care Governance. Health Hum. Rights 2018, 20, 147–162. [Google Scholar] [PubMed]
  15. Caetano, R.; Silva, R.M.D.; Pedro, E.M.; Oliveira, I.A.G.; Biz, A.N.; Santana, P. Incorporation of new medicines by the National Commission for Incorporation of Technologies, 2012 to June 2016. Cienc. Saude Coletiva 2017, 22, 2513–2525. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Campolina, A.G.; Soárez, P.C.D.; Amaral, F.V.d.; Abe, J.M. Análise de decisão multicritério para alocação de recursos e avaliação de tecnologias em saúde: Tão longe e tão perto? Cad. Saude Publica 2017, 33, e00045517. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Carvalho, V.K.d.S.; de Sousa, M.S.A.; Barreto, J.O.M.; da Silva, E.N. Public engagement in health technology assessment in Brazil: The case of the Trastuzumab public consultation. BMC Health Serv. Res. 2019, 19, 762. [Google Scholar] [CrossRef] [Green Version]
  18. Elias, F.T.S.; Morais, R.D.G.d.; Silva, E.T.d.; Pereira, D.C.R. Perfil de estudos da rede brasileira de avaliação de tecnologia em saúde (Rebrats) de 2004 a 2015. Comun. Ciênc. Saúde 2016, 27, 53–70. Available online: https://bvsms.saude.gov.br/bvs/periodicos/ccs_artigos/perfil_estudos_rede_brasileira_avaliacao.pdf (accessed on 21 January 2019).
  19. Ferraz, M.B.; Soárez, P.C.d.; Zucchi, P. Health technology assessment in Brazil: What do healthcare system players think about it? Sao Paulo Med. J. 2011, 129, 198–205. [Google Scholar] [CrossRef] [Green Version]
  20. Girardi, J.d.M.; Elias, F.T.S.; Vanni, T.; Silva, E.T. Relações de colaboração na rede brasileira de avaliação de tecnologias em saúde. Comun. Ciênc. Saúde 2016, 27, 71–82. Available online: https://bvsms.saude.gov.br/bvs/periodicos/ccs_artigos/relacoes_colaboracao_rede_%20brasileira_avaliacao.pdf (accessed on 21 January 2019). [CrossRef]
  21. Gomes, L.D.M. A saúde como objeto de consumo: Uma análise sobre as demandas e consultas públicas de incorporação de medicamentos no SUS. Cad. Ibero-Am. Direito SanitÁrio 2015, 4, 145. [Google Scholar] [CrossRef] [Green Version]
  22. Justo, N.; Espinoza, M.A.; Ratto, B.; Nicholson, M.; Rosselli, D.; Ovcinnikova, O.; Garcia Marti, S.; Ferraz, M.B.; Langsam, M.; Drummond, M.F. Real-World Evidence in Healthcare Decision Making: Global Trends and Case Studies From Latin America. Value Health J. Int. Soc. Pharm. Outcomes Res. 2019, 22, 739–749. [Google Scholar] [CrossRef] [Green Version]
  23. Mariano, C.M.F.; Emanuel, T.; Albuqeurqeu, F.B.; Pereira, F.H.L.C.d.S.P. Diálogos sanitários interinstitucionais e a experiência de implantação do NAT-JUS. Rev. Investig. Const. 2018, 5, 169–188. [Google Scholar] [CrossRef] [Green Version]
  24. Novaes, H.M.D.; Elias, F.T.S. Uso da avaliação de tecnologias em saúde em processos de análise para incorporação de tecnologias no Sistema Único de Saúde no Ministério da Saúde. Cad. Saúde Pública 2013, 29, s7–s16. [Google Scholar] [CrossRef] [Green Version]
  25. Novaes, H.M.D.; Soárez, P.C.d. Health technology assessment (HTA) organizations: Dimensions of the institutional and political framework. Cad. Saude Publica 2016, 32 (Suppl. 2), e00022315. [Google Scholar] [CrossRef] [PubMed]
  26. Nunes, L.M.N.; Fonteles, M.M.d.F.; Passos, A.C.B.; Arrais, P.S.D. Evaluation of demands of inclusion, exclusion and alteration of technologies in the Brazilian Health System submitted to the National Committee on Technology Incorporation. Braz. J. Pharm. Sci. 2017, 53, e16073. [Google Scholar] [CrossRef] [Green Version]
  27. Pereira, V.d.C.S.; Flávia, C.R.; de Souza, A.B. Critérios para decisões sobre incorporação de tecnologias em saúde no Brasil e no mundo. Rev. Eletrônica Gestão Saúde 2015, 4, 2015–3066. [Google Scholar] [CrossRef]
  28. Perlingeiro, R. Recognizing the public right to healthcare: The approach of Brazilian courts. Rev. Port. Saúde Pública 2014, 32, 134–143. [Google Scholar] [CrossRef] [Green Version]
  29. Pichon-Riviere A, A.F.; Marti, S.G. The efficiency path to universal health coverage: Derivation of cost-effectiveness thresholds based on health expenditures and life expectancy.Updated country-level estimates for 194 countries. Value Health 2017, 20, A858. [Google Scholar] [CrossRef] [Green Version]
  30. Pinto, M.; Santos, M.; Trajman, A. Limiar de custo-efetividade: Uma necessidade para o Brasil? J. Bras. Econ. Saúde 2016, 8, 58–60. [Google Scholar] [CrossRef]
  31. Rosselli, D.; Quirland-Lazo, C.; Csanadi, M.; Ruiz de, C.E.M.; Gonzalez, N.C.; Valdes, J.; Abicalaffe, C.; Garzon, W.; Leon, G.; Kalo, Z. HTA Implementation in Latin American Countries: Comparison of Current and Preferred Status. Value Health Reg. Issues 2017, 14, 20–27. [Google Scholar] [CrossRef]
  32. Rossi, F.R.I. A Importância da Correta Análise de Custo-Efetividade para a Introdução de Novas Tecnologias no Sistema Único de Saúde. Rev. Bras. Cardiol. Invasiva 2014, 22, 113–114. [Google Scholar] [CrossRef]
  33. Santos, A.S.; Guerra-Junior, A.A.; Godman, B.; Morton, A.; Ruas, C.M. Cost-effectiveness thresholds: Methods for setting and examples from around the world. Expert Rev. Pharm. Outcomes Res. 2018, 18, 277–288. [Google Scholar] [CrossRef] [Green Version]
  34. Silva, A.S.; Petramale, C.A. Public involvement in health technology assessment: Experiences from the world and Brazil. Rev. Eletrônica Gestão Saúde. 2015, 6 (Suppl. 4), 331. [Google Scholar] [CrossRef]
  35. Soarez, P.C.; Novaes, H.M.D. Cost-effectiveness thresholds and the Brazilian Unified National Health System. Cad. Saude Publica 2017, 33, e00040717. [Google Scholar] [CrossRef] [Green Version]
  36. Vanni, T.; Stein, A.T.; Souza, K.M.; Freitas, M.G.d.; Patterson, I.; Assis, E.C.; Motta, M.L.d.; Leão, L.; Oliveira, R.C.; Elias, F.T.S. Inteligência avaliativa em rede: Construindo consenso em Avaliação de Tecnologias em Saúde. RECIIS 2015, 9, 1–10. [Google Scholar] [CrossRef]
  37. Vargas-Pelaez, C.M.; Rover, M.R.; Leite, S.N.; Rossi Buenaventura, F.; Farias, M.R. Right to health, essential medicines, and lawsuits for access to medicines--a scoping study. Soc. Sci. Med. 2014, 121, 48–55. [Google Scholar] [CrossRef]
  38. Yuba, T.Y.; Novaes, H.M.D.; de Soarez, P.C. Challenges to decision-making processes in the national HTA agency in Brazil: Operational procedures, evidence use and recommendations. Health Res. Policy Syst. 2018, 16, 40. [Google Scholar] [CrossRef] [Green Version]
  39. Pichler, F.; Oortwijn, W.; Ruether, A.; Trowman, R. Defining capacity building in the context of HTA: A proposal by the HTAi Scientific Development and Capacity Building Committee. Int. J. Technol. Assess Health Care 2019, 35, 362–366. [Google Scholar] [CrossRef]
  40. Eysenbach, G. Improving the quality of Web surveys: The Checklist for Reporting Results of Internet E-Surveys (CHERRIES). J. Med. Int. Res. 2004, 6, e34. [Google Scholar] [CrossRef] [PubMed]
  41. Pereira, C.C.A.; Rabello, R.D.S.; Elias, F.T.S. Hospital-based Health technology Assessment in Brazil: An overview of the initial experiences . Int. J. Technol. Assess Health Care 2017, 33, 227–231. [Google Scholar] [CrossRef]
  42. Palinkas, L.A.; Horwitz, S.M.; Green, C.A.; Wisdom, J.P.; Duan, N.; Hoagwood, K. Purposeful Sampling for Qualitative Data Collection and Analysis in Mixed Method Implementation Research. Adm. Policy Ment. Health 2015, 42, 533–544. [Google Scholar] [CrossRef] [Green Version]
  43. Braun, V.; Clarke, V. Using thematic analysis in psychology. Qual. Res. Psychol. 2006, 3, 77–101. [Google Scholar] [CrossRef] [Green Version]
  44. Drummond, M.F.; Schwartz, J.S.; Jönsson, B.; Luce, B.R.; Neumann, P.J.; Siebert, U.; Sullivan, S.D. Key principles for the improved conduct of health technology assessments for resource allocation decisions. Int. J. Technol. Assess Health Care 2008, 24, 244–258. [Google Scholar] [CrossRef] [Green Version]
  45. Voorhoeve, A.; Tan-Torres Edejer, T.; Kapiriri, L.; Norheim, O.F.; Snowden, J.; Basenya, O.; Bayarsaikhan, D.; Chentaf, I.; Eyal, N.; Folsom, A.; et al. Making Fair Choices on the Path to Universal Health Coverage: Applying Principles to Difficult Cases. Health Syst. Reform 2017, 3, 301–312. [Google Scholar] [CrossRef] [Green Version]
  46. Emanuel, E.J.; Fuchs, V.R.; Garber, A.M. Essential elements of a technology and outcomes assessment initiative. JAMA 2007, 298, 1323–1325. [Google Scholar] [CrossRef]
  47. Dams, F.; Gonzalez Rodriguez, J.L.; Cheung, K.L.; Wijnen, B.F.M.; Hiligsmann, M. Relevance of barriers and facilitators in the use of health technology assessment in Colombia. J. Med. Econ. 2018, 21, 510–517. [Google Scholar] [CrossRef]
  48. Lessa, F.; Caccavo, F.; Curtis, S.; Ouimet-Rathé, S.; Lemgruber, A. Strengthening and implementing health technology assessment and the decision-making process in the Region of the Americas. Rev. Panam. Salud Publica Pan Am. J. Public Health 2017, 41, e165. [Google Scholar] [CrossRef] [Green Version]
  49. Tantivess, S.; Chalkidou, K.; Tritasavit, N.; Teerawattananon, Y. Health Technology Assessment capacity development in low- and middle-income countries: Experiences from the international units of HITAP and NICE. F1000Res. 2017, 6, 2119. [Google Scholar] [CrossRef] [Green Version]
  50. Stojanovic, J.; Wübbeler, M.; Geis, S.; Reviriego, E.; Gutiérrez-Ibarluzea, I.; Lenoir-Wijnkoop, I. Evaluating Public Health Interventions: A Neglected Area in Health Technology Assessment. Front. Public Health 2020, 8, 106. [Google Scholar] [CrossRef] [Green Version]
  51. Oortwijn, W.; Mathijssen, J.; Banta, D. The role of health technology assessment on pharmaceutical reimbursement in selected middle-income countries. Health Policy 2010, 95, 174–184. [Google Scholar] [CrossRef]
  52. Goeree, R.; Burke, N.; O'Reilly, D.; Manca, A.; Blackhouse, G.; Tarride, J.E. Transferability of economic evaluations: Approaches and factors to consider when using results from one geographic area for another. Curr. Med. Res. Opin. 2007, 23, 671–682. [Google Scholar] [CrossRef]
  53. Tjørnhøj-Thomsen, T.; Hansen, H.P. Knowledge in health technology assessment: Who, what, how? Int. J. Technol. Assess. Health Care 2011, 27, 324–329. [Google Scholar] [CrossRef] [Green Version]
  54. Wild, C.; Stricka, M.; Patera, N. Guidance for the development of a National HTA-strategy. Health Policy Technol. 2017, 6, 339–347. [Google Scholar] [CrossRef]
Ijerph 18 11912 g001 550
Figure 1. Basic structure of the questionnaire repeated for each domain.
Figure 1. Basic structure of the questionnaire repeated for each domain.
Ijerph 18 11912 g001
Table
Table 1. Participants.
Table 1. Participants.
GroupsExperts Invited (n)Total Responses (n)Complete Responses (n) 1
NATS702319
Regulatory3965
Pharmaceutical industry1576
Total1243630
Abbreviations: NATS: nuclei for health technology assessment. 1 Included in final analysis.
Table
Table 2. Expectation of experts with regard to the theses and respective challenges according to the domains.
Table 2. Expectation of experts with regard to the theses and respective challenges according to the domains.
DomainThesesExpectation of ExpertsChallenges to the Achievement of the Thesis
In 10 Years (Nr.)Mode (%)Mean (SD)
Capacity buildingBrazil will have sufficient adequately trained personnel to understand, implement and conduct HTA studies (1)Possible (83%)3.0 (0.41)
  • Lack of funding (8 experts)
  • Education is not a political priority (8 experts)
  • Students without basic skills (i.e., evidence-based medicine, English language) to receive advanced training on HTA (7 experts)
Public participationPlain public involvement will be guaranteed without compromising the technical quality of the process (2)Possible (50%)2.6 (0.56)
  • Patient representatives or collaborative networks exist for a few groups of diseases (6 experts).
  • Difficulty to identify legitimate patient representatives (2 experts)
  • Conflict of interest of patient representatives funded by the industry (8 experts)
  • Lack of public awareness (3 experts)
Role of cost-effectiveness analysis (CEA)A CEA will be required in the HTA process to obtain coverage/reimbursement of new technologies in the benefits catalog (3)Possible (87%)2.9 (0.36)
  • Lack of funding for research (5 experts)
  • Need for capacity building on health economics (5 experts)
  • Need for epidemiological and utility data (3 experts)
Institutional frameworkA timeframe of three months to complete the HTA will be mandatory (4.a)Possible (53%)2.6 (0.66)
  • Lack of human resources to comply with the deadlines (9 experts)
  • Potential impact on the quality of the reports (2 experts)
The HTA appraisal process for public and private institutions will be merged (4.b)Impossible (53%)2.3 (0.69)
  • Private and public insurances in Brazil operate from different perspectives (7 experts)
Scope of HTAThe scope of HTA will be restricted to new medical technologies with high added value (e.g., biologics, biosimilars, combination products, devices, oncologic therapy, among others) and potentially high budgetary impact (5)Possible (67%)3.1 (0.57)
  • Difficult to foresee which technology will have a low budgetary impact (1 expert)
Methodology of HTAThe conduction of HTA studies will have high-quality methodology (6)Possible (70%)2.9 (0.54)
  • Lack of funding (5 experts)
  • Lack of reliable epidemiological data on the Brazilian population (5 experts)
  • Need for capacity building (3 experts)
HTA as basis for JurisdictionJudicial decisions on individual right-to-health lawsuits concerning the coverage of medical innovative technologies will use CONITEC reports as basis for jurisdiction (7)Possible (63%)2.8 (0.58)
  • Need for capacity building (3 experts)
  • Mistrust between the Judiciary and technical advisors (3 experts)
Abbreviations. HTA: health technology assessment; CONITEC: National Commission for incorporation of Technologies; NATS: nuclei for HTA; CEA: cost-effectiveness analysis; ANS: National Agency for Supplementary Healthcare; SD: standard deviation.
Table
Table 3. Elicited measures to promote HTA in the Brazilian health care system according to the domains.
Table 3. Elicited measures to promote HTA in the Brazilian health care system according to the domains.
DomainMeasures to Promote HTA in Brazil according to the Domain [Mean Value (SD)]
Capacity building
  • Project-based training [3.7 (0.47)], permanent university-based graduate [3.2 (0.91)] and post-graduation programs [3.9 (0.34)];
  • Courses offered by private universities [3.3 (0.51)], public universities [3.8 (0.42)], international collaborations [3.7 (0.44)] or public–private partnerships [3.7 (0.54)];
  • In-class traditional courses [3.3 (0.57)], online courses [3.0 (0.75)] or combination of in-class and online courses [3.6 (0.67)].
Public participation
  • Standardized advertising to the public to stimulate participation in public consultations [3.4 (0.72)];
  • Mandatory voting seat for patients’ representatives in the Plenaries of CONITEC [2.9 (0.87)];
  • Education for patients’ representatives on HTA to support participation in public consultations [3.4 (0.75)].
Role of cost-effectiveness analysis (CEA)
  • Mandatory CEAs for inclusion in the benefits catalog (reinforced by law) [2.9 (0.81)];
  • Self-binding from the pharmaceutical industry on producing CEAs [3.1 (0.70)];
  • Responsibility of conduction of CEA by Independent public universities staff [3.6 (0.50)], independent private universities staff [3.2 (0.64)], or an internal capacitated commission of CONITEC [3.1 (0.65)];
  • CET as reference for the interpretation of the results of the CEA [3.0 (0.80)];
  • CET as a standard value to be developed by Brazilian researchers, based on the budget available for health in Brazil (or willingness to pay) [3.2 (0.90)];
  • CET applied as one criterion among others (including ethical, evidence of medical benefit, health care priority, practicability, etc.) [3.6 (0.48)];
  • Co-financing by the proponent (third parties) and the government would be appropriate and sustainable for encouraging cost-effectiveness studies.a
Institutional framework
  • Reform of the specific legislation to ensure timeliness of reports (3 months) [3.0 (0.75)];
  • Expansion of the capacity of the NATS [3.4 (0.76)] and of the CONITEC [3.5 (0.67)];
  • Increase of participation of the ANS in the plenaries of CONITEC [3.0 (0.77)];
  • Health professionals other than physicians should be represented in decision-making bodies a;
  • Regional representation with regard to ethnical characteristics a;
  • To finance full-time researchers to work at the NATS a.
Scope of HTA
  • Simplified appraisal procedure to medical technologies with low budget impact (e.g., over-the-counter drugs, organizational and informational protocols, among others) [3.2 (0.78)];
  • Alternative criteria to prioritize the scope of HTA:
    ○
    Public health needs [3.6 (0.70)], frequent right to health lawsuits concerning a specific technology [3.2 (0.70)], unmet medical needs [3.3 (0.70)], technologies not previously evaluated by other countries [3.0 (0.80)], high therapeutic value of the technology [3.3 (0.77)].
  • Prioritize technologies for primary health care a.
Methodology of HTA
  • Expansion of the capacity and training of the CONITEC [3.5 (0.62)] and of the NATS [3.6 (0.55)];
  • Revision and periodical update of the methodological guidelines [3.6 (0.48)];
  • Provision of financial support to independent researchers that dedicate themselves to either from public universities HTA [3.5 (0.62)] or from private universities [3.1 (0.70)];
  • Expansion of the capacity of data collection [3.7 (0.47)] and amelioration of the accessibility of “DATASUS” [3.7 (0.62)];
  • Implementation of mandatory integrated electronic databases in the main hospitals [3.5 (0.62)] and in centers of the “Family Health Program” [3.5 (0.67)].
HTA as basis for Jurisdiction
  • Establishment of expert groups to advise the law courts regarding HTA [3.6 (0.66)];
  • Implementation of early awareness system (or horizon scanning) to identify innovative medical technologies with the potential to become a target of lawsuits [3.4 (0.55)];
  • Mandatory HTA appraisal by CONITEC after authorization to enter the market is granted by ANVISA, to ensure timely reports [3.2 (0.78)];
  • Invest in the expansion of the NATS JUS a.
a Measures suggested as free text, therefore not appraised by the group. Abbreviations: HTA: health technology assessment; CONITEC: National Commission for incorporation of Technologies; NATS: nuclei for HTA; CEA: cost-effectiveness analysis; CET: cost-effectiveness Threshold; ANS: National Agency for Supplementary Healthcare; ANVISA: National Health Surveillance Agency; DATASUS: Information Technology Department of the National Healthcare system; NATS JUS: NATS dedicated entirely to assisting the judiciary with regard to technical issues on HTA; SD: standard deviation.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Simões Corrêa Galendi, J.; Caramori, C.A.; Lemmen, C.; Müller, D.; Stock, S. Expectations for the Development of Health Technology Assessment in Brazil. Int. J. Environ. Res. Public Health 2021, 18, 11912. https://doi.org/10.3390/ijerph182211912

AMA Style

Simões Corrêa Galendi J, Caramori CA, Lemmen C, Müller D, Stock S. Expectations for the Development of Health Technology Assessment in Brazil. International Journal of Environmental Research and Public Health. 2021; 18(22):11912. https://doi.org/10.3390/ijerph182211912

Chicago/Turabian Style

Simões Corrêa Galendi, Julia, Carlos Antonio Caramori, Clarissa Lemmen, Dirk Müller, and Stephanie Stock. 2021. "Expectations for the Development of Health Technology Assessment in Brazil" International Journal of Environmental Research and Public Health 18, no. 22: 11912. https://doi.org/10.3390/ijerph182211912

APA Style

Simões Corrêa Galendi, J., Caramori, C. A., Lemmen, C., Müller, D., & Stock, S. (2021). Expectations for the Development of Health Technology Assessment in Brazil. International Journal of Environmental Research and Public Health, 18(22), 11912. https://doi.org/10.3390/ijerph182211912

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop