Next Article in Journal
Fostering Open Data Practices in Research-Performing Organizations
Previous Article in Journal
The Time from Submission to Publication in Primary Health Care Journals: A Cross-Sectional Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Research on Disinformation in Academic Studies: Perspectives through a Bibliometric Analysis

by
Nuria Navarro-Sierra
,
Silvia Magro-Vela
and
Raquel Vinader-Segura
*
Departamento de Comunicación Audiovisual y Publicidad, Facultad de Comunicación, Universidad Rey Juan Carlos, 28942 Fuenlabrada, Spain
*
Author to whom correspondence should be addressed.
Publications 2024, 12(2), 14; https://doi.org/10.3390/publications12020014
Submission received: 14 February 2024 / Revised: 22 March 2024 / Accepted: 25 April 2024 / Published: 7 May 2024

Abstract

:
Disinformation is a phenomenon of concern to all political systems, as it poses a threat to freedom and democracy through the manipulation of public opinion aimed at eroding institutions. This paper presents a bibliometric and systematized study which allows the establishment of a comprehensive view of the research and current state of academic investigations on disinformation. To this end, a content analysis of the scientific articles indexed in Scopus up to 31 December 2023 has been carried out based on three categories of analysis: journals, authors and investigations. Similarly, a systematic study of the 50 most cited articles in this sample was performed in order to gain a deeper understanding of the nature, motivations and methodological approaches of these investigations. The results indicate that disinformation is a research topic which has gained great interest in the academic community since 2018, with special mention to the impact of COVID-19 and the vaccines against this disease. Thus, it can be concluded that disinformation is an object of study which attracts significant attention and which must be approached from transdisciplinarity to respond to a phenomenon of great complexity.

1. Introduction

In the last decade, disinformation has emerged as a phenomenon of remarkable complexity, standing out especially for its constitutive plurivocity. Not only does it manifest itself as an (un)informative phenomenon with diverse strategies, but it is also presented in multiple forms in the numerous academic approaches which have been published in the last decade [1,2,3]. This conceptual variety reflects the epistemological difficulty in its definition, encompassing a wide range of terms such as disinformation, misinformation, fake news, hoax, deepfakes and astroturfing, amongst others [4,5,6], all of which refer to different realities within the same phenomenon that is normally termed generically, in turn, as disinformation. In addition, academic research has highlighted the various scenarios in which disinformation proliferates, especially stressing its predominant presence on social media [7,8].
A rallying point of the academic literature is the threatening nature of contemporary political systems of disinformation, in that they jeopardize the ability of individuals to freely generate their own opinions, an essential feature of democracies [9]. This factor may be a determining one when justifying the overwhelming number of initiatives of different natures which have been put forward to identify and mitigate its effects. These include not only governmental actions and international organizations to combat disinformation [10,11,12], but also other academic proposals which have made effective progress in identifying the phenomenon. Among them, Salaverría and Cardoso [2] propose a study on the future of disinformation research that emphasizes the four most studied aspects: typological studies of disinformation; fact-checking; disinformation on digital platforms; and media literacy. In addition, their proposal goes a step further and points out, within these emerging fields, what studies are addressing the topic and what they should pay attention to in the future.
Among these topics, research has highlighted the role of spreading false information, identifying its sources and subjects. It also focuses on recognizing the characteristic elements that allow its identification, as well as searching for population segments most vulnerable to its impact. Understanding the causes and motivations behind disinformation has been another key area of interest [13,14,15]. These approaches, which emanate from various academic disciplines, seek to illuminate the intricate dynamics of disinformation, thus promoting the development of more effective strategies to mitigate the adverse effects that this phenomenology generates in the social fabric [16,17].
This richness in the disciplines which have addressed the phenomenon and its protean nature itself underpin the interest of this research since, in this context, conducting a bibliometric study is presented as an essential tool to understand the evolution and dimension of disinformation [18]. It also offers a historical and social context that explains why it has emerged and intensified in recent times, especially in relation to technological development and changes in media consumption, as well as its multidisciplinary nature through knowledge of the areas which address this phenomenon. On the other hand, a systematic study of the most cited articles within the field of disinformation will allow us to not only understand the magnitude of the problem, but also to design appropriate strategies and policies to counter disinformation more effectively [19].
Although bibliometric studies on disinformation are not new to the academic literature, and other authors have published articles with data close to that presented here [20,21], this work presents significant contributions that expand the current understanding of the topic. The integration of a bibliometric analysis along with a detailed systematic analysis, focused especially on the 50 most cited articles, allows us to offer a richer and deeper perspective on the methodological approaches of disinformation research. This dual approach, which combines quantification with analytical depth, is notable for its ability to identify emerging trends and research priorities.
Furthermore, the study of the 50 most cited articles demonstrates the importance of transdisciplinarity in the study of disinformation, addressing it not only from multiple disciplines but also by promoting the active integration of knowledge to better understand this complex phenomenon. Through the analysis of a sample updated to December 2023, we provide insights into how disinformation is being addressed in fields as varied as Social Sciences, Medicine, and Computer Science, highlighting the need for collaborative and multifaceted strategies to effectively counteract its effects. The relevance of our research is further underscored by the global diversity of contributions, with an analysis that encompasses 8070 documents and reflects the breadth and depth with which the international academic community is responding to the challenges posed by disinformation.
Therefore, despite methodological similarities with previous research, we believe this study brings new insights into disinformation studies. By updating the existing body of knowledge with recent data and delving into the analysis of the most influential articles, our work not only reflects the current state of research but also points towards future directions, highlighting emerging areas and providing a solid foundation for the development of more informed and effective interventions against disinformation.

2. Materials and Methods

The present research aims to understand the state of scientific research on disinformation through a bibliometric study and a systematic analysis. Bibliometrics is a branch of scientometrics oriented towards the quantitative study of scientific publications [22]. Its descriptive approach focuses on the quantification of scientific and academic output, allowing for the identification of publication patterns, collaboration, and knowledge dissemination. Unlike other investigative methods that seek to establish causal relationships, bibliometrics confines itself to describing and measuring specific aspects of scientific information, such as citation frequency or the distribution of publications in a specific field. Bibliometric studies are a vision of research activity in a national and/or international context [23] and serve to qualify the scientific process, providing important information on scientific production and allowing the opening of new lines of research based on reflection on what has already been published [24]. On the other hand, a systematic analysis facilitates a more detailed exploration of a portion of the bibliometric study sample. This approach focuses on discovering relevant elements and characteristics, as well as identifying relationships and common aspects among the articles examined through the categories and research questions posed [25,26].
In this way, the present work aims to show an accurate picture of the state of scientific research on the global phenomenon of disinformation. In order to achieve this objective, a series of partial goals were set: (1) to determine the area of knowledge in which there are the greatest number of publications on this subject; (2) to verify research of scientific activity in the different disciplines; (3) to study the origin of the publications; and (4) to carry out a systematic analysis of the 50 most cited articles on disinformation.
This is, therefore, a descriptive type of research that will be performed with a quantitative approach through this academic discipline. To achieve this objective, a content analysis has been performed using the scientific article as an element of analysis, since it is the basic unit of scientific communication. Through this type of publication, researchers from all over the world have access to the reading and use of published scientific data.
Multistage sampling was carried out to obtain these items for analysis through the Scopus database, one of the most prestigious in the international context. Thus, we selected those which met a series of requirements: (1) scientific articles published in open access; (2) those containing in the title, keywords and/or abstract any of the following words: Disinformation, Dis-information, Malinformation, Mal-information, Misinformation, Mis-information, Fakenews, Fake news or Fake-news; (3) published since records were kept up to 31 December 2023; and (4) language of publication—those written in English, Spanish or Portuguese were selected as they are the most prolific in publications on disinformation. According to Scopus data, the third language, which is Portuguese, accounts for 159 articles, while the fourth is French with 10 publications; the difference between these makes it pertinent to present the data from the first three languages. Fulfilling all these criteria, a final sample of 8070 documents was obtained.
Once the sample was established, three levels of analysis were decided [27], and from there the following indicators were established:
  • Journals, referring to publications: journal name, year of publication, language of publication, publisher, area of knowledge.
  • Authors, which analyzes authorship: number of authors per publication, institutional affiliation and country of origin.
  • Research (Systematic Study—50 most cited articles) on the content of the texts: subject matter, transdisciplinary, motivation, keywords, methodology and analysis techniques used.

3. Results

Taking into account the aforementioned criteria, 8070 scientific articles were registered from the Scopus database. The main results obtained after statistical analysis of the registered data, bearing in mind the three levels of analysis established in the research design, are presented below.

3.1. Journals

Publications on disinformation in the Scopus database date back to 1964, when the first scientific article meeting the aforementioned requirements was recorded. This is evidence that this phenomenon is not recent, but its importance has been increasing over time, as the data show. Thus, if we look at the data as a whole, it becomes apparent that the intensity of publication on this issue is not uniform (Figure 1). In fact, the data show an upward trend since 2018, which is consolidated in the period 2020–2023, in which almost 80% of the documents are concentrated.
This fact could be explained by the interest of the academic community in studying the impact of disinformation regarding the Coronavirus and subsequent vaccination against this disease. However, after studying the areas of knowledge, a wide variety of disciplines approaching this subject of study can be observed, with Social Sciences, Medicine and Computer Sciences being the ones which bring together the most publications. These account for 55% of the academic papers. However, the contributions of Psychology (6%), Arts and Humanities (6%), Engineering (5%) and Environmental Sciences (3%) should also be highlighted. Scopus records articles on the subject in a total of 27 disciplines. This demonstrates that disinformation is a cross-cutting problem which affects all areas of knowledge.
In this sense, there is a wide variety of journals that have published the analyzed papers, but the performance of each of them is varied. Thus, there are journals that have published only a few papers compared to others which have published dozens or even hundreds of articles on this topic. PLOS One stands out as the journal which has published the most with 203 articles, 3% of the sample of this study, followed by the International Journal of Environmental Research and Public Health (n = 161), Journal of Medical Internet Research (n = 135) and IEEE Access (n = 107). As can be seen in Table 1, the 25 journals which have published the most scientific articles account for 22% of the total (n = 1810).
The journals are diverse in terms of their origin and the areas of knowledge of their publications. Thus, we have recorded journals that come from an international context, but Switzerland (n = 6) and the United States (n = 6) are the territories of origin of a significant number of titles. This international vocation and the intention to achieve the widest dissemination of published results is evident in the use of English as the main language of publication. This trend was extrapolated to the total sample, showing that 93.5% of the papers are published in English (n = 7619), while Spanish (n = 373) and Portuguese (n = 159) can be considered minority languages. In the case of Spanish, the publication of these works in said language is mainly due to the work of two journals, El Profesional de la Información and Estudios del Mensaje Periodístico, ranked 7th and 21st, respectively, in the ranking of journals with the highest number of publications.
Another interesting topic regarding the journals, taking into account the top 25 publications, is their publishing company. Thus, within this ranking, it can be seen that 13 titles belong to a publishing group. Thus, Frontiers Media, MDPI and JMIR Publications Inc., with 3 journals each, and SAGE and Springer Nature, with 2, are the most outstanding publishing companies in terms of the number of publications they contribute to the scientific community, and they do so with significant contributions in different areas of knowledge.

3.2. Authors

The authorship of the papers is widely distributed, probably due to the variety of papers of international origin and relating to different areas of knowledge. Thus, the top 25 authors on research topics related to disinformation (Table 2) account for only 6% of the registered articles, with 474 documents.
The profile of these authors with the most publications is characterized by being mainly male (76%), belonging to institutions in Anglo-Saxon countries (88%), and coming from the field of Psychology (48%). In terms of their academic performance, we can highlight 19 publications on average. These are, therefore, authors with a prominent role in terms of their work related to disinformation. However, the role of authors such as Ecker or Lewandosky, each of whom have more than 40 publications, is worth noting, although some of them have been published jointly.
The data shown in Table 2 allow the analysis of the role of these authors considering the total number of their publications in Scopus. Thus, the authors with the highest number of documents related to the topic of disinformation are not necessarily those who have published the most articles and/or are indexed in this database, and therefore those who demonstrate a greater emphasis on this issue in their research career. Noteworthy are researchers such as Roozenbeek, Swire-Thompson, and Altay, with more than 40% of their articles registered in this database being related to this research topic. Meanwhile, Ecker (44 docs) and Hameleers (32 docs) have a significant number of articles in the selected sample, representing 40% and 37%, respectively, of their total publications in Scopus.
If we analyze the contribution to the field of study by the universities of affiliation of the author (Table 3), the first 25 universities contributed 20% of the study sample (n = 1590). These institutions are mainly from the United States (n = 673), United Kingdom (n = 359) and Australia (n = 139). In terms of origin, countries such as Spain, the Netherlands, Canada, Brazil, Switzerland and Singapore also stand out in terms of the number of papers published by their authors. This provides a global context of the institutions with the most contributions.

3.3. Research (Systematic Study—50 Most Cited Articles)

In order to delve deeper into the characteristics of research on disinformation, the 50 publications with the most citations in Scopus within the period and parameters described in the Materials and Methods Section of this research were filtered.
As with the total number of articles covered in this study, the most cited articles were also analyzed in terms of the journal in which they were published, the editor, the country and the area or areas to which they belong. An analysis of the authors of these articles was also carried out, taking into account their country and field of expertise, as well as the methods and techniques applied in these studies.
Moreover, an analysis of the SCIVAL indicators was conducted for these 50 most cited articles, focusing on the topics in which Scopus has indexed these works, the prominence percentage and the FWCI. Thus, 22 distinct categories were detected, with the “Rumor; Social Media: Disinformation” topic (n = 16) significantly standing out with a prominence of 99.819%, aligning with the main thematic focus of these articles and the overall sample. Therefore, it represents significant visibility at present. Similarly, other recurring topics include “Vaccine Hesitancy; Measles; Anti-Vaccination Movement” (n = 5 and prominence 99.970%); “Conspiracy Theory; Mentality; COVID-19” (n = 4 and 99.244%); and “Twitter; Human Influenza; Social Media” (n = 4 and prominence 99.688%). Moreover, considering the prominence variable, research with higher values and thus greater visibility are those related to “Psychological Support; Mindfulness; COVID-19” (99.996%), “Radiological Findings; Clinical Features; COVID-19” (99.994%), or “Vaccine Hesitancy; Measles; Anti-Vaccination Movement” (99.970%). Regarding the Field-Weighted Citation Indicator (FWCI), Table 4 further displays the 25 articles with the highest citation impact in their respective fields.

3.3.1. Journals

In view of the data obtained, there is no clear trend showing the specialization of any publications on disinformation, but only a few stand out from the rest by having more than one article. These are PLoS One (n = 3); Proceedings of the National Academy of Sciences of the United States of America (n = 3); Psychological Science (n = 2); BMJ Global Health (n = 2); Journal of Medical Internet Research (n = 2); and JMIR Public Health and Surveillance (n = 2).
With regard to the geographical location from which the articles with the greatest impact are published, and in accordance with the results, the United States is at the top of the list with 16 headers, although the difference with the United Kingdom is minimal (n = 15). Behind are the Netherlands, Switzerland and Canada, all of them equal to or below 3 publications.
Finally, it is interesting to know the area of publication of the articles studied in order to understand in which areas this topic has a special incidence or is of greater interest.
As shown in Figure 2, the field of Medicine predominates (25%), followed by journals belonging to the Multidisciplinary area (15%), Computer Science (15%) and Psychology (12%).
However, despite these data, in order to gain a deeper understanding of the perspectives from which disinformation is approached, the articles were analyzed taking into account their subject matter and also their final motivation. After their classification, three categories were established that responded to the general theme: health (n = 26), psychology (n = 5) and another more generic branch called “disinformation as a threat to the communicative process”, which affects different areas transversally—social networks, politics, technology and climate change, among others—(n = 19).
Following this criterion, the articles were coded into subcategories in order to better understand what they address. Among the studies carried out on health, the treatment of disinformation in relation to COVID-19 stands out, accounting for 84.62% of them (n = 22). The rest only showed residual percentages as follows: disinformation and H1N1 flu (3.85%); disinformation and HIV (3.85%); disinformation and Ebola (3.85%); and, finally, an article which not only studied the relationship between public perception of COVID-19 threats, but was based on how information and/or disinformation is presented by politicians and the media (3.85%).
The next major theme is disinformation as a threat to communication; that is, disinformation itself.
In this case, there is also a division according to more specific issues. The texts which stood out focused on exploring the relationship between disinformation or malinformation processes within social media (31.58%). This was followed by a similar representation (21.05%) of research that focuses on the study of disinformation from a technological perspective—which includes a review of methods for detecting fake news, techniques for manipulating expressions and faces, and other logarithmic or programmatic issues—and those that investigate electoral processes and the disinformation mechanisms which influence them. In third position (15.79%) are those articles that explore fake news from a more general point of view; for example, their characteristics or how they are disseminated, etc. The last position (10.53%) is held by the two studies that address disinformation applied to climate change and its consequences.
Finally, the third large group, which deals with psychology, has not been broken down because it presents more heterogeneous research that seeks to relate the malicious or erroneous use of information with aspects of personality, which influences the bias or reliability of the source, among other things.
It is customary to measure the impact of research in terms of the number of citations received. All the articles within the range of the 50 most cited exceed 300 citations (Table 5). From the eighth position onwards, the number of citations rises above 1000, and in the first two positions the number of citations exceeds 2000. The total number of citations reached by the 50 articles is n = 32,661, but the distribution of these figures in relation to the subject is heterogeneous. Thus, the perspective that has aroused the most interest given the volume of citations received has to do with COVID-19 and all the informative confusion experienced during the pandemic. This topic holds first position with a great distance from the rest, as can be seen in the following table. The background color highlights the areas with more citations per article.
Another consideration to bear in mind is that most of the research has not been published as thematic issues, but as miscellanea, thus presenting a great diversity of objects and fields of study. On the contrary, only five studies correspond to monographs, where the medical discipline and, specifically, the context of COVID-19 is the main focus.
Also significant are the periods in which the most cited articles are located in time, i.e., their date of publication. On those occasions in which the articles have been made available to readers online prior to the publication of the issue in which they are included, the former was taken into account.
Figure 3 shows the data corresponding to this temporal distribution, where the first thing which can be noticed is an upward trend in volume, which indicates a high degree of citability and, therefore, of interest in the topic of disinformation.
Another of the issues which becomes relevant when viewing the data provided by Figure 3 is that 2020 is the year with the most publications. Therefore, 22 articles fall within this period, which represents 44% of the total—always in relation to the 50 most cited in Scopus. It seems inevitable to connect these results with the concern that arose at an international level during the pandemic, especially during the moments of greatest confusion that practically coincide with the dates indicated.

3.3.2. Authors

With regard to authors, a relevant aspect is the average number of authors per article, because this trend has changed in recent decades. This aspect concerns how science is conducted and disseminated, and the current reality seems to be a transformation from the individual or “author” to a co-authorship or “committee” [28]. With this idea in mind, the frequency (Figure 4) was observed on the basis of the number of authors per article. If we calculate the average value, this would be 6.9 authors.
The affiliations and areas of the authors in the 50 most-cited articles reveals a complex web of collaboration, both within and across national borders (Figure 5). If authors listed multiple affiliations or countries, these were included in the tally, illustrating the extent and nature of their collaboration. Often, such collaborations span multiple institutions within a single country, with instances where each author comes from a different entity.
Notably, in 19 articles, authors from two different countries participated, and on 6 occasions authors from three countries collaborated. The United States and the United Kingdom stand out for cross-country collaborations, contributing to 13 and 10 articles, respectively (6 of which involved both countries, with a third country participating on 2 occasions). Australia follows with five works.
It is not surprising that this convergence encompasses these three countries, given the commonality of language—though in this case, one might expect some co-authorship between Latin American countries and Spain due to their linguistic ties—but it is also due to these countries’ significant scientific output. The presence of such collaborations reflects not just shared linguistic and cultural backgrounds but also the robust academic and research environments that foster such interdisciplinary and international partnerships.
However, not all countries in the sample engaged in international collaborations; for example, Israel, Iraq, and Mexico each have one highly cited article without cross-border collaboration. In contrast, the remainder of the countries participated in at least one or two collaborative efforts, as can be seen in the graph.
Furthermore, the disciplinary backgrounds of the authors add another layer of interest. Only two articles in the sample are single-authored, whereas at the other extreme, there are articles with 16 and 12 authors, showcasing a broad range of contributing fields (it is notable that the article with 16 authors includes collaborators exclusively from institutions across the United States).
A total of 19 articles benefit from multidisciplinary perspectives, with 15 of these featuring authors from different countries. Table 6 outlines the most represented disciplines:
These data emphasize that while less represented disciplines contribute their expertise to the discussed topics, they typically do so within a multi-author framework that includes at least one author from a different field, enriching the article’s multidisciplinary approach. The domains of Psychology, Medicine and Computer Science (potentially combined with Systems Engineering) not only are the most prevalent among the most-cited articles but also engage most frequently in collaborative publishing.
Lastly, Figure 6 illustrates the intersections of the three most common disciplines, highlighting the interdisciplinarity at the heart of these influential publications.
Only five fields converge on more than one occasion, with Psychology and Communication reaching the highest figure, occurring in three different articles. One of these instances pertains to the article with 16 authors, in which five different fields intersect.
Furthermore, within these broader disciplinary categories, collaborations have been noted with specialists in highly specific fields. These include radiologists, crisis management experts and infectious disease specialists, showcasing the depth and diversity of expertise contributing to the research.

3.3.3. Methods

As a final part of the analysis of these 50 articles, attention was paid both to the type of methodology employed and the technique used. There is a dominance of quantitative research (64%) as opposed to qualitative research (26%), followed by papers in which this is not explicit (6%) and those using a mixed methodology (4%).
In line with the above, Figure 7 shows the most frequent techniques used in research. As previously noted, the prevalence of quantitative methodologies is reflected in these data, where 28% of the articles (n = 14) used surveys as a means to achieve their objectives. Similarly, several modalities of surveys are used, for example, online or by telephone, and are carried out on sample groups of different sizes. The application of both single surveys and multistage surveys to the population analyzed have also been observed, thus serving to obtain comparative results.
Content analysis was also one of the most common techniques, representing 22% of the total (n = 11), and was detected in both quantitative and qualitative applications. Literature reviews were the most commonly used qualitative technique, in third position, representing 18% of the total (n = 9). This was followed by those studies in which the technique was not specifically mentioned in the research design, representing 14% of the total (n = 7), and those that used experiments, representing 10% of the sample (n = 5). From this point on, the figures drop to 2%, which means that the numbers of works that opt for the rest of the techniques were marginal.
To finalize the profiling, the keywords with which all the texts indexed in Scopus were tagged from authors and from Scopus itself were taken as a reference, and a keyword co-occurrence map was created (Figure 8) in order to synthesize the research on disinformation.
Although the size of these words reflects the most frequent interests in this field, the number of labels highlights the multidisciplinary nature of the various possible points of view when addressing disinformation as an object of study in academic research.
Terms related to specific areas such as medicine, social media, journalism or technology are clearly identifiable. These areas have also been identified through the disciplines of the authors, thanks to the systematic study of the 50 most-cited articles. Additionally, transdisciplinarity is manifested in the visualization through the connections between different terms, ranging from “human” to “communication” and “interpersonal”. These connections form six clusters that can be generally categorized within the highlighted areas.
At first glance, it is apparent that Public Health themes are among the most repeated, with terms like “COVID-19”, “vaccination”, and “public health” showing the direct influence of the pandemic on disinformation research. This underscores the urgency of understanding how misinformation spreads on critical health issues.
Another evident relationship is the link between “disinformation” and other terms that allude to disinformation, with terms related to social media references, such as “social network”, “social media platforms” or “social media”, with the latter being one of the most significant channels for studying the spread of disinformation.
Lastly, another notable aspect is the words related to technology, such as “fake news detection”, “big data” or “machine learning”, indicative of the interest in using technology to identify and counter disinformation, which may be a promising direction for future research.

4. Discussion and Conclusions

Although the results presented in the different sections address the questions raised in the first part of the article, it is essential to re-cover some key aspects.
The bibliometric analysis has offered a comprehensive view on the evolution and current state of academic research on disinformation. An exponential growth in the literature on this issue has been identified, especially in the fields of Medicine, Computer Science and Psychology (although journals categorized as multidisciplinary ranked second), as confirmed in the sample of the 50 most cited articles with the disciplines most represented among their authors. This increase reflects a greater academic awareness and concern regarding the subject. The journals identified as leaders in publishing on disinformation demonstrate a diversity of approaches and fields, underscoring the interdisciplinary nature and complexity of disciplines and countries from authors’ affiliations. This plurality suggests a growing need for transdisciplinary collaboration to effectively address the challenges presented by disinformation.
In relation to the origin of disinformation research, this study reveals a remarkable variety in terms of authors, areas of expertise and country of origin. Contrary to concentrating on a few authors, there is a wide range of researchers addressing this issue. For example, if we look at the profile of the authors, Anglo-Saxon men in the field of psychology predominate, but as far as universities are concerned, North American institutions are the most prominent, thus reflecting the multifaceted quality of research in this field.
Regarding the level of content, the systematic analysis of the most cited publications identified predominant and emerging themes in disinformation research. The frequent mention of COVID-19 evidences how global events influence research topics. In addition, there is an evolution in the topics of interest, from more general aspects of disinformation to more specific and solution-oriented approaches, with a special mention to the presence on social media. The diversity in methodologies and approaches underlines the complexity of the field and points to the importance of continuously adapting research methodology to keep up with the changing nature of disinformation, but also the need for multidisciplinary strategies to address this issue.
Another research interest recorded amongst the articles cited is the concern regarding climate change and knowing what kind of information is published, as well as the vulnerability of the population in assessing it and identifying it as disinformation.
From a sociological perspective, we can speak of the emergence of publications in the area of psychology highlighting the importance of understanding the social and personality aspects which are influenced by disinformation, including its impact on public opinion and social behavior. This trend reinforces the need for approaches that address not only the content of disinformation, but also its broader social implications.
In short, this systematic bibliometric analysis highlights the importance of disinformation as an object of study, which is evident from the initial figures. From the picture described here, future research can be oriented to fill gaps, go a step further than the most common themes and areas and respond to emerging challenges, or those less studied, in this field of study.

Author Contributions

Conceptualization, N.N.-S., S.M.-V. and R.V.-S.; methodology, N.N.-S., S.M.-V. and R.V.-S.; validation, N.N.-S.; formal analysis, S.M.-V. and R.V.-S.; investigation, N.N.-S., S.M.-V. and R.V.-S.; resources, N.N.-S., S.M.-V. and R.V.-S.; data curation, S.M.-V. and R.V.-S.; writing—original draft preparation, N.N.-S., S.M.-V. and R.V.-S.; writing—review and editing, N.N.-S. and S.M.-V.; visualization, R.V.-S.; project administration, N.N.-S.; funding acquisition, N.N.-S. and R.V.-S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by IBERIFIER: Iberian Media Research & Fact-Checking, funding from the European Commission under the agreement CEF-TC-2020-2 (European Digital Media Observatory) with reference 2020-EU-IA-0252.

Data Availability Statement

The original contributions presented in the study are included in the article, further inquiries can be directed to the corresponding author/s.

Acknowledgments

This research was supported by IBERIFIER: Iberian Media Research & Fact-Checking (2020-EU-IA-0252) and the project ‘Politainment in the Face of Media Fragmentation: Disintermediation, Engagement, and Polarization’ (PID2020-114193RB-I00), funded by the Ministry of Science and Innovation.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Pasławska, P.; Popielska-Borys, A. Phenomenon of Fake News. Soc. Commun. 2018, 4, 136–140. [Google Scholar] [CrossRef]
  2. Salaverría, R.; Cardoso, G. Future of disinformation studies: Emerging research fields. Prof. Inf. Inf. Prof. 2023, 32, 5. [Google Scholar] [CrossRef]
  3. Wilson, A.; Wilkes, S.; Teramoto, Y.; Hale, S. Multimodal analysis of disinformation and misinformation. R. Soc. Open Sci. 2023, 10, 230964. [Google Scholar] [CrossRef]
  4. Fallis, D. What is disinformation? Libr. Trends 2015, 63, 401–426. [Google Scholar] [CrossRef]
  5. Baines, D.; Elliott, R.J.R. Defining Misinformation, Disinformation and Malinformation: An Urgent Need for Clarity during the COVID-19 Infodemic; Discussion Papers, Article 20-06; Department of Economics, University of Birmingham: Birmingham, UK, 2020; Available online: https://ideas.repec.org//p/bir/birmec/20-06.html (accessed on 24 April 2024).
  6. Chan, J. Online astroturfing: A problem beyond disinformation. Philos. Soc. Crit. 2022, 50, 01914537221108467. [Google Scholar] [CrossRef]
  7. Akram, M.; Nasar, A.; Arshad-Ayaz, A. A Bibliometric Analysis of Disinformation through Social Media. Online J. Commun. Media Technol. 2022, 12, e202242. [Google Scholar] [CrossRef]
  8. Aïmeur, E.; Amri, S.; Brassard, G. Fake news, disinformation and misinformation in social media: A review. Soc. Netw. Anal. Min. 2023, 13, 30. [Google Scholar] [CrossRef]
  9. Cipers, S.; Meyer, T.; Lefevere, J. Government responses to online disinformation unpacked. Internet Policy Rev. 2023, 12, 1–19. [Google Scholar] [CrossRef]
  10. House of Commons. Disinformation and ‘Fake News’: Final Report; Digital, Culture, Media and Sport Committee; House of Commons: London, UK, 2019. [Google Scholar]
  11. United Nations. Countering Disinformation for the Promotion and Protection of Human Rights and Fundamental Freedoms: Report of the Secretary-General. 2022. Available online: https://digitallibrary.un.org/record/3987886 (accessed on 12 August 2022).
  12. Presidencia del Gobierno. Foro Contra las Campañas de Desinformación en el Ámbito de la Seguridad Nacional—Trabajos 2023; Gobierno de España. Sitio oficial del Departamento de Seguridad Nacional: Spain, 2023. Available online: https://www.dsn.gob.es/es/documento/foro-contra-campa%C3%B1as-desinformaci%C3%B3n-%C3%A1mbito-seguridad-nacional-trabajos-2023 (accessed on 24 April 2024).
  13. Puebla-Martínez, B.; Navarro-Sierra, N.; Alcolea-Díaz, G. Methodological Proposal for the Detection of the Composing Elements of Vulnerability Regarding Disinformation. Publications 2021, 9, 44. [Google Scholar] [CrossRef]
  14. Ceron, W.; de-Lima-Santos, M.-F.; Quiles, M.G. Fake news agenda in the era of COVID-19: Identifying trends through fact-checking content. Online Soc. Netw. Media 2021, 21, 100116. [Google Scholar] [CrossRef]
  15. Chung, M.; Kim, N. When I Learn the News is False: How Fact-Checking Information Stems the Spread of Fake News Via Third-Person Perception. Hum. Commun. Res. 2021, 47, 1–24. [Google Scholar] [CrossRef]
  16. Kozik, R.; Mazurczyk, W.; Cabaj, K.; Pawlicka, A.; Pawlicki, M.; Choraś, M. Deep Learning for Combating Misinformation in Multicategorical Text Contents. Sensors 2023, 23, 9666. [Google Scholar] [CrossRef] [PubMed]
  17. Dame Adjin-Tettey, T. Combating fake news, disinformation, and misinformation: Experimental evidence for media literacy education. Cogent Arts Humanit. 2022, 9, 2037229. [Google Scholar] [CrossRef]
  18. Donthu, N.; Kumar, S.; Mukherjee, D.; Pandey, N.; Lim, W.M. How to conduct a bibliometric analysis: An overview and guidelines. J. Bus. Res. 2021, 133, 285–296. [Google Scholar] [CrossRef]
  19. Paul, J.; Barari, M. Meta-analysis and traditional systematic literature reviews—What, why, when, where, and how? Psychol. Mark. 2022, 39, 1099–1115. [Google Scholar] [CrossRef]
  20. Wang, S.; Su, F.; Ye, L.; Jing, Y. Disinformation: A Bibliometric Review. Int. J. Environ. Res. Public Health 2022, 19, 16849. [Google Scholar] [CrossRef] [PubMed]
  21. Bran, R.; Tiru, L.; Grosseck, G.; Holotescu, C.; Malita, L. Learning from Each Other—A Bibliometric Review of Research on Information Disorders. Sustainability 2021, 13, 10094. [Google Scholar] [CrossRef]
  22. Romaní, F.; Huamaní, C.; González-Alcaide, G. Estudios bibliométricos como línea de investigación en las Ciencias Biomédicas: Una aproximación para el pregrado. Ciencia e Investigación Medico Estudiantil Latinoamericana. 2022, 16, 52–62. [Google Scholar]
  23. Bordons, M.; Zulueta, M.Á. Evaluación de la actividad científica a través de indicadores bibliométricos. Rev. Española Cardiol. 1999, 52, 790–800. [Google Scholar] [CrossRef]
  24. Angarita Becerra, L.D. Estudio bibliométrico sobre uso de métodos y técnicas cualitativas en investigación publicada en bases de datos de uso común entre el 2011–2013. Rev. Iberoam. Psicol. 2014, 7, 2. [Google Scholar] [CrossRef]
  25. Petticrew, M.; Roberts, H. Systematic Reviews in the Social Sciences: A Practical Guide, 1st ed.; Wiley: Hoboken, NJ, USA, 2006. [Google Scholar] [CrossRef]
  26. Avenali, A.; Daraio, C.; Di Leo, S.; Matteucci, G.; Nepomuceno, T. Systematic reviews as a metaknowledge tool: Caveats and a review of available options. Int. Trans. Oper. Res. 2023, 30, 2761–2806. [Google Scholar] [CrossRef]
  27. Polanco, X. Infometría e ingeniería del conocimiento: Exploración de datos y análisis de la información en vista del descubrimiento de conocimientos. In El Universo de la Medición: La Perspectiva de la Ciencia y la Tecnología. COLCIENCIAS, CYTED, RICYT: Segundo Taller Iberoamericano Sobre Indicadores en Ciencia y Tecnología; Jaramillo, H.; Albornoz, M., Translators; Tercer Mundo Editores: Santa Fe de Bogotá, Colombia, 1997; pp. 335–350. [Google Scholar]
  28. Crandford, S. The decline of Academic Auteur. Matter 2020, 2, 507–510. [Google Scholar] [CrossRef]
Figure 1. Evolution of publications related to disinformation (1990–2023 period). Source: own elaboration based on data from Scopus.
Figure 1. Evolution of publications related to disinformation (1990–2023 period). Source: own elaboration based on data from Scopus.
Publications 12 00014 g001
Figure 2. Journal subject area. Source: own elaboration based on data from Scopus.
Figure 2. Journal subject area. Source: own elaboration based on data from Scopus.
Publications 12 00014 g002
Figure 3. Time distribution of the most cited papers. Source: own elaboration based on data from Scopus.
Figure 3. Time distribution of the most cited papers. Source: own elaboration based on data from Scopus.
Publications 12 00014 g003
Figure 4. Frequency of authors per article. Source: own elaboration based on data from Scopus.
Figure 4. Frequency of authors per article. Source: own elaboration based on data from Scopus.
Publications 12 00014 g004
Figure 5. Country of origin by authors’ affiliation. Source: own elaboration based on data from Scopus.
Figure 5. Country of origin by authors’ affiliation. Source: own elaboration based on data from Scopus.
Publications 12 00014 g005
Figure 6. Collaborative relationships between disciplines. Source: own elaboration based on data from Scopus.
Figure 6. Collaborative relationships between disciplines. Source: own elaboration based on data from Scopus.
Publications 12 00014 g006
Figure 7. Distribution by techniques used. Source: own elaboration.
Figure 7. Distribution by techniques used. Source: own elaboration.
Publications 12 00014 g007
Figure 8. Keyword co-occurrence map. Source: own elaboration.
Figure 8. Keyword co-occurrence map. Source: own elaboration.
Publications 12 00014 g008
Table 1. Journals with the most publications on disinformation.
Table 1. Journals with the most publications on disinformation.
#NameDocsCountryPublisherLanguageSubject Area
1PLOS One203United StatesPLOSEnglishMultidisciplinary
2International Journal of
Environmental Research
and Public Health
161SwitzerlandMDPIEnglishMedicine,
Environmental Science
3Journal of Medical
Internet Research
135CanadaJMIR Publications Inc.EnglishMedicine
4IEEE Access107United StatesIEEEEnglishEngineering, Computing Science,
Materials Science
5Vaccines92SwitzerlandMDPIEnglishMedicine, Pharmacology, Immunology
6Social Media and Society86United
Kingdom
SAGEEnglishSocial Sciences: Cultural Studies,
Communication, Computing Science
7Profesional
de la Información
85SpainEl profesional de la informaciónEnglish,
Spanish
Social Sciences,
Communication, Library and Information Sciences
8Harvard Kennedy School
Misinformation Review
80United StatesHarvard Kennedy SchoolEnglishSocial Sciences
9Scientific Reports78GermanySpringer NatureEnglishMultidisciplinary
10Frontiers in Public Health71SwitzerlandFrontiers MediaEnglishMedicine: Public Health, Environment and
Occupational Health
11Media and Communication70PortugalCogitatio PressEnglishSocial Sciences:
Communication
12Frontiers in Psychology64SwitzerlandFrontiers MediaEnglishPsychology
13BMC Public Health62GermanySpringer NatureEnglishMedicine: Public Health, Environment and
Occupational Health
14Proceedings of the ACM
on Human–Computer
Interaction
54United StatesAssociation for Computing MachineryEnglishSocial Sciences,
Computing Science
15Human Vaccines
and Immunotherapeutics
50United
Kingdom
Taylor & FrancisEnglishPharmacology,
Medicine, Immunology
16Proceedings of The National Academy of Sciences
of The United States
of America
46United StatesNational Academy
of Sciences
EnglishMultidisciplinary
17BMJ Open45United
Kingdom
BMJ Publishing GroupEnglishMedicine
18Jmir Formative Research44CanadaJMIR Publications Inc.EnglishMedicine
19Vaccine44NetherlandsElsevierEnglishVeterinary,
Medicine,
Immunology
20Jmir Infodemiology41CanadaJMIR Publications Inc.EnglishMedicine, Computing Science
21Estudios Sobre El Mensaje
Periodístico
40SpainUniversidad Complutense de MadridEnglish,
Spanish
Social Sciences:
Cultural Studies,
Communication
22Applied Cognitive
Psychology
39United StatesWiley-BlackwellEnglishArts and Humanities,
Psychology
23Applied Sciences
Switzerland
38SwitzerlandMDPIEnglishEngineering,
Physics and Astronomy
Materials Science, Chemical Engineering
24Frontiers
In Communication
38SwitzerlandFrontiers MediaEnglishSocial Sciences,
Communication
25New Media
and Society
37United
Kingdom
SAGEEnglishSocial Sciences:
Sociology,
Communication
Source: own elaboration based on data from Scopus.
Table 2. Authors with the most scientific articles published on disinformation.
Table 2. Authors with the most scientific articles published on disinformation.
#AuthorAffiliationCountrySubject AreaGenderDisinf. docsTotal docs%
1Ecker, U.K.H.The University
of Western Australia
AustraliaPsychologyMale4411140%
2Lewandowsky, S.University of BristolUnited KingdomPsychologyMale4128115%
3Hameleers, M.University
of Amsterdam
NetherlandsCommunicationMale328737%
4Loftus, E.F.University
of California
United StatesPsychologyFemale313569%
5Rand, D.G.Massachusetts
Institute of
Technology (MIT)
United StatesPsychologyMale3122514%
6Pennycook, G.Cornell UniversityUnited StatesPsychologyMale2911825%
7van der Linden, S.University
of Cambridge
United KingdomPsychologyMale2317113%
8Roozenbeek, J.University
of Cambridge
United KingdomPsychologyMale214053%
9Otgaar, H.Maastricht
University
NetherlandsPsychologyMale202239%
10Menczer, F.Indiana UniversityUnited StatesComputing
Science
Male171879%
11Nyhan, B.Darmouth CollegeUnited StatesPolitical ScienceMale177922%
12Carley, K.M.Carnegie Mellon UniversityUnited StatesComputing
Science
Female154583%
13Ferrara, E.University of
Southern California
United StatesComputing
Science
Male131877%
14Quattrociocchi, W.Sapienza Universitá di RomaItalyComputing
Science
Male137817%
15Swire-Thompson, B.Northeastern
University
United StatesPolitical Science
and Psychology
Female132748%
16Altay, S.University of OxfordUnited StatesPolitical ScienceMale132846%
17Reifler, J.University of ExeterUnited KingdomPolitical ScienceMale128614%
18Jamieson, K.H.University
of Pennsylvania
United StatesCommunicationFemale121837%
19Murphy, G.University
College Cork
IrelandPsychologyFemale124726%
20Cook, J.University
of Melbourne
AustraliaPsychologyMale115520%
21Chadwick, A.Loughborough
University
United KingdomCommunicationMale114326%
22Vaccari, C.The University
of Edinburgh
United KingdomPolitical ScienceMale116517%
23Chan, J.C.K.Iowa State
University
United StatesPsychologyMale113531%
24Greene, C.M.University
College Dublin
IrelandPsychologyFemale115819%
25Bastos, M.University
College Dublin
IrelandCommunicationMale104423%
4743272
Source: Own elaboration.
Table 3. Universities with the most publications on disinformation.
Table 3. Universities with the most publications on disinformation.
#UniversityCountryNumber
of Articles
1University of OxfordUnited Kingdom100
2Universiteit van AmsterdamNetherlands89
3The University of Western AustraliaAustralia73
4University of PennsylvaniaUnited States69
5Harvard UniversityUnited States68
6University of TorontoCanada68
7University of Michigan, Ann ArborUnited States68
8London School of Hygiene
& Tropical Medicine
United Kingdom68
9University of WashingtonUnited States67
10University College LondonUnited Kingdom67
11Massachusetts Institute of TechnologyUnited States67
12The University of SydneyAustralia66
13University of CambridgeUnited Kingdom66
14Harvard Medical SchoolUnited States65
15Stanford UniversityUnited States65
16Universidade de São PauloBrazil62
17Universidad Complutense de MadridSpain59
18University of BristolUnited Kingdom58
19The University of North Carolina
at Chapel Hill
United States58
20University of California, IrvineUnited States52
21Universität ZürichSwitzerland47
22National University of SingaporeSingapore47
23Universidad Rey Juan CarlosSpain47
24Indiana University BloomingtonUnited States47
25University of California, San FranciscoUnited States47
Source: own elaboration based on data from Scopus.
Table 4. Top 10 articles with the highest FWCI.
Table 4. Top 10 articles with the highest FWCI.
IDTitleSCIVAL TopicsProminence %FWCI
1COVID-19 and mental health: A review of the existing literaturePsychological Support; Mindfulness; COVID-1999.996172.95
2Measuring the impact of COVID-19 vaccine misinformation on vaccination intent in the UK and USAVaccine Hesitancy; Measles; Anti-Vaccination Movement99.970111.78
3Conspiracy theories as barriers to controlling the spread of COVID-19 in the U.S.Conspiracy Theory; Mentality; COVID-1999.24488.44
4Fighting COVID-19 Misinformation on Social Media: Experimental Evidence for a Scalable Accuracy-Nudge InterventionRumor; Social Media: Disinformation99.81970.73
5Vaccine hesitancy: the next challenge in the fight against COVID-19Vaccine Hesitancy; Measles; Anti-Vaccination Movement99.97066.60
6A Comprehensive Review of the COVID-19 Pandemic and the Role of IoT, Drones, AI, Blockchain, and 5G in Managing its ImpactBitcoin; Ethereum; Internet of Things99.98964.83
7The science of fake news: Addressing fake news requires a multidisciplinary effortNO DATANO DATA61.70
8High rates of COVID-19 vaccine hesitancy and its association with conspiracy beliefs: A study in Jordan and Kuwait among other Arab countriesVaccine Hesitancy; Measles; Anti-Vaccination Movement99.97049.40
9Health-protective behaviour, social media usage and conspiracy belief during the COVID-19 public health emergencyConspiracy Theory; Mentality; COVID-1999.24446.18
10A Survey of Fake News: Fundamental Theories, Detection Methods, and OpportunitiesRumor; Social Media: Disinformation99.81945.41
Source: own elaboration based on data from Scopus.
Table 5. Quotes received according to subject topic.
Table 5. Quotes received according to subject topic.
TopicN° ArticlesNumber of QuotesAverage
Health and COVID2213,926633
Fake News343111437
Disinformation and Social Networks64280713.33
Psychology52958591.6
Disinformation and Politics41979494.75
Disinformation and Technology41838459.5
Health and H1N1 flu111621162
Disinformation and Climate Change2893446.5
Health and HIV1658658
Health and Ebola1331331
Health, COVID and Politics1325325
Source: own elaboration.
Table 6. Authors’ disciplines.
Table 6. Authors’ disciplines.
Field 1Articles in the SampleCollaborative Articles (with One or More Fields)
Psychology147
Medicine147
Computer Science127
Communication84
Political Science74
Systems Engineering52
Physics33
Economics22
Humanities22
Mathematics22
Anthropology11
Climate Change11
Law11
Marketing11
Sociology11
Veterinary11
Source: own elaboration based on data from Scopus. 1 The fields represent the specialties of the different authors according to data from Scopus and the websites of the institutions where they work.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Navarro-Sierra, N.; Magro-Vela, S.; Vinader-Segura, R. Research on Disinformation in Academic Studies: Perspectives through a Bibliometric Analysis. Publications 2024, 12, 14. https://doi.org/10.3390/publications12020014

AMA Style

Navarro-Sierra N, Magro-Vela S, Vinader-Segura R. Research on Disinformation in Academic Studies: Perspectives through a Bibliometric Analysis. Publications. 2024; 12(2):14. https://doi.org/10.3390/publications12020014

Chicago/Turabian Style

Navarro-Sierra, Nuria, Silvia Magro-Vela, and Raquel Vinader-Segura. 2024. "Research on Disinformation in Academic Studies: Perspectives through a Bibliometric Analysis" Publications 12, no. 2: 14. https://doi.org/10.3390/publications12020014

APA Style

Navarro-Sierra, N., Magro-Vela, S., & Vinader-Segura, R. (2024). Research on Disinformation in Academic Studies: Perspectives through a Bibliometric Analysis. Publications, 12(2), 14. https://doi.org/10.3390/publications12020014

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop