Identifying and Analyzing Health-Related Themes in Disinformation Shared by Conservative and Liberal Russian Trolls on Twitter
Abstract
:1. Introduction
2. Materials and Methods
2.1. Data Pre-Processing
2.2. Identification and Analysis of Health Tweets and Topics
2.2.1. Linguistic Analysis
2.2.2. Topic Modeling
Topics | Documents | |
& | ||
P(Wk|Tk) | P(Tk|Dj) |
2.2.3. Topic Analysis
2.3. Statistical Comparison
3. Results
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Appendix A
ID | Label | An Example of Tweets |
---|---|---|
T2 | Clinton Health Issue | Well looks like Hillary’s pneumonia caused by Parkinsons disease |
T3 | Fitness | Shoulder/Abdominal workouts have been brutal this month..progress..quotes quote gym gymlife |
T4 | Health Issues | Have some dark chocolate (an ounce/dayindulgecan lower blood pressureincrease blood flow improve good cholesterol (HDL) |
T5 | Health Policy | Trump Wants to Know Why Congress Isnt Paying What the Public Pays for Health Care |
T6 | Health Care bill | Constituents applaud GOP senator for opposing health care bill |
T9 | Public Health Risks | Pepsi admits its soda contains cancer-causing ingredients cancer soda pepsi diet |
T10 | Abortion | Abortion Clinic Killed This Woman in a Botched Abortion. Then Her Organs Were Harvested |
T12 | Poisoned Food | Happy Thanksgiving Turkey was poisoned? Turkey Food Poisoning USDA |
T13 | Hospital Setting (Environment) | local Desperate patients search for Minnesota doctors who will help them sign up for medical marijuana |
T14 | Water Pollution | Water in American Falls is poisoned with phosphorus waste I suppose that our government wants to poison us phosphorus disaster Traitors |
T15 | Opioid Epidemic | Seattle Approves Safe Injection Sites for Illegal Drug Users to Inject Illegal Drugs |
T16 | LGBT Conversion Therapy | So much so that they can disregard gay conversion therapy supporter Mike Pence |
T19 | FDA and New Drugs | news FDA panel backs female sex pill under safety conditions |
T20 | Healthcare System | The largest example of government-run health care in the U.S should be a warning to all #WakeUpAmerica |
T21 | Planned Parenthood/Abortions | Planned Parenthood U.KNow Pitching Abortions as Just a Form of Birth Control barr |
T22 | Flint Water Crisis | They’re pumping millions of gallons of water for free while flint residents pay for poisoned water. |
T23 | Substance Abuse | the many people who must use pain killers temporarily they’re a God send but just like alcohol abuse. |
T25 | Gender Reassignment Surgeries | Gender Reassignment Surgery Has Just Reached Disgusting New Heights |
T27 | ObamaCare Legal Challenge | Obama defends health care law ahead of Supreme Court ruling |
T28 | Veteran’s Health Issues | Veterans at Wisconsin VA Hospital May Have Been Infected with Hepatitis HIV |
T29 | Medicaid and Taxes | Trump is backing a bill that cuts Medicaid by nearly a trillion dollars. It also gives a big tax cut to the rich. |
T30 | Hospitalizations (Sensational) | Hospitalized woman deprived of water died in jail after arrest for unpaid fines BLM |
T31 | Emergency Alert | BREAKING One Dead Injured in #VAState of Emergency Declared! |
T32 | Diet and Weight Loss | What weight loss drink did Sherman use on #NuttyProfessor? Jenny Craig, Mega Shake, Super Diet, Weight Off |
T33 | Body shape and weight | This is what lbs of muscle vs. lbs of fat look Focus on what youre made of not your weight Daily Reminder |
T34 | Mental Health | I learned how to prioritize my mental health. That depression wasn’t my fault. That anxiety wasn’t my fault. That there was no shame. |
T35 | Medical Marijuana | Medical marijuana isn’t enough. It’s not legal until it’s legal for black and brown communities who are still x more likely to be arrested! |
T36 | Diet | If taking junk food out of my diet improves my health taking junk media out of my life improves my soul quote |
T37 | Health Insurance Policy | Trying to figure out how #TakeAKnee is un-American but letting people die because of lack of health insurance is patriotic #TrumpBudget |
T39 | Health Insurance Coverage | Throwing million people off their health care to give billionaires a tax break is heartless & amp irresponsible. We cannot pass #Trumpcare. |
T40 | War on Drugs | Nixon Official Admits The War on Drugs Was Really A War On Blacks And It Worked. |
T42 | Drug and Medical Tests | NC High Schooler Who Passed Drug Test Suspended for Smelling Like Weed #BlackTwitter |
T44 | Bird Flu | Growth in Iowa bird flu cases appears to be slowing health |
T46 | Healthcare Reform Cost | Despite Obama Promise, sHealth Care Costs Have Risen the Most in Years Breitbart |
T47 | Pharmaceutical Industry | When big pharma jacks up the prices of a life-saving medicationthe cost isn’t just dollars and cents--it’s livesYeson |
T49 | Violent Incident Reports | top RT @AnnaBDAlgerian Paris Attacker Identified in Hospital After Being Shot Five Times During Arrest |
T51 | Female genital mutilation (FGM) | Detroit doctor arrested for performing Female Genital Mutilation on girls ages six to eight years old. Feminists are silent. |
T53 | Healthcare Donations | Please Support Help the Dave Fredrick Family with medical expenses Donate. |
T56 | HIV | EXCLUSIVE:Clinton Foundation AIDS Program Distributed Watered-Down Drugs To Third World Countries. |
T60 | Chronic Diseases | Johnson Johnson starts project to prevent Type diabetes health |
T63 | Vaccine | VaccinateUS vaccines eradicated smallpox and have nearly eradicated other diseases such as polio. |
T64 | Texas Abortion Legislation | BREAKING Texas Takes a YUGE Step Forward in Battling Abortion amelin |
T69 | Sports Injuries | sports Cavs say Kyrie Irving has fractured left knee cap will have surgery and miss months |
T72 | Obamacare (ACA) Repeal | This is rich House GOP exempt themselves their health insurance from their latest ACA repeal plan |
T73 | Global Health News | South Korea reports sixth death from Middle East Respiratory Syndrome as government steps up monitoring |
T74 | Cost of Transgender Medical Car for Military | Transgender Medical Care SHOCKINGLY More Costly than Average Military Soldier. |
T76 | Abortion Legislation | Top News Florida governor signs bill requiring two clinic visits waiting period for abortion |
T78 | Cancer | Cancer Killing Molecule Destroys Tumor Cells and Leaves Normal Cells Unaffected |
References
- Turner-McGrievy, G.; Karami, A.; Monroe, C.; Brandt, H.M. Dietary pattern recognition on Twitter: A case example of before, during, and after four natural disasters. Nat. Hazards J. Int. Soc. Prev. Mitig. Nat. Hazards 2020, 103, 1035–1049. [Google Scholar]
- Hao, K.; Basu, T. The Coronavirus is the First True Social-Media “Infodemic”. MIT Technol. Rev. 2020. Available online: https://www.technologyreview.com/2020/02/12/844851/the-coronavirus-is-the-first-true-social-media-infodemic/ (accessed on 1 November 2020).
- Vosoughi, S.; Roy, D.; Aral, S. The spread of true and false news online. Science 2018, 359, 1146–1151. [Google Scholar] [CrossRef]
- Shu, K.; Wang, S.; Lee, D.; Liu, H. Mining Disinformation and Fake News: Concepts, Methods, and Recent Advancements; Springer: Berlin/Heidelberg, Germany, 2020. [Google Scholar]
- Garg, N.; Venkatraman, A.; Pandey, A.; Kumar, N. YouTube as a source of information on dialysis: A content analysis. Nephrology 2015, 20, 315. [Google Scholar] [CrossRef]
- Strychowsky, J.E.; Nayan, S.; Farrokhyar, F.; MacLean, J. YouTube: A good source of information on pediatric tonsillectomy? Int. J. Pediatric Otorhinolaryngol. 2013, 77, 972–975. [Google Scholar] [CrossRef] [PubMed]
- Larson, H.J. The biggest pandemic risk? Viral misinformation. Nature 2018, 562, 309–310. [Google Scholar] [CrossRef] [Green Version]
- Jang, S.M.; Mckeever, B.W.; Mckeever, R.; Kim, J.K. From social media to mainstream news: The information flow of the vaccine-autism controversy in the US, Canada, and the UK. Health Commun. 2019, 34, 110–117. [Google Scholar] [CrossRef] [PubMed]
- Broniatowski, D.A.; Jamison, A.M.; Qi, S.; AlKulaib, L.; Chen, T.; Benton, A.; Quinn, S.C.; Dredze, M. Weaponized health communication: Twitter bots and Russian trolls amplify the vaccine debate. Am. J. Public Health 2018, 108, 1378–1384. [Google Scholar] [CrossRef]
- Many Americans say made-up news is a critical problem that needs to be fixed. Available online: https://www.journalism.org/2019/06/05/many-americans-say-made-up-news-is-a-critical-problem-that-needs-to-be-fixed/ (accessed on 1 November 2020).
- Stocking, G.; Sumida, N. Social Media Bots Draw Public’s Attention and Concern. In Pew Research Center’s Journalism Project. 15 October 2018. Available online: https://www.journalism.org/2018/10/15/social-media-bots-draw-publics-attention-and-concern/ (accessed on 3 October 2020).
- Pulido, C.M.; Ruiz-Eugenio, L.; Redondo-Sama, G.; Villarejo-Carballido, B. A New Application of Social Impact in Social Media for Overcoming Fake News in Health. Int. J. Environ. Res. Public health 2020, 17, 2430. [Google Scholar] [CrossRef] [Green Version]
- CHEQ. The Economic Cost of Bad Actors on the Internet; University of Baltimore: Baltimore, MD, USA, 2019. [Google Scholar]
- Jamison, A.M.; Broniatowski, D.A.; Quinn, S.C. Malicious actors on Twitter: A guide for public health researchers. Am. J. Public Health 2019, 109, 688–692. [Google Scholar] [CrossRef]
- Wojcik, S.; Messing, S.; Smith, A.; Rainie, L.; Hitlin, P. Bots in the Twittersphere: An Estimated Two-Thirds of Tweeted Links to Popular Websites are Posted by Automated Accounts-Not Human Beings; Pew Research Center: Washington, DC, USA, 2018. [Google Scholar]
- Wang, Y.; McKee, M.; Torbica, A.; Stuckler, D. Systematic literature review on the spread of health-related misinformation on social media. Soc. Sci. Med. 2019, 240, 112552. [Google Scholar] [CrossRef]
- Beskow, D.M.; Carley, K.M. Characterization and comparison of Russian and Chinese disinformation campaigns. In Disinformation, Misinformation, and Fake News in Social Media; Springer: Berlin/Heidelberg, Germany, 2020; pp. 63–81. [Google Scholar]
- Boatwright, B.C.; Linvill, D.L.; Warren, P.L. Troll Factories: The Internet Research Agency and State-Sponsored Agenda Building. Resour. Cent. Media Freedom Eur. 2018. Available online: https://www.rcmediafreedom.eu/Publications/Academic-sources/Troll-Factories-The-Internet-Research-Agency-and-State-Sponsored-Agenda-Building (accessed on 1 November 2020).
- Giachanou, A.; Rosso, P.; Crestani, F. Leveraging emotional signals for credibility detection. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, Paris, France, 21–25 July 2019; pp. 877–880. [Google Scholar]
- Ghanema, B.; Buscaldib, D.; Rossoa, P. TexTrolls: Identifying Trolls on Twitter with Textual and Affective Features. In Proceedings of the Workshop on Online Misinformation- and Harm-Aware Recommender Systems, Rio de Janeiro, Brazil, 25 September 2020. [Google Scholar]
- Addawood, A.; Badawy, A.; Lerman, K.; Ferrara, E. Linguistic cues to deception: Identifying political trolls on social media. In Proceedings of the International AAAI Conference on Web and Social Media, Münich, Germany, 8–11 June 2019; pp. 15–25. [Google Scholar]
- Freelon, D.; Lokot, T. Russian Twitter disinformation campaigns reach across the American political spectrum. Harv. Kennedy Sch. Misinform. Rev. 2020. [Google Scholar] [CrossRef] [Green Version]
- Linvill, D.L.; Warren, P.L. Troll factories: Manufacturing specialized disinformation on Twitter. Political Commun. 2020, 37, 447–467. [Google Scholar] [CrossRef]
- Internet Research Agency. Wikipedia. 2020. Available online: https://en.wikipedia.org/w/index.php?title=Internet_Research_Agency&oldid=978587564 (accessed on 10 October 2020).
- Roeder, O. Why We’re Sharing 3 Million Russian Troll Tweets. In FiveThirtyEight. 31 July 2018. Available online: https://fivethirtyeight.com/features/why-were-sharing-3-million-russian-troll-tweets/ (accessed on 30 September 2020).
- Bail, C.A.; Guay, B.; Maloney, E.; Combs, A.; Hillygus, D.S.; Merhout, F.; Freelon, D.; Volfovsky, A. Assessing the Russian Internet Research Agency’s impact on the political attitudes and behaviors of American Twitter users in late 2017. Proc. Natl. Acad. Sci. USA 2020, 117, 243–250. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Aslam, S. Twitter by the Numbers: Stats, Demographics & Fun Facts. 2021. Available online: https://www.omnicoreagency.com/twitter-statistics/#:~:text=Twitter%20Demographics&text=There%20are%20262%20million%20International,users%20have%20higher%20college%20degrees (accessed on 11 February 2021).
- Pennebaker, J.W.; Boyd, R.L.; Jordan, K.; Blackburn, K. The Development and Psychometric Properties of LIWC2015. Austin, TX:Pennebaker Conglomerates; 2015. Available online: www.LIWC.net (accessed on 10 July 2020).
- Karami, A.; Bennett, L.S.; He, X. Mining public opinion about economic issues: Twitter and the us presidential election. Int. J. Strateg. Decis. Sci. (IJSDS) 2018, 9, 18–28. [Google Scholar] [CrossRef] [Green Version]
- Karami, A.; Zhou, B. Online Review Spam Detection by New Linguistic Features. In iConference 2015 Proceedings; iSchools: Irvine, CA, USA, 2015. [Google Scholar]
- Blei, D.M.; Ng, A.Y.; Jordan, M.I. Latent dirichlet allocation. J. Mach. Learn. Res. 2003, 3, 993–1022. [Google Scholar]
- Karami, A. Fuzzy Topic Modeling for Medical Corpora. Ph.D. Thesis, University of Maryland, Baltimore County, MD, USA, 2015. [Google Scholar]
- Bian, J.; Yoshigoe, K.; Hicks, A.; Yuan, J.; He, Z.; Xie, M.; Guo, Y.; Prosperi, M.; Salloum, R.; Modave, F. Mining Twitter to assess the public perception of the “Internet of Things. ” PLoS ONE 2016, 11, e0158450. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Karami, A.; Gangopadhyay, A.; Zhou, B.; Kharrazi, H. Fuzzy approach topic discovery in health and medical corpora. Int. J. Fuzzy Syst. 2018, 20, 1334–1345. [Google Scholar] [CrossRef]
- Ghassemi, M.; Naumann, T.; Doshi-Velez, F.; Brimmer, N.; Joshi, R.; Rumshisky, A.; Szolovits, P. Unfolding physiological state: Mortality modelling in intensive care units. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, NY, USA, 24–27 August 2014; pp. 75–84. [Google Scholar]
- Karami, A.; Pendergraft, N.M. Computational Analysis of Insurance Complaints: GEICO Case Study. In Proceedings of the International Conference on Social Computing, Behavioral-Cultural Modeling, & Prediction and Behavior Representation in Modeling and Simulation, Washington, DC, USA, 10–13 July 2018. [Google Scholar]
- Lim, K.W.; Buntine, W. Twitter opinion topic model: Extracting product opinions from tweets by leveraging hashtags and sentiment lexicon. In Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management, Shanghai, China, 3–7 November 2014; pp. 1319–1328. [Google Scholar]
- Shin, G.; Jarrahi, M.H.; Fei, Y.; Karami, A.; Gafinowitz, N.; Byun, A.; Lu, X. Wearable Activity Trackers, Accuracy, Adoption, Acceptance and Health Impact: A Systematic Literature Review. J. Biomed. Inform. 2019, 93, 103153. [Google Scholar] [CrossRef] [PubMed]
- Karami, A.; Lundy, M.; Webb, F.; Dwivedi, Y.K. Twitter and research: A systematic literature review through text mining. IEEE Access. 2020, 8, 67698–67717. [Google Scholar] [CrossRef]
- Mohammadi, E.; Karami, A. Exploring research trends in big data across disciplines: A text mining analysis. J. Inf. Sci. 2020, 0165551520932855. [Google Scholar] [CrossRef]
- Money, V.; Karami, A.; Turner-McGrievy, B.; Kharrazi, H. Seasonal characterization of diet discussions on Reddit. Proc. Assoc. Inf. Sci. Technol. 2020, 57, e320. [Google Scholar] [CrossRef]
- Karami, A.; Shaw, G. An exploratory study of (#) exercise in the Twittersphere. In iConference 2019 Proceedings; iSchools: Washington, DC, USA, 2019. [Google Scholar]
- Karami, A.; Webb, F.; Kitzie, V.L. Characterizing transgender health issues in twitter. Proc. Assoc. Inf. Sci. Technol. 2018, 55, 207–215. [Google Scholar] [CrossRef] [Green Version]
- Karami, A.; Webb, F. Analyzing health tweets of LGB and transgender individuals. Proc. Assoc. Inf. Sci. Technol. 2020, 57, e264. [Google Scholar] [CrossRef]
- Karami, A.; Anderson, M. Social media and COVID-19: Characterizing anti-quarantine comments on Twitter. Proc. Assoc. Inf. Sci. Technol. 2020, 57, e349. [Google Scholar] [CrossRef] [PubMed]
- Karami, A.; Elkouri, A. Political popularity analysis in social media. In International Conference on Information; Springer: Berlin/Heidelberg, Germany, 2019. [Google Scholar]
- Karami, A.; Shah, V.; Vaezi, R.; Bansal, A. Twitter speaks: A case of national disaster situational awareness. J. Inf. Sci. 2020, 46, 313–324. [Google Scholar] [CrossRef] [Green Version]
- Xu, Z.; Lachlan, K.; Ellis, L.; Rainear, A.M. Understanding public opinion in different disaster stages: A case study of Hurricane Irma. Internet Res. 2019, 30, 695–709. [Google Scholar] [CrossRef]
- Karami, A.; White, C.N.; Ford, K.; Swan, S.; Spinel, M.Y. Unwanted advances in higher education: Uncovering sexual harassment experiences in academia with text mining. Inf. Process. Manag. 2020, 57, 102167. [Google Scholar] [CrossRef] [Green Version]
- Lim, B.H.; Valdez, C.E.; Lilly, M.M. Making meaning out of interpersonal victimization: The narratives of IPV survivors. Violence Women 2015, 21, 1065–1086. [Google Scholar] [CrossRef] [PubMed]
- Pruim, R.; Kaplan, D.; Horton, N. Mosaic: Project MOSAIC Statistics and Mathematics Teaching Utilities. R Package Version 06-2 2012. Available online: https://www.r-pkg.org/pkg/mosaic (accessed on 15 October 2020).
- Kim, J.H.; Ji, P.I. Significance testing in empirical finance: A critical review and assessment. J. Empir. Financ. 2015, 34, 1–14. [Google Scholar] [CrossRef]
- Good, I.J. C140. Standardized tail-area prosabilities. J. Stat. Comput. Simul. 1982, 16, 65–66. [Google Scholar] [CrossRef]
- Benjamini, Y.; Hochberg, Y. Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. R. Stat. Soc. Ser. B Stat. Methodol. 1995, 57, 289–300. [Google Scholar] [CrossRef]
- Jafari, M.; Ansari-Pour, N. Why, when and how to adjust your P values? Cell J. 2019, 20, 604. [Google Scholar] [PubMed]
- Rehurek, R.; Sojka, P. Software framework for topic modelling with large corpora. In Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks, Citeseer, Valletta, Malta, 22 May 2010. [Google Scholar]
- MALLET: A Machine Learning for Language Toolkit. Available online: http://mallet.cs.umass.edu/ (accessed on 15 June 2019).
- Zipf, G.K. Human Behavior and the Principle of Least Effort: An Introduction to Human Ecology; Addison-Wesley Press: Bostoan, MA, USA, 1949. [Google Scholar]
- Hrynowski, Z. Several Issues Tie as Most Important in 2020 Election. Available online: https://news.gallup.com/poll/276932/several-issues-tie-important-2020-election.aspx (accessed on 27 March 2020).
- Center, P.R. 2016 Campaign: Strong Interest, Widespread Dissatisfaction. 2016. Available online: https://www.pewresearch.org/politics/2016/07/07/2016-campaign-strong-interest-widespread-dissatisfaction/ (accessed on 27 March 2020).
- The Big Issues Of The 2016 Campaign. In FiveThirtyEight. 19 November 2015. Available online: https://fivethirtyeight.com/features/year-ahead-project/ (accessed on 14 October 2020).
- Winston, D. Priority Issues in 2016 Election. In Democracy Fund Voter Study Group. Available online: https://www.voterstudygroup.org/publication/placing-priority?VSGToken=Jc10kUBctGqSVlyzfDc998X9tIRprQbh (accessed on 14 October 2020).
- Election. Battleground State Poll Which Issues Matter Voters | Commonwealth Fund. 2020. Available online: https://www.commonwealthfund.org/publications/2020/sep/election-2020-battleground-state-health-care-poll (accessed on 14 October 2020).
- Important Issues in the 2020 Election | Pew Research Center. Available online: https://www.pewresearch.org/politics/2020/08/13/important-issues-in-the-2020-election/ (accessed on 14 October 2020).
- Sugarman, E. Kaiser Health Tracking Poll: October 2016. In KFF. 27 October 2016. Available online: https://www.kff.org/health-costs/poll-finding/kaiser-health-tracking-poll-october-2016/ (accessed on 14 October 2020).
- Blendon, R.J.; Benson, J.M.; Casey, L.S. Health care in the 2016 election—A view through voters’ polarized lenses. N. Engl. J. Med. 2016, 375, e37. [Google Scholar] [CrossRef]
- Top Voting Issues in 2016 Election. Available online: https://www.pewresearch.org/politics/2016/07/07/4-top-voting-issues-in-2016-election/ (accessed on 1 November 2020).
- KFF Health Tracking Poll—September 2020: Top Issues in 2020 Election, The Role of Misinformation, and Views on A Potential Coronavirus Vaccine. In KFF. 10 September 2020. Available online: https://www.kff.org/coronavirus-covid-19/report/kff-health-tracking-poll-september-2020/ (accessed on 14 October 2020).
- Southwell, B.G.; Niederdeppe, J.; Cappella, J.N.; Gaysynsky, A.; Kelley, D.E.; Oh, A.; Peterson, E.B.; Sylvia Chou, V.-Y. Misinformation as a misunderstood challenge to public health. Am. J. Prev. Med. 2019, 57, 282–285. [Google Scholar] [CrossRef]
- Southwell, B.G.; Thorson, E.A.; Sheble, L. Misinformation and Mass Audiences; University of Texas Press: Austin, TX, USA, 2018. [Google Scholar]
ID | Label | Topic |
---|---|---|
T2 | Clinton Health Issue | hillary clinton pneumonia hillaryshealth sick records medical disease lies parkinson |
T3 | Fitness | workout make exercise hard fitness day good stay summer body |
T4 | Health Issues | medicine health heart trust blood food find made wellness disease |
T5 | Health Policy | health public congress care trump job paying pays lose benefits |
T6 | Health Care bill | health care bill gop vote house trump plan senate republican |
T9 | Public Health Risks | world toxic health linked found food cancer epa air cancer-causing |
T10 | Abortion | abortion baby parts born body pro-life abortions women defends unborn |
T12 | Poisoned Food | kochfarms turkey happy poisoned thanksgiving omg launch friend usda sad |
T13 | Hospital Setting (Environment) | patients doctors work hospital cancer treatment nurses medical healthcare nhs |
T14 | Water Pollution | american water government falls poisoned live poison traitors native phosphorus |
T15 | Opioid Epidemic | drug opioid epidemic addiction heroin crisis deaths overdose dealer treat |
T16 | LGBT Conversion Therapy | therapy life pence mike year low lgbt wife changing conversion |
T19 | FDA—New Drugs | health news fda panel drug price human female backs secretary |
T20 | Healthcare System | health care system democrats republican traitor anti-trump warning approves |
T21 | Planned Parenthood/Abortions | planned parenthood control abortions birth form pitching pro-life responsible defund |
T22 | Flint Water Crisis | water lead flint poisoning toxic people children residents pay days |
T23 | Substance Abuse | alcohol pain people topl died drinking medication dangerous doctor told abuse |
T25 | Gender Reassignment Surgeries | life gender live nfl football set reassignment wins disgusting team |
T27 | ObamaCare Legal Challenge | court law health supreme obama case justice politics watch political |
T28 | Veteran’s Health Issues | veterans medical pill hospital receive immediately hours died vets private |
T29 | Medicaid and Taxes | medicaid tax cut trump medicare state social billion gop security |
T30 | Hospitalizations (Sensational) | hospital died man police family home woman year-old left injuries |
T31 | Emergency Alert | injured dead breaking emergency vastate declared kids illnesses visits listeria |
T32 | Diet and Weight Loss | health natural diet loss weight ways remove benefits top nutrition |
T33 | Body shape and weight | fat big ass body eat guy people weight lose obese |
T34 | Mental Health | mental health illness black issues suffering emotional depression stress anxiety |
T35 | Medical Marijuana | medical marijuana news cannabis legal oil treatment cigarette smoking weed |
T36 | Diet | diet eating food healthy unhealthy vegan meals junk alternatives sugar |
T37 | Health Insurance Policy | health major policy issues causing people die lack percent insurance |
T39 | Health Insurance Coverage | health care people insurance million americans plan coverage millions lose |
T40 | War on Drugs | drugs war drug johnson black problem marijuana death junkieus addicts |
T42 | Drug and Medical Tests | drug test high find school remember testing scientists passed discovered |
T44 | Bird Flu | news health flu local bird cases business officials deadly outbreak |
T46 | Healthcare Reform Cost | health care costs reform education universal end free concerns concerned |
T47 | Pharmaceutical Industry | drug big cost prices pharma companies lower americans industry prescription |
T49 | Violent Incident Reports | hospital secret report police officer reveals fire shot operating physically |
T51 | Female Genital Mutilation (FGM) | doctor female girls woman african genital black states american mutilation |
T53 | Healthcare Donations | money support million donate pay fund living medical children dollars |
T56 | HIV | hiv aids world infected cure lived days archived end drugs |
T60 | Chronic Diseases | disease risk heart diabetes obesity prevent researchers death attack chronic |
T63 | Vaccine | vaccine health diseases children call doctors critical spread harm effects |
T64 | Texas Abortion Legislation | takes texas step abortion breaking forward battling yuge moving stopping |
T69 | Sports Injuries | sports injury game left surgery live back baseball head nba |
T72 | Obamacare (ACA) Repeal | obamacare health insurance repeal healthcare congress trump gop support aca |
T73 | Global Health News | health news surgery south death released mers global fever science |
T74 | Cost of Transgender Medical Car for Military | heart surgery military transgender soldier plastic trump average medical wounded |
T76 | Abortion Legislation | abortion bill law ban passes women funding signs house pregnancy |
T78 | Cancer | cancer breast kills brain cells fight awareness cure survivor patients |
Topic | Results | Topic | Result |
---|---|---|---|
Clinton Health Issue | * L < R | Body shape and weight | NS |
Fitness | * L > R | Mental Health | * L > R |
Health Issues | NS | Medical Marijuana | NS |
Health Policy | NS | Diet | NS |
Health Care bill | * L < R | Health Insurance Policy | NS |
Public Health Risks | NS | Health Insurance Coverage | * L > R |
Abortion | * L < R | War on Drugs | * L > R |
Poisoned Food | * L < R | Drug and Medical Tests | NS |
Hospital Setting (Environment) | NS | Bird Flu | NS |
Water Pollution | * L > R | Healthcare Reform Cost | NS |
Opioid Epidemic | NS | Pharmaceutical Industry | NS |
LGBT Conversion Therapy | * L > R | Violent Incident Reports | NS |
FDA—New Drugs | NS | Female Genital mutilation (FGM) | * L > R |
Healthcare System | * L < R | Healthcare Donations | NS |
Planned Parenthood/Abortions | * L < R | HIV | NS |
Flint Water Crisis | * L > R | Chronic Diseases | NS |
Substance Abuse | NS | Vaccine | NS |
Gender Reassignment Surgeries | NS | Texas Abortion Legislation | * L < R |
ObamaCare Legal Challenge | NS | Sports Injuries | NS |
Veteran’s Health Issues | NS | Obamacare (ACA) Repeal | NS |
Medicaid and Taxes | NS | Global Health News | NS |
Hospitalizations (Sensational) | * L > R | Cost of Trans gender Medical Car for Military | NS |
Emergency Alert | * L < R | Abortion Legislation | NS |
Diet and Weight Loss | NS | Cancer | NS |
Left Trolls | Right Trolls |
---|---|
Mental Health (L > R) | Clinton Health Issue (L < R) |
Health Insurance Coverage (L > R) | Health Care bill (L < R) |
Hospitalizations (Sensational) (L > R) | Planned Parenthood/Abortions (L < R) |
Flint Water Crisis (L > R) | Abortion Legislation (L = R) |
Health Care bill (L < R) | Obamacare (ACA) Repeal (L = R) |
Cancer (L = R) | Abortion (L < R) |
War on Drugs (L > R) | Cancer (L = R) |
Sports Injuries (L = R) | Health Insurance Coverage (L > R) |
Body shape and weight (L = R) | Diet and Weight Loss (L = R) |
Medicaid and Taxes (L = R) | Emergency Alert (L < R) |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Karami, A.; Lundy, M.; Webb, F.; Turner-McGrievy, G.; McKeever, B.W.; McKeever, R. Identifying and Analyzing Health-Related Themes in Disinformation Shared by Conservative and Liberal Russian Trolls on Twitter. Int. J. Environ. Res. Public Health 2021, 18, 2159. https://doi.org/10.3390/ijerph18042159
Karami A, Lundy M, Webb F, Turner-McGrievy G, McKeever BW, McKeever R. Identifying and Analyzing Health-Related Themes in Disinformation Shared by Conservative and Liberal Russian Trolls on Twitter. International Journal of Environmental Research and Public Health. 2021; 18(4):2159. https://doi.org/10.3390/ijerph18042159
Chicago/Turabian StyleKarami, Amir, Morgan Lundy, Frank Webb, Gabrielle Turner-McGrievy, Brooke W. McKeever, and Robert McKeever. 2021. "Identifying and Analyzing Health-Related Themes in Disinformation Shared by Conservative and Liberal Russian Trolls on Twitter" International Journal of Environmental Research and Public Health 18, no. 4: 2159. https://doi.org/10.3390/ijerph18042159