The Toxic Masculinity Scale: Development and Initial Validation
Abstract
:1. Public Significance Statement
2. The Toxic Masculinity Scale: Development and Initial Validation
3. The Current Research
3.1. Study 1: Scale Item Development
3.1.1. Participant Characteristics
3.1.2. Measure
3.1.3. Procedures
3.1.4. Data Analysis
3.1.5. Results and Discussion
3.2. Phase 2: Initial Exploratory Factor Analysis
3.2.1. Participant Characteristics
3.2.2. Measure
3.2.3. Procedures
3.2.4. Data Analysis
3.2.5. Results and Discussion
3.3. Phase 3: Confirmatory Factory Analysis, Reliability Analysis, and Preliminary Validation Analysis
3.3.1. Participant Characteristics
3.3.2. Measures
Demographic Information
Toxic Masculinity
Conformity to Masculine Norms
Male Role Norms
Liberal Feminist Attitudes
3.3.3. Procedures
3.3.4. Data Analysis
3.3.5. Data and Study Materials Availability
4. Results
Convergent and Discriminant Validity
5. Discussion
6. Implications
7. Limitations and Future Directions
Supplementary Materials
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Appendix A
Subscale | Item | Standardized B | SE |
---|---|---|---|
Masculine Superiority | |||
TMS 10 | Men are superior to women | 0.73 | 0.05 |
TMS 15 | Men cheating on their partner is natural | 0.52 | 0.04 |
TMS 16 | Men should not work for women | 0.63 | 0.04 |
TMS 17 | My opinion as a man is more important than that of a woman’s | 0.86 | 0.03 |
TMS 18 | I don’t value the opinion of women | 0.87 | 0.03 |
TMS 19 | A woman’s ideas are not as important as a man’s | 0.82 | 0.03 |
TMS 23 | Lying to my partner is okay, because I am a man | 0.72 | 0.03 |
TMS 28 | On average, men are smarter than women | 0.69 | 0.05 |
TMS 29 | Men are more capable than women | 0.67 | 0.05 |
TMS 30 | Men talking over women isn’t rude | 0.70 | 0.03 |
TMS 31 | I see it as a challenge when someone refuses my sexual advance | 0.74 | 0.03 |
Gender Rigidity | |||
TMS 11 | Gender and sex are the same thing | 0.86 | 0.06 |
TMS 12 | There are only two genders | 0.91 | 0.06 |
TMS 13 | Gender is not different from sex | 0.86 | 0.06 |
TMS 14 | It is propaganda that there are more than two genders | 0.91 | 0.06 |
TMS 20 | Men should use only masculine pronouns (e.g., he/him) | 0.75 | 0.06 |
TMS 32 | Sex workers have no self-respect | 0.68 | 0.06 |
TMS 33 | Sex work isn’t a career | 0.65 | 0.07 |
TMS 34 | There is no such thing as male privilege | 0.72 | 0.06 |
TMS 35 | Men don’t have inherent advantages in life | 0.68 | 0.06 |
Emotional Restriction | |||
TMS 1 | If I cry, I am weak | 0.94 | 0.04 |
TMS 2 | Crying means I am weak | 0.94 | 0.04 |
TMS 3 | Expressing sadness publicly makes me weak | 0.79 | 0.05 |
TMS 4 | Public displays of sadness means I am not masculine | 0.73 | 0.05 |
Repressed Suffering | |||
TMS 24 | If I am in pain, I don’t let people know | 0.79 | 0.05 |
TMS 25 | I ignore pain when I feel it | 0.85 | 0.05 |
TMS 26 | If I am sick, I refuse to go to the doctor | 0.76 | 0.05 |
TMS 27 | If I don’t feel well, I just ignore it | 0.81 | 0.05 |
Subscale | Item | Standardized B | SE |
---|---|---|---|
Masculine Superiority | |||
TMS 10 | Men are superior to women | 0.79 | 0.05 |
TMS 15 | Men cheating on their partner is natural | 0.58 | 0.05 |
TMS 16 | Men should not work for women | 0.77 | 0.05 |
TMS 17 | My opinion as a man is more important than that of a woman’s | 0.89 | 0.04 |
TMS 18 | I don’t value the opinion of women | 0.77 | 0.03 |
TMS 19 | A woman’s ideas are not as important as a man’s | 0.79 | 0.04 |
TMS 23 | Lying to my partner is okay, because I am a man | 0.77 | 0.03 |
TMS 28 | On average, men are smarter than women | 0.75 | 0.05 |
TMS 29 | Men are more capable than women | 0.73 | 0.06 |
TMS 30 | Men talking over women isn’t rude | 0.74 | 0.04 |
TMS 31 | I see it as a challenge when someone refuses my sexual advances | 0.72 | 0.04 |
Gender Rigidity | |||
TMS 11 | Gender and sex are the same thing | 0.90 | 0.07 |
TMS 12 | There are only two genders | 0.93 | 0.07 |
TMS 13 | Gender is not different from sex | 0.88 | 0.07 |
TMS 14 | It is propaganda that there are more than two genders | 0.92 | 0.07 |
TMS 20 | Men should use only masculine pronouns (e.g., he/him) | 0.77 | 0.07 |
TMS 32 | Sex workers have no self-respect | 0.69 | 0.07 |
TMS 33 | Sex work isn’t a career | 0.65 | 0.08 |
TMS 34 | There is no such thing as male privilege | 0.73 | 0.07 |
TMS 35 | Men don’t have inherent advantages in life | 0.63 | 0.07 |
Emotional Restriction | |||
TMS 1 | If I cry, I am weak | 0.94 | 0.05 |
TMS 2 | Crying means I am weak | 0.95 | 0.05 |
TMS 3 | Expressing sadness publicly makes me weak | 0.85 | 0.06 |
TMS 4 | Public displays of sadness means I am not masculine | 0.82 | 0.06 |
Repressed Suffering | |||
TMS 24 | If I am in pain, I don’t let people know | 0.65 | 0.07 |
TMS 25 | I ignore pain when I feel it | 0.79 | 0.06 |
TMS 26 | If I am sick, I refuse to go to the doctor | 0.82 | 0.06 |
TMS 27 | If I don’t feel well, I just ignore it | 0.90 | 0.06 |
References
- Harrington, C. What is “Toxic Masculinity” and Why Does it Matter? Men Masculinities 2021, 24, 345–352. [Google Scholar] [CrossRef]
- Schall, K.J. “Suck It Up”: Discrimination and Toxic Masculinity on Mental Health Across Genders. Unpublished Doctoral Dissertation, Alliant International University, Alhambra, CA, USA, 2021. [Google Scholar]
- de Boise, S. Editorial: Is masculinity toxic? Int. J. Masculinity Stud. 2019, 14, 147–151. [Google Scholar] [CrossRef]
- Levant, R.F.; Hall, R.J.; Rankin, T.J. Male Role Norms Inventory-Short Form (MRNI-SF): Development, confirmatory factor analytic investigation of structure, and measurement invariance across gender. J. Couns. Psychol. 2013, 60, 228–238. [Google Scholar] [CrossRef] [PubMed]
- Mahalik, J.R.; Locke, B.; Ludlow, L.; Diemer, M.; Scott, R.P.J.; Gottfried, M.; Freitas, G. Development of the Conformity to Masculine Norms Inventory. Psychol. Men Masculinity 2003, 4, 3–25. [Google Scholar] [CrossRef]
- Parent, M.C.; Moradi, B. Confirmatory factor analysis of the Conformity to Masculine Norms Inventory and development of the CMNI-46. Psychol. Men Masculinity 2009, 10, 175–189. [Google Scholar] [CrossRef]
- Parent, M.C.; Gobble, T.D.; Rochlen, A. Social Media Behavior, Toxic Masculinity, and Depression. Psychol. Men Masculinity 2019, 20, 277–287. [Google Scholar] [CrossRef] [PubMed]
- Connell, R.W.; Messerschmidt, J.W. Hegemonic masculinity: Rethinking the concept. Gend. Soc. 2005, 19, 829–859. [Google Scholar] [CrossRef]
- Kimmel, M.S. The History of Men: Essays on the History of American and British Masculinities; State University of New York Press: Albany, NY, USA, 2012. [Google Scholar]
- Beasley, C. Rethinking hegemonic masculinity in transnational context. In Rethinking Transnational Men; Routledge: Oxford, UK, 2013; pp. 29–44. [Google Scholar]
- Kimmel, M.S. Globalization changes masculinities, reshaping the arena in which national. In Handbook of Studies on Men and Masculinities; Sage Publications: Thousand Oaks, CA, USA, 2004; p. 414. [Google Scholar]
- Drost, E.A. Validity and reliability in social science research. Educ. Res. Perspect. 2011, 38, 105–123. [Google Scholar]
- Creswell, J.W.; Poth, C.N. Qualitative Inquiry and Research Design: Choosing Among Five Approaches; Sage Publications: Thousand Oaks, CA, USA, 2017. [Google Scholar]
- Strauss, A.L.; Corbin, J.M. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory; Sage Publications: Thousand Oaks, CA, USA, 1998. [Google Scholar]
- Sona Systems (n.d.). Sona Systems: Cloud-Based Participant Management Software; Computer Software; Sona Systems, Ltd.: Wilson Lane Bethesda, MD, USA; Available online: https://www.sona-systems.com (accessed on 16 November 2022).
- Peer, E.; Brandimarte, L.; Samat, S.; Acquisti, A. Beyond the Turk: Alternative platforms for crowdsourcing behavioral research. J. Exp. Soc. Psychol. 2017, 70, 153–163. [Google Scholar] [CrossRef]
- Dziuban, C.D.; Shirkey, E.C. When is a correlation matrix appropriate for factor analysis? Some decision rules. Psychol. Bull. 1974, 81, 358–361. [Google Scholar] [CrossRef]
- Morgan, B.L. Putting the feminism into feminism scales: Introduction of a Liberal Feminist Attitude and Ideology Scale (LFAIS). Sex Roles 1996, 34, 359–390. [Google Scholar] [CrossRef]
- Kline, R.B. Principles and Practice of Structural Equation Modeling, 4th ed.; Guilford Press: New York, NY, USA, 2016. [Google Scholar]
- Ford, J.K.; MacCallum, R.C.; Tait, M. The application of exploratory factor analysis in applied psychology: A critical review and analysis. Pers. Psychol. 1986, 39, 291–314. [Google Scholar] [CrossRef]
Item | Masculine Superiority | Domination and Desire | Gender Rigidity | Emotional Restriction | Repressed Suffering |
---|---|---|---|---|---|
Cronbach’s α | 0.94 | 0.78 | 0.95 | 0.92 | 0.87 |
# of items | 13 | 3 | 11 | 4 | 4 |
1. If I cry, I am weak | 0.7904 | ||||
2. Crying means I am weak | 0.8015 | ||||
3. Expressing sadness publicly makes me weak | 0.7209 | ||||
4. Public displays of sadness means I am not masculine | 0.6594 | ||||
5. Dominant men are attractive to their partners | 0.7587 | ||||
6. People are attracted to men who dominate others | 0.6938 | ||||
7. Muscles are indicators of masculinity | 0.6917 | ||||
8. Men who wear women’s (e.g., dresses) clothing aren’t masculine | 0.6551 | ||||
9. Men who wear dresses/skirts aren’t masculine | 0.6512 | ||||
10. Men are superior to women | 0.7197 | ||||
11. Gender and sex are the same thing | 0.8599 | ||||
12. There are only two genders | 0.8719 | ||||
13. Gender is not different from sex | 0.8316 | ||||
14. It is propaganda that there are more than two genders | 0.8718 | ||||
15. Men cheating on their partner is natural | 0.6596 | ||||
16. Men should not work for women | 0.7307 | ||||
17. My opinion as a man is more important than that of a woman’s | 0.8296 | ||||
18. I don’t value the opinion of women | 0.89 | ||||
19. A woman’s ideas are not as important as a man’s | 0.8654 | ||||
20. Men should use only masculine pronouns (e.g., he/him) | 0.7672 | ||||
21. Men can’t rape women because consent isn’t a real thing | 0.6855 | ||||
22. Men’s behavior isn’t their fault because they are men | 0.81 | ||||
23. Lying to my partner is okay, because I am a man | 0.675 | ||||
24. If I am in pain, I don’t let people know | 0.7087 | ||||
25. I ignore pain when I feel it | 0.8143 | ||||
26. If I am sick, I refuse to go to the doctor | 0.6899 | ||||
27. If I don’t feel well, I just ignore it | 0.7933 | ||||
28. On average, men are smarter than women | 0.7192 | ||||
29. Men are more capable than women | 0.6688 | ||||
30. Men talking over women isn’t rude | 0.7743 | ||||
31. I see it as a challenge when someone refuses my sexual advances | 0.6795 | ||||
32. Sex workers have no self-respect | 0.7125 | ||||
33. Sex work isn’t a career | 0.7417 | ||||
34. There is no such thing as male privilege | 0.6824 | ||||
35. Men don’t have inherent advantages in life | 0.6569 |
χ2 | CFI | TLI | RMSEA | SRMR | AIC | BIC | |
---|---|---|---|---|---|---|---|
Administration 1 (35 items) | 2948.59 (df = 550, p < 0.001) | 0.77 | 0.76 | 0.11 | 0.09 | 30,745.62 | 31,061.47 |
Administration 1 (28-items) | 1837.72 (df = 344, p < 0.001) | 0.83 | 0.81 | 0.11 | 0.08 | 24,529.13 | 24,774.23 |
Administration 2 (35 items) | 2333.22 (df = 550, p < 0.001) | 0.79 | 0.77 | 0.11 | 0.10 | 21,674.22 | 21,962.10 |
Administration 2 (28 items) | 1435.99 (df = 344, p < 0.001) | 0.84 | 0.82 | 0.11 | 0.09 | 17,270.46 | 17,493.79 |
1 | 2 | 3 | 4 | M | SD | |
---|---|---|---|---|---|---|
TMS | (0.94) | 57.70 | 18.59 | |||
CMNI | 0.73 *** | (0.90) | 1.25 | 0.35 | ||
MNRI | 0.81 *** | 0.69 *** | (0.96) | 2.75 | 1.21 | |
LFAIS | −0.81 *** | −0.61 *** | −0.75 *** | (0.87) | 3.14 | 0.89 |
1 | 2 | 3 | 4 | M | SD | |
---|---|---|---|---|---|---|
TMS | (0.95) | 59.19 | 19.74 | |||
CMNI | 0.75 *** | (0.92) | 1.25 | 0.38 | ||
MNRI | 0.830 *** | 0.71 *** | (0.96) | 2.89 | 1.23 | |
LFAIS | −0.82 *** | −0.67 *** | −0.73 *** | (0.88) | 3.09 | 0.93 |
1 | 2 | 3 | 4 | 5 | |
---|---|---|---|---|---|
TMS1 | - | ||||
CMNI2 | 0.68 *** | - | |||
MNRI2 | 0.77 *** | 0.71 *** | - | ||
LFAIS2 | −0.62 *** | −0.58 *** | −0.52 *** | - | |
TMS2 | 0.93 *** | 0.75 *** | 0.83 *** | −0.64 *** | - |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Sanders, S.M.; Garcia-Aguilera, C.; Borgogna, N.C.; Sy, J.R.T.; Comoglio, G.; Schultz, O.A.M.; Goldman, J. The Toxic Masculinity Scale: Development and Initial Validation. Behav. Sci. 2024, 14, 1096. https://doi.org/10.3390/bs14111096
Sanders SM, Garcia-Aguilera C, Borgogna NC, Sy JRT, Comoglio G, Schultz OAM, Goldman J. The Toxic Masculinity Scale: Development and Initial Validation. Behavioral Sciences. 2024; 14(11):1096. https://doi.org/10.3390/bs14111096
Chicago/Turabian StyleSanders, Steven Michael, Claudia Garcia-Aguilera, Nicholas C. Borgogna, John Richmond T. Sy, Gianna Comoglio, Olivia A. M. Schultz, and Jacqueline Goldman. 2024. "The Toxic Masculinity Scale: Development and Initial Validation" Behavioral Sciences 14, no. 11: 1096. https://doi.org/10.3390/bs14111096
APA StyleSanders, S. M., Garcia-Aguilera, C., Borgogna, N. C., Sy, J. R. T., Comoglio, G., Schultz, O. A. M., & Goldman, J. (2024). The Toxic Masculinity Scale: Development and Initial Validation. Behavioral Sciences, 14(11), 1096. https://doi.org/10.3390/bs14111096