Next Article in Journal
“It Changes Your Orbit”: The Impact of Suicide and Traumatic Death on Adolescents as Experienced by Adolescents and Parents
Next Article in Special Issue
Association between Antidepressant Treatment during Pregnancy and Postpartum Self-Harm Ideation in Women with Psychiatric Disorders: A Cross-Sectional, Multinational Study
Previous Article in Journal
Development and Evaluation of a Classified and Tailored Community-Based Exercise Program According to the Mobility Level of People with Stroke Using the Knowledge to Action Framework
Previous Article in Special Issue
Factors Related to Seeking Help for Postpartum Depression: A Secondary Analysis of New York City PRAMS Data
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Creating a Multisite Perinatal Psychiatry Databank: Purpose and Development

1
Division of Psychiatry, Department of Medicine, College of Medicine, King Abdulaziz University, Jeddah 21589, Saudi Arabia
2
Department of Psychiatry, McGill University, Jewish General Hospital, Montréal, QC H3T 1E2, Canada
3
Perinatal Mental Health Service, Department of Psychiatry, McGill University, Jewish General Hospital, Montréal, QC H3T 1E2, Canada
4
Community Medicine and Obstetrics and Gynecology, Department of Community Medicine, School of Medicine, Mercer University, Macon, GA 31207, USA
5
Perinatal and Early Childhood Psychiatry Clinic, Sainte-Justine University Hospital Center and Université de Montréal, Montréal, QC H3T 1C5, Canada
6
Department of Psychiatry, McGill University, Montréal, QC H4A 3J1, Canada
7
Department Obstetrics and Gynecology, McGill University, Montréal, QC H4A 3J1, Canada
8
Ludmer Center for Neuroinformatics and Mental Health Reproductive Psychiatry Clinic, Research Institute of the McGill University Health Center (RI-MUHC), MUHC, Montréal, QC H3T 1J4, Canada
9
Department of Psychiatry, St. Mary’s Hospital Center, McGill University, Montréal, QC H3T 1M5, Canada
10
Institut Universitaire en Santé Mentale de Québec, Quebec, QC G1J 2G3, Canada
11
Centre intégré universitaire en santé et services sociaux de la capitale nationale (CIUSSSCN), Quebec, QC G1C 3S2, Canada
12
DHU Ste-Justine, University of Montréal, Montréal, QC H3T 1J4, Canada
13
Department of Psychiatry, University of Montréal, Montreal, QC H3T 1J4, Canada
14
Department of Pathology, King Saud University, Riyadh 11451, Saudi Arabia
15
Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, QC H3T 1E2, Canada
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2020, 17(24), 9352; https://doi.org/10.3390/ijerph17249352
Submission received: 21 October 2020 / Revised: 6 December 2020 / Accepted: 8 December 2020 / Published: 14 December 2020

Abstract

:
Mental health issues during the perinatal period are common; up to 29% of pregnant and 15% of postpartum women meet psychiatric diagnostic criteria. Despite its ubiquity, little is known about the longitudinal trajectories of perinatal psychiatric illness. This paper describes a collaboration among six perinatal mental health services in Quebec, Canada, to create an electronic databank that captures longitudinal patient data over the course of the perinatal period. The collaborating sites met to identify research interests and to select a standardized set of variables to be collected during clinical appointments. Procedures were implemented for creating a databank that serves both research and clinical purposes. The resulting databank allows pregnant and postpartum patients to complete self-report questionnaires on medical and psychosocial variables during their intake appointment in conjunction with their clinicians who fill in relevant medical information. All participants are followed until 6 months postpartum. The databank represents an opportunity to examine illness trajectories and to study rare mental disorders and the relationship between biological and psychosocial variables.

1. Introduction

Perinatal mental health problems are highly prevalent; up to 29% of pregnant women and 15% of postpartum women have symptoms severe enough to warrant a psychiatric diagnosis [1]. These problems can affect women’s wellbeing, mental health and functioning [2,3] and the development of their children [4,5]. Many disorders have a higher prevalence during the pregnancy and postpartum period. For instance, the rate of obsessive-compulsive disorder (OCD) is increased from 1.08% in the general population to 2.07% in the pregnant and 2.43% in the postpartum populations [6]. For other disorders, pregnancy can be a tumultuous period of relapse, such as for women with histories of bipolar affective disorder who have a 50% risk of symptom relapse during pregnancy [7].
Research has shown that maternal mental health issues during the perinatal period not only affect the mother’s wellbeing and functioning, but also have far reaching consequences for obstetric and neonatal outcomes, as well as long-term effects on child development [4,8,9,10].
Greater awareness of these disorders has led to the rise of reproductive psychiatry as an important subspecialty in psychiatry. However, as this is still a relatively recent field of research, there are still few epidemiologic studies of psychiatric episodes related to the perinatal period [11]. The focus to date has largely been on identifying risk factors, screening and symptom assessment in the community [12,13,14].
The focus on community research has led to the conflation of two different populations: those who have perinatal “distress” and those who are diagnosed with major mental “disorders” by clinicians. Murray and Carothers found that many distressed individuals who scored above the threshold on the Edinburgh Postnatal Depression Scale (EPDS) did not actually meet full diagnostic criteria for a major depressive disorder (MDD) [15]. Furthermore, Wisner et al. reported that 2/3 of those screening positive on the EPDS had a comorbid anxiety disorder, and 23% had bipolar disorder rather than MDD [16]. Thus, there is a need to move beyond the assumption that women screening positive on the EPDS are a homogeneous “depressed” group. The same holds true for screening tools used for other diagnoses such as anxiety and psychosis. These limitations can be addressed by combining screening tools with clinician-based evaluations and diagnoses.
Other aspects that remain unclear in the clinical perinatal literature are the trajectories of different illnesses, the predictors of severe illness course, and whether treatment success is influenced by factors such as sociodemographic variables, comorbidities, medical and obstetrical complications and childhood adversity. Following patients longitudinally may facilitate answers to some of these questions.
In summary, there are still many unanswered questions about perinatal mental health in at least four broad areas: (1) the factors that differentiate between those with perinatal distress and those with more severe perinatal psychiatric disorders, (2) the course of different perinatal mental disorders, (3) the best treatments and practices across the spectrums of clinical severity and perinatal stage (pregnancy trimesters and postpartum period) for different disorders, and (4) the effects that sociodemographic variables have on treatment adherence and effectiveness.
These research questions have yet to be answered due to constraints of time, cost, along with patient and clinician burden. Researchers often encounter problems with recruitment and retention of participants, inadequate statistical power due to low incidence rates, and large variance in terms of treatments and treatment outcomes [17]. Because of these difficulties, and the challenges associated with studying pregnant women, many important research questions have been left unanswered, even though physicians are collecting rich data during their clinical appointments with patients.
Data collection that is integrated into a clinical setting, and facilitated by clinicians, offers an efficient and feasible way for overcoming these limitations. Using databanks for psychiatric research can be relatively inexpensive [18]; it has the potential to decrease cost and improve outcomes for patients and providers [19]. Creating such a mechanism at multiple clinical sites would allow for the accumulation of large sets of diverse data into a databank which can be used to study a large variety of research questions.
Such multisite clinical databanks have been created increasingly in the field of general perinatal health [20,21,22] and general psychiatry [23,24]. To our knowledge, however, there is a paucity of such databanks focused on women’s mental health and perinatal psychiatry. The utilization of multisite clinical databanks is an advantageous methodology because it allows health records to be analyzed on a numerically greater scale with more diverse samples, resulting in increased statistical power, generalizability, external validity and greater subtyping within heterogeneous diagnostic groups [25]. Additionally, they allow for increased collaboration between research sites while conducting longitudinal research, which results in more comparable results due to standardization of methods and minimization of potential differences between sites.
The aim of this project was to create a multicenter perinatal mental health databank, which is now successfully under way in Quebec. Data collection occurs during clinical appointments and includes both standardized measures and clinical diagnostic evaluations. This information is used immediately by doctors during the clinical appointment and later by researchers for study purposes. Data collection occurs at least twice in the perinatal period, which allows for the collection of longitudinal data and the pursuit of further clinical questions without overburdening patients. For those women who are initially seen during pregnancy, data are collected again at 6 weeks and between 4–6 months postpartum. Women who are initially assessed in the early postpartum period are reassessed again at 4–6 months postpartum. This paper describes the process of creating this databank so that it may be replicated at other sites, therefore facilitating a better understanding of perinatal mental health and leading to improved patient care.

2. Materials and Methods

2.1. Overview

In 2014, the Quebec Reproductive Psychiatry Network (QRPN) was established. It consists of clinicians and researchers across six sites in Montreal and Quebec City, which offer perinatal psychiatry services. Collectively, these perinatal clinics serve a population of over 25,000 deliveries per year and receive over 800 consults annually, and collect rich information during patient assessments, which are stored as documents in patients’ charts. However, the collected information is not standardized across sites. Additionally, these data, until now, were not accessible for research purposes due to the absence of a databank that respected patient confidentiality and was accessible to researchers. Thus, the network’s first major goal was to create a mechanism to collect standardized patient data for clinical and research purposes, such that information collected during clinical appointments could be stored both in patients’ medical charts and into a secure databank that protects patient confidentiality.

2.2. Standardizing the Collection of Clinical Information

From 2014–2016, regular meetings were held to determine the network’s broad areas of research interest and the relevant corresponding variables. A two-pronged approach was used to select the best measures for each outcome of interest. Searches were conducted through Medline and HAPI (Health and Psychological Instruments), as well as through the McGill University library website and public search engines (e.g., Google Scholar). Outcome measures and tools that appeared relevant were further examined for adequate psychometric properties. In a parallel iterative process, the network members discussed search results and provided input on their familiarity and experience with different measures, and their opinions regarding their practicality and ease of use. Additional questionnaires were created to address variables such as demographic characteristics and medical histories in order to standardize history-taking across sites. Every attempt was made to find the right balance between length/burden to the patient and inclusion of the most relevant information. Permission and scoring manuals were requested from authors when needed, and tools not available in French were translated and back-translated, as both French-speaking and English-speaking patients are served in Quebec.

2.3. Choosing the Software

Finally, because the network wanted to collect and store data electronically, electronic survey software programs were reviewed, and meetings were held with hospital information technology departments, as well as with software developers, to select the program best suited to the network’s needs. While choosing the software, the project needs were considered. The ideal software would have the following characteristics: the ability to collect data offline, function across the different sites, export data easily for analysis, and be linked to a data server located in Canada.

2.4. Ethical Standards

The databank mechanism was designed to be in accordance with prevailing ethical standards established in the 1964 Declaration of Helsinki and its later amendments and was reviewed by the Institutional Review Board of the primary investigating site using their Multicenter Mechanism (reference code: 17-115/MP-05-2018-774), which facilitates research by simplifying approval for collaborating sites. Written informed consent to have their data included in our databank is obtained from patients prior to their inclusion in the databank. Patients were assured that all data are automatically coded so that no identifying information enters the databank besides patients’ email addresses. The confidentiality section of the consent form states the following: “A separate list will be stored in the office of the Principal Investigator of this project, which links participants’ code numbers to their names and other identifying information. Email addresses in the databank will be heavily protected behind many layers of security provided by the software system and all email addresses will be removed from any analysis or exportation of data. Only specified members of the research team will be able to view your email address in the databank and will only do so when they need to contact you for future phases of the study. All the information collected during the research project will remain confidential to the extent provided by law. You will only be identified by a code number”.

3. Results

The process of initiating this collaboration, meeting, brainstorming, selecting the software, determining research areas of interest, and selecting outcomes and measures across different sites (described above) constitutes our methodological approach. Presently, we describe the final design of the databank (the “result” of this development process) in terms of the final research questions agreed upon, the measures included, and the process of data collection, as well as some preliminary demographic data. The scoring manual is provided in the Supplementary Materials in order to facilitate the adaptation and use of our protocol by others.

3.1. Questions

The questions listed below represent the distillation of the broader research areas of interest; they were determined to be essential to the project and reflective of its primary purpose (Figure 1). These questions were selected because they were clinically relevant, have the potential to change current practice, and could be feasibly answered. It is expected that with time, more questions and measures will be added based on emerging trends that may suggest new hypotheses or questions. The databank was designed in such a way that researchers can identify a group of patients relevant to their query through the use of filters.
For example, a researcher interested in studying women whose babies were admitted to the neonatal intensive care unit (NICU) could easily find relevant data on this cohort by filtering for participants who had identified as such on their intake survey. If investigators want more information for their research, they can obtain approval from the Ethics Board to conduct a chart review of the hospital records. The same is possible in terms of posing questions regarding a subpopulation that received a certain intervention or diagnosis or medication class etc.

3.2. Justification of Variable Choice and Questionnaire Contents

Each research area of interest was broken down into relevant variables and outcome measures. The main variables of interest were as follows: maternal depression, anxiety, psychosocial risk, attachment, bonding and maternal functioning. These variables have been identified as risk factors in the literature, and are often associated with one another. In addition, they are relevant to the research areas of interest described above, which stem from both the literature and clinical practice.
Depression is estimated to affect roughly 13% of women globally, with a range of 5–25% [26]. Anxiety disorders have an even higher incidence than mood disorders [27], and it is believed that perinatal anxiety is underrecognized and undertreated compared to perinatal depression [28]. Moreover, the two disorders may be linked, as higher depression scores in early pregnancy may be associated with higher rates of anxiety later in pregnancy [29].
Psychosocial risk factors such as experiencing stressful life events during the perinatal period, lack of social support, and low socioeconomic status [30] have been linked to perinatal depression. Both mental health issues such as postpartum depression and psychosocial adversity such as stressful life events can lead to negative maternal and infant health outcomes [31,32,33,34].
Attachment style and bonding were included in our databank since the literature has long suggested that the quality of attachment may predispose to certain affective disorders [35]. Insecure attachment may increase the risk of developing mental disorders in general and mood disorders in particular [36]. Moreover, maternal attachment is important for the normal development of an infant’s social, cognitive and behavioral skills. Maternal depression has been associated with insecure and disorganized attachment [37] and more harsh or disrupted parenting behaviors, which may contribute to poor health outcomes later in childhood [38].
Attachment is an aspect of the relationship between a child and caregiver that is involved with making the child feel safe, secure and protected [39]. It refers to the child’s experience and feelings. Bonding, on the other hand, refers to the other direction of the mother–infant relationship, or the mother’s feelings and her subjective experience of her newborn. Mental disorders such as postpartum depression and posttraumatic stress disorder have been associated with impaired bonding [40], thus making it another important area to include in our research.
A summary of the relevant variables and outcome measures is shown in Table 1. Details of each measure’s psychometrics can be found in the Supplementary Material. Maternal functioning correlates with infant development [41,42,43], and has been found to be inversely related to maternal depression [41].

3.3. Agreed upon Study Setting and Sample

Participants in the databank are consenting women who were referred to one of the participating perinatal mental health services during pregnancy and up to 6 months postpartum. The ability to respond to questionnaires in either English or French is an inclusion criterion.
All patients arriving at their clinical assessments are asked to fill out questionnaires on a tablet device. The questionnaires and forms of consenting participants are exported to the secure server of the databank.

3.4. Final Procedures

Upon arrival at the clinic or prior to their appointments, patients are informed of the databank project by a clinician or research assistant. They are given an explanation of the rationale and procedures of the databank project and are asked to sign a consent form if they wish to participate. Due to the longitudinal nature of the study, and to facilitate the process of contacting patients, participants are also asked to provide contact information on a separate form, including their email address, phone number and the contact information of a relative.
This information is needed so that patients can be easily contacted throughout the study and sent surveys at the appropriate times. The participant’s email address is stored in the databank and categorized as an “identifier”. This allows it to be de-identified, separated from data, and made non-visible. All other contact information is not stored in the databank and is only accessible to those with specialized user rights (the project coordinator, the research coordinator, and the research assistants).
After providing this information, participants are asked to fill out a set of standardized measures and sociodemographic questions on a tablet device. Once patients finish completing the questionnaires, they meet with their clinician who has the opportunity to review and address relevant questionnaire results with them. Additionally, physicians fill out a standardized form on the tablet device which documents the participant’s current and past obstetrical, medical and psychiatric histories and their diagnoses according to the Diagnostic and Statistical Manual for Mental Disorders, fifth edition (DSM-V) as well as the treatment plan for the patient.
After the clinical appointment, all questionnaires and physician forms from the tablet are exported to the research databank. It is important to mention that as a result of the COVID-19 global pandemic, in-person recruitment has become limited at several sites, thus, online recruitment has been offered where needed.

3.5. Timeline

The number of times patients are assessed and the measures they fill out depends on the perinatal stage that they are in when first seen at the clinic. Participants who are first assessed during pregnancy fill out questionnaires during three separate assessment time points: at their first intake appointment, at 6 weeks postpartum and at 4–6 months postpartum. Participants who are first assessed postpartum fill out questionnaires only twice: at their initial appointment and at 4–6 months postpartum. Although the first data collection time point always occurs in tandem with an actual clinical assessment, the second and third data collection may occur by phone, or online, depending on the patient’s preference. Due to the impact of COVID-19 pandemic, some centers opted for online recruitment and data collection for all visits in accordance with health regulations. Online surveys are sent securely by email from the databank online software. Details on the timeline of protocols are shown in Table 2 and Table 3.

3.6. Software

After a review of software options, a secure web application called REDCap (Vanderbilt University, Nashville, USA) was chosen because it best fit the needs we described above. REDCap is used to make surveys and allows for data entry and seamless export of data into different statistical programs. REDCap is recognized for outstanding protection of confidentiality of identifiable data, easy handling of longitudinal data, and the ability to link-up with other data sources (i.e., medical charts). To protect patient confidentiality, REDCap provides detailed audit trailing, record-locking, fine-grained control over user rights and de-identification functions for data export. REDCap is compliant with Health Insurance Portability and Accountability Act (HIPAA), and it is highly secure [59]. Certain fields in REDCap can be marked as “identifiable”, thus allowing researchers to de-identify data during export. All data are automatically coded so that no identifying information enters the databank besides patients’ email addresses. Before clinical appointments, REDCap is used to administer surveys to patients on tablets. After the appointments, data from the tablet are securely transmitted to and from the REDCap server that is located in Canada, meets Canadian Privacy Standards and is managed by the Information Management Service at the central clinical site.

3.7. Use of the Data

To date, 225 records have been collected in the databank, of which 175 are completed. Of the 225 participants, 167 began participating during pregnancy, while 57 began participating postpartum. The response rate for participants at 6-week follow up from all sites is 71.4%. Response rate for participants at 4–6 month follow up from all sites is 77.2%. The mean age of participants is 32 years, and some demographics are shown in the table below (Table 4).
The majority of participants reported that the questionnaire was easy or very easy to complete (78.9%), and 84.3% reported no or little discomfort in relation to answering the questions. For example, four participants commented on the Postpartum Bonding Questionnaire items 18 and 24 that explore feelings of harming the baby; it made them uncomfortable or sad to think that some mothers faced having such thoughts. Clinicians using the questionnaire generally report they found it user friendly.

4. Discussion

4.1. Summary

This paper describes the formation and functioning of a multisite databank that collects medical and psychosocial variables from pregnant and postpartum patients. Data collection is focused on maternal depression, anxiety, psychosocial risk, attachment, bonding and maternal functioning, and is underway with 225 cases enrolled to date.

4.2. Databank Research Areas in Psychiatry

Clinical research that utilizes computerized databases has greatly enhanced many areas of knowledge in psychiatry [60]. An international review found that database research in psychiatry has included areas such as pharmacoepidemiology, perinatal, etiological, suicidology and health service research [18]. Databanks focused on pregnancy and mental illness are fewer than those related to pharmacology, suicidology and other areas, highlighting a need for more databanks focused on reproductive and perinatal psychiatry.

4.3. Perinatal Databanks

Psychiatry databanks related to illness and pregnancy include the General Practice Research Database (GPRD): UK, Denmark’s Psychiatric Register, and Denmark’s Birth & Congenital Malformation Registers. These databases have been used to explore fertility, stillbirth rate, perinatal death rate, and other pregnancy outcomes in women with psychotic disorders [18].
Another rich source of ongoing research is the Pregnancy Risk Assessment Monitoring System (PRAMS) in the United States, which is a surveillance system of maternal behaviors, attitudes, and experiences in the perinatal period [58]. It provides ongoing state-based data for key maternal and child health indicators over time. Most of the core topics covered relate to general and obstetric health rather than mental health (e.g., multivitamin use, oral health, and contraception use), but postpartum depressive symptoms are also one of the core topics of interest in this surveillance system. Our databank collects some obstetric and medical data, but focuses more on mental health outcomes, such as depression, anxiety, psychosocial risk and relationships.
The databanks described above are mostly national registries that have governmental support. Our databank is center-based and much smaller in scope. Hospital or center-based research tends to be smaller than governmental registries, yet can conduct more detailed and highly specialized research programs. For example, the Center for Women’s Mental Health at the Massachusetts General Hospital has both a Clinical and a Research Program that address women’s mental health issues across the lifespan. Their research is regularly published in scientific journals. Current active research programs that focus on the perinatal period include the Massachusetts General Hospital Postpartum Psychosis Project, the national pregnancy registry for psychiatric medications, the UPWARD study (Understanding and Preventing Women’s Relapse of Depression) and the UPWARD(S) study which looks at suicidal thoughts and behaviors in peripartum women [61].

4.4. Limitations

Our databank has several limitations. The numbers recruited to date remain small, and the buildup of cases will take time. It is known that amongst the different types of databanks, those based on clinical interviews and surveys are not considered the best way to acquire large numbers [62]. This is somewhat offset by the depth and quality of information obtained by physician evaluation and interviews combined with validated screening tools.
Databases are often used in psychiatry research by linking clinical and national administrative databases [18]. Linking the data we collected to patients’ clinical records would have made it possible to broaden the scope of research. An example of record linkage research is Sweden’s population-based registers that were used to link reports of suicide to psychiatric diagnoses and unemployment [62]. However, this was not possible in our databank due to confidentiality, ethical and technical reasons. Linking our databank with medical records in the future would enable us to answer many more research questions related to medical illness, infant and child outcomes, and many other outcomes.

4.5. Strengths

Despite these limitations, this type of databank offers an advantage to most databank-related research. Its data stem from well-chosen outcome measures selected to answer specific research questions. This contrasts with most database research, which draws on the type of data that are gathered for administrative reasons and are readily available for research, which limits the research questions asked. These questions may be opportunistic, based on available data, and may not reflect the priorities of clinicians or patients [18].
For example, medication-oriented research may be one of the most common types of research due to the presence of accessible readily available data on medication prescription [62]. In addition, proxy measures are often used in this type of research [18,62]; for example, prescriptions may be used to indicate medication use despite the fact that medications may not have been dispensed or used with adherence.
Reviews on databank research point to the need for a transition whereby databanks are designed to reflect research priorities, which should be in turn a reflection of clinical needs. [18,62]. Our databank addresses this need, as the research areas/questions were formulated first and the outcome measures chosen carefully. Thus, the data collected are tailored to accurately answer research questions that are important and not easily answered by the usual databank research available.

4.6. Challenges

Outlined below are some of the specific problems encountered by our network and some useful approaches and solutions to them. In the absence of guiding literature on how to create a multicenter electronic databank in perinatal psychiatry, this methodological paper may prove useful to others in the field.
This databank involves several researchers with overlapping but differing research interests. Initial brainstorming meetings resulted in many interesting research questions and variables. It was important to find the balance between collecting rich data and keeping the protocol realistic, feasible and not too burdensome for both clinicians and patients. It was thus important to reach a consensus about the main aims of the databank and then to select the most essential variables to formulate key research questions.
Methods were developed to maximize data collection without increasing the length of the questionnaires. The demographic questionnaire that the patient completes contains branching logic, for example, to only ask about number of children at home if a patient has indicated that she has children. To minimize the length of the standardized form that the clinicians fill out, branching logic was added to several sections, for example, to display only relevant information for specific DSM-V diagnoses, and to make visible fertility treatment options only if the patient indicates an infertility diagnosis. For secondary questions that interested one researcher or site (e.g., types of fetal abnormalities), a filtering system was instituted, whereby a researcher is able to search and filter for patients that answered positively to “abnormality on neonatal testing” in the databank, and then conduct a chart review after obtaining ethics approval for this subproject.
Agreeing on the appropriate instrument for every outcome and reviewing the literature on each was time consuming but necessary. It was useful to write and share a written review of the pros, cons, psychometrics and validation studies of the instruments while selecting the measurements of choice.
Perhaps one of the longest but most fruitful processes was the development of a standardized form that physicians fill out during clinical appointments. This ensures that the physician history-taking, diagnosis and treatment plan are standardized and thorough, and will translate into retrievable data across sites. The feasibility and acceptability of this tool may be evaluated in the future and may be modified to other research programs and specialties.
Another challenge that may be faced when setting up electronic databanks is identifying the right software. It is advisable for researchers to outline their unique requirements (e.g., need for exporting data into certain programs, tablets for filling-out surveys, offline capabilities for data collection etc.) and to meet early on with their institution’s information technology, medical records and ethics departments to understand their requirements and research software options.
Finally, when conducting research across many sites, obtaining ethics approval can be difficult. Some institutions may have a multicenter mechanism, which facilitates research across sites by allowing one site’s ethics review board to act as the primary ethics review board and be recognized by other sites, thus minimizing repetitive paperwork and addressing only site-specific concerns.

5. Conclusions

This paper describes the process of creating an electronic multicenter databank for perinatal psychiatry in the province of Quebec. Such a databank may be replicated by other centers to facilitate research that can advance the understanding of mental health issues of mothers, and thus inform best practice and policy formation with regard to this population.

Supplementary Materials

The following is available online at https://www.mdpi.com/1660-4601/17/24/9352/s1, Scoring Manual.

Author Contributions

Conceptualization, W.K., L.A., B.H., J.L.B., M.S.-A., T.-V.N., H.S., M.-J.P., I.S., R.W.-G. and P.Z.; funding acquisition, P.Z.; methodology, W.K., L.A., B.H., J.L.B., M.S.-A., T.-V.N., H.S., M.-J.P., I.S., R.W.-G. and P.Z.; software, L.A.; supervision, B.H. and P.Z.; visualization, M.A.; writing—original draft, W.K. and L.A.; writing—review and editing, W.K., L.A., B.H., J.L.B., M.S.-A., T.-V.N., H.S., M.-J.P., I.S., R.W.-G., M.A. and P.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Acknowledgments

The authors would like to acknowledge the contribution of Kathelijne Keeren, Project Coordinator Reproductive Psychiatry and Transitional Care Team, for initiating and coordinating data collection; Stephanie Robins, Reproduction and Mental Health Research Coordinator, for acting as a research projects consultant; Siobhan O’Connell, Research Assistant, for acting as a data and administrative consultant; and Alix Lahuec, Research Assistant, for support with REDCap software.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Andersson, L.; Sundström-Poromaa, I.; Wulff, M.; Aström, M.; Bixo, M. Depression and anxiety during pregnancy and six months postpartum: A follow-up study. Acta Obstet. Gynecol. Scand. 2006, 85, 937–944. [Google Scholar] [CrossRef] [PubMed]
  2. Barkin, J.L.; Wisner, K.L.; Bromberger, J.T.; Beach, S.R.; Wisniewski, S.R. Factors Associated with Postpartum Maternal Functioning in Women with Positive Screens for Depression. J. Womens Health 2016, 25, 707–713. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Barkin, J.L.; McKeever, A.; Lian, B.; Wisniewski, S.R. Correlates of Postpartum Maternal Functioning in a Low-Income Obstetric Population. J. Am. Psychiatr. Nurses Assoc. 2017, 23, 149–158. [Google Scholar] [CrossRef] [PubMed]
  4. Maina, G.; Saracco, P.; Giolito, M.R.; Danelon, D.; Bogetto, F.; Todros, T. Impact of maternal psychological distress on fetal weight, prematurity and intrauterine growth retardation. J. Affect. Disord. 2008, 111, 214–220. [Google Scholar] [CrossRef]
  5. Murray, L. The impact of postnatal depression on infant development. J. Child Psychol. Psychiatry 1992, 33, 543–561. [Google Scholar] [CrossRef]
  6. Russell, E.J.; Fawcett, J.M.; Mazmanian, D. Risk of obsessive-compulsive disorder in pregnant and postpartum women: A meta-analysis. J. Clin. Psychiatry 2013, 74, 377–385. [Google Scholar] [CrossRef]
  7. Vladimirova, R.; Stoyanova, V.; Milanova, V. Bipolar affective disorder, pregnancy and childbirth: Clinical characteristics and heredity. Biotechnol. Biotechnol. Equip. 2016, 30, 976–983. [Google Scholar] [CrossRef] [Green Version]
  8. Rahman, A.; Bunn, J.; Lovel, H.; Creed, F. Association between antenatal depression and low birthweight in a developing country. Acta Psychiatr. Scand. 2007, 115, 481–486. [Google Scholar] [CrossRef]
  9. Howard, L.M. Fertility and pregnancy in women with psychotic disorders. Eur. J. Obstet. Gynecol. Reprod. Biol. 2005, 119, 3–10. [Google Scholar] [CrossRef]
  10. Stein, A.; Pearson, R.M.; Goodman, S.H.; Rapa, E.; Rahman, A.; McCallum, M.; Howard, L.M.; Pariante, C.M. Effects of perinatal mental disorders on the fetus and child. Lancet Lond. Engl. 2014, 384, 1800–1819. [Google Scholar] [CrossRef]
  11. Leight, K.L.; Fitelson, E.M.; Weston, C.A.; Wisner, K.L. Childbirth and mental disorders. Int. Rev. Psychiatry Abingdon Engl. 2010, 22, 453–471. [Google Scholar] [CrossRef] [PubMed]
  12. Dietz, P.M.; Williams, S.B.; Callaghan, W.M.; Bachman, D.J.; Whitlock, E.P.; Hornbrook, M.C. Clinically identified maternal depression before, during, and after pregnancies ending in live births. Am. J. Psychiatry 2007, 164, 1515–1520. [Google Scholar] [CrossRef] [PubMed]
  13. Gotlib, I.H.; Whiffen, V.E.; Mount, J.H.; Milne, K.; Cordy, N.I. Prevalence rates and demographic characteristics associated with depression in pregnancy and the postpartum. J. Consult. Clin. Psychol. 1989, 57, 269–274. [Google Scholar] [CrossRef] [PubMed]
  14. Chaudron, L.H.; Klein, M.H.; Remington, P.; Palta, M.; Allen, C.; Essex, M.J. Predictors, prodromes and incidence of postpartum depression. J. Psychosom. Obstet. Gynaecol. 2001, 22, 103–112. [Google Scholar] [CrossRef] [PubMed]
  15. Murray, L.; Carothers, A.D. The validation of the Edinburgh Post-natal Depression Scale on a community sample. Br. J. Psychiatry J. Ment. Sci. 1990, 157, 288–290. [Google Scholar] [CrossRef]
  16. Wisner, K.L.; Sit, D.K.Y.; McShea, M.C.; Rizzo, D.M.; Zoretich, R.A.; Hughes, C.L.; Eng, H.F.; Luther, J.F.; Wisniewski, S.R.; Costantino, M.L.; et al. Onset timing, thoughts of self-harm, and diagnoses in postpartum women with screen-positive depression findings. JAMA Psychiatry 2013, 70, 490–498. [Google Scholar] [CrossRef]
  17. Weinberger, M.; Oddone, E.Z.; Henderson, W.G.; Smith, D.M.; Huey, J.; Giobbie-Hurder, A.; Feussner, J.R. Multisite randomized controlled trials in health services research: Scientific challenges and operational issues. Med. Care 2001, 39, 627–634. [Google Scholar] [CrossRef]
  18. Higgins, N.; Howard, L. Database use in psychiatric research: An international review. Eur. J. Psychiatry 2005, 19, 19–30. [Google Scholar] [CrossRef] [Green Version]
  19. James, A.; Costello, M. The Benefits of Incorporating Clinical Research Into Physician Practices. Available online: https://www.elligohealthresearch.com/wp-content/uploads/Elligo_PhysicianPaper_11-15-19_VF.pdf (accessed on 10 October 2020).
  20. Gould, J.B. The role of regional collaboratives: The California Perinatal Quality Care Collaborative model. Clin. Perinatol. 2010, 37, 71–86. [Google Scholar] [CrossRef]
  21. Kaplan, H.C.; Lannon, C.; Walsh, M.C.; Donovan, E.F. Ohio Perinatal Quality Collaborative Ohio statewide quality-improvement collaborative to reduce late-onset sepsis in preterm infants. Pediatrics 2011, 127, 427–435. [Google Scholar] [CrossRef]
  22. Frosst, G.; Hutcheon, J.; Joseph, K.S.; Kinniburgh, B.; Johnson, C.; Lee, L. Validating the British Columbia Perinatal Data Registry: A chart re-abstraction study. BMC Pregnancy Childbirth 2015, 15, 123. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Sinclair, L. Partnership Expands Database Available for Autism Research. Psychiatr. News 2012, 47, 19b. [Google Scholar] [CrossRef]
  24. Potash, J.B.; Toolan, J.; Steele, J.; Miller, E.B.; Pearl, J.; Zandi, P.P.; Schulze, T.G.; Kassem, L.; Simpson, S.G.; Lopez, V.; et al. The bipolar disorder phenome database: A resource for genetic studies. Am. J. Psychiatry 2007, 164, 1229–1237. [Google Scholar] [CrossRef] [PubMed]
  25. Flynn, L. The benefits and challenges of multisite studies: Lessons learned. AACN Adv. Crit. Care 2009, 20, 388–391. [Google Scholar] [CrossRef]
  26. Woody, C.A.; Ferrari, A.J.; Siskind, D.J.; Whiteford, H.A.; Harris, M.G. A systematic review and meta-regression of the prevalence and incidence of perinatal depression. J. Affect. Disord. 2017, 219, 86–92. [Google Scholar] [CrossRef] [Green Version]
  27. Kessler, R.C.; Berglund, P.; Demler, O.; Jin, R.; Merikangas, K.R.; Walters, E.E. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Arch. Gen. Psychiatry 2005, 62, 593–602. [Google Scholar] [CrossRef] [Green Version]
  28. Giardinelli, L.; Innocenti, A.; Benni, L.; Stefanini, M.C.; Lino, G.; Lunardi, C.; Svelto, V.; Afshar, S.; Bovani, R.; Castellini, G.; et al. Depression and anxiety in perinatal period: Prevalence and risk factors in an Italian sample. Arch. Womens Ment. Health 2012, 15, 21–30. [Google Scholar] [CrossRef]
  29. Rallis, S.; Skouteris, H.; McCabe, M.; Milgrom, J. A prospective examination of depression, anxiety and stress throughout pregnancy. Women Birth J. Aust. Coll. Midwives 2014, 27, e36–e42. [Google Scholar] [CrossRef]
  30. Robertson, E.; Grace, S.; Wallington, T.; Stewart, D.E. Antenatal risk factors for postpartum depression: A synthesis of recent literature. Gen. Hosp. Psychiatry 2004, 26, 289–295. [Google Scholar] [CrossRef]
  31. Hobel, C.J.; Goldstein, A.; Barrett, E.S. Psychosocial Stress and Pregnancy Outcome. Clin. Obstet. Gynecol. 2008, 51, 333–348. [Google Scholar] [CrossRef]
  32. Lobel, M.; Cannella, D.L.; Graham, J.E.; DeVincent, C.; Schneider, J.; Meyer, B.A. Pregnancy-specific stress, prenatal health behaviors, and birth outcomes. Health Psychol. 2008, 27, 604–615. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Meltzer-Brody, S. New insights into perinatal depression: Pathogenesis and treatment during pregnancy and postpartum. Dialogues Clin. Neurosci. 2011, 13, 89–100. [Google Scholar] [PubMed]
  34. Nkansah-Amankra, S.; Luchok, K.J.; Hussey, J.R.; Watkins, K.; Liu, X. Effects of maternal stress on low birth weight and preterm birth outcomes across neighborhoods of South Carolina, 2000–2003. Matern. Child Health J. 2010, 14, 215–226. [Google Scholar] [CrossRef] [PubMed]
  35. Lamb, M.E. Patterns of Attachment: A Psychological Study of the Strange Situation; Halsted (Wiley): New York, NY, USA, 1980; pp. 68–70. [Google Scholar]
  36. Dozier, M.; Stovall-McClough, K.C.; Albus, K.E. Attachment and psychopathology in adulthood. In Handbook of attachment: Theory, Research, and Clinical Applications, 2nd ed.; The Guilford Press: New York, NY, USA, 2008; pp. 718–744. ISBN 978-1-59385-874-2. [Google Scholar]
  37. Campbell, S.B.; Brownell, C.A.; Hungerford, A.; Spieker, S.I.; Mohan, R.; Blessing, J.S. The course of maternal depressive symptoms and maternal sensitivity as predictors of attachment security at 36 months. Dev. Psychopathol. 2004, 16, 231–252. [Google Scholar] [CrossRef]
  38. Brummelte, S.; Galea, L.A.M. Postpartum depression: Etiology, treatment and consequences for maternal care. Horm. Behav. 2016, 77, 153–166. [Google Scholar] [CrossRef]
  39. Bowlby, J. Attachment and loss: Retrospect and prospect. Am. J. Orthopsychiatry 1982, 52, 664–678. [Google Scholar] [CrossRef]
  40. Seng, J.S.; Sperlich, M.; Low, L.K.; Ronis, D.L.; Muzik, M.; Liberzon, I. Childhood Abuse History, Posttraumatic Stress Disorder, Postpartum Mental Health, and Bonding: A Prospective Cohort Study. J. Midwifery Womens Health 2013, 58, 57–68. [Google Scholar] [CrossRef]
  41. Barkin, J.L.; Wisner, K.L.; Wisniewski, S.R. The Psychometric Properties of the Barkin Index of Maternal Functioning. J. Obstet. Gynecol. Neonatal Nurs. 2014, 43, 792–802. [Google Scholar] [CrossRef]
  42. Mirghafourvand, M.; Barkin, J.L.; Jafarabadi, M.A.; Karami, F.; Ghanbari-Homayi, S. The psychometric properties of the Barkin index of maternal functioning (BIMF) for the Iranian population. BMC Womens Health 2019, 19, 166. [Google Scholar] [CrossRef]
  43. Aydın, R.; Kukulu, K. Adaptation of the Barkin scale of maternal functioning and examination of the psychometric properties. Health Care Women Int. 2018, 39, 50–64. [Google Scholar] [CrossRef]
  44. Cox, J.L.; Holden, J.M.; Sagovsky, R. Detection of postnatal depression. Development of the 10-item Edinburgh Postnatal Depression Scale. Br. J. Psychiatry J. Ment. Sci. 1987, 150, 782–786. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Cox, J.L.; Chapman, G.; Murray, D.; Jones, P. Validation of the Edinburgh Postnatal Depression Scale (EPDS) in non-postnatal women. J. Affect. Disord. 1996, 39, 185–189. [Google Scholar] [CrossRef]
  46. Spitzer, R.L.; Kroenke, K.; Williams, J.B.W.; Löwe, B. A brief measure for assessing generalized anxiety disorder: The GAD-7. Arch. Intern. Med. 2006, 166, 1092–1097. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  47. Green, J.M.; Kafetsios, K.; Statham, H.E.; Snowdon, C.M. Factor structure, validity and reliability of the Cambridge Worry Scale in a pregnant population. J. Health Psychol. 2003, 8, 753–764. [Google Scholar] [CrossRef] [PubMed]
  48. Austin, M.-P.; Colton, J.; Priest, S.; Reilly, N.; Hadzi-Pavlovic, D. The antenatal risk questionnaire (ANRQ): Acceptability and use for psychosocial risk assessment in the maternity setting. Women Birth J. Aust. Coll. Midwives 2013, 26, 17–25. [Google Scholar] [CrossRef]
  49. Sims, D.; Christl, B.; Reilly, N.; Smith, M.; Chavasse, F.; Austin, M. Psychosocial assessment and mental health: Use of the Post Natal Risk Questionnaire (PNRQ) in an early parenting facility. Women Birth J. Aust. Coll. Midwives 2013, 26, 1–19. [Google Scholar] [CrossRef]
  50. Bartholomew, K.; Horowitz, L.M. Attachment styles among young adults: A test of a four-category model. J. Pers. Soc. Psychol. 1991, 61, 226–244. [Google Scholar] [CrossRef]
  51. Scharfe, E.; Bartholomew, K. Reliability and stability of adult attachment patterns. Pers. Relatsh. 1994, 1, 23–43. [Google Scholar] [CrossRef]
  52. Griffin, D.; Bartholomew, K. The metaphysics of measurement: The case of adult attachment. In Advances in Personal Relationships: Attachment Processes in Adulthood; Bartholomew, K., Perlman, D., Eds.; Jessica Kingsley Publishers: London, UK, 1994; Volume 5, pp. 17–52. [Google Scholar]
  53. Felitti, V.J.; Anda, R.F.; Nordenberg, D.; Williamson, D.F.; Spitz, A.M.; Edwards, V.; Koss, M.P.; Marks, J.S. Relationship of childhood abuse and household dysfunction to many of the leading causes of death in adults. The Adverse Childhood Experiences (ACE) Study. Am. J. Prev. Med. 1998, 14, 245–258. [Google Scholar] [CrossRef]
  54. Murphy, A.; Steele, M.; Dube, S.R.; Bate, J.; Bonuck, K.; Meissner, P.; Goldman, H.; Steele, H. Adverse Childhood Experiences (ACEs) questionnaire and Adult Attachment Interview (AAI): Implications for parent child relationships. Child Abus. Negl. 2014, 38, 224–233. [Google Scholar] [CrossRef]
  55. Brockington, I.F.; Oates, J.; George, S.; Turner, D.; Vostanis, P.; Sullivan, M.; Loh, C.; Murdoch, C. A Screening Questionnaire for mother-infant bonding disorders. Arch. Womens Ment. Health 2001, 3, 133–140. [Google Scholar] [CrossRef]
  56. Brockington, I.F.; Fraser, C.; Wilson, D. The Postpartum Bonding Questionnaire: A validation. Arch. Womens Ment. Health 2006, 9, 233–242. [Google Scholar] [CrossRef] [PubMed]
  57. Barkin, J.L.; Wisner, K.L.; Bromberger, J.T.; Beach, S.R.; Terry, M.A.; Wisniewski, S.R. Development of the Barkin Index of Maternal Functioning. J. Womens Health 2002 2010, 19, 2239–2246. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  58. Centers for Disease Control and Prevention Pregnancy Risk Assessment Monitoring System. Available online: https://www.cdc.gov/prams/index.htm (accessed on 10 October 2020).
  59. Partridge, E.F.; Bardyn, T.P. Research Electronic Data Capture (REDCap). J. Med. Libr. Assoc. 2018, 106, 142–144. [Google Scholar] [CrossRef] [Green Version]
  60. Simon, G.E.; Unützer, J.; Young, B.E.; Pincus, H.A. Large medical databases, population-based research, and patient confidentiality. Am. J. Psychiatry 2000, 157, 1731–1737. [Google Scholar] [CrossRef]
  61. The Center for Women’s Mental Health at Massachusetts General Hospital Perinatal Information Resource Center. Available online: https://womensmentalhealth.org/about/ (accessed on 10 October 2020).
  62. Stewart, R.; Davis, K. “Big data” in mental health research: Current status and emerging possibilities. Soc. Psychiatry Psychiatr. Epidemiol. 2016, 51, 1055–1072. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Research areas of interest.
Figure 1. Research areas of interest.
Ijerph 17 09352 g001
Table 1. Outcomes and measures.
Table 1. Outcomes and measures.
VariableMeasure/ToolReliabilityValidity
Demographic characteristicsDemographic form
(Tool created by QRPN)
N/AN/A
Medical, obstetric and psychiatric historyPhysician Form
(Tool created by QRPN)
N/AN/A
DepressionEdinburgh Postnatal Depression Scale
[44,45]
Internal consistency:
α = 0.88
[44]
Sensitivity: 63–93%
Specificity: 88–99%
[15]
AnxietyGeneralized Anxiety Disorder-7
[46]
Internal consistency:
α = 0.92
[46]
Sensitivity: 89%
Specificity: 82%
[46]
Cambridge Worry Scale
[47]
Internal consistency:
α = 0.79
Correlation between trait anxiety and total worry scores
(r = 0.45–0.56)
Psychosocial riskAntenatal Risk Questionnaire
[48]
N/ASensitivity: 62%
Specificity: 64%
Postnatal Risk Questionnaire
[49]
N/AN/A
Adult peer relationship styleRelationship Questionnaire
[50]
Test–retest:
r = 0.39 to 0.58
[51]
Convergent validity with interview attachment ratings:
r = 0.22 to 0.50
[52]
Childhood adversityAdverse Childhood Experiences Questionnaire
[53]
Internal consistency:
α = 0.88
[54]
Convergent validity with adult attachment interview:
chi sq = 17.50, df = 4,
p = 0.002
[54]
BondingThe Postpartum Bonding Questionnaire
[55]
Test–retest:
Scale 1, r = 0.95
Scale 2, r = 0.95
Scale 3, r = 0.93
Scale 4, r = 0.77
[55]
* Sensitivity:
Scale 1 = 82%
Scale 2 = 67 to 88%
[56]
Maternal FunctioningBarkin Index of Maternal Functioning
[3,41,57]
Internal consistency:
α = 0.87
[57]
Construct validity:
Significant correlations found with three relevant measures
[57]
Pregnancy Risk Assessment Monitoring System Questionnaire (PRAMS)
[58]
N/AN/A
QRPN: Quebec Reproductive Psychiatry Network; * Scale 3 and 4 had unsatisfactory validity but were deemed useful for clinical purposes.
Table 2. Timeline of protocol 1 (first seen during pregnancy).
Table 2. Timeline of protocol 1 (first seen during pregnancy).
MeasureIntake~6 Weeks Post-Partum4–6 Months Post-Partum
Contact information and demographics—full version
Exercise
Complementary alternative medicine (CAM)
Newborn and birth information
Demographics—update
The Edinburgh Postnatal Depression Scale (EPDS)
The Generalized Anxiety Disorder (GAD)-7
The Antenatal Risk Questionnaire (ANRQ)—full version
Postnatal Risk Questionnaire (PNRQ) Last 3 questions ✓Full version ✓
The Cambridge Worry Scale (CWS)
The Relationship Questionnaire (RQ)
The Adverse Childhood Experiences Questionnaire (ACE)
The Postpartum Bonding Questionnaire (PBQ)
Pregnancy Risk Assessment Monitoring System Questionnaire (PRAMS)—14 questions
The Barkin Index of Maternal Functioning (BIMF)
Physician history-taking form
Compliance with recommendations
COVID-19 module
Table 3. Timeline of protocol 2 (first seen after pregnancy).
Table 3. Timeline of protocol 2 (first seen after pregnancy).
MeasureIntake4–6 Months Post-Partum
Contact information and demographics—full version
Exercise
Complementary alternative medicine (CAM)
Newborn and birth information
Demographics—update
The Edinburgh Postnatal Depression Scale (EPDS)
The Generalized Anxiety Disorder (GAD)-7
Postnatal Risk Questionnaire (PNRQ)—full
The Relationship Questionnaire (RQ)
The Adverse Childhood Experiences Questionnaire (ACE)
The Postpartum Bonding Questionnaire (PBQ)
Pregnancy Risk Assessment Monitoring System Questionnaire (PRAMS)—14 questions only
The Barkin Index of Maternal Functioning (BIMF)
Physician history-taking form
Compliance with recommendations
COVID-19 module
Table 4. Demographics of current participants.
Table 4. Demographics of current participants.
Demographic FeaturesNumber (Percentage)
Single (never married)18 (10.2)176 (Missing = 0)
Married76 (43.2)
Living with your partner78 (44.3)
Divorced/separated4 (2.3)
Widow0 (0.0)
Unemployed110 (62.9)175 (Missing = 1)
Employed65 (37.1)
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Kattan, W.; Avigan, L.; Hayton, B.; Barkin, J.L.; St-André, M.; Nguyen, T.-V.; Schwartz, H.; Poulin, M.-J.; Stikarovska, I.; Wolde-Giorghis, R.; et al. Creating a Multisite Perinatal Psychiatry Databank: Purpose and Development. Int. J. Environ. Res. Public Health 2020, 17, 9352. https://doi.org/10.3390/ijerph17249352

AMA Style

Kattan W, Avigan L, Hayton B, Barkin JL, St-André M, Nguyen T-V, Schwartz H, Poulin M-J, Stikarovska I, Wolde-Giorghis R, et al. Creating a Multisite Perinatal Psychiatry Databank: Purpose and Development. International Journal of Environmental Research and Public Health. 2020; 17(24):9352. https://doi.org/10.3390/ijerph17249352

Chicago/Turabian Style

Kattan, Wid, Laura Avigan, Barbara Hayton, Jennifer L. Barkin, Martin St-André, Tuong-Vi Nguyen, Hannah Schwartz, Marie-Josée Poulin, Irena Stikarovska, Rahel Wolde-Giorghis, and et al. 2020. "Creating a Multisite Perinatal Psychiatry Databank: Purpose and Development" International Journal of Environmental Research and Public Health 17, no. 24: 9352. https://doi.org/10.3390/ijerph17249352

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop