Next Article in Journal
Ambidextrous Innovation in Project Management: A Systematic Literature Review
Previous Article in Journal
Exploring Croatian Consumer Adoption of Subscription-Based E-Commerce for Business Innovation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Adaptation and Validation of the Individual Work Performance Questionnaire into a Portuguese Version

by
Eva Petiz Lousã
1,2,3,*,
Marta Pereira Alves
3 and
Linda Koopmans
4
1
Research Unit in Business Sciences and Sustainability (UNICES), University of Maia, 4475-690 Maia, Portugal
2
Centre for Organizational and Social Studies of Polytechnic of Porto (CEOS.PP, ISCAP, Polytechnic of Porto), 4465-004 Porto, Portugal
3
Research Center in Business Sciences (NECE-UBI), University of Beira Interior, 6200-209 Covilhã, Portugal
4
TNO Healthy Living and Work, Department of Sustainable Productivity and Employability, 2333 BE Leiden, The Netherlands
*
Author to whom correspondence should be addressed.
Adm. Sci. 2024, 14(7), 150; https://doi.org/10.3390/admsci14070150
Submission received: 3 June 2024 / Revised: 6 July 2024 / Accepted: 10 July 2024 / Published: 15 July 2024

Abstract

:
The aim of this study is to adapt and validate the Individual Work Performance Questionnaire (IWPQ) to a Portuguese version (IWPQ-PT) and to evaluate its psychometric properties in a sample of 423 digital sector workers. Two studies were conducted to define the factorial structure. In study 1 (n = 162), the results of an exploratory factor analysis pointed to a three-factor structure (18 items), explaining 55.56% of the variance. In study 2 (n = 261), the results of a confirmatory factor analysis revealed a good model fit (CFI = 0.95; RMSEA = 0.06), also reproducing the structure of the original model. The overall scale and subscales demonstrated good reliability, with Cronbach’s alpha coefficients ranging from 0.72 to 0.88. Correlations between the IWPQ-PT subscales and other instruments revealed that higher task and contextual performance are associated with increased job satisfaction, work engagement, and decreased turnover intention. Conversely, counterproductive work behavior is associated with lower job satisfaction, work engagement, and higher turnover intention. This study underscores the contributions of the IWPQ-PT as a reliable and valid tool for assessing individual work performance in Portuguese organizations and highlights its contributions to the field of employee work performance research as well as human resources practices.

1. Introduction

Individual performance at work must be studied in order to understand how people contribute to an organization’s success and ensure its competitiveness. Individual performance has been addressed both as an outcome or dependent variable in research (Carpini et al. 2017; Koopmans et al. 2011), and over the last century, this topic has been central to scholars, highlighting its relevance and complexity (Carpini et al. 2017; Dalal et al. 2020). Several theoretical frameworks have been proposed to understand and analyze job performance (Campbell and Wiernik 2015; Carpini et al. 2017). This diversity mirrors the focus of different disciplines: management, occupational health, and work and organizational psychology. Management is focused on increasing employee productivity (e.g., Beaton et al. 2009); occupational health focuses on preventing productivity loss due to health issues (e.g., Schultz et al. 2009); and work and organizational psychologists study the association between antecedents, like work engagement, satisfaction, and personality, and individual work performance (Halbeslebe et al. 2008; Judge et al. 2001). Nonetheless, there is a consensus in the literature that individual work performance can be defined as the behaviors or actions of employees that are relevant to the organization’s objectives (Campbell 1990; Campbell and Wiernik 2015; Carpini et al. 2017; Koopmans et al. 2011). This definition highlights some important characteristics of individual job performance. On the one hand, it puts the attention on employee behaviors. On the other hand, it emphasizes that individual performance at work involves the concrete activities that employees perform to achieve the organization’s goals. In addition, these behaviors are understood from a multidimensional perspective (e.g., Campbell 1990; Campbell and Wiernik 2015; Koopmans et al. 2011), which encompasses performance of the task (i.e., contributing directly to the production of goods or services); organizational citizenship behaviors (i.e., employee behaviors that benefit the organization’s social and psychological environment, and in this sense, contribute to its overall goals); and counterproductive behaviors at work (i.e., voluntary actions that have the potential to harm the well-being of the organization and its stakeholders). Job performance is also linked with proactive behavior (i.e., it involves anticipatory actions by employees to impact themselves or the work environment), creative behavior (i.e., it encompasses the generation of innovative ideas and solutions), and adaptive performance (i.e., it includes behavioral modifications in response to the demands and situations of the work environment) (Dalal et al. 2020).
Koopmans et al. (2012) identified several limitations associated with the variety of scales used to measure the dimensions of individual work performance (e.g., Podsakoff and MacKenzie 1989; Spector et al. 2006; Williams and Anderson 1991). First, no single scale encompasses all dimensions, requiring researchers to combine multiple instruments. Second, the way these dimensions are defined and operationalized varies across scales, making it difficult to choose the most appropriate one for a specific study population. Another issue is the presence of antithetical items, as observed by Dalal (2005), where overlapping behaviors are found in scales that measure different dimensions, compromising the content validity of the measures. To address these limitations and facilitate the optimal measurement of individual work performance, Koopmans et al. (2014b) developed the Individual Work Performance Questionnaire (IWPQ) for assessing individual-level work performance in a generic and short questionnaire. The Individual Work Performance Questionnaire was developed in several phases. Initially, Koopmans et al. (2011), based on a systematic review of the literature on individual work performance in different fields of research, namely in occupational health, psychology, and management, identified four dimensions frequently used to describe individual performance in any job: task performance; contextual performance; counterproductive work behavior; and adaptive performance. In a later study, Koopmans et al. (2012) developed a generic and short questionnaire to measure job performance at the individual level and identified a three-dimensional structure, consisting of task performance, contextual performance, and counterproductive work behavior. Items related to adaptive performance were included in contextual performance. Koopmans et al. (2011) defined task performance as the competence with which individuals perform the essential or technical tasks central to their work. This is the traditional focus of the individual performance construct at work, and it involves the effective execution of the specific responsibilities assigned to a role or position. Contextual performance, according to Koopmans et al. (2011), consists of behaviors that contribute to the organizational, social, and psychological environment in which technical work is performed. These behaviors support and facilitate the effective functioning of the work environment, promoting a positive and collaborative organizational climate. Additionally, Koopmans et al. (2011) described counterproductive work behavior as behaviors that harm the well-being and functioning of the organization. This includes actions such as sabotage, unethical behavior, excessive absenteeism, and misappropriation of the organization’s resources, among others, which have a negative impact on the company’s operations and results.
The IWPQ was developed in the Netherlands and Koopmans et al. (2016) culturally adapted the instrument to American English, evaluating the internal consistency and content validity of the questionnaire in this context. Research with the IWPQ has shown validity evidence across different countries, such as Bahasa Indonesia (Widyastuti and Hidayat 2018), Italy (Platania et al. 2023), Vietnam (Nguyen-Duc et al. 2023), and Spain (Ramos-Villagrasa et al. 2019). In Portugal, there is no instrument to assess individual performance at work. In this sense, its adaptation to the Portuguese context is crucial in providing a reliable and valid tool for evaluating the performance of employees in Portuguese-speaking organizations. A reliable and validated tool will allow organizations to gain a more accurate understanding of their employees’ performance and identify areas for improvement. In turn, the original questionnaire was developed to measure various aspects of individual job performance. Thus, it is also the objective of the present study to evaluate the psychometric properties of the IWPQ through exploratory and confirmatory factor analysis in a sample of workers from digital sector organizations. The digital sector encompasses activities related to information technology, communications, the internet, software, and e-commerce. And this is a sector that has been growing in the last few years (OECD 2024). Thus, it is pertinent to study the behaviors, ways of working, and methods for evaluating the individual work performance of people whose activities are carried out in a digital context. More specifically, this study aimed to (a) identify the factor structure for the Portuguese version (IWPQ) and compare it with the original version by Koopmans et al. (2014b), through exploratory factor analysis; (b) analyze the internal consistency and intercorrelations of IWPQ scores; (c) confirm the factor structure and calculate adjustment indices through a confirmatory factor analysis; (d) assess composite reliability, convergent, and discriminant validity of the measure; and (e) provide further evidence of construct validity by examining how IWPQ scores relate to measures of work engagement, job satisfaction, and turnover intention.
We tested the hypothesis that the Portuguese version of the IWPQ demonstrates a similar structure to the original version, composed of three dimensions—task performance, contextual performance, and counterproductive work behavior—while also presenting adequate reliability. The dimensions of job performance and contextual performance are expected to correlate positively with engagement and job satisfaction, and the counterproductive performance dimension is expected to correlate negatively with engagement and job satisfaction (Koopmans et al. 2014a; Platania et al. 2023). It is also anticipated that the dimensions of task performance and contextual performance will correlate negatively with turnover intention (Van Scotter 2000). In turn, the counterproductive performance dimension will correlate positively with turnover intention (Hattab et al. 2022).

2. Method

2.1. Participants

Sample 1. A sample of 162 workers from digital sector organizations (e.g., digital marketing, telecommunications, e-commerce, information technology, and software development) participated in the first study. Most of them were male (60.5%), aged between 21 and 30 years (48.1%), and their organizational tenure was more than six years (43.8%). Regarding educational level, most of the participants were highly educated (74.1%), of which 37.7% had a bachelor’s degree and 36.4% had a master’s degree.
Sample 2: Participants were 261 workers from digital sector organizations, with 56.3% being male, aged between 19 and 58 years (M = 32.22; SD = 8.41), and their average organizational tenure was 4.01 years (SD = 4.24). Regarding educational level, most of the participants were highly educated (83.3%), of which 52.9% had a bachelor’s degree and 32.5% had a master’s degree.

2.2. Procedure

We used a non-probabilistic convenience sample and a self-administered questionnaire for data collection. Data were collected both in organizational contexts and through informal networks. In the first case, the procedure adopted was carried out by e-mail by sending a cover letter to the organizations, in which objectives, variables under study, and steps for the collection of information were explained. After the organizations accepted, more detailed information was provided, and a self-administered questionnaire was made available to the workers, which could be completed online. In the case of informal networks, participants were contacted by personal emails, social networks (Facebook, Instagram, and LinkedIn), and in person. Google Forms was the tool used for this purpose. The sample inclusion criteria were organizations that partially or fully provided digital services or workers of organizations operating in the digital sector. For Studies 1 and 2, data related to the variables of the IWPQ and data concerning the sample characterization were collected. Data related to work engagement, job satisfaction, and turnover intention were collected in the second study. The studies were approved by the Ethics Committee of the University of Maia. Informed consent and voluntary participation, anonymity, and confidentiality of the answers were ensured, and the data collected would only be used for research purposes to ensure the ethical issues of research.

2.3. Instruments

2.3.1. Individual Work Performance Questionnaire (IWPQ)

The original version of the scale is composed of 18 items divided into three subscales: task performance (e.g., “I was able to set priorities”), contextual performance (e.g., “I took on extra responsibilities”), and counterproductive work behavior (e.g., “I focused on the negative aspects of the work situation instead of the positive aspects”) (Koopmans et al. 2014b). On all subscales, all items correspond to a 3-month recall span, and it has a rating of 5 points on a Likert scale. For task and contextual performance, 0 was labeled as “rarely” and 4 as “always”. For counterproductive work behavior, 0 was labeled as “never” and 4 as “often”.
To ensure the cultural and linguistic validity of the individual performance scale for the Portuguese context, the process of translation and linguistic adjustments was conducted following the guidelines of Gjersing et al. (2010). Initially, the scale items were translated into Portuguese by two translators fluent in the target language, following the reverse translation guidelines. Then, a consolidated version was elaborated, integrating the translators’ suggestions and considering the clarity and comprehension of the items for potential participants. Subsequently, this version was submitted for review by a panel of experts composed of professionals with expertise in organizational psychology and linguistics. This panel evaluated the semantic and conceptual equivalence of the items, as well as their cultural adequacy in the Portuguese context. Based on the recommendations of the expert panel, additional adjustments were made to the items when necessary, to ensure that the scale maintained its fidelity to the original construct while being linguistically understandable and culturally relevant to Portuguese collaborators. Finally, we did a pilot test with a small group of 10 workers, who did not suggest any additional modifications. Appendix A contains the list of the 18 items of IWPQ in Portuguese.

2.3.2. Work Engagement Scale Short Version (UWES-9)

The Work Engagement Scale, in its short version, is a psychometric instrument that measures employees’ work engagement in organizations. The original version, UWES-9, was developed by Schaufeli and Bakker (2003), and it was adapted and validated in Portugal by Sinval et al. (2018). The UWES-9 is a self-report scale, and on all subscales, all items have a rating of 7 points on a Likert scale (0 = never; 6 = always). The scale is divided into three subscales: vigor (e.g., “At my work, I feel bursting with energy”), dedication (e.g., “My job inspires me”), and absorption (e.g., “I feel happy when I am working intensely”), with three questions each. Internal consistency of the measure was very good, with an ordinal Cronbach’s α for the total sample of 0.95. This measure was assessed in Sample 2.

2.3.3. Short Index of Job Satisfaction (SIJS)

The Short Index of Job Satisfaction is a psychometric instrument that measures job satisfaction through five items adapted to Portuguese by Sinval and Marôco (2020). The original version is based on a self-report psychometric instrument created by Brayfield and Rothe (1951), although a shorter version with five items (SIJS) has also been proposed by Judge et al. (2000) and Judge and Klinger (2008). One example of an item is “I feel fairly satisfied with my present job”. All items have a rating on a five-point scale (1 “Strongly Disagree”, 2 “Disagree”, 3 “Undecided”, 4 “Agree”, 5 “Strongly Agree”), and two of those items are reversed. Cronbach’s alpha reliability coefficient was 0.88. Higher scores on this scale indicate greater satisfaction of the individual with their job. This measure was assessed in Sample 2.

2.3.4. Turnover Intention (TI)

Turnover intention includes three items derived from a study by Mobley et al. (1978), also used by Skelton et al. (2019), employing a five-point Likert scale, ranging from 1 (strongly disagree) to 5 (strongly agree). One example of an item is “I often think of leaving the organization”. Higher scores on this scale indicate greater intention of the individual to leave the organization. This measure was assessed in Sample 2.

2.4. Statistical Analysis Plan

IBM SPSS Statistics 29 and IBM SPSS Amos 29 statistical analysis software was used. Each sample was examined separately to verify that the data were normal and free of missing values. First, an exploratory factor analysis (EFA) was carried out in Study 1 (n = 162) using Varimax orthogonal rotation and principal component analysis (PCA). Also, the internal consistency of each subscale (i.e., Cronbach’s alpha) and correlations between subscales were calculated. Following Cohen’s (1988) guidelines, a correlation absolute value between (-)0.10 and 0.29 corresponds to a weak association between two variables, absolute values between 0.30 and 0.49 indicate a moderate correlation, and absolute values above 0.50 indicate a strong relationship.
Second, in Study 2, the factor solution was tested using the maximum likelihood (ML) estimation method in confirmatory factor analysis (CFA) on a different sample (n = 261). The model fit was evaluated using the following indexes: chi-square (χ2 and χ2/df), comparative fit index (CFI), goodness-of-fit index (GFI), and root mean square error of approximation (RMSEA, 90% CI) (Jackson et al. 2009). Additionally, composite reliability (CR) and average variance extracted (AVE) were calculated to assess construct consistency and validity, respectively. Finally, correlation analyses were performed between IWPQ-PT subscales and other relevant variables, namely measures of job satisfaction, turnover intention, and work engagement.

3. Results

3.1. Exploratory Factor Analysis

A total of 18 items from the IWPQ were submitted to an EFA (using principal component analysis and Varimax orthogonal rotation). These decisions regarding methodology were in accordance with the procedures followed by researchers to validate the scale’s initial version (Koopmans et al. 2014b).
The Kaiser–Mayer–Olkin (KMO) was 0.84 and the Barlett test for sphericity reached statistical significance: χ2(153) = 1319.07, p < 0.001. Thus, the dataset was shown to be appropriate for factor analysis. The Cattell scree test (Cattell 1966), which recommends factor extraction of three to four, was used to ascertain the number of components to be kept. The items with the highest loadings were taken into consideration when deciding which component an item should belong to. In the present study, the value of 0.40 was considered as the threshold loading value, following the recommendations of some authors in the literature (e.g., Costello and Osborne 2005). Two EFAs were performed, fixing three and then four factors to extract. In the three-factor solution, eight items were related to the contextual performance dimension, five to task performance, and five to counterproductive work behavior (CWB). In the four-factor structure, two contextual performance items from the three-factor solution were loaded into a different and fourth dimension (i.e., items 8 and 9). Both theoretically and statistically, the three-component factor solution was revealed to be consistent with the three-factor structure of the version of the IWPQ that emerged in the empirical validation study of Koopmans et al. (2014b). Thus, we decided to consider the three-factor structure. Table 1 shows the factor loadings, communalities, explained variance, and descriptive statistics.
The final solution for 18 items, displayed in Table 1, comprised three components that accounted for 55.56% of the variance. As expected, in the final solution, items 8 and 9 showed cross-loadings into components 1 and 2 with values above 0.40. Both items were assigned to the first component (contextual performance) for two reasons. First, this decision was congruent with the original version of the scale; second, items 8 and 9 revealed higher loading values on that component. Considering the final after-rotation solution, the first component, contextual performance, is composed of eight items and explains 24.06% of the total variance. The second component, task performance, includes five items and accounts for 18.15% of the total variance. The third component, CWB, explains 13.76% of the total variance and contains five items.

3.2. Internal Consistency and Correlations between Subscales

Considering Sample 1, Cronbach’s alpha reliability coefficients were computed to assess the internal consistency of the exploratory three-factor solution (Table 2). Regarding subscales reliability coefficients, we obtained 0.81 for task performance, 0.88 for context performance, and 0.72 for CWB. According to the results presented in Table 2, correlations between task performance and context performance were significant (p < 0.001), positive, and strong (i.e., r = 0.50). In contrast, the correlations between task performance and CWB and between context performance and CWB were not statistically significant.

3.3. Confirmatory Factor Analysis

Using a different sample of 261 individuals (Sample 2), the three-factor structure found through EFA has been submitted to a CFA (Study 2). We tested if the IWPQ factorial structure was appropriate for the Portuguese data using the ML estimation approach.
In terms of the local adjustment of the items (see Figure 1), all of them had significant non-standardized regression weights (p > 0.05) and critical ratio (CR) values substantially above 1.96. Moreover, three items (i.e., 14, 17, and 18) of CWB presented standardized estimates a little below 0.40 (i.e., 0.37, 0.30, and 0.34, respectively). These three items also had the lowest values of R2 (i.e., 0.16, 0.12, and 0.15, respectively).
Regarding the model global adjustment, a good model fit has been associated with a small and significant χ2, values near 0.90 for CFI and GFI, and RMSEA below 0.10 (Byrne 2010). The initial model did not appropriately fit the data: χ2(132) = 411.26, p < 0.001; χ2/df = 3.12, CFI = 0.95, GFI = 0.81, and RMSEA = 0.09 [90% CI 0.08–0.10]. Since the modification indices suggested indications for the model improvement, covariances between two error pairs comprising consecutive items with comparable content were added (i.e., between item 11 and item 12, and between item 17 and item 18). Only correlations between error measurements associated with the same factor were estimated. Afterwards, findings showed a more acceptable model fit: χ2(130) = 261.62, p < 0.001; χ2/df = 2.01; CFI = 0.95; GFI = 0.90; RMSEA = 0.06 [90% CI 0.05–0.07]. Finally, AVE was 0.64 for task performance, 0.60 for context performance, and 0.36 for CWB. The CR values obtained were 0.90, 0.92, and 0.70 for task performance, context performance, and CWB, respectively. Following the recommendations of Fornell and Larcker (1981), AVE values were satisfactory for task performance and context performance (i.e., greater than 0.50) and inadequate for the CWB subscale. All AVE values were superior to the squared correlation values (R2) obtained between IWPQ-PT dimensions (i.e., superior to 0.25), indicating discriminant validity between variables. With regard to CR values, the three subscales showed adequate scores, considering 0.70 as the lower threshold.

3.4. Correlations with Relevant Variables

The matrix of correlations between IWPQ-PT subscales and some relevant variables is presented in Table 3. Measures of job satisfaction, turnover intention, and work engagement were used. First, findings point to the existence of moderate-to-strong positive associations between both task performance and context performance and job satisfaction (r = 42 and r = 0.53, p < 0.001, respectively) and all of the dimensions of work engagement (vigor, dedication, and absorption), with values of correlation ranging from 0.58 to 0.69 (p < 0.001). Second, the CWB subscale was negatively and weakly to moderately related to job satisfaction (r = −0.30, p < 0.001) and work engagement subscales (r = −0.15, p < 0.05 for dedication and r = −0.17, p < 0.01 for vigor and absorption). Finally, both the dimensions of task performance and context performance were moderately and negatively correlated to turnover intention (r = −0.33 for task performance and r = −0.44 for context performance, p < 0.001); contrastingly, the association between CWB and turnover intention was positive and weak (r = 0.22, p < 0.001).

4. Discussion

The present study aimed to adapt and validate the Individual Work Performance Questionnaire (IWPQ) into a Portuguese version (IWPQ-PT). The findings provide evidence to support the adaptation and psychometric properties of the IWPQ-PT for assessing individual work performance in Portuguese-speaking samples working in digital service organizations. In addition, the results obtained allow us to establish the relationship with other relevant variables, namely work engagement, job satisfaction, and turnover intention.
Regarding the factorial structure of the IWPQ-PT, the EFA supported a three-factor structure for the IWPQ-PT, mirroring the structure of the original IWPQ. This structure aligns with the theoretical framework proposed by Koopmans et al. (2014b). The following factors were identified: task performance, contextual performance, and counterproductive work behavior (CWB). Notably, two items were initially loaded onto two components: contextual performance and task performance. However, both were reassigned to the contextual performance dimension based on theoretical grounds and stronger loadings on that factor, ensuring consistency with the original instrument.
The internal consistency of the IWPQ-PT subscales was satisfactory, with Cronbach’s alpha coefficients exceeding 0.70 for all of the dimensions.
As expected, the study found positive and significant correlations between task and contextual performance, while correlations between these performance dimensions and CWB were non-significant. Ramos-Villagrasa et al. (2019) also reported a non-significant relationship between contextual performance and counterproductive behavior, despite the expected negative association. The authors explained these results by highlighting that the IWPQ contextual performance items focus on individual behaviors, while counterproductive behavior items focus on behaviors performed by oneself toward others. This explanation could also be applied to task performance items, as they also focus on individual behaviors.
In addition, the CFA provided further evidence for the three-factor structure of the IWPQ-PT. The initial model fit indices were acceptable, and subsequent modifications based on error term correlations yielded an even better fit. While three items of the CWB dimension (i.e., items 14, 17, and 18) displayed slightly lower standardized loadings, their overall contribution to the model remained acceptable. In fact, the CWB subscale revealed less convergent validity than the other two IWP dimensions, presenting an AVE value inferior to 0.50. This result suggests that the CWB items’ variance is not adequately explained by the respective factor, mostly due to items 14, 17, and 18. However, the IWPQ constructs have shown good composite reliability (i.e., the items consistently reflect the scale dimension with which they are associated), and also discriminant validity. The lower loadings of these specific items (complaining behaviors) warrant further investigation. Future studies are necessary to definitively clarify these findings and explore the role of dispositional characteristics (e.g., personality), work context factors (e.g., technology sector), and cultural influences on these behaviors. Also, more research may provide light on the potential impact of participant demographics on the results, given that most of the employees were male, relatively young, and had a higher level of education.
As expected, the IWPQ-PT subscales (task performance, contextual performance, and CWB) showed correlations with job satisfaction, work engagement, and turnover intention. This supports evidence of construct validity, in particular nomological validity, since it is based on correlations among constructs assumed to be related (Geisinger 1992). Task and contextual performance showed moderate and positive correlations with all dimensions of work engagement, whereas CWB showed weak and negative correlations. These findings suggest that higher levels of task and contextual performance are associated with greater work engagement, which is in line with previous literature (e.g., Bakker et al. 2008; Demerouti and Cropanzano 2010; Koopmans et al. 2014a). The job demands–resources theory (Bakker et al. 2023) posits job performance as an outcome of work engagement, which is supported by evidence of a direct and indirect relationship between work engagement and job performance (Kim et al. 2013). The association between work engagement and task performance was also confirmed through the meta-analysis conducted by Neuber et al. (2022). In addition to the relationship between these variables, Christian et al. (2011) highlighted the importance of extra-role performance, a facet of contextual performance. Furthermore, the findings align with Koopmans et al. (2014a) by showing stronger correlations between contextual performance behaviors and work engagement dimensions compared to task performance behaviors. These results suggest that when individuals are engaged in their work and experience active positive emotions (e.g., vigor, dedication, and absorption), they may be motivated to take initiative and persist with challenging tasks. Additionally, they may be motivated to contribute to a positive and collaborative work environment through the creation of a supportive organizational, social, and psychological climate.
As expected, supporting the established link between job satisfaction and higher performance (e.g., Koopmans et al. 2014a), the present study found positive and moderate correlations between job satisfaction and the IWPQ-PT subscales of contextual performance and task performance. These results sustain the assumption that satisfied employees tend to perform better (e.g., Van Scotter 2000). The relationship between contextual performance and job satisfaction is particularly strong. This is consistent with theories that highlight the role of contextual performance in creating a positive and supportive work environment, which in turn contributes to employee satisfaction (Borman and Motowidlo 1993; Podsakoff and MacKenzie 1997). In contrast, the CWB subscale exhibited a moderate negative correlation with job satisfaction.
As expected, task and contextual performance were negatively correlated with turnover intention, aligning with previous research (e.g., Van Scotter 2000). This negative association is particularly strong for contextual performance. Contextual performance reflects an employee’s willingness to go beyond their core job duties and contribute to the organization’s social and psychological well-being. In contrast, turnover intention signifies a desire to withdraw from these very aspects of work life. Therefore, employees who engage in contextual behaviors are likely to feel more connected to the organization, leading to lower intentions to leave. Conversely, higher levels of CWB were associated with increased turnover intentions.

Limitations and Suggestions for Future Studies

It is important to note that this study has some limitations that warrant consideration in future studies. The data were collected from workers in digital service organizations, limiting the generalizability of the results to other contexts. Future research should involve samples from diverse sectors and organizational contexts. Additionally, the study employed a cross-sectional design, which precludes establishing causal relationships between the variables. Longitudinal studies are recommended to investigate the causal nature of these relationships and the predictive validity of the IWPQ-PT for other work outcomes. Furthermore, future research could explore the relationship between the IWPQ-PT and other factors relevant to individual performance at work, such as organizational culture, leadership, emotional intelligence, and individual characteristics of employees.

5. Conclusions

In conclusion, the IWPQ-PT demonstrates a reliable and valid instrument for evaluating individual work performance in Portuguese organizational settings. The analyses performed provide evidence that the IWPQ-PT is a reliable and valid instrument to assess individual work performance in samples of Portuguese workers. The three dimensions of the questionnaire capture relevant aspects of individual performance and correlate with measures of job satisfaction, work engagement, and turnover intention. The instrument provides an available tool to be used in human resource practice, but also in research to assess various aspects of individual employee performance and their associations with job satisfaction, work engagement, and turnover intention.

Author Contributions

Conceptualization, E.P.L. and M.P.A.; Methodology, E.P.L. and M.P.A.; Software, E.P.L. and M.P.A.; Validation, E.P.L., M.P.A. and L.K.; Formal analysis, E.P.L. and M.P.A.; Investigation, E.P.L.; Resources, E.P.L.; Data curation, E.P.L.; Writing—original draft, E.P.L. and M.P.A.; Writing—review & editing, E.P.L., M.P.A. and L.K.; Funding acquisition, E.P.L. and M.P.A. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by FCT—Fundação para a Ciência e Tecnologia, I.P., by project reference UIDB/05422/2020, and project reference UIDB/04630/2020 and DOI: 10.54499/UIDB/04630/2020.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Ethics Committee of the University of Maia (protocol code N.° 203/2023 and N.° 191/2024).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data that support the findings of this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflicts of interest.

Appendix A. IWPQ-PT—List of the Items in Portuguese—18 Items

Nos últimos 3 meses…
  • Consegui planear o meu trabalho para terminar no prazo.
  • Eu tinha em mente o resultado do trabalho que eu precisava para atingir.
  • Consegui definir prioridades.
  • Consegui realizar meu trabalho com eficiência.
  • Geri bem o meu tempo.
  • Por iniciativa própria, iniciei uma nova tarefa quando as minhas tarefas antigas foram concluídas.
  • Assumi tarefas desafiadoras quando elas estavam disponíveis.
  • Trabalhei para manter os meus conhecimentos relacionados com o trabalho atualizados.
  • Trabalhei para manter as minhas competências profissionais atualizadas.
  • Criei soluções criativas para novos problemas.
  • Assumi responsabilidades extra.
  • Procurei continuamente novos desafios no meu trabalho.
  • Participei ativamente em reuniões e/ou consultas.
  • Reclamei sobre questões menores relacionadas com o trabalho no trabalho.
  • Criei problemas no trabalho maiores do que eram.
  • Concentrei-me nos aspetos negativos da situação no trabalho em vez dos aspetos positivos.
  • Conversei com os colegas sobre os aspetos negativos do meu trabalho.
  • Conversei com pessoas que não eram da organização sobre os aspetos negativos do meu trabalho.

References

  1. Bakker, Arnold B., Evangelia Demerouti, and Ana Sanz-Vergel. 2023. Job Demands–Resources Theory: Ten Years Later. Annual Review of Organizational Psychology and Organizational Behavior 10: 25–53. [Google Scholar] [CrossRef]
  2. Bakker, Arnold B., Wilmar B. Schaufeli, Michael P. Leiter, and Toon W. Taris. 2008. Work Engagement: An Emerging Concept in Occupational Health Psychology. Work and Stress 22: 187–200. [Google Scholar] [CrossRef]
  3. Beaton, Dorcas, Claire Bombardier, Reuben Escorpizo, Wei Zhang, Diane Lacaille, Annelies Boonen, Richard H. Osborne, Aslam H. Anis, C. Vibeke Strand, and Peter S. Tugwell. 2009. Measuring Worker Productivity: Frameworks and Measures. The Journal of Rheumatology 36: 2100–9. [Google Scholar] [CrossRef] [PubMed]
  4. Borman, Walter C., and Steve Motowidlo. 1993. Expanding the Criterion Domain to Include Elements of Contextual Performance. In Personnel Selection in Organizations. Edited by Neil Schmitt and Walter C. Borman. San Francisco: Jossey-Bass, pp. 71–98. [Google Scholar]
  5. Brayfield, Arthur H., and Harold F. Rothe. 1951. An Index of Job Satisfaction. The Journal of Applied Psychology 35: 307–11. [Google Scholar] [CrossRef]
  6. Byrne, Barbara M. 2010. Structural Equation Modelling with AMOS: Basic Concepts, Applications, and Programming. New York: Routledge. [Google Scholar]
  7. Campbell, John. P. 1990. Modeling the Performance Prediction Problem in Industrial and Organizational Psychology. In Handbook of Industrial and Organizational Psychology. Edited by Marvin D. Dunnette and Leaetta M. Hough. Palo Alto: Consulting Psychologists Press, Inc., pp. 687–732. [Google Scholar]
  8. Campbell, John P., and Brenton M. Wiernik. 2015. The Modeling and Assessment of Work Performance. Annual Review of Organizational Psychology and Organizational Behavior 2: 47–74. [Google Scholar] [CrossRef]
  9. Carpini, Joseph A., Sharon K. Parker, and Mark A. Griffin. 2017. A Look Back and a Leap Forward: A Review and Synthesis of the Individual Work Performance Literature. Academy of Management Annals 11: 825–85. [Google Scholar] [CrossRef]
  10. Cattell, Raymond B. 1966. The Scree Test for the Number of Factors. Multivariate Behavioral Research 1: 245–76. [Google Scholar] [CrossRef] [PubMed]
  11. Christian, Michael S., Adela S. Garza, and Jerel E. Slaughter. 2011. Work engagement: A quantitative review and test of its relations with task and contextual performance. Personnel Psychology 64: 89–136. [Google Scholar] [CrossRef]
  12. Cohen, Jacob. 1988. Statistical Power Analysis for the Behavioral Sciences, 2nd ed. Hillsdale: Lawrence Erlbaum Associates. [Google Scholar]
  13. Costello, Anna B., and Jason Osborne. 2005. Best Practices in Exploratory Factor Analysis: Four Recommendations for Getting the Most from Your Analysis. Practical Assessment, Research, and Evaluation 10: 7. [Google Scholar] [CrossRef]
  14. Dalal, Reeshad S. 2005. A Meta-Analysis of the Relationship Between Organizational Citizenship Behavior and Counterproductive Work Behavior. Journal of Applied Psychology 90: 1241–55. [Google Scholar] [CrossRef]
  15. Dalal, Reeshad S., Balca Alaybek, and Filip Lievens. 2020. Within-person job performance variability over short timeframes: Theory, empirical research, and practice. Annual Review of Organizational Psychology and Organizational Behavior 7: 421–49. [Google Scholar] [CrossRef]
  16. Demerouti, Evangelia, and Russel Cropanzano. 2010. From Thought to Action: Employee Work Engagement and Job Performance. In Work Engagement: A Handbook of Essential Theory and Research. Edited by Arnold B. Bakker and Michael P. Leiter. London: Psychology Press. [Google Scholar]
  17. Fornell, Claes, and David F. Larcker. 1981. Structural Equation Models with Unobservable Variables and Measurement Error: Algebra and Statistics. JMR, Journal of Marketing Research 18: 382. [Google Scholar] [CrossRef]
  18. Geisinger, Kurt F. 1992. The Metamorphosis to Test Validation. Educational Psychologist 27: 197–222. [Google Scholar] [CrossRef]
  19. Gjersing, Linn, John R. M. Caplehorn, and Thomas Clausen. 2010. Cross-Cultural Adaptation of Research Instruments: Language, Setting, Time and Statistical Considerations. BMC Medical Research Methodology 10: 13. [Google Scholar] [CrossRef] [PubMed]
  20. Halbeslebe, Jonathon R. B., Anthony R. Wheeler, and M. Ronald Buckley. 2008. Clarifying the Relationship between Organizational Commitment and Job Performance: Extending the Conservation of Resources Model. In Applied Psychology Research Trends. Edited by Karl H. Kiefer. New York: Nova Science Publishers, pp. 35–58. [Google Scholar]
  21. Hattab, Syahruddin, Hillman Wirawan, Rudi Salam, Daswati Daswati, and Risma Niswaty. 2022. The Effect of Toxic Leadership on Turnover Intention and Counterproductive Work Behaviour in Indonesia Public Organisations. International Journal of Public Sector Management 35: 317–33. [Google Scholar] [CrossRef]
  22. Jackson, Dennis L., J. Arthur Gillaspy, and Rebecca Purc-Stephenson. 2009. Reporting Practices in Confirmatory Factor Analysis: An Overview and Some Recommendations. Psychological Methods 14: 6–23. [Google Scholar] [CrossRef] [PubMed]
  23. Judge, Timothy A., and Ryan Klinger. 2008. Job Satisfaction: Subjective Well-Being at Work. In The Science of Subjective Well-Being. Edited by Michael Eid and Randy J. Larsen. New York: Guilford Press, pp. 393–413. [Google Scholar]
  24. Judge, Timothy A., Carl J. Thoresen, Joyce E. Bono, and Gregory K. Patton. 2001. The Job Satisfaction–Job Performance Relationship: A Qualitative and Quantitative Review. Psychological Bulletin 127: 376–407. [Google Scholar] [CrossRef] [PubMed]
  25. Judge, Timothy A., Joyce E. Bono, and Edwin A. Locke. 2000. Personality and Job Satisfaction: The Mediating Role of Job Characteristics. The Journal of Applied Psychology 85: 237–49. [Google Scholar] [CrossRef]
  26. Kim, Woocheol, Judith A. Kolb, and Taesung Kim. 2013. The Relationship between Work Engagement and Performance: A Review of Empirical Literature and a Proposed Research Agenda. Human Resource Development Review 12: 248–76. [Google Scholar] [CrossRef]
  27. Koopmans, Linda, Claire Bernaards, Vincent Hildebrandt, Stef van Buuren, Allard J. van der Beek, and Henrica C. W. de Vet. 2012. Development of an Individual Work Performance Questionnaire. International Journal of Productivity and Performance Management 62: 6–28. [Google Scholar] [CrossRef]
  28. Koopmans, Linda, Claire M. Bernaards, Vincent H. Hildebrandt, Debra Lerner, Henrica C. W. de Vet, and Allard J. van der Beek. 2016. Cross-Cultural Adaptation of the Individual Work Performance Questionnaire. Work 53: 609–19. [Google Scholar] [CrossRef]
  29. Koopmans, Linda, Claire M. Bernaards, Vincent H. Hildebrandt, Henrica C. W. de Vet, and Allard J. van der Beek. 2014a. Construct Validity of the Individual Work Performance Questionnaire. Journal of Occupational and Environmental Medicine 56: 331–37. [Google Scholar] [CrossRef]
  30. Koopmans, Linda, Claire M. Bernaards, Vincent H. Hildebrandt, Stef van Buuren, Allard J. van der Beek, and Henrica C. W. de Vet. 2014b. Individual Work Performance Questionnaire. In PsycTESTS Dataset. Washington, DC: American Psychological Association (APA). [Google Scholar]
  31. Koopmans, Linda, Claire M. Bernaards, Vincent H. Hildebrandt, Wilmar B. Schaufeli, C. W. de Vet Henrica, and Allard J. van der Beek. 2011. Conceptual Frameworks of Individual Work Performance: A Systematic Review. Journal of Occupational and Environmental Medicine 53: 856–66. [Google Scholar] [CrossRef] [PubMed]
  32. Mobley, William H., Stanley O. Horner, and Andrew T. Hollingsworth. 1978. An evaluation of precursors of hospital employee turnover. Journal of Applied Psychology 63: 408–14. [Google Scholar] [CrossRef]
  33. Neuber, Lina, Colinda Englitz, Niklas Schulte, Boris Forthmann, and Heinz Holling. 2022. How Work Engagement Relates to Performance and Absenteeism: A Meta-Analysis. European Journal of Work and Organizational Psychology 31: 292–315. [Google Scholar] [CrossRef]
  34. Nguyen-Duc, Thinh, Linh Phuong Nguyen, Tam To Phuong, Hanh Thi Hien Nguyen, and Vinh Thi Hong Cao. 2023. Validation of Individual Work Performance Questionnaire in a Vietnamese Context. European Journal of Training and Development. [Google Scholar] [CrossRef]
  35. Organisation for Economic Co-Operation and Development (OECD). 2024. The Growth Outlook of the ICT Sector. (Volume 1): Embracing the Technology Frontier. Paris: OECD Publishing. [Google Scholar] [CrossRef]
  36. Platania, Silvia, Martina Morando, Stefania Valeria Gruttadauria, and Linda Koopmans. 2023. The Individual Work Performance Questionnaire: Psychometric Properties of the Italian Version. European Journal of Investigation in Health Psychology and Education 14: 49–63. [Google Scholar] [CrossRef]
  37. Podsakoff, Philip M., and Scott B. MacKenzie. 1989. A Second Generation Measure of Organizational Citizenship Behavior. Bloomington: Indiana University. [Google Scholar]
  38. Podsakoff, Philip M., and Scott B. MacKenzie. 1997. Impact of Organizational Citizenship Behavior on Organizational Performance: A Review and Suggestions for Future Research. Human Performance 10: 133–51. [Google Scholar] [CrossRef]
  39. Ramos-Villagrasa, Pedro J., Juan R. Barrada, Elena Fernández-del-Río, and Linda Koopmans. 2019. Assessing Job Performance Using Brief Self-Report Scales: The Case of the Individual Work Performance Questionnaire. Revista de Psicología Del Trabajo y de Las Organizaciones 35: 195–205. [Google Scholar] [CrossRef]
  40. Schaufeli, Wilmar, and Arnold B. Bakker. 2003. Utrecht Work Engagement Scale. Utrecht: Occupational Health Psychology Unit, Utrecht University. [Google Scholar]
  41. Schultz, Alyssa B., Chin-Yu Chen, and Dee W. Edington. 2009. The Cost and Impact of Health Conditions on Presenteeism to Employers: A Review of the Literature. Pharmacoeconomics 27: 365–78. [Google Scholar] [CrossRef] [PubMed]
  42. Sinval, Jorge, and João Marôco. 2020. Short Index of Job Satisfaction: Validity Evidence from Portugal and Brazil. PLoS ONE 15: e0231474. [Google Scholar] [CrossRef] [PubMed]
  43. Sinval, Jorge, Sonia Pasian, Cristina Queirós, and João Marôco. 2018. Brazil-Portugal Transcultural Adaptation of the UWES-9: Internal Consistency, Dimensionality, and Measurement Invariance. Frontiers in Psychology 9: 353. [Google Scholar] [CrossRef] [PubMed]
  44. Skelton, Angie R., Deborah Nattress, and Rocky J. Dwyer. 2019. Predicting Manufacturing Employee Turnover Intentions. Journal of Economics, Finance, and Administrative Science 25: 101–17. [Google Scholar] [CrossRef]
  45. Spector, Paul E., Suzy Fox, Lisa M. Penney, Kari Bruursema, Angeline Goh, and Stacey Kessler. 2006. The dimensionality of counterproductivity: Are all counterproductive behaviors created equal? Journal of Vocational Behavior 68: 446–60. [Google Scholar] [CrossRef]
  46. Van Scotter, James R. 2000. Relationships of Task Performance and Contextual Performance with Turnover, Job Satisfaction, and Affective Commitment. Human Resource Management Review 10: 79–95. [Google Scholar] [CrossRef]
  47. Widyastuti, Tria, and Rahmat Hidayat. 2018. Adaptation of Individual Work Performance Questionnaire (IWPQ) into Bahasa Indonesia. International Journal of Research Studies in Psychology 7: 101–12. [Google Scholar] [CrossRef]
  48. Williams, Larry J., and Stella E. Anderson. 1991. Job satisfaction and organizational commitment as predictors of organizational citizenship and in-role behaviors. Journal of Management 17: 601–17. [Google Scholar] [CrossRef]
Figure 1. Confirmatory factor analysis of the Individual Work Performance Questionnaire (Portuguese Version; IWPQ-PT): three-factor model, standardized regression weights, and correlations across factors.
Figure 1. Confirmatory factor analysis of the Individual Work Performance Questionnaire (Portuguese Version; IWPQ-PT): three-factor model, standardized regression weights, and correlations across factors.
Admsci 14 00150 g001
Table 1. Descriptive statistics, factor loadings, communalities, and explained variance: IWPQ-PT.
Table 1. Descriptive statistics, factor loadings, communalities, and explained variance: IWPQ-PT.
IWPQ Items
In the Past Three Months…
Components
MSD123h2
Component 1
12. I continually sought new challenges in my work2.990.860.870.10−0.080.77
11. I took on extra responsibilities2.950.940.820.030.060.67
10. I came up with creative solutions for new problems2.980.790.760.17−0.020.61
7. I took on challenging tasks when they were available3.120.820.720.25−0.060.58
6. On my own initiative, I started new task when my old tasks were completed3.150.880.680.170.070.49
13. I actively participated in meetings and/or consultations2.950.900.620.250.090.46
9. I worked on keeping my work skills up-to-date a3.250.640.590.41−0.230.57
8. I worked on keeping my job-related knowledge up-to-date a3.230.680.550.49−0.240.60
Component 2
3. I was able to set priorities3.210.640.070.77−0.020.62
1. I managed to plan my work so that I finished it on time3.090.680.070.750.080.57
4. I was able to carry out my work efficiently3.150.200.250.74−0.020.39
2. I kept in mind the work result I needed to achieve3.150.650.260.69−0.050.52
5. I managed my time well2.900.770.260.67−0.010.41
Component 3
14. I complained about minor work-related issues at work1.731.020.220.060.720.57
16. I focused on the negative aspects of situation at work instead of the positive aspects1.200.89−0.24−0.120.690.55
17. I talked to colleagues about the negative aspects of my work2.121.070.030.030.680.46
15. I made problems at work bigger than they were0.820.930.04−0.160.670.48
18. I talked to people outside the organization about the negative aspects of my work1.801.23−0.130.090.650.45
Eigenvalues 4.333.272.48
% of Variance 24.0618.1513.76
Notes. Values in bold indicate the inclusion of the items on the respective components. a Items with cross-loadings on Components 1 and 2. IWPQ-PT = Individual Work Performance Questionnaire-Portuguese Version.
Table 2. Inter-correlations, means, standard deviations, and Cronbach’s alpha: IWPQ-PT.
Table 2. Inter-correlations, means, standard deviations, and Cronbach’s alpha: IWPQ-PT.
12M (SD)Cronbachα
1. Task performance--3.10 (0.51)0.81
2. Context performance0.50 **-3.08 (0.61)0.88
5. CWB−0.05−0.071.54 (0.71)0.72
Note. IWPQ-PT = Individual Work Performance Questionnaire-Portuguese Version. CWB = Counterproductive Work Behaviors. ** p < 0.01.
Table 3. Correlations between IWPQ-PT, SIJS, TI, and UWES-9 scores.
Table 3. Correlations between IWPQ-PT, SIJS, TI, and UWES-9 scores.
IWPQ-PT ScoresSIJSTIUWES-9
VigorDedicationAbsorption
Task performance0.42 ***−33 ***0.58 ***0.62 ***0.63 ***
Contextual performance0.53 ***−44 ***0.61 ***0.69 ***0.68 ***
CWB−0.30 ***−0.22 ***−0.17 **−0.15 *−0.17 **
Notes. IWPQ-PT = Individual Work Performance Questionnaire-Portuguese Version. SIJS = Short Index of Job Satisfaction. TI = Turnover Intention. UWES-9 = Work Engagement Scale short version. CWB = Counterproductive Work Behaviors. * p < 0.05; ** p < 0.01; *** p < 0.001.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Lousã, E.P.; Alves, M.P.; Koopmans, L. Adaptation and Validation of the Individual Work Performance Questionnaire into a Portuguese Version. Adm. Sci. 2024, 14, 150. https://doi.org/10.3390/admsci14070150

AMA Style

Lousã EP, Alves MP, Koopmans L. Adaptation and Validation of the Individual Work Performance Questionnaire into a Portuguese Version. Administrative Sciences. 2024; 14(7):150. https://doi.org/10.3390/admsci14070150

Chicago/Turabian Style

Lousã, Eva Petiz, Marta Pereira Alves, and Linda Koopmans. 2024. "Adaptation and Validation of the Individual Work Performance Questionnaire into a Portuguese Version" Administrative Sciences 14, no. 7: 150. https://doi.org/10.3390/admsci14070150

APA Style

Lousã, E. P., Alves, M. P., & Koopmans, L. (2024). Adaptation and Validation of the Individual Work Performance Questionnaire into a Portuguese Version. Administrative Sciences, 14(7), 150. https://doi.org/10.3390/admsci14070150

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop