Next Article in Journal
Networked Analysis of a Teaching Unit for Primary School Symmetries in the Form of an E-Book
Previous Article in Journal
k-Nearest Neighbor Learning with Graph Neural Networks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Methodology for Analysis and Quantitative Evaluation of Teaching Quality in University Subjects

by
José Manuel Arenas Reina
*,
Juan David Cano-Moreno
,
Francisca Victoria Sánchez Martínez
and
Manuel Islán Marcos
Escuela Técnica Superior de Ingeniería y Diseño Industrial, Universidad Politécnica de Madrid, 28012 Madrid, Spain
*
Author to whom correspondence should be addressed.
Mathematics 2021, 9(8), 831; https://doi.org/10.3390/math9080831
Submission received: 18 March 2021 / Revised: 6 April 2021 / Accepted: 7 April 2021 / Published: 11 April 2021

Abstract

:
This work describes a general method to quantitatively evaluate the teaching quality of a subject by taking into account the main factors that intervene in the educational process (companies, teachers, students, etc.). The proposed methodology, based on the concatenation of the four “Houses of Quality” of the “Quality Function Deployment” (QFD), is applicable to any university subject. Through an integrated matrix development of the four quality houses, a vector has been obtained ( q 4 ) that integrates in its definition the entire teaching process of a university subject. Therefore, from this vector, a representative parameter of the teaching quality has been defined, namely, the “Teaching Value”, which globally quantifies the teaching of a university subject. Likewise, and in a complementary manner, the overall effectiveness of teaching has been established ( η g l o b a l ), which is defined as the geometric mean of the product of the efficiencies of the four Houses of Quality and allows the determination of the current performance of teaching and its margin for potential improvement. In particular, the use of the proposed methodology for the engineering course “Project Management” has allowed the teaching quality of this course to be determined (64.2 Megapoints with an efficiency of 48.60%).

1. Introduction

Continuous improvement in the quality of university teaching will define and select the universities of the future. To be competitive in the labor market, each university must analyze and improve the quality of their university’s studies in relation to companies’ real needs. The main reason for choosing university studies is the personal attraction to a career, [1] and in most cases, students would like to carry out their professional life in an environment related to their studies. However, it is difficult for all students to find a job related to the studies they have completed. Therefore, positive expectations of employability motivate students to choose some studies over others, according to a study conducted in Europe [2].

1.1. Literature Review

Many of the methods used to improve quality in higher education can be included in the so-called “Total Quality Management” (TQM), developed by Japanese industries between 1950 and 1970 [3]. Bilen [4] provides a review of the TQM methods applied to improving the quality of university studies. Kwarteng [5] measured from external customers’ perspectives the quality performance concerning TQM implementation at Higher Education. Hawi and Al-zyadat [6] measured the TQM through tree points of view, participation, development and evaluation, showing the participation variable was the stronger one. Vykydal et al. [7] presents the approaches of quality management systems at universities. They point out three concepts (ISO 9000, the branch standard and organization’s excellence) as a suitable direction for applying within higher education environment. Author’s argued that the European Foundation for Quality Management (EFQM) excellence model could serve as an example for universities organization.
In addition, other researchers have proposed other methods for improving quality in higher education. Thus, Plaza et al. [8] use the “Sheward cycle” or “ Deming quality circle” (plan-do-check-act or plan-do-check-adjust) to increase the satisfaction of students (clients in this case) through the cycle of continuous improvement. Likewise, there is a large number of publications [9,10,11,12,13,14,15,16,17,18,19,20,21] seeking quality improvement through the use of the so-called “Quality Function Deployment” (QFD), a Japanese methodology developed by Yoji Akao [22]. There are also different quality studies [23,24,25,26,27] using variations from the classic QFD approach.
One of the main difficulties in applying a quality method is defining the client. For example, Karapetrovic [28] considers the industry, community, society, alumni, students and professional or accreditation organizations to be the client, since the author applied ISO 9000 standard terms to engineering education and research. Wiklund and Wiklund [29] used QFD and conjoint analysis for transforming student needs into quantified course attributes. They were focused on student satisfaction and learning. Alves et al. [30] studied a work integrated learning (WIL) program in a master’s degree of two years. They tried to join companies needs with student engagement through student’s labor practices in companies, supervised and coordinated. Quality needs a target customer for the optimization a process, product or service. Many publications speak only of students as a single client [8,12,14,16,17,19,29,30]. Other publications consider companies as customers [13,20]. There are also a number of authors who support the view that the client is not unique. Thus, with the aim of improving teaching quality in engineering, Köksal and Eğїtman [15] consider the needs of three clients (students, companies and faculty members) and generate the weight of each client’s needs by means of a geometric mean of the valuation of each client using a procedure based on the analytic hierarchy process (AHP) [31]. Other authors [9,32] address this question regarding the identification of the client through the Triple Role of Juran, where students, teachers, colleagues and the industry (society) can act, in one way or another, as a client, process or supplier.
Most researchers who use the QFD technique as a tool to improve quality in higher education use a single house of quality; even if researchers use more than one house of quality, they analyse these houses independently [14]. However, Brian and Teo [9] are an exception because they use three concatenated houses of quality (house-to-house translation) that are obtained from an adaptation of the basic theory of the QFD. These authors applied this methodology in three cases: improvement of a course in NUS Business School (students are considered clients), an online registration system for a course and an application for research grants. In this line, Authors [33] present a preliminary investigation to evaluate teacher quality through three sequential QFD matrices in which students were the only clients.

1.2. Objectives and Hypothesis

However, these works do not take into account all the sectors that participate in the educational process and do not perform a quantitative assessment of the quality of the teaching provided. Therefore, this paper aims to propose a method to quantify the teaching quality of an engineering course considering the main factors that intervene in the educational process: society (through companies), university (as an institution), teachers and students.
The proposed methodology is based on QFD matrices with sequential dependence, and it is applicable to any university subject. The main hypothesis is that this methodology will allow the quantitatively evaluation of the global teaching of a subject, highlighting the strengths and weaknesses of the teaching, and facilitating a proposal of actions to improve teaching within a framework of the continuous improvement of educational quality.

2. Methodology

The proposed methodology for assessing the teaching–learning process of a university subject taking into account the participation of students, professors, companies and universities will be presented in this section.
This methodology is based on the concatenation of matrices called “Houses of Quality” (QFD) [22,34,35]. The QFD technique uses decision matrices to relate and weigh the client’s needs (WHATs) with the attributes that allow the satisfaction of these needs (HOWs). In the proposed method, four concatenated matrices are considered that relate the main aspects of the teaching process of a subject two to two (Table 1). In this way, the WHATs will be different in each of the proposed matrices, and the weighted HOWs of a matrix will be the WHATs of the following matrix.
Figure 1 shows the workflow of the four concatenated matrices. In this scheme, matrices are numbered, indicating in each matrix, the WHATs, the HOWs and who participates and where each factor participates in each part of the teaching process (WHOs and WHEREs).

2.1. The Proposed “House of Quality”: Description and Characteristics

Figure 2 shows the structure and detailed composition of each house of quality. Thus, the first column (W1, W2, …, Wn) is constituted by the “n” WHATs. The second column ( P 1 , P 2 , , P n ) corresponds to the weights assigned to the WHATs. The first row ( H 1 , H 2 , , H n ) is formed by the “m” HOWs.
On the rooftop of the house of quality, the compatibility between the different HOWs is collected (“+” positive correlation, “−” negative correlation and “or” without correlation). The relationship of each WHAT with each HOW must be evaluated according to a numerical scale. For example, on a scale of “1” to “9”, the value “1” would indicate the minimal correlation and “9” the maximal correlation (values cij of Figure 2). The following matrix shows the correlation (relationship matrix) between the WHATs and the HOWs (matrix C of dimensions n x m):
C = [ c 11 c 12 c 1 j c 1 m c i c i 2 c ij c im c n c n 2 c nj c nm ]
In each box of the correlation zone in Figure 2, in the lower triangle, each element dij of the correlation matrix is calculated as the product of the weighting of row i, Pi, by the corresponding value of the correlation matrix, cij, that is, dij = Pi · cij.
Thus, satisfaction of each WHAT could be defined as the sum of the weighted terms of its corresponding row. That is, the degree of satisfaction of WHAT located in row “i” (Si) would be obtained by the following expression:
S i = P i · ( j = 1 j = m c ij )
The last column of Figure 2 shows the satisfaction degrees of the “n” WHATs (S1, S2, …, Sn).
Similarly, satisfaction of each HOW could be defined by adding the weighted terms of its corresponding column. That is, the degree of satisfaction of the HOW located in the “j” column (qj) would be obtained by the following expression:
q j = i = 1 i = n c ij · P i
Row “n + 1” of Figure 2 shows the satisfaction degrees of the “m” HOWs (q1, q2, …, qm).
The satisfaction of the WHATs and HOWs could be written in a matrix form in the following way:
  • Satisfaction matrix of WHATs (row vector of dimension 1 × n):
    s = ( S 1 , S 2 , , S n )
  • Satisfaction matrix of HOWs (row vector of dimension 1 × m):
    q = ( q 1 , q 2 , , q m )
If a row vector is defined for the weights in the following way:
p = ( P 1 , P 2 , , P n )
The vector q could be written in the form of the following matrix product:
q = ( q 1 , q 2 , , q m ) = p · C
where C is the relationship matrix between the WHATs and the HOWs.
The efficiency values η (qj) of each HOW Hj have been added in the “House of Quality” of Figure 2. These values relate the degree of satisfaction of each HOW with the maximum that would be possible to obtain; that is, when the corresponding column of the relationship matrix had the maximum value in all its boxes. Thus, if the maximum obtainable valuation in each box Cij of the relationship matrix defined in Equation (1) is Δ, then, η(qj) would be obtained in the following way:
η ( q j ) = q j Δ · i = 1 i = n P i
Figure 2 also shows the general efficiency of the matrix, η ( C ) , which relates the degree of satisfaction of all the HOWs j = 1 j = m q j with the maximum that would be possible to obtain; that is, when all the squares of the relationship matrix had their maximum value (Δ). Thus, the general efficiency of the matrix, η(C), would be obtained in the following way:
η ( C ) = j = 1 j = m q j Δ · m · i = 1 i = n P i = j = 1 j = m η ( q j ) m

2.2. Analysis and Matrix Development

By applying Equation (7) to the four matrices considered in the proposed methodology, we obtain the following matrix development that characterizes the teaching process of a university subject:
q 1 1 × m = P 1 P n 1 × n · [ c 11 c 12   c 1 j   c 1 m c i 1 c i 2 c i j c i m c n 1 c n 2 c nj c nm ] n × m = p · C 1
q 2 1 × r = q 1 1 × n [ d 11 d 12   d 1 j   d 1 r d i 1 d i 2 d i j d i r d m 1 d m 2 d mj d mr ] m × r = q 1 · C 2
q 3 1 × s = q 2 1 × r [ e 11 e 12   e 1 j   e 1 s e i 1 e i 2 e i j e i m e r 1 e r 2 e rj e rs ] r × s = q 2 · C 3
q 4 1 × t = q 3 1 × s [ f 11 f 12   f 1 j   f 1 t f i 1 f i 2 f i j f i t f s 1 f s 2 f sj f st ] s × t = q 3 · C 4
Substituting Equation (10) to (12) in Equation (13), we have to:
q 4 1 × t = p 1 × n · [ C 1 ] n × m · [ C 2 ] m × r · [ C 3 ] r × s · [ C 4 ] s × t
where C 1 ,   C 2 ,   C 3   y   C 4 are the relationship matrices of each phase of the proposed methodology. In general, for k concatenated matrices, the weight vector of the HOWs could be obtained in the following way:
q k = p · j = 1 j = k C j
Thus, given that the vector q 4 integrates the valuation of the companies, the conditioning factors of the university, the teaching work of the professors and the opinion of the students in its definition, it is possible to propose a representative parameter of the teaching quality ( T e a c h i n g   V a l u e ) from this vector that globally quantifies the teaching of a university subject as follows:
T e a c h i n g   V a l u e = j = 1 j = t q 4 ( j ) = q 4 ( 1 ) + + q 4 ( i ) + + q 4 ( t )
The “ T e a c h i n g   V a l u e ” obtained by applying Equation (16) usually reaches a high numerical score, since it comes from the multiplication of four matrices. For this reason, it is preferable to give the “ T e a c h i n g   V a l u e ” in units of Megapoints ( 1   Mp = 10 6   points ) so that it has fewer significant digits, and its practical use is facilitated.
Thus, according to Equations (14) and (16), to calculate the “ T e a c h i n g   V a l u e ” corresponding to the teaching of a subject, it is necessary to know the weights of the competencies that must be acquired with their teaching (vector p ) and the relationship matrices between the different WHATs and HOWs (matrices C 1 ,   C 2 ,   C 3   and   C 4 ). To obtain the vector p , surveys will be carried out with managers and technical directors of companies in sectors related to the subject, where they weigh the importance of each competency in the professional development from 1 to 10. The first three relationship matrices are determined by the consensus assessment of professors who teach the subject. The fourth matrix, C 4 , will be obtained from a survey of the students of the subject on the means and teaching resources used (each element of the matrix corresponds to the average value of the surveys conducted).
The overall effectiveness of the teaching of a subject is a complementary parameter to the “ T e a c h i n g   V a l u e ” that allows for the evaluation the teaching performance and its margin of potential improvement. The overall efficiency relates the “ T e a c h i n g   V a l u e ” to the maximum that would be possible to obtain, (that is, when all the squares of the four relationship matrices had their maximum value, Δ), and it is defined as the geometric mean of the product of the efficiencies of the four matrices considered. Thus, the overall effectiveness of the teaching of a subject ( η global ) would be obtained in the following way:
η global = η ( C 1 ) · η ( C 2 ) · η ( C 3 ) · η ( C 4 ) 4 = [ j = 1 j = t q 4 ( j ) m · r · s · t · Δ 4 ( i = 1 i = n P i ) ] 1 / 4

2.3. Internal and External Variables of the “Teaching Value”

Some research papers show the existence of internal and external variables in the assessment of the teaching process of a subject [4,37]. In this study, the university institution, teachers and students are considered internal variables while companies would be the external variable.
To highlight the differential contribution of each of these variables (internal and external) in the teaching assessment of a subject, a process of analytical decomposition of the “Teaching Value” has been developed that makes it possible to express this value as a sum of products of external and internal factors.
First, the vector p is expressed as a linear combination of unit vectors as follows:
p =   P 1 · ( 1 , 0 , 0 ) + + P i · ( 0 , . , 1 , . . , 0 ) + + P n · ( 0 , . , 0 , . . , 1 )
If we call C g the product of four matrices, we have:
[ C g ] = [ C 1 ]   n × t   n × m · [ C 2 ] m × r · [ C 3 ] r × s · [ C 4 ] s × t
Substituting Equations (18) and (19) in Equation (14), we have
q 4 = P 1 · ( 1 , 0 , 0 ) [ C g ] + + P i · ( 0 , . , 1 , . . , 0 ) [ C g ] + + P n · ( 0 , . , 0 , . . , 1 ) [ C g ]
q 4 = p 1 ( C g 11 C g 1 t ) 1   ×   t + p 2 ( C g 21 C g 2 t ) 1   ×   t + + p n ( C g n 1 C g nt ) 1   ×   t
As seen in Equation (21), each initial “k” weighting of the competencies (external variable defined by the companies) multiplies row “k” of the resulting global matrix C g . On the other hand, the influence of the other factors (internal variables) in the “Teaching Value” can be grouped into a single parameter. This parameter, called “Subject Value” ( S v k ), takes into account, for the “k” competency, the assessment of learning goals, topics, techniques and resources used in the teaching of a subject. The following equation expresses this concept:
S vk = C g k 1 + C g k 2 + + C g kt = j = 1 j = t C g kj
Thus, Equation (22) provides the “Subject Value” or internal contribution of the k-th competency to the “Teaching Value”.
By developing the products indicated in Equation (21) and substituting in Equation (16), the “Teaching Value” can be rewritten according to the following equation:
T e a c h i n g   V a l u e = p 1 · C g 11 + + p 1 · C g 1 t + p 2 · C g 21 + + p 2 · C g 2 t + p n · C g n 1 + + p n · C g nt
Taking as a common factor p1, p2, ..., pn in the above equation, and taking into account the definition of the “Subject Value” (22), we have:
T e a c h i n g   V a l u e = p 1 · S v 1 + p 2 · S v 2 + + p n · S vn = i = 1 i = n P i · S v i
Equation (24) defines the “Teaching Value” as a sum of products of internal variables ( S v i ) by external variables ( P i ). Likewise, it can be deduced from Equation (24) that each summand ( p i · S vi ) contributes a certain percentage (xi) to the total value of the “Teaching Value” (TV); that is:
p 1 · S v 1 = x 1 · TV   p 2 · S v 2 = x 2 · TV p n · S vn = x n · TV
By moving the second member terms of internal variables ( S v i ) and the percentages (xi) the first member and adding all the Equation (25) the following expression will result:
p 1 x 1 + p 2 x 2   + + p n x n   =   TV   ( 1 S v 1 + 1 S v 2 + + 1 S vn )
Defining the following internal and external equivalent variables:
p eq =   p 1 x 1 + p 2 x 2   + + p n x n
S veq = ( 1 S v 1 + 1 S v 2 + + 1 S vn ) 1
Equation (26) can be put in the following way:
p eq · S veq = TV  
Thus, Equation (29) defines the “Teaching Value” of a subject as the product of an equivalent external variable p eq (which takes into account the general assessment of companies on teaching competencies) by an equivalent internal variable S veq (which globally value the intrinsic factors to the university environment).

3. Results and Discussion

3.1. Project Management Subject

The methodology described in the previous section was applied to the subject “Project Management” during the 2018–2019 academic year. This subject is taught in the fourth engineering course of the School of Engineering and Industrial Design of the Polytechnic University of Madrid.
The progressive harmonization of university systems required by the process of the construction of the European Higher Education Area (EHEA), initiated in 1999 with the Bologna Declaration and the subsequent interaction between these systems by the various national regulations successively promulgated, has promoted change in European universities. Therefore, the universities of the EHEA define a series of general and specific competencies that students must acquire to obtain the corresponding degree. The competencies, according to the definition of the Polytechnic University of Madrid, represent a dynamic combination of attributes that describe the learning goals of a given program, or how students will be able to perform at the end of the educational process. A distinction is made between general competencies (common to a set of subjects) and specific competencies (specific to each subject). The subject “Project Management” has seven general competencies (GCi) and a specific competency (SCi) (Table 2).
The learning goals ( L G i ) are the explicit description of what the student must know, understand and/or be able to apply after the completion of the learning process. The subject “Project Management” considers twelve learning goals (Table 3).
The themes of the program (Ti) are the set of differentiated contents in which the subject is divided. The subject “Project Management” considers twelve themes (Table 4).
Teaching techniques are the different pedagogical ways of transmitting the contents of the subject to the students and, thus, achieve the learning goals and associated competencies. In “Project Management”, three main techniques were used, which are described in Table 5.
Teaching resources are those material resources that facilitate communication between teachers and students. The six teaching resources used in “Project Management” are shown in Table 6.

3.2. Characterization of Teaching Matrix

The proposed matrix analysis in Section 2 is applied in this section to the subject “Project Management” in order to calculate its “Teaching Value” and to determine the most important areas for improvement in teaching.
To accomplish this goal, first, the vector p weighting of competencies by company executives and managers through opinion polls is obtained. The results of these surveys on the eight competencies are shown below:
p = ( 8.08 8.83 7.17 9.25 9.42 8.0 8.33 8.58 )
Second, the four correlation matrices corresponding to the subject “Project Management” must be carried out. The rating scale for each element will be the same in all matrices: 1, 3, 5, 7 and 9 (“1” indicates minimum correlation and “9” maximum correlation).
Thus, the relationship matrix of the learning targets (Table 3) with the competencies (Table 2) is obtained by consensus assessment of the teachers of the subject. The obtained results (matrix C1) are indicated below:
C 1 = [ 3 3 3 5 5 7 7 5 1 1 1 1 5 5 3 7 7 7 5 7 1 9 9 9 9 5 5 9 9 7 3 1 1 1 3 1 1 5 5 1 1 3 3 1 1 3 3 9 1 1 1 1 1 1 1 1 9 7 1 1 9 5 3 3 5 9 5 9 1 7 1 1 9 9 9 9 7 7 3 9 1 3 5 3 9 9 9 9 9 9 9 9 1 1 7 3 ] 8   ×   12
The interpretation of the meaning of each element of the matrix C1 requires the use of Table 3 and Table 4. Thus, for example, the term C1 (3,4) (row 3, column 4), relates the general competency GC3 from Table 2 (“Understanding the impact of industrial engineering on the environment, the sustainable development of society and the importance of working in a professional and responsible environment”) with the LG4 learning goal from Table 3 (“Understanding the implications of total quality management for industrial design and manufacturing projects “). In this case, as C1 (3,4) = 9, there was a high relation between GC3 and LG4.
Then, the matrix relating C2 subjects (Table 4) with learning outcomes (Table 3) by consensus assessment of teachers of the subject was obtained. The obtained results were the following:
C 2 = [ 9 9 9 9 1 1 1 1 1 1 1 1 9 9 9 9 1 1 1 1 1 1 1 1 9 9 9 9 1 1 1 1 1 1 1 1 1 1 1 1 1 9 1 1 1 1 1 1 1 1 1 1 9 7 9 9 7 9 1 1 1 1 1 1 5 7 5 7 7 7 1 1 1 1 1 1 1 1 1 1 9 1 9 1 1 1 1 1 1 1 1 1 1 1 1 9 5 5 5 5 5 5 5 5 5 5 5 5 1 1 1 1 5 5 9 9 3 9 1 1 9 1 1 1 9 1 1 1 3 7 1 3 9 1 1 1 9 3 1 3 1 3 1 1 ] 12   ×   12
In this case, for example, the term C 2 ( 4 , 1 ) (row 4, column 1), relates the LG4 learning goal of Table 3 (“Understanding the implications of total quality management for design projects and industrial manufacturing”) with theme T1 of Table 4 (“Project Methodology”). In this case, since C 2 ( 4 , 1 ) = 1, there was a low relation between LG4 and T1.
The next step consists of the realization of the matrix C 3 that relates teaching techniques (Table 5) with themes (Table 4). This matrix was also constructed through the consensus opinion of the teachers. The obtained results are indicated below:
C 3 = [ 1 9 7 1 9 7 1 7 7 1 5 9 3 9 7 5 1 9 7 5 7 7 5 7 5 3 7 3 7 7 7 5 9 7 5 7 ] 12   ×   3
In this case, for example, the term C 3 ( 1 , 3 ) (row 1, column 3), relates theme T1 from Table 4 (“Project Methodology”) with the educational technique GGT1 from Table 5 (“Expository technique”). In this case, as C 3 ( 1 , 3 ) = 7 , there was a medium-high relationship between T1 and GGT1.
Finally, we obtained the matrix C 4 that relates the teaching resources (Table 6) with the teaching techniques (Table 5). This matrix was constructed taking into account the opinion of the students through a survey. Each element of the matrix includes the average value of the opinion of the 117 students who studied the subject “Project Management” in the 2018–2019 academic year (rating scale: 0 to 9, the null value supposes the non-existence of a relationship). The obtained results are indicated below:
C 4 = [ 0 0 0 6.1 5.2 6.1 6.6 0 5.9 5.8 5.8 6.0 6.6 6.9 6.6 0 0 5.9 ] 3 × 6
In this case, for example, the term C 4 ( 1 , 6 ) ) (row 1, column 6), relates the Teaching Technique IT1 from Table 5 (“Directed Study”) to the Teaching Resource dIR1 from Table 6 (“Documentation of the subject”). In this case, as C 4 ( 1 , 6 ) = 6.1 , there is a medium-high relationship between IT1 and dIR1.
Once known C 1 , C 2 , C 3   y   C 4 , the vector q 4 , the “Teaching Value” and the overall teaching efficacy of the subject are obtained by applying Equations (14), (16) and (17):
q 4 1 × 6 = p 1 × 8 · [ C 1 ] 8 × 12 · [ C 2 ] 12 × 12 · [ C 3 ] 12 × 3 · [ C 4 ] 3 × 6 = 10 6 · ( 13.0   7.5   12.4   8.4   7.9   15.0 ) 1   ×   6
T e a c h i n g   V a l u e = j = 1 j = 6 q 4 ( j ) = 64.2   · 10 6   p = 64.2   Mp
η global = [ j = 1 j = t q 4 ( j ) m · r · s · t · Δ 4 ( i = 1 i = n P i ) ] 1 / 4 = [   64.2 ·   10 6 12 · 12 · 3 · 6 · 9 4 ( 67.66 ) ] 1 / 4 = 0.4860
Thus, the overall assessment corresponding to the teaching of the subject “Project Management” is 64.2 Megapoints with a global efficacy of 48.60%.

3.3. Compacted QFD Design

To improve the interpretation of the traditional QFD and show the results of the previous analysis in more detail, a new design of the QFD has been developed that reflects the scheme from Figure 1 but with the four houses of quality attached (Figure 3). This compacted design of the QFD gathered the most relevant elements of each quality house (described in Figure 2) and allowed the strengths and weaknesses of the teaching of a subject to be highlighted. The most relevant characteristics of this new QFD are the following:
(a)
Each quality house has a matrix of numbers that are obtained from the product of the weights of the WHATs by the corresponding relationship matrix. Specific:
  • The House of Quality 1 relates the competencies (with weights p1, p2, …, pn) with the learning goals. Therefore, the values of the numerical boxes are obtained as the product of the weights by the elements of the matrix C1. For example, the value to be entered in box d123 (row 2, column 3 of House 1) is the product of p2 by C123; that is, d123 = 8.83 · 3 = 26.5. Additionally, the sum of each of the columns in House 1 provides each of the components of the vector q 1 (375.8, 352.1,…, 246.1).
  • The House of Quality 2 relates the weighted learning goals (vector q 1 1 of House 1) with the themes of the subject. Therefore, the values of the numerical boxes are obtained as the product of the components of the vector q 1 by the elements of the matrix C2. For example, in box d246 (row 4, column 6 of House 2) the product of q1(4) will be entered by C246; that is, d246 = 361.6 · 9 = 3254.4 = 32.54 · 102 (32.5 is recorded in the box since 102 is extracted as a common factor of all the boxes in House 2). Additionally, the sum of each of the columns of House 2 provides each of the components of the vector q 2 (167.2, 127.0,…, 76.6).
  • The House of Quality 3 relates the themes of the subject weighted in House 2 (vector q 2 ) with the teaching techniques. Therefore, the values of the numerical boxes were obtained as the product of the components of the vector q 2 by the elements of the matrix C3. For example, in box d363 (row 6, column 3 of House 3) the product of q2(6) will be entered by C363; that is, d363 = 134.7 · 102 · 9 = 121,230 = 12.1 · 104 (in the box 12.1 is noted since 104 is extracted as a common factor of all the boxes in House 3). Additionally, the sum of each of the columns in House 3 provides each of the components of the vector q 3 (53.4, 88.1, 109.2).
  • The House of Quality 4 relates the weighted teaching techniques (vector q 3 of House 3) with the teaching resources. Therefore, the values of the numerical boxes are obtained as the product of the components of the vector q 3 by the elements of the matrix C4. For example, in box d423 (row 2, column 3 of House 4) the product of q3(2) will be entered by C423; that is, d423 = 88.1 · 104 · 5.9 = 5,197,900 = 5.19 · 106 (in the box 5.2 is given since 106 is extracted as a common factor of all the boxes in House 4). Additionally, the sum of each of the columns of House 4 provides each of the components of the vector q 4 (13.0, 7.5,…, 15.0).
(b)
Each quality house has a roof at the top where the compatibility between each two HOWs is noted by symbols. Thus, “+” indicates positive correlation, “−” indicates negative correlation and “or” indicates no correlation.
(c)
In the lower part of the houses of quality a table is included with the values of the teaching efficiencies (partial and global) of the subject. The following considerations have been taken into account for its calculation:
  • The efficiency of each HOW, η i ( q j ) , relates the degree of satisfaction obtained, qi(j), with the maximum that would be possible to obtain. Therefore, the calculation of the effectiveness of each HOW will be different in each of the four quality houses:
    -
    Efficiency of HOW “j” of House 1:
    η 1 ( q j ) = q 1 ( j ) Δ · i = 1 i = n p i
    -
    Efficiency of HOW “j” of House 2:
    η 2 ( q j ) = q 2 ( j ) Δ · i = 1 i = m q 1 ( i )
    -
    Efficiency of HOW “j” of House 3:
    η 3 ( q j ) = q 3 ( j ) Δ · i = 1 i = r q 2 ( i )
    -
    Efficiency of HOW “j” of House 4:
    η 4 ( q j ) = q 4 ( j ) Δ · i = 1 i = s q 3 ( i )
  • The efficiency of each house of quality, η i ( C C i ) , relates the degree of satisfaction of all its HOWs,   q i ( j ) , to the maximum that would be possible to obtain. Therefore, the calculation of this effectiveness will be different in each of the four quality houses:
    -
    House Efficiency 1:
    η 1 ( C C 1 ) = j = 1 j = m q 1 ( j ) Δ · m · i = 1 i = n P i   =   0.5144
    -
    House Efficiency 2:
    η 2 ( C C 2 ) = j = 1 j = r q 2 ( j ) Δ · r · j = 1 j = m q 1 ( j ) = 0.3612
    -
    House Efficiency 3:
    η 3 ( C C 3 ) = j = 1 j = s q 3 ( j ) Δ · s · j = 1 j = r q 2 ( j ) = 0.6315
    -
    − House Efficiency 4:
    η 4 ( C C 4 ) = j = 1 j = t q 4 ( j ) Δ · t · j = 1 j = s q 3 ( j ) = 0.4743
  • The sum of all the components of the vector q 4 (13.0, 7.5, …, 15.0) allows the “Teaching Value” to be determined (64.2 Megapoints). The overall effectiveness of the teaching of the subject, η g l o b a l , can be determined by direct application of Equation (17) or as a geometric mean of the product of the efficiencies of the four houses of quality; that is:
    η g l o b a l = η 1 · η 2 ·   η 3 ·   η 4 4 = [ j = 1 j = t q 4 ( j ) m · r · s · t · Δ 4 ( i = 1 i = n P i ) ] 1 / 4 =   0.4860
(d)
The boxes in the picture of the efficiencies are shown with a background color whose tone varied according to the value of the effectiveness. Thus, strong tones indicate that the efficiency was relatively high (greater than 50%) while light tones highlight that the effectiveness was low (less than 50%) and that it should be improved.
The analysis of the results shown in Figure 3 allowed us to draw the following conclusions:
(a)
The House of Quality 1 had adequate efficiency (51.44%). However, the low efficiency of the HOW “LG9: autonomous learning” (23%) indicates that it does not have, in the opinion of the companies, an adequate correspondence with the competencies of the subject established in the curriculum. Therefore, this HOW would be an aspect to reconsider in future modifications of the curriculum.
(b)
The House of Quality 2 had low efficiency (36.12%). In general, themes related to industrial facilities projects are better valued than those related to industrial manufacturing projects (in particular, Topics 11 and 12 had very low efficiencies: 20% and 23%, respectively). Thus, one aspect to improve would be the focus and content of the issues related to industrial manufacturing projects so that they are better suited to the learning goals considered.
(c)
The House of Quality 3 had good efficiency (63.15%) that indicates an adequate relationship between the themes of the subject and the teaching techniques proposed for its teaching. However, the technique “IT1: directed study” (40%) should be enhanced in the first four topics and the advisability of introducing teaching techniques complementary to those currently used should be analyzed.
(d)
The House of Quality 4 has an average value efficiency (47.43%) that could be improved by enhancing the teaching resources “ocR2: blackboard” (33%), “trR1: Basic bibliographic endowment” (37%) and “trR2: access to document databases (35%)” to better adapt to the teaching techniques used. Likewise, the use of other teaching resources that are accepted by students and improve their learning should also be considered.
(e)
The overall effectiveness of the teaching of the subject had an average value (48.60%) and, therefore had room for improvement. In this sense, two priority areas of action must be considered: improving the focus and content of the themes related to industrial manufacturing projects (House of Quality 2) and promoting current teaching resources and incorporating new complementary resources (House of Quality 4).

3.4. Analysis of the Internal and External Variables of the “Teaching Value”

By applying Equation (24) to the subject “Project Management”, its “Teaching Value” can be expressed as a sum of products of internal variables (related to university, professors and students) by external variables (related to opinion of companies). Likewise, by applying the Equations (27) and (28) the values of the internal and external equivalent variables of the “Teaching Value” can be determined. Table 7 lists these results and shows the values of the external and internal variables for each of the competencies of the subject “Project Management”, the contributions of these variables to the total “Teaching Value” and the equivalent variables.
The analysis in Table 7 allowed us to draw the following conclusions:
(a)
The GC4 and GC5 competencies were valued as the best by the companies (9.25 and 9.42, respectively). However, these competencies were relatively undervalued (6.26·105 and 5.43·105, respectively) by internal variables (university institution, professors and students).
(b)
The specific competency SC8 was highly valued by both internal variables (8.58) and external variables (13.88·105).
(c)
The CG2 and SC8 competencies provide, through the product of the corresponding external and internal variables, the highest contributions to the “Teaching Value” (17.04% and 18.55%, respectively). However, the lowest contribution was provided by the GC5 competition (7.96%). However, it should be noted that only three competencies (SC8, GC2 and GC7) contributed more than 50% to the total value of the “Teaching Value”.
(d)
In the composition of the “Teaching Value” the internal factor (equivalent internal variable: 1.073·105) had a much higher range (approximately 102) than the external factor (equivalent external variable: 598.41).

4. Conclusions

In the present work, a general method was proposed that allows the quantification of the teaching quality of an engineering subject taking into account the main factors involved in the educational process: society (through companies), university (as an institution), professors and students. The proposed methodology is based on the concatenation of four matrices called “Quality Houses” (QFD) and is applicable to any university subject.
Through an integrated matrix development of the four quality houses, a vector was obtained ( q 4 ) that integrates in its definition the entire teaching process of a university subject. Therefore, from this vector, a representative parameter of the teaching quality has been defined, namely, the “Teaching Value”, which globally quantifies the teaching of a university subject. Likewise, and in a complementary manner, the overall effectiveness of teaching has been established ( η g l o b a l ), which is defined as the geometric mean of the product of the efficiencies of the four houses of quality and allows the determination of the current performance of teaching and its margin for potential improvement.
Additionally, and in order to highlight the differential contribution that the internal (relative to the university, professors and students) and external (related to the companies) variables have in the teaching assessment of a subject, an analytical decomposition of the “Teaching Value” was used. This approach has allowed, on the one hand, the determination of the values of the external and internal variables for each competition and their percentage of contribution to the total “Teaching Value”, and, on the other hand, the expression the “Teaching Value” as a product of an equivalent external variable p eq (which takes into account the general valuation of companies on teaching competencies) by an equivalent internal variable S veq (which globally values the factors intrinsic to the university environment).
The proposed general methodology has been applied to the subject “Project Management” in order to show its suitability and usefulness for the analysis and improvement of the teaching quality of university subjects.
Thus, the matrix characterization of the subject “Project Management” has made it possible to determine its “Teaching Value” (64.2 Mp) and its overall effectiveness (48.60%). To show the results of the matrix analysis in more detail, a new compacted design of the QFD (with the four quality houses attached) has been developed that collects the most relevant elements of each quality house and has highlights the strengths and weaknesses of the teaching of the subject. In the first case (strengths), an adequate relationship between the themes of the subject and the teaching techniques proposed for teaching (partial effectiveness of 63.15%) stood out. In the second case (weak points), it was concluded that two priority areas of action should be considered: improving the focus and content of the issues related to industrial manufacturing projects (partial efficiency of 36.12%) and strengthening current teaching resources and incorporating new complementary resources (partial efficiency of 47.43%).
Additionally, the analytical decomposition of the “Teaching Value” of the “Project Management” course allowed us to conclude that only three competencies (SC8, GC2 and GC7) contribute more than 50% to the total “Teaching Value”. Likewise, it was determined that in the “Teaching Value” composition, the internal factor (equivalent internal variable: 1.073·105) had a much higher range (approximately 102) than the external factor (equivalent external variable: 598.41).
Thus, the proposed method proved appropriate to quantitatively assess the overall teaching of a subject, to highlight its strengths and weaknesses and to facilitate the proposal for actions to improve teaching in a framework of the continuous improvement of educational quality.

Author Contributions

Conceptualization, J.M.A.R. and J.D.C.-M.; methodology, J.M.A.R. and J.D.C.-M.; supervision, J.M.A.R. and J.D.C.-M.; validation, All authors; investigation, All authors; data curation, F.V.S.M. and M.I.M.; writing—original draft preparation, J.D.C.-M.; writing—review and editing, J.M.A.R. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Why Do Students Go to University and How Do They Choose Which One? Available online: https://www.timeshighereducation.com/student/news/why-do-students-go-university-and-how-do-they-choose-which-one (accessed on 2 April 2019).
  2. Dippelhofer-Stiem, B.; Bargel, T.; Bromberek, B.; Jetten, E.; Kump, S.; Sagmeister, G.; Walter, H.-G.; Thesz, J. Students in Europe: Motives for Studying, Expectations of Higher Education and the Relevance of Career Prospects. Eur. J. Educ. 1984, 19, 309–325. [Google Scholar] [CrossRef]
  3. Martínez-Lorente, A.; Dewhurst, F.; Dale, B. Total Quality Management: Origins and Evolution of the Term. Tqm Mag. 1998, 10, 378–386. [Google Scholar] [CrossRef] [Green Version]
  4. Bilen, C. Total Quality Management in Higher Education Institutions: Challenges and Future Directions. Int. J. Product. Qual. Manag. 2010, 5, 473–492. [Google Scholar] [CrossRef]
  5. Kwarteng, A.J. An Assessment of Outcome Criteria Associated with the Implementation of TQM in a Higher Education Institution in Ghana. Cogent Educ. 2021, 8, 1859198. [Google Scholar] [CrossRef]
  6. Hawi, R.; AL-zyadat, W. TQM Measured Students’ Satisfaction in the Jordanians’ Private University for Achieving Institutional Excellence. TEM J. 2019, 8, 409–416. [Google Scholar] [CrossRef]
  7. Vykydal, D.; Folta, M.; Nenadál, J. A Study of Quality Assessment in Higher Education within the Context of Sustainable Development: A Case Study from Czech Republic. Sustainability 2020, 12, 4769. [Google Scholar] [CrossRef]
  8. Plaza, I.; Igual, R.; Medrano, C.; Rubio, M.Á. From Companies to Universities: Application of R & D & I Concepts in Higher Education Teaching. IEEE Trans. Educ. 2013, 56, 308–315. [Google Scholar] [CrossRef]
  9. Brian Hwarng, H.; Teo, C. Translating Customers’ Voices into Operations Requirements—A QFD Application in Higher Education. Int. J. Qual. Reliab. Mgmt 2001, 18, 195–226. [Google Scholar] [CrossRef]
  10. Carmignani, G. Modified QFD and Problem-Solving Techniques Integrated Approach Implementing Corrective Actions: A Case Study in an Italian Manufacturing Plant. Qual. Reliab. Eng. Int. 2009, 25, 241–252. [Google Scholar] [CrossRef]
  11. Dror, S. Identify Important Factors for Service Simulation Experiments Using QFD. Qual. Reliab. Eng. Int. 2016, 32, 2107–2114. [Google Scholar] [CrossRef]
  12. Higgins, S.; Smith, J.A.; Baker, K.J. The Use of Quality Function Deployment During the Review of a B.Eng Honours Degree Course. Educ. Train. Technol. Int. 1994, 31, 196–200. [Google Scholar] [CrossRef]
  13. Ictenbas, B.D.; Eryilmaz, H. Linking Employers’ Expectations with Teaching Methods: Quality Function Deployment Approach. Procedia Soc. Behav. Sci. 2011, 28, 568–572. [Google Scholar] [CrossRef] [Green Version]
  14. Jaraiedi, M.; Ritz, D. Total Quality Management Applied to Engineering Education. Qual. Assur. Educ. 1994, 2, 32–40. [Google Scholar] [CrossRef]
  15. Köksal, G.; Eğїtman, A. Planning and Design of Industrial Engineering Education Quality. Comput. Ind. Eng. 1998, 35, 639–642. [Google Scholar] [CrossRef]
  16. Madara, O.; Okudan, G. A Student Centered Approach To Improving Course Quality Using Quality Function Deployment. Int. J. Eng. Educ. 2007, 23, 916–928. [Google Scholar]
  17. Lantada, A.D.; Morgado, P.L.; Otero, J.E.; Munoz-Guijosa, J.M.; Sanz, J.M. Listening to Students as a Way of Improving Teaching: Application of QFD-Based Techniques to a Final Year Subject. Int. J. Eng. Educ. 2010, 26, 1508–1523. [Google Scholar]
  18. Mrad, F. An Industrial Workstation Characterization and Selection Using Quality Function Deployment. Qual. Reliab. Eng. Int. 1997, 13, 261–268. [Google Scholar] [CrossRef]
  19. Mukaddes, A.M.M.; Bagum, N.; Islam, M.A.; Khan, M.M.A. The Application of Quality Function Deployment to Improve the Teaching Techniques in Higher Education. Int. J. Ind. Syst. Eng. 2012, 11, 97–109. [Google Scholar] [CrossRef]
  20. Sahney, S.; Karunes, S.; Banwet, D.K. Enhancing Quality in Education: Application of Quality Function Deployment—An Industry Perspective. Work Study 2003, 52, 297–309. [Google Scholar] [CrossRef]
  21. Shahriari, H.; Haji, M.J.; Eslamipoor, R. An Integrated Approach for Enhancing the Quality of the Product by Combining Robust Design and Customer Requirements. Qual. Reliab. Eng. Int. 2014, 30, 1285–1292. [Google Scholar] [CrossRef]
  22. Akao, Y. Despliegue de Funciones de Calidad Qfd, 1st ed.; Prod Press: Madrid, Spain, 1993; ISBN 978-84-87022-88-3. [Google Scholar]
  23. Dawson, D.; Askin, R.G. Optimal New Product Design Using Quality Function Deployment with Empirical Value Functions. Qual. Reliab. Eng. Int. 1999, 15, 17–32. [Google Scholar] [CrossRef]
  24. Haber, N.; Fargnoli, M.; Sakao, T. Integrating QFD for Product-Service Systems with the Kano Model and Fuzzy AHP. Total Qual. Manag. Bus. Excell. 2020, 31, 929–954. [Google Scholar] [CrossRef]
  25. Kim, K.-J.; Kim, D.-H.; Min, D.-K. Robust QFD: Framework and a Case Study. Qual. Reliab. Eng. Int. 2007, 23, 31–44. [Google Scholar] [CrossRef]
  26. Neira-Rodado, D.; Ortíz-Barrios, M.; De la Hoz-Escorcia, S.; Paggetti, C.; Noffrini, L.; Fratea, N. Smart Product Design Process through the Implementation of a Fuzzy Kano-AHP-DEMATEL-QFD Approach. Appl. Sci. 2020, 10, 1792. [Google Scholar] [CrossRef] [Green Version]
  27. Zhang, X.; Li, J.; Hu, Z.; Qi, W.; Zhang, L.; Hu, Y.; Su, H.; Ferrigno, G.; Momi, E.D. Novel Design and Lateral Stability Tracking Control of a Four-Wheeled Rollator. Appl. Sci. 2019, 9, 2327. [Google Scholar] [CrossRef] [Green Version]
  28. Karapetrovic, S. Why and How to Develop a Meaningful Quality Assurance System in Engineering Schools. Int. J. Eng. Educ. 2002, 18, 258–294. [Google Scholar]
  29. Wiklund, H.; Sandvik Wiklund, P. Student Focused Design and Improvement of University Courses. Manag. Serv. Qual. 1999, 9, 434–443. [Google Scholar] [CrossRef]
  30. Alves, J.A.; Lima, N.; Alves, G.R.; García-Peñalvo, F.J. Adjusting Higher Education Competences to Companies Professional Needs: A Case Study in an Engineering Master’s Degree. IJHCITP 2017, 8, 66–78. [Google Scholar] [CrossRef] [Green Version]
  31. Saaty, T.L. Analytic Heirarchy Process. In Wiley StatsRef: Statistics Reference Online; American Cancer Society: Atlanta, GA, USA, 2014; ISBN 978-1-118-44511-2. [Google Scholar]
  32. Juran, J.M.; JURAN, J.M.A. Juran on Quality by Design: The New Steps for Planning Quality Into Goods and Services; Simon and Schuster: New York, NY, USA, 1992; ISBN 978-0-02-916683-3. [Google Scholar]
  33. Cano-Moreno, J.D.; Arenas Reina, J.M.; Sánchez Martínez, F.V.; Alía García, C. Learning to teach by listening to students: Application of QFD for improvement of practical teaching in Technical Office and Projects. In Proceedings of the 22nd International Congress on Project Management and Engineering, Madrid, Spain, 11–13 July 2018; pp. 2191–2201, ISBN 978-84-09-05132-8. [Google Scholar]
  34. Akao, Y. Quality Function Deployment; Productivity Press: New York, NY, USA, 2004. [Google Scholar]
  35. Akao, Y.; Mazur, G.H. The Leading Edge in QFD: Past, Present and Future. Int. J. Qual Reliab. Mgmt 2003, 20, 20–35. [Google Scholar] [CrossRef]
  36. Cano-Moreno, J.D.; Arenas, J.M.; Sánchez, V.; Islán, M.; Narbón, J. Methodology for Quantitative Evaluation of University Teaching. Application to the Subject of Project Management. Procedia Manuf. 2019, 41, 930–937. [Google Scholar] [CrossRef]
  37. Cherednichenko, O.; Yangolenko, O. Towards Quality Monitoring and Evaluation Methodology: Higher Education Case-Study. In Proceedings of the 4th International United Information Systems Conference, UNISCON 2012, Yalta, Ukraine, 1–3 June 2012; Revised Selected Papers. Mayr, H.C., Kop, C., Liddle, S., Ginige, A., Eds.; Springer: Berlin/Heidelberg, Germany, 2013; pp. 120–127. [Google Scholar]
Figure 1. Workflow of the four concatenated matrices.
Figure 1. Workflow of the four concatenated matrices.
Mathematics 09 00831 g001
Figure 2. Structure and composition of the house of quality.
Figure 2. Structure and composition of the house of quality.
Mathematics 09 00831 g002
Figure 3. Compacted design of the quality function deployment (QFD) (“terraced houses”).
Figure 3. Compacted design of the quality function deployment (QFD) (“terraced houses”).
Mathematics 09 00831 g003
Table 1. The WHATs and HOWs of the four concatenated matrices [36].
Table 1. The WHATs and HOWs of the four concatenated matrices [36].
MatrixWHATsHOWsWHOs
1“n” CompetenciesLearning Goals (m)University, companies and teachers
2“m” Learning GoalsThemes of the subject (r)Teachers
3“r” Themes of the subjectTeaching Techniques (s)Teachers
4“s” Teaching TechniquesTeaching resources (t)Students and teachers
Table 2. General and specific competencies of the subject “Project Management” [36].
Table 2. General and specific competencies of the subject “Project Management” [36].
CodeDescription
GC1Know and apply knowledge of basic sciences and technologies to the practice of industrial engineering
GC2Apply the knowledge acquired to identify, formulate and solve problems within broad and multidisciplinary contexts, being able to integrate knowledge, working in interdisciplinary teams
GC3Understand the impact of industrial engineering on the environment, the sustainable development of society and the importance of working in a professional and responsible environment
GC4Know how to communicate the knowledge and conclusions, orally, written and graphically, to specialized and non-specialized audiences in a clear and unambiguous way.
GC5Possess learning skills that allow students to continue studying throughout their lives for their adequate professional development.
GC6Incorporate new technologies and tools of industrial engineering in their professional activities.
GC7Organization and planning in the field of the company, and other institutions and organizations of projects and human teams.
SC8Knowledge and skills to organize and manage projects. Know the organizational structure and functions of a project office.
Table 3. Learning goals “Project Management” subject [36].
Table 3. Learning goals “Project Management” subject [36].
CodeDescription
LG 1Apply the methodology for the management and legal processing of projects of facilities or industrial plants of a singular character
LG 2Differentiate the main functions of the project manager in the field of his relationship with the client and the planning of the project of an installation or industrial plant
LG 3Enumerate the characteristic activities in the procedures for implementation, control, monitoring and project closure of a facility or industrial plant.
LG 4Understand the implications of total quality management for industrial design and manufacturing projects
LG 5Analyze the activities, production system and plant layout necessary for the development of the design and industrial manufacturing project
LG 6Evaluate design and manufacturing processes to introduce improved methods
LG 7Apply techniques for the determination of manufacturing times and costs
LG 8Practice the methodology to streamline work and schedule batch design and manufacturing projects
LG 9Learn autonomously
LG 10Have an open attitude and constructive criticism when analyzing technical issues
LG 11Work as a team in an organized way
LG 12Communicate effectively to the public
Table 4. Themes of the subject “Project Management” [36].
Table 4. Themes of the subject “Project Management” [36].
CodeDescription
T1Project Methodology
T2Basic Documentation of the Project
T3Planning, programming and execution
T4Legislation and legal processing of Projects
T5Design of products
T6Quality management
T7Process and capacity strategies
T8Analysis of processes with machines and labor
T9Measure of Work
T10Plant layout
T11Manufacturing costs and budget
T12Planning and programming of work
Table 5. Teaching techniques applied in the subject “Project Management” [36].
Table 5. Teaching techniques applied in the subject “Project Management” [36].
CodeDescription
IT1Directed study
GT3Project method
GGT1Expository technique
Table 6. Teaching resources of the subject “Project Management” [36].
Table 6. Teaching resources of the subject “Project Management” [36].
CodeDescription
ocR1The classroom: sufficient capacity, good lighting, both natural and artificial, and, for group work, have mobile tables.
ocR2Blackboard (presentation of the lessons and the resolution of the proposed exercises).
ocR3Presentation system: Projector, screen and PC with presentation software (you could even consider the use of electronic whiteboards connected to the computer)
trR1Basic bibliographic endowment (follow-up and learning of the lessons, exercises and group work).
trR2Access to document databases: university library, access to databases of electronic documents (magazines, catalogs, etc.) and consultation of AENOR regulations.
dlR1Documentation of the subject (lessons, exercises, bibliography, links of interest)
Table 7. Internal and external variables and contribution to “Teaching Value”.
Table 7. Internal and external variables and contribution to “Teaching Value”.
Subject CompetenciesEquival. Variables
GC1GC2GC3GC4GC5GC6GC7SC8
Variables
external
Weighing
competitions
pi
8.088.837.179.259.428.008.338.58598.41
Variables
internal
Subject value
S vi
(×105)
6.7712.399.516.265.439.8612.3413.881.073
Contribution to
Teaching Value
p i   ·   S vi
(×106)
5.4710.946.825.795.117.8910.2811.9164.21
Contribution percentage
Xi%
8.5217.0410.629.027.9612.2816.0118.55100%
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Arenas Reina, J.M.; Cano-Moreno, J.D.; Sánchez Martínez, F.V.; Islán Marcos, M. Methodology for Analysis and Quantitative Evaluation of Teaching Quality in University Subjects. Mathematics 2021, 9, 831. https://doi.org/10.3390/math9080831

AMA Style

Arenas Reina JM, Cano-Moreno JD, Sánchez Martínez FV, Islán Marcos M. Methodology for Analysis and Quantitative Evaluation of Teaching Quality in University Subjects. Mathematics. 2021; 9(8):831. https://doi.org/10.3390/math9080831

Chicago/Turabian Style

Arenas Reina, José Manuel, Juan David Cano-Moreno, Francisca Victoria Sánchez Martínez, and Manuel Islán Marcos. 2021. "Methodology for Analysis and Quantitative Evaluation of Teaching Quality in University Subjects" Mathematics 9, no. 8: 831. https://doi.org/10.3390/math9080831

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop