Next Article in Journal
Oxygen Sensing of Pt/PEO-TiO2 in Humid Atmospheres at Moderate Temperatures
Next Article in Special Issue
Mixed Assessment of Virtual Serious Games Applied in Architectural and Urban Design Education
Previous Article in Journal
3D Sensors for Sewer Inspection: A Quantitative Review and Analysis
Previous Article in Special Issue
Applying Learning Analytics to Detect Sequences of Actions and Common Errors in a Geometry Game
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Qualitative Assessment of Effective Gamification Design Processes Using Motivators to Identify Game Mechanics

1
Group of Research on Technology Enhanced Learning (GRETEL), Universitat Ramon Llull, La Salle, 08022 Barcelona, Spain
2
Communities and Children Faculty, University of St. Mark and St. John, Plymouth PL6 8BH, UK
3
Facultad de Psicología, Universidad Complutense de Madrid, 28223 Madrid, Spain
*
Authors to whom correspondence should be addressed.
Sensors 2021, 21(7), 2556; https://doi.org/10.3390/s21072556
Submission received: 15 February 2021 / Revised: 31 March 2021 / Accepted: 31 March 2021 / Published: 6 April 2021
(This article belongs to the Special Issue Pervasive Mobile-Based Games, AR/VR and Sensors)

Abstract

:
This research focuses on the study and qualitative assessment of the relationships between motivators and game mechanics per the ratings of expert gamification consultants. By taking this approach, it is intended that during the design phase of a gamified system, decisions can be made about the design of the system based on the motivators of each of the profiles. These motivators can be determined from the information provided by the potential players themselves. The research presented starts from a previous analysis in which, based on the three most used gamification frameworks and through a card sorting technique that allows the user to organize and classify the content, a set of mechanics are determined. In the present study, each of the mechanics is analyzed, and a more precise motive is decided. As a result, a higher level of personalization is achieved and, consequently, approximates a higher level of gamification effectiveness. The main conclusions are implemented in the development of the Game4City 3.0 project, which addresses gamified and interactive strategies to visualize urban environments in 3D at an educational and social level.

1. Introduction

Systems based on user experience methodologies must consider the following factors: technological requirements; cognitive psychology in order to understand the user’s learning process of our design; and the design itself, which allows us to develop projects according to the necessary processes [1] because they are planned according to the motivators and needs of the potential users to whom they are directed [2]. The gamification of any content, system or environment requires prior studies to understand the technology and technique of the use of devices, sensors, systems or methods [3,4]. This overall statement is important because, depending on the dynamics to be gamified, the context or device to be used and finally the user’s profile, it is necessary to consider various variables that can influence the success or failure of a gamified proposal [4,5]. Starting from these premises, players and users become protagonists of the development process, promoting the creation of more effective systems from the beginning [6]. The research presented here is based on the study of the system’s future users. Therefore, in this case, the users become the gamification experts.
To analyze and establish the process, an iterative design system is used, which allows continuous and improved redesign from the previous design phase [7]. Therefore, we start by considering the discipline of user because the user’s experience will define the applicable methodology and technique; the expert thereby serves as the basis for the analysis to understand the mental model each expert adopts from the point of view of their work [8].
For the development of our objectives, we opted for a qualitative approach because we are initiating an exploratory process with the participation of sector consultants. This approach will be the most successful because it will allow us not only to identify and weigh data but also to explain their origins in depth [9,10,11].
The study is derived from an investigation of a methodology called I’M IN [12]. The methodology aims to indicate the process of designing a workshop session with users, incorporates the user experience as a behavioral evaluation, and includes the application of gamification as a method of improvement/enhancement of the motivations arising during the work session. The test that emerges raises the need to work with expert professionals in the sector when analyzing the necessary requirements, thereby generating data focused on the people who should be using them.
In parallel, the main conclusions of the project are implemented in the development of the Game4City 3.0 project. This project addresses gamified and interactive strategies for viewing urban environments in 3D at the educational and social levels [13]. The ability to create interactive and immersive virtual architectural models encourages a creative approach to architecture and fosters the acquisition of the skills needed to reproduce and understand the space [14]. Initially, some expert users in gamification who are related to the Game4City 3.0 project participated in our study as a first step towards understanding all motivational issues to leverage during the different phases of the project, which is designed to facilitate the participation of nonspecialized users and students in the visualization, understanding and reinterpretation of urban models and spaces, the promotion of user-centered design, and participation in design initiatives [15]. The main results and phases of the project have been widely published [16,17,18,19,20], which validated the motivational and user profile approach used. Adopting those previous results to the present work was justified because it was necessary to adapt the gamification as a function of the user and their needs [21].
According to Ryan, Rigby and Przybylski’s theory of self-determination in video games [22], gamification is used as part of the motivational design that can influence the behavior of the players based on the stimuli they receive; therefore, having useful information regarding motivators (which may include those of future users) can yield a very effective design proposal [23]. Innate psychological needs such as competence, autonomy and relationships, if satisfied, cause an improvement in self-motivation and mental health; conversely, when they are frustrated, they can produce a reduction in the motivation and well-being of a person [24]. Taking this parameter into account can provide added value for projects targeted for gamification. The term “degamification” was introduced by Margaret Robertson [25] who stated that in a gamified system, the commitment of the player to the game must be monitored. If the player is initially frustrated, they may stop participating in the challenge. Therefore, when the fictional elements of the games disappear, the game itself disappears as well. The decision in regard to choosing the mechanics, dynamics and game elements [26] is essential so that the player does not lose engagement [27] and stays immersed from the beginning to the end of the process. The various game elements can serve different motivational mechanisms, so several elements can be combined with these mechanisms [28]. For example, most games have a shelf life of 12 to 18 months, so in order to generate long-term commitment to a game, the key element of motivation is required.
On the same path and according to Mollick et al. [29], gamification separates the work that a person does from the work that they perceive themselves to be doing; thus, to understand gamification, it is necessary to understand the motivation for it. For this, the motive can be treated as a reward structure, and it can therefore define the behavior that the designer wants to encourage. It can help to train the person as a player—that is, to train the person to participate in the investment environment—and can help the player focus on tasks that are interesting to him.
The same concept is reaffirmed by Savignac [30], who indicated that gamification can improve the quality of life because it is a motivational tool and is therefore applicable to work environments.
This described link between gamification and motivation serves as a key feature in understanding the objective of the project (gamification key-points) that is to be proposed and the player profile for which it is designed because it reflects an emotional factor that drives a user to carry out an action.
Emotional behavior is based on the emotions that users experience while participating in the use of systems or projects, and these emotions are part of the human character. Using the definition of emotional behavior offered by Don Norman [31], three key factors of the users can be taken into account: the emotions evoked by the product during the interaction, the user’s mood and the user’s feelings associated with the product prior to the interaction.
In this sense, the user experiences various emotions during their interaction. The individual’s state of mind or humor can condition the emotions elicited by the product [32]. Taking into account the idea that user emotions can change over the course of their product interactions and be detected by a system, sensor, or device, our study is relevant because it provides gamification experts tools and allows their future improvement through the prism of knowledge surrounding the motivators related to user experience in gamified approaches. In this way, the article proposes new tools for experts by which to define the mechanics related to a gamified environment depending on the sensor or sensors used: fixed, mobile, multiuser environment, etc.
There are several studies that highlight the need to personalize gamified systems. Hexad, for example, is a system that allows a 24-question survey to define user preferences and that concludes in one of the following: philanthropist, socializer, disruptor, free spirit, completer or player [33].
According to Brave et al. [34], emotions are transmitted towards the use of the product during their interaction. Feelings are states not of the person but of the association that a person has with the product as a result of previous experiences with the same or similar products. Emotions affect attention and memorization capacity, user performance, and assessment. Therefore, the emotional aspects of the user influence the interactive use of the products from a hedonic perspective, as well as the cognitive processes [35]. The user experience as a methodology can be applied in several ways, and a clear example would be the evolution of virtual reality. The evaluation of the experience is carried out with various instruments: the Simulator Sickness Questionnaire (SSQ), the Fast Motion Sickness Score (FMS), the User Experience Questionnaire (UEQ-S) and the Virtual Reality Neuroscience Questionnaire (VRNQ) [36].
To address this problem, motivators are used as a conceptual framework. As presented in a previous study, the design of strategies based on motivators with a clear goal orientation results in an approach that encourages participation and the design of strategies [37]. From the approach of the design of strategies based on motivation, studies have focused on gamification wherein the main objective is based on enhancing motivation in the participation of users—this time, in learning environments [38]. The design of the technique is based on the link connecting gamification with motivation and commitment, and the results offer evidence on the effect of gamification on the motivation and commitment of students in three university courses [39].
When talking about the user’s previously associated feelings, one works from the point of view of intrinsic factors or motivational factors, that is, those feelings that are part of the individual, such as achievement, responsibility or recognition. These aspects can be conditioned by extrinsic factors, such as social and cultural elements, the product itself and the context of use. Therefore, the experiences that an individual has previously felt or lived can condition the feelings attributed to the product [40].
The link between user and player experience provides specific assessment tools in specific gaming environments, and there are several techniques that are recommended, particularly for games [41].
Therefore, gamification is linked to the will that drives effort with the interest in or purpose of achieving certain challenges. Because our behaviors are spurred mainly by motivations that give us the impetus to do something, deciding on the right game mechanics becomes a key element. A game must be voluntary, and motivation helps. As shown in Figure 1, as stated in engagement loops [42], when we work on motivation, action and feedback, feedback allows us to push back the motivation defined initially. According to the overlapping value structures, they determine that the type of player motivators must be known [43]; in this way, we avoid gamification remaining only on the surface.
The research starts from two initial premises: in light of the fact that there are several definitions of game mechanics and several gamification frameworks, can there be a consensus on game mechanics? In addition, game mechanics are directly related to provoking the motivations of the players. Can the most appropriate motivation be defined for each of the mechanics? The result of the study aims to establish a single criterion that allows applicability to various types of system [43].

2. Materials and Methods

2.1. Initial Concepts

The study is based on a study carried out as part of an investigation focused on providing gamification criteria to a methodology created for the evaluation of users in the field of user experience [44]. For example, game mechanics can be proposed as facilitators of the creation of calibration games holding the attentions of the users in a manner that is required in this type of task, thus maintaining the quality of the data [45]. Calibration kits are a novel way to motivate users to perform calibrations, thereby improving the performance and accuracy of many human-computer systems [46].
When designing a gamified product, the experts are the ones who choose the mechanics necessary to carry out the project according to the objectives and the profile of the players at which it is aimed, such that the consideration of the real motivations of each player provides very valuable information when choosing the item to include. Therefore, it considers two elements: game mechanics and motivators.

2.1.1. Game Mechanics

We experimented with the hybrid card sorting technique, which focuses on diverging across data from several gamification frameworks that implement various game elements, in a phase prior to the one presented in this paper. We were able to extract a set of mechanics for categorizing, organizing, classifying, and hierarchizing content during this phase. The current research is based on the application of a technique that allows for the convergence of previous data, resulting in concrete results that enable successful design work. Figure 2 depicts the type of work done by two of the experts who were assessed in the previous phase [47].
The game mechanics used as a starting point are based on the results obtained in a hybrid card sorting analysis that starts as the basis for decisions about the meaning of the mechanics or the game elements, which are determined as the MDA system: mechanics, dynamics and aesthetics [26]. The purpose of the study is to identify the first impressions regarding the categorization of elements that are used to gamify and, therefore, represent the consensus drawn by experts in the sector. Three types of mechanics are considered [47]:
  • Actionable Gamification Octalysis by Yu-Kai Chou [48]. Based on eight factors: meaning, empowerment, social influence, unpredictability, avoidance, scarcity, ownership, and accomplishment, with a total of 76 game mechanics. Unlike with the creation of the first version of cards, the total sub classifications of the eight indicated parameters were considered.
  • Gamification Model Canvas by Sergio Jiménez [49]. Based on platforms, mechanics, dynamics, components, aesthetics, behaviors, players, simplicity, costs, revenues and a total of 59 cards distributed among the different mentioned parameters.
  • Gamification Inspiration Cards by Andrej Marczewski [50], with a total of 54 cards, including options for mechanics and options for profiles.
From the 189 elements evaluated, the experts identified a total of 58 items to be selected as real mechanics. The mechanics obtained are shown below and are analyzed in this test. In Table 1, they are detailed in alphabetical order.
In the results of the study, the concept of storytelling is not considered game mechanics but is considered a key element as part of immersion in a gamification design.

2.1.2. Motivators

In learning psychology, it is well known that one of the main factors that favors learning and information retention is precise motivation. This effect can be explained from the cognitive point of view and from the perspective of how the brain processes information. From the cognitive perspective, motivation favors the processes of attention and concentration that favor the acquisition of information, and the system is more receptive to store the information more adequately; therefore, more is retained. From the point of view of the brain, motivation activates the participation of brain structures, such as the limbic system and the hippocampus, which are closely related to the process of acquiring information, consolidating and storing it; therefore, it favors the player having better acting, learning and remembering [51,52,53].
In the case of the motivators used, because the decision of what motivates each user starts from a questionnaire previously made by the people themselves and therefore starts from rigorous and personalized information, the analysis of the motivational profile of Valderrama et al. is proposed [54].
The questionnaire is focused on human resources departments to determine the true motives or work behaviors of the workers. Even so, and as indicated by the same author, Beatriz Valderrama, the method can be adapted to research contexts [55]. The questionnaire is based on the model of the Wheel of motives by Beatriz Valderrama created in 2010, which shows five motives of approach and five of avoidance, which counteract the opposite motives, for a total of 10 dimensions [56].
Definition of approach motives:
  • Autonomy: Preference for being independent, following one’s own criteria and making decisions for oneself.
  • Power: Desire to lead others, compete and win, rise, receive admiration, have popularity and prestige.
  • Achievement: Preference for overcoming challenges, achieving professional success and reaching high standards of excellence.
  • Exploration: Interest in novelty and variety, seeking to learn and discover new ways of doing things.
  • Contribution: Desire to help others, contribute to society and have a positive impact on the lives of others.
Definition of avoidance motives:
  • Affiliation: Preference for being with others, being part of a group and feeling accepted.
  • Cooperation: Desire to maintain egalitarian relationships, avoid inequity, and create distance from power, rivalry and abuse of power.
  • Hedonism: Preference for saving effort and tension, avoiding sacrificing one’s own well-being to pursue goals.
  • Security: Preference for maintaining the stability of the environment, as well as avoiding changes and uncertainty.
  • Conservation: Desire to protect oneself, earn money and conserve material goods.
To understand the correspondence between approach grounds and avoidance reasons, Table 2 indicates the correspondence in a visual way. Table 2 shows the lists of motives according to the correspondence between them [56]:

2.2. Methodological Approach

The objective of the test is to obtain rigorous information thinking about the needs of the projects in which gamification is applied; for this, an approach in which the protagonist of the evaluation is the expert in this sector is chosen because such an expert has knowledge of the applicability of the system and understands the needs when choosing the best gamification properties, such as mechanics, dynamics and perception towards the players [56]. Therefore, a methodology of user-centered design (UCD) is applied [57].
The classic usability methods are based on the hypothetical-deductive paradigm, so the paradigm shift towards a less objective base perspective allows us to understand and explore the opinions of the participants evaluated during the test. This constructivist model adds value to the subjective model and permits the Socratic treatment of the individual. The user experience allows us to qualitatively assess the perspectives of the experts in the disciplines being studied, who truly are the future users of the study results [58]. A constructivist approach allows creating knowledge from the learning that emerged from the users themselves; under this premise, they create two tools: Create@School App (Clermont House, Wicklow County Campus, Rathnew, Ireland; available online https://www.createschool.ie/ (accessed on 1 March 2021)) and the Project Management Dashboard (PMD, available online http://webvantage.bvk.com/ (accessed on 1 March 2021)), which integrates game mechanics, dynamics and aesthetics in the study plan. The project measures satisfaction and usability based on user experience methodologies [59]. The techniques carried out from evaluation systems with users allow the project to evaluate a minimum of five users of the same profile, and an evaluation based on qualitative results allows results obtained from User 6 to be repeated with previous users [60]. The study that is presented has a rating of 14, which supports the rigor of the results and validates the results of the assessments.

2.2.1. Definition of the Evaluated User Profile

Taking into account several existing works on sample size in qualitative studies, there are two outcomes. On the one hand, the technique applied for data collection and on the other hand, always taking into account the saturation principle, the analysis of these data [61]. This principle is based on defining to what extent the data collection is providing new information in terms of the setting and the possible sample. The aim of qualitative research is to understand people’s perceptions in depth and to understand a detailed description. Therefore, a larger sample size may lead to a repetition of information [62].
It is important to highlight that for the study, the decisions of the professionals are critical, so special attention has been given to ensuring that all participants are highly qualified, that they are actively part of the sector and that they have a certain prestige in the field in which they work. Moreover, it is emphasized that to motivate the completion of the questionnaire, the motivation of the users of their projects is clearly and uniformly valued.
Some studies, such as those that evaluate people with autism spectrum disorder, allow us to understand the importance of being specific in the profile to provide concrete solutions to specific needs [63,64].
Regarding the number of experts required, there is no unanimous agreement for their determination. In Cabero-Almenara et al. [65], the selection of the number of experts depends on aspects such as the ease of accessing them or the possibility of having enough experts on the subject under investigation. On the other hand, authors such as Escobar-Pérez et al. [66] point out that the number of judges to be employed in a trial depends on the level of expertise and the diversity of knowledge. For this, expert judgement is used, which is defined as an informed opinion of people with experience in the subject, who are recognized by others as qualified experts in it and who can provide information, evidence, judgements and evaluations [65]. The characteristics of the expert must be defined, and at the same time, the number of them must be determined. According to Delgado-Rico et al. there must be at least three [67].
The test is carried out with a homogeneous group of people, consisting of 14 expert consultants in gamification [60] with more than five years of experience in business projects, educational projects or research projects and with a standard deviation of 3.33 with respect to age. It is important that the study be based on such a specific profile that, as previously explained, would consist of the potential users of the study results.

2.2.2. Consent of Respondents

Prior to the sessions, information was provided on the research project along with information about the questionnaire that they were going to be administered; signed consent was requested from all consultants. During all phases of the research, special care was taken with the treatment of data both at an ethical level and in the consent of all participants for each action of the research. To formally comply with these processes, the research was overseen by the ethics committee of Universitat Ramon Llull, both for the information detailing the research and the type of informed consent given to the participants. The data obtained from participation were not used for any purpose other than that specified in this research; they were used exclusively for academic purposes and were kept in absolute confidentiality.

2.2.3. Applied Methodology

The applied methodology was designed specifically for the study; therefore, it was specifically fashioned in light of the needs to be reflected in the results. The methodology is based on the telematics dissemination of a questionnaire for each expert to complete individually. Apart from the support information, the questionnaire consists of two steps:
  • Step 1: This step includes a list of 58 predefined and indicated game mechanics, as shown in Table 1. The order is impartial; therefore, the list is presented alphabetically. A checklist allows quick selection of each mechanic. Each field that is selected is reinforced with a label that highlights that it is a game mechanic. In this step, the consultants are encouraged to re-evaluate their decisions when considering the game mechanics so that the consultants themselves are sure of the work they are doing; this procedure ensures criteria that are rigorous and necessary for the second step.
  • Step 2: In this step, respondents link each item selected as a mechanic in Step 1 with one of the 10 motives raised and indicated in Table 2. The proposed mechanics are automatically indicated from the sample selected in the previous step; in this way, it is guaranteed that the consultant works only from the selection made by himself during the previous step. Each of the included motives is defined by the author so that there are no doubts about the interpretations of any of the consultants. For the selected mechanics, the names may be changed if necessary, and the consultants are asked to define each mechanic to clarify the link indicated with the motive. Once defined, the consultant selects the most related motivator from a list field.
For the result to be consistent among the experts, the objective of the survey is initially explained, and the source of the game elements of the first step is described. Definitions for each of the motives are provided so that differing interpretations do not arise.

3. Results

3.1. Step 1. Selection of Game Mechanics

The results obtained in the first step are provided in detail in Table 3, which shows the percentage of consultants who selected each item. Sharing knowledge was the most valued item for game mechanics, with a 93% selection rate, followed by Exploration, Gifting/Sharing and Voting/Voice, at 64%—that is, selected by more than half of the consultants. Among the concepts, a broader degree of dispersion exists with regard to selections made by almost half of the consultants (i.e., from 43% to 21%): Boss fights, Competition, Milestone unlocks, Miniquests, To attend an appointment, To win a reward, Build from scratch, Challenges, Exchangeable points, Group quests, and To enhance identity. The items for which a smaller number of consultants were in concurrence (i.e., selected in 7% to 14% of evaluations) were Inventory, Leader board, On-boarding/Tutorials, Social discovery, Social network, Social status, Unlockable/Rare content, Access, Catalogue, Innovation platform, Meaning/Purpose, Signposting and Virtual goods.
According to the observed degree of agreement in the selection of mechanics, it can be seen that most consultants considered the elements in bold in Table 3 to be those that they would use as game mechanics, for a total of 15 elements.
In the same way, the elements that no consultant appreciated as a game mechanic are highlighted: Status points, Status quo sloth, Theme and Virtual currency. These elements are considered or appreciated as game elements but cannot be used as mechanics.

3.2. Step 2. Motivators According to Mechanics

From the list that the consultants considered mechanisms per Step 1, the links that each consultant identified with the most-related motivator are analyzed. These motivators are indicated in Table 2. A list of the motivators is provided in Table 4 along with the percentage of their selection (and, therefore, of their association), based on the mechanics. Achievement is the most selected motive at 55%, followed by much lower values for Autonomy and Hedonism at 28% and Affiliation and Power at 26%. The motivators least appreciated among the selections were those of Contribution at 22%, Cooperation and Exploration at 19% and, least linked, the motivators of Conservation at 14% and Certainty at 10%.

3.3. Motivators Linked to Mechanics

From the selection of the game mechanics, the percentage of agreement of the experts with respect to the presented list of motivators is indicated in Figure 3. In this way, the motivators most closely related to each of the mechanics are known.
  • The percentage of motivators linked to Sharing knowledge was highest for the Cooperative motivator (at 50% of the links), followed by 34% for Contribution and 8% for Power and Affiliation.
  • Exploration had 75% of its linkages made to the Exploration motivator, with the 25% remaining linkages being made to Autonomy and Achievement.
  • For the Gifting/Sharing mechanic, the Contribution motivator was noted by 50% of the consultants, whereas only one-quarter (25%) selected the Cooperation motivator, and even smaller percentages associated the mechanic with the motivators Hedonism and Achievement. In Figure 3, in the case of Voting/Voice the results were more even, with 40% being linked to Contribution and Power and 20% to Autonomy.
  • The mechanic Boss fights was linked to Power by 50%, to Achievement by 38%, and, at a much lower level, to Affiliation by 12%, as seen in Figure 3.
  • The Competition mechanic was linked to the power motivator by 67% and to Achievement and Contribution by far fewer (17% and 16%, respectively).
  • The selection rates for the Milestone unlocks mechanic were 50% for Achievement, followed by 37% for Conservation and 13% for Contribution.
  • For Miniquests, as indicated in Figure 3, four motivators were indicated: Exploration at 50%, Achievement at 25%, Certainty at 13% and Cooperation at 12%.
  • To attend an appointment, per Figure 3, was dispersed to five different mechanics, but the most linked was Affiliation at 50%, with the remaining percentage distributed equally across Autonomy, Cooperation, Achievement and Exploration.
  • For the evaluation of To win a reward, the selection of Achievement as a motive stood out at 56%, followed by lower percentages for Conservation (33%) and Power (11%).
  • In the case of Build from scratch, there was much dispersion in the results because there was no clear agreement among the experts. Achievement’s value was the highest at 37%, followed by Autonomy at 25% and the motives of Certainty, Exploration and Contribution at 13%.
  • The attribution of the mechanic Challenges was very clear, with 63% agreement on achievement. The rest of the percentage was distributed among three motivators: Affiliation, Cooperation and Power.
  • In the case of Exchangeable points, the motivator that the consultants most frequently selected was cooperation at 57%. The rest of the motivators had lower percentages, between 14% and 15%: Power, Achievement and Contribution.
  • Match rates of 38% and 37% were made for the motivators Hedonism and Autonomy, respectively, with the rest of the percentage distributed to Achievement (13%) and Affiliation (12%). The Group quest mechanic was linked 100% to the motivator Cooperation.

3.4. Mechanics and Motivators

From the indicated results, the selected percentages for each mechanic are shown, classified according to whether they are closeness motives or avoidance motives [55]. The experts expressed their rationales for why they selected the motivator according to the mechanics with which they were already familiar and that they had already used. Below are some exact sentences taken directly from the comments.
Competition was defined as a “Motivation tool” when it was linked to Achievement, as “Competing when overcoming a certain challenge”, “Challenge between two or more people in which only one can win”, “Compete to achieve a goal” and “Relating to the competition between the player vs system or player vs player” when linked to Power and as a “Collective challenge to solve a problem” when linked to Contribution.
  • To win a reward was defined as “Prizes through achievements”, “Get a reward for completing a challenge”, “Reward” and “Earning a reward after overcoming a challenge” when linked to Achievement and as “Having ability, an action that gives the ability to do something” when linked to Power.
  • Exploration was defined as follows: “Give the user the opportunity to know the details of a system by himself" in the case of Autonomy; “Relative to the fact that the player explores the system”, “Exploring the environment in order to learn to solve a challenge”, “Explore a play space”, and “Short investigation that seeks the observation of a faction to explore a space, site, information seeking to discover something/someone" in the case of Exploration; and "Search, observe, analyze, synthesize, elaborate, decide and, ultimately, practice a good amount of skills thanks to a goal and a certain lack of means to get it” in the case of Achievement.
  • Gifting was defined as “Gifts from a user to other users” in the case of Hedonism; “Sharing achievements or knowledge that allow overcoming new challenges”, “Prize” and “Action of exchanging objects between different players or characters of a team controlled by a single player” in the case of Cooperation; and “Relating to the action of sharing something with other players” in the case of Contribution.
  • Boss fights were defined as “Relating to the action of fighting, in this particular case doing it against”, “Bigger than normal challenge, usually at the end of a stage”, “End of level challenge where a player can demonstrate all the skills learned and use all the elements obtained during the same and previous challenges”, "Although it can be against other types of enemies, even with other players” and “I understand that it refers to the mechanics of facing a challenge with a higher level of difficulty (difficulty concentration)” when related to Power.
  • Sharing knowledge was defined as “Relating to the fact of sharing, but in this case when sharing information—for example, with other players, since they do not know it" and “Action of sharing knowledge that can be parameterized within the game or that cannot be parameterized, in which could constitute some kind of Milestone Unlock” when linked to Contribution, “Sharing what is known to achieve a greater good and thanks to the cooperation of an entire community” in the case of Cooperation, and “Many classic board games use this mechanic of evaluating knowledge. Dangerous by the way” in the case of Power.
  • To attend an appointment was defined as “Relating to the action of attending, but in this case to attending an appointment; it can be understood as a game mechanic if it is based on attending appointments, for example” when it was related to Autonomy, “Reward yourself for being there and on time, to contribute and/or participate in a certain way in a certain activity. It can lead to the knowledge of new opportunities, people and/or content” when related to Affiliation, “Understand mechanics as behaviors and actions that the players must do. Therefore, a mechanic would fit here” when related to Achievement, and “The possibility of acting and thinking without depending on something or others” when related to Autonomy.
  • To enhance the identity was defined as “Relating to the expansion/development of a specific skill, such as that which could occur, for example, in a skill tree” and “The possibility of acting and thinking without depending on something or others" when related to Autonomy, “Reward yourself for being there and on time, to contribute and/or participate in a certain way in a certain activity. It can lead to the knowledge of new opportunities, people and/or content” in the case of Affiliation, and “Understand mechanics as behaviors and actions that the players must do. Therefore, a mechanic would fit here” in the case of Achievement.
  • Milestone Unlocks was defined as “I like to think of the mechanical part as the way that players interact with the game elements (and with the game itself). Therefore, an unlocking of an achievement (mechanic) fits to overcome a level (element)”, “Milestones to be achieved within a process”, “Point that unlocks new game elements”, “Action to remove impediments that hinder the progress of an action to obtain an expected result”, and “Challenges that unlock new challenges, new mechanics, new tools and/or exploration spaces” when linked to Achievement.
  • Miniquests were defined as “Small challenges” and “Actions to remove impediments that hinder the progress of an action to obtain an expected result” when linked to Achievements and “Small noncompulsory alternative missions that can enrich the gameplay and storytelling experience while refreshing the player with more relaxed levels of difficulty” when linked to Security.
  • Build from scratch was defined as “Construction from blocks, physical or conceptual, of one" and “Start from the beginning” when linked to Autonomy and “I guess he refers to when building from scratch in strategy or farming games" when linked to Conservation.
  • Exchangeable points were defined as “Action of exchange of items between monetary goods in the game (rupees) and goods for sale (weapons, armor, potions, etc.)” in the case of Security.
  • Group quests were defined as “Challenges to be solved in a group” and “Missions shared between different players in a multiplayer context” in the case of Affiliation.
  • Challenges were defined as “End of mission, challenges, tests to overcome” when linked to Achievement, “Challenges to be overcome by the user” when linked to Power, “Challenges that test the player’s skill and motivate them to keep playing” when linked to Affiliation and “Introduce challenges to solve in a period of time” when linked to Cooperation.
Table 5 and Table 6 show the game mechanics defined by the consultants and their relationship with the motivators categorized by closeness and avoidance. As previously indicated, the selection of mechanics does reflect the consensus of all; therefore, in the sum of percentages, there may be mechanics that do not show 100% consensus across the selected motivators.
In Table 5, the mechanics related to Power stand out, such as Competition, with 67%, and Boss fights, with 50%. In the case of Achievement, Challenges were cited 63% of the time, To win a reward 56% of the time, Milestone unlocks 50% of the time and Build from scratch 37% of the time. The Exploration motive was primarily associated with the Exploration mechanic (75%) and Miniquests (50%). The Contribution motive was associated with the case of Gifting/Sharing 50% of the time. In the case of the Voting/Voice mechanic, 40% of associations were with Power and the same percentage with Contribution.
In the case of the avoidance motives, as indicated in Table 6, for the Sharing knowledge mechanic, Cooperation was proposed 50% of the time; for the For attending an appointment mechanic, Affiliation was proposed 50% of the time; for the Exchangeable points mechanic, Cooperation was proposed 57% of the time; for the Group quests mechanic, Cooperation was proposed 100% of the time; and for the To enhance identity mechanic, Autonomy and Hedonism were proposed equally often (37% and 38%, respectively).

3.5. Summary of the Links between Mechanics and Motives

In summary, Table 7 indicates the list of mechanics together with the motives linked at the highest relative frequencies.
Table 8 indicates the mechanics related to the different motivators.

4. Discussion

In this section, the results obtained from the study are analyzed, focusing both on the evolution of the selection of game mechanics and the study of the link with the most related motives.
The selection of game mechanics is based on a study carried out previously using the card sorting technique. This study is based on an aggregation of three of the most commonly used mechanisms in gamification projects: Octalysis de Yu-Kai Chou, Gamification Model Canvas by Sergio Jiménez and Gamification Inspiration Cards by Andrej Marczewiski. The results identified a total of 58 items considered to be game mechanics according to the experts; these serve as the starting point for the analysis presented. Working with experts in the project allows us to focus the results on an objective they might find useful and necessary for their new projects in the gamification sector.
As reflected in previous studies, gamification can be a key element to motivate or involve people to achieve the challenges that are proposed to them, for example, in software development organizations. It has a direct impact on productivity and the quality of production. The entire contribution of the person is based on intrinsic motivation [68].
The study starts from a review of the previous selection wherein experts are asked to evaluate the proposed items according to whether they consider them to be game mechanics. The result shows a great dispersion of opinions, so with a consensus of a minimum of 50% of the professionals, a total of 15 mechanics have been obtained, requiring a total of 43 proposed items from the previous test to be thrown out, out of which 17 items have a percentage of coincident selection of 14% or less.
From the selected mechanics, links with the proposed motives are indicated. The most selected motive, with a 55% link, is that of Achievement. According to the definition of gamification and the main objectives, this makes sense because a clear motivation is to overcome challenges and achieve success or excellence. Consequently, many designs are precisely based on this type of objective, and for this, different game elements are applied. The next most linked motives, at 28%, are Autonomy and Hedonism. On the one hand, Autonomy is based on an approach motive, and there is a certain preference for being independent and making decisions autonomously. In the case of Hedonism, which is based on the avoidance motive, the achievement of challenges is pursued, but with some ease, saved effort and reduced tension. In both cases, the personal valuation of the players is appreciated, and in a certain way, these two are also linked to the motive for overcoming challenges through making decisions. With lower percentages of selection are Affiliation, Power and Contribution; these are motivators whose focus lies in the preference to be with others and form a group, with the desire to lead others to win and succeed and with the desire to help and contribute. In this case, as in the case of Achievement, these are concepts closely linked to the objectives of why projects are gamified. The list continues with the values of Cooperation, Exploration and Conservation; in these cases, the motivations are focused on maintaining a type of relationship with others in an egalitarian way, with an interest in variety, innovation and learning and with the value of conserving one’s own property. The motive least linked to mechanics is Certainty; maintaining security and avoiding uncertainty is not a parameter very closely related to gamification, but even so, at 10%, it appears to be important for at least some mechanics.
Taking into account the qualitative evaluation—which captures the point of view behind the choice and offers definitions of the game mechanics—allows us to understand their indicated relations with the motivators. Therefore, our approach allows us to understand not only the result but also the motive for the result.
From these results, the percentages of motives selected according to the game mechanics are indicated. The significant value of this type of information is based on the fact that the selection of an appropriate element for a gamified design is decided based on the motives personalized according to the players’ profiles. Therefore, it is key information to be effective in the initial phase of a proposal.
The mechanism with the greatest consensus in the selection of the motive is that of Group quests, with a 100% percentage link to Cooperation; knowledge of this motive can add value in how to include this parameter. This motive is centered on the desire of users to maintain a type of egalitarian relationship, thereby avoiding power and rivalry.
The mechanics with the highest consensus are those of Exploration, Competition and Challenges. In the case of Exploration, the linkage is 75% with Exploration. Although this is a high percentage, not linking it with the eponymous motive would be striking. By definition, Exploration describes a user who likes to explore, learn and discover. However, for this mechanic, some of the consultant’s highlight autonomy when making decisions and the achievement or objective in achieving challenges. Competition is mostly linked to the desire to help others and contribute to society; therefore, experts appreciate competition in the field of gamification outside of power and achievement. In the case of Challenges, a concept focused on Achievement is appreciated.
The game mechanics with less consensus among experts is that of Build from scratch because it is divided among five different motives: Autonomy, Achievement, Certainty, Exploration and Contribution. All of these motives are based on the preference to be independent, to achieve challenges to achieve excellence, to achieve security with an interest in learning and the desire to help others.
As a result of the study, a classification of the mechanics is obtained with the priority motive. From these data, experts can choose the appropriate mechanics for their potential players and can, in this way, ensure more effective gamification.

5. Conclusions

Carrying out the study using the evaluations of gamification experts allows us to obtain subjective results through quantitative data and related qualitative data. Developing a study leveraging an iterative design and the participation of experts is key to adding value to this type of proposal and, therefore, was a decision needing to be made in the design phase.
The realization of the study of motivators using a questionnaire administered in the market of potential players allows us to achieve rigor in the results obtained and very valuable information when making decisions. When decisions are made with game mechanics, potential players have the necessary association to understand the profile.
It would be very beneficial to obtain a certain consensus in the materials that can be used at the design level of a gamified product to select the most used game mechanics. The research has made it possible to understand the need for a study that would allow the extraction of the items, but even so, a second study has again seen differing opinions among the experts.
The motivators should not be interpreted as enhancing elements alone; they can also be elements to mitigate. If the stimuli of the player profiles are known, the experts, depending on the objectives of the project, can decide what they are interested in using.
Engagement is essential when considering this type of system, so understanding the stimulus and real emotions of the players allows the creation of a more effective system. In the case of the application of the results in our current Game4City 3.0 project, we have taken into account the need to adapt the interaction of the gamified system as a function of the user to maximize the engagement. Additionally, we have identified how different types of profiles use a gamified environment and interact in significantly different ways, illuminating the need to personalize this interaction. Students perceive the use of new representative systems to have great exploitative potential for their architectural projects and have high motivation to continue their training in these methods and systems. However, once specific training has been implemented, such as that proposed in the subject, there is still a certain resistance to its widespread use, even when accompanied by high levels of satisfaction and aid in the spatial understanding of the project.
By analyzing engagement with teachers and professionals, it can be perceived that part of the problem lies in the lack of training of professors in these systems. Typical professors who use CAD and photographic composition systems do not have the necessary training in new technologies that allow their use to be transversally promoted within their subjects. Due to this lack of use, students do not perceive the usefulness of advanced tools within their training and sense them as complex training. The present study could help define a gamified system adapted to the motives of the students and thus propose a more effective type of education focused on their needs. On the other hand, the individuals who have played with the Game4City 3.0 proposals describe a high level of engagement, autonomy, exploration and valuable contribution to the space design, identifying different aspects that were not contemplated in the initial architectural and urban projects. These positive results can be related to the previous experience realized by the game designers who participated in the current experience, who have identified some motivators to empower in the design and implementation of the architectural project.
As a next step and as part of the iterative design process, the results obtained should be analyzed in the application of a project design to understand their effectiveness in decision making, with regard to the interpretation and training of experts before the evaluation of the results of the motivation questionnaires, and for the degree of effectiveness of the gamified design.

Author Contributions

Conceptualization, E.V. and D.F.; methodology, E.V., D.F. and S.F.-G.; validation, E.V., D.F. and S.F.-G.; formal analysis, E.V., D.F. and S.F.-G.; investigation, E.V.; resources, E.V., D.F. and S.F.-G.; data curation, E.V. and D.F.; writing—original draft preparation, E.V., D.F. and S.F.-G.; writing—review and editing, E.V., D.F., P.B. and S.F.-G.; visualization, E.V., E.P., and D.F.; supervision, D.F. and S.F.-G.; project administration, D.F. and E.P.; funding acquisition, E.V., D.F., E.P. and S.F.-G. All authors have read and agreed to the published version of the manuscript.

Funding

This research has been partially funded by the ‘Secretaria d’Universitats i Recerca’ of the Department of Business and Knowledge of ‘Generalitat de Catalunya’ (grant identification “2017 SGR 934”), and also supported by the National Program of Research, Development and Innovation aimed to the Society Challenges with the references BIA2016-77464-C2-1-R & BIA2016-77464-C2-2-R, both of the National Plan for Scientific Research, Development and Technological Innovation 2013-2016, Government of Spain, titled “Gamificación para la enseñanza del diseño urbano y la integración en ella de la participación ciudadana (ArchGAME4CITY)”, & “Diseño Gamificado de visualización 3D con sistemas de realidad virtual para el estudio de la mejora de competencias motivacionales, sociales y espaciales del usuario (EduGAME4CITY)”. (AEI/FEDER, UE).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Paravati, G.; Gatteschi, V. Human-Computer Interaction in Smart Environments. Sensors 2015, 15, 19487–19494. [Google Scholar] [CrossRef] [Green Version]
  2. Villegas, E.; Labrador, E.; Fonseca, D.; Fernández-Guinea, S.; Moreira, F. Design Thinking and Gamification: User Centered Methodologies. In Proceedings of the 21st International Conference on Human-Computer Interaction (HCII 2019), Orlando, FL, USA, 26–31 July 2019; Volume 11590, pp. 115–124. [Google Scholar]
  3. L’Heureux, A.; Grolinger, K.; Higashino, W.A.; Capretz, M.A. A Gamification Framework for Sensor Data Analytics. In Proceedings of the 2017 IEEE International Congress on Internet of Things (ICIOT), Honolulu, HI, USA, 25–30 June 2017; pp. 74–81. [Google Scholar] [CrossRef] [Green Version]
  4. Méndez, J.I.; Mata, O.; Ponce, P.; Meier, A.; Peffer, T.; Molina, A. Multi-sensor system, gamification, and artificial intelligence for benefit elderly people. In Studies in Systems, Decision and Control; Springer International Publishing: New York, NY, USA, 2020; Volume 273, pp. 207–235. [Google Scholar] [CrossRef]
  5. Deliyannis, I.; Kaimara, P. Developing Smart Learning Environments Using Gamification Techniques and Video Game Technologies. In Didactics of Smart Pedagogy for Technology Enhanced Learning; Springer: Berlin/Heidelberg, Germany, 2018; pp. 285–307. [Google Scholar]
  6. De la Hermosa, L.R.E.; Portero, V.E. Unir Gamificación y Experiencia de Usuario para mejorar la experiencia docente. RIED. Rev. Iberoam. Educ. Distancia 2016, 19, 125–142. [Google Scholar]
  7. Nielsen, J. Iterative user-interface design. Computer 1993, 26, 32–41. [Google Scholar] [CrossRef]
  8. Jakob, N. Mental Models. 2010. Available online: http://www.nngroup.com/articles/mental-models (accessed on 1 March 2021).
  9. Leung, L. Validity, reliability, and generalizability in qualitative research. J. Fam. Med. Prim. Care 2015, 4, 324–327. [Google Scholar] [CrossRef]
  10. Aspers, P.; Corte, U. What is Qualitative in Qualitative Research. Qual. Sociol. 2019, 42, 139–160. [Google Scholar] [CrossRef] [Green Version]
  11. Ellis, D. Qualitative evaluation and research methods. Int. J. Inf. Manag. 1990, 10, 323. [Google Scholar] [CrossRef]
  12. Villegas, E.; Labrador, E.; Fonseca, D.; Fernández-Guinea, S. Methodology I’M IN applied to workshop: Successful educational practice for consultants in user experience with gamification fields. Univers. Access Inf. Soc. 2019, 18, 507–521. [Google Scholar] [CrossRef]
  13. Fonseca, D.; Villagrasa, S.; Navarro, I.; Redondo, E.; Valls, F.; Sánchez, A. Urban Gamification in Architecture Education. In Proceedings of the 5th World Conference on Information Systems and Technologies (WorldCIST 2017), Madeira, Portugal, 11–13 April 2017; Volume 571, pp. 335–341. [Google Scholar]
  14. Redondo, E.; Giménez, L.; Navarro, I.; Fonseca, D. “Gamification” for teaching collaborative urban design and citizen participation. In Proceedings of the Congreso Internacional de Expresión Gráfica Arquitectónica (EGA 2020), Zaragoza, Spain, 4–6 June 2020; pp. 431–441. [Google Scholar] [CrossRef]
  15. Fonseca, D.; Valls, F.; Redondo, E.; Villagrasa, S. Informal interactions in 3D education: Citizenship participation and assessment of virtual urban proposals. Comput. Hum. Behav. 2016, 55, 504–518. [Google Scholar] [CrossRef] [Green Version]
  16. Sanchez-Sepulveda, M.; Fonseca, D.; Franquesa, J.; Redondo, E. Virtual interactive innovations applied for digital urban transformations. Mixed approach. Futur. Gener. Comput. Syst. 2019, 91, 371–381. [Google Scholar] [CrossRef]
  17. Valls, F.; Redondo, E.; Fonseca, D.; Torres-Kompen, R.; Villagrasa, S.; Martí, N. Urban data and urban design: A data mining approach to architecture education. Telemat. Inform. 2018, 35, 1039–1052. [Google Scholar] [CrossRef]
  18. Sanchez-Sepulveda, M.V.; Fonseca, D.; Franquesa, J.; Redondo, E.; Moreira, F.; Villagrasa, S.; Peña, E.; Martí, N.; Canaleta, X.; Montero, J.A. Collaborative Design of Urban Spaces Uses: From the Citizen Idea to the Educational Virtual Development. In Proceedings of the 21st International Conference on Human-Computer Interaction (HCII 2019), Orlando, FL, USA, 26–31 July 2019; pp. 253–269. [Google Scholar] [CrossRef]
  19. Calvo, X.; Fonseca, D.; Sánchez-Sepúlveda, M.; Amo, D.; Llorca, J.; Redondo, E. Programming Virtual Interactions for Gamified Educational Proposes of Urban Spaces. In Proceedings of the International Conference on Learning and Collaboration Technologies (LCT 2018), Las Vegas, NV, USA, 15–20 July 2018; pp. 128–140. [Google Scholar] [CrossRef]
  20. Sanchez-Sepulveda, M.V.; Fonseca, D.; García-Holgado, A.; García-Peñalvo, F.J.; Franquesa, J.; Redondo, E.; Moreira, F. Evaluation of an interactive educational system in urban knowledge acquisition and representation based on students’ profiles. Expert Syst. 2020, 37, e12570. [Google Scholar] [CrossRef]
  21. Sanchez-Sepulveda, M.V.; Marti-Audi, N.; Fonseca-Escudero, D. Visual technologies for urban design competences in architecture education. In Proceedings of the 7th International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM 2019), León, Spain, 16–18 October 2019; pp. 726–731. [Google Scholar]
  22. Ryan, R.M.; Rigby, C.S.; Przybylski, A.K. The Motivational Pull of Video Games: A Self-Determination Theory Approach. Motiv. Emot. 2006, 30, 344–360. [Google Scholar] [CrossRef]
  23. Amir, B.; Ralph, P. Proposing a theory of gamification effectiveness. In Proceedings of the 36th International Conference on Software Engineering, Hyderabad, India, 31 May–7 June 2014; pp. 626–627. [Google Scholar]
  24. Ryan, R.M.; Deci, E.L. La Teoría de la Autodeterminación y la Facilitación de la Motivación Intrínseca, el Desarrollo Social, y el Bienestar Teoría de la Autodeterminación. Am. Psychol. 2000, 55, 68–78. [Google Scholar] [CrossRef]
  25. Robertson, M. Can’t Play, Won’t Play; Hide&Seek. 2010. Available online: https://kotaku.com/cant-play-wont-play-5686393 (accessed on 1 March 2021).
  26. Hunicke, R.; LeBlanc, M.; Zubek, R. MDA: A formal approach to game design and game research. In Proceedings of the AAAI Workshop on Challenges in Game AI, San José, CA, USA, 25–26 July 2004; Volume 4, p. 1722. [Google Scholar]
  27. Franklin, A.L.L. Stakeholder Engagement; Springer: Berlin/Heidelberg, Germany, 2020. [Google Scholar]
  28. Sailer, M.; Hense, J.; Mandl, H.; Klevers, M. Psychological perspectives on motivation through gamification. Interact. Des. Archit. 2014, 19, 28–37. [Google Scholar]
  29. Mollick, E.R.; Rothbard, N. Mandatory Fun: Gamification and the Impact of Games at Work. 2013. Available online: https://ssrn.com/abstract=2277103 (accessed on 1 March 2021).
  30. Savignac, E. Gamification of Work: The Use of Games in the Workplace; Wiley Publishing: New York, NY, USA, 2017. [Google Scholar]
  31. Norman, D.A. Emotion & design. Interactions 2002, 9, 36–42. [Google Scholar] [CrossRef]
  32. O’Donohoe, S.; Vedrashko, I. Game-Based Marketing: Inspire Customer Loyalty Through Rewards, Challenges, and Contests. Int. J. Advert. 2011, 30, 189–190. [Google Scholar] [CrossRef]
  33. Tondello, G.F.; Wehbe, R.R.; Diamond, L.; Busch, M.; Marczewski, A.; Nacke, L.E. The Gamification User Types Hexad Scale. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY 2016), Austin, TX, USA, 16–19 October 2016; pp. 229–243. [Google Scholar]
  34. Brave, S.; Nass, C.; Hutchinson, K. Computers that care: Investigating the effects of orientation of emotion exhibited by an embodied computer agent. Int. J. Human-Comput. Stud. 2005, 62, 161–178. [Google Scholar] [CrossRef]
  35. Slama, M.E. Emotions and life: Perspectives from psychology, biology, and evolution. Psychol. Mark. 2004, 22, 97–101. [Google Scholar] [CrossRef]
  36. Somrak, A.; Pogačnik, M.; Guna, J. Suitability and Comparison of Questionnaires Assessing Virtual Reality-Induced Symptoms and Effects and User Experience in Virtual Environments. Sensors 2021, 21, 1185. [Google Scholar] [CrossRef]
  37. Gómez-Barrón, J.-P.; Manso-Callejo, M.-Á.; Alcarria, R. Needs, drivers, participants and engagement actions: A framework for motivating contributions to volunteered geographic information systems. J. Geogr. Syst. 2019, 21, 5–41. [Google Scholar] [CrossRef]
  38. Siang, A.C.; Rao, R.K. Theories of learning: A computer game perspective. In Proceedings of the IEEE 5th International Symposium on Multimedia Software Engineering (ISMSE 2003), Taichung, Taiwan, 10–12 December 2003; pp. 239–245. [Google Scholar]
  39. Alsawaier, R.S. The effect of gamification on motivation and engagement. Int. J. Inf. Learn. Technol. 2018, 35, 56–79. [Google Scholar] [CrossRef]
  40. Reiners, T.; Wood, L.C. Gamification in Education and Business; Springer: Berlin/Heidelberg, Germany, 2015. [Google Scholar]
  41. Rienzo, A.; Cubillos, C. Playability and Player Experience in Digital Games for Elderly: A Systematic Literature Review. Sensors 2020, 20, 3958. [Google Scholar] [CrossRef]
  42. Kumar, J. Gamification at work: Designing engaging business software. In Proceedings of the International Conference of Design, User Experience, and Usability (DUXU 2013), Las Vegas, NV, USA, 21–26 July 2013; pp. 528–537. [Google Scholar] [CrossRef]
  43. Xi, N.; Hamari, J. Does gamification satisfy needs? A study on the relationship between gamification features and intrinsic need satisfaction. Int. J. Inf. Manag. 2019, 46, 210–221. [Google Scholar] [CrossRef]
  44. Labrador, E.; Villegas, E. Sistema Fun Experience Design (FED) Aplicado en el Aula. ReVisión 2014, 7, 6. [Google Scholar]
  45. Yee, N. Motivations for Play in Online Games. CyberPsychol. Behav. 2006, 9, 772–775. [Google Scholar] [CrossRef] [PubMed]
  46. Flatla, D.R.; Gutwin, C.; Nacke, L.E.; Bateman, S.; Mandryk, R.L. Calibration games: Making calibration tasks enjoyable by adding motivating game elements. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST 2011), Santa Barbara, CA, USA, 16–19 October 2011; pp. 403–412. [Google Scholar]
  47. Villegas, E.; Labrador, E.; Fonseca, D.; Fernández-Guinea, S. Validating Game Mechanics and Gamification Parameters with Card Sorting Methods. In Proceedings of the Advances in Intelligent Systems and Computing, Lviv, Ukraine, 17–19 September 2019. [Google Scholar]
  48. Chou, Y.-K. Octalysis: Complete Gamification Framework. Available online: https://yukaichou.com/gamification-examples/octalysis-complete-gamification-framework/ (accessed on 1 March 2021).
  49. Jiménez, S. Gamification Model Canvas/Game Marketing. Available online: https://gecon.es/gamification-model-canvas-evolution/ (accessed on 1 March 2021).
  50. Marczewski, A. 48 Gamification Elements, Mechanics and Ideas. Available online: https://www.gamified.uk/user-types/gamification-mechanics-elements/ (accessed on 1 March 2021).
  51. Ašeriškis, D.; Damaševičius, R. Computational evaluation of effects of motivation reinforcement on player retention. J. Univers. Comput. Sci. 2017, 23, 432–453. [Google Scholar]
  52. Vyvey, T.; Castellar, E.N.; Van Looy, J. Loaded with Fun? The Impact of Enjoyment and Cognitive Load on Brand Retention in Digital Games. J. Interact. Advert. 2018, 18, 72–82. [Google Scholar] [CrossRef]
  53. Craik, F.I.M.; Lockhart, R.S. Levels of processing: A framework for memory research. J. Verbal Learn. Verbal Behav. 1972, 11, 671–684. [Google Scholar] [CrossRef]
  54. De Valderrama, B.G.F.; Martín, S.E.; Moreno, L.L. Análisis de Perfil Motivacional; TEA Ediciones: Madrid, Spain, 2015. [Google Scholar]
  55. Valderrama, B.; Capacidad, D.E.P.A. La Rueda De Motivos: Hacia Una Tabla Periódica De La Motivación Humana. Pap. Psicólogo Psychol. Pap. 2018, 39, 60–70. [Google Scholar] [CrossRef] [Green Version]
  56. Valderrama, B. Motivación Inteligente: El Impulso para Lograr tus Metas; Pearson Educación: Madrid, Spain, 2010. [Google Scholar]
  57. Al Marshedi, A.; Wanick, V.; Wills, G.B.; Ranchhod, A. Gamification and Behaviour. In Gamification; Springer International Publishing: Cham, Switzerland, 2016; pp. 19–29. [Google Scholar] [CrossRef]
  58. Anderson, N.S.; Norman, D.A.; Draper, S.W. User Centered System Design: New Perspectives on Human-Computer Interaction. Am. J. Psychol. 1988, 101, 148. [Google Scholar] [CrossRef]
  59. Pifarré, M.; Tomico, O. Bipolar laddering (BLA): A participatory subjective exploration method on user experience. In Proceedings of the 2007 Conference on Designing for User eXperiences (DUX 2007), Chicago, IL, USA, 5–7 November 2007; pp. 2–13. [Google Scholar]
  60. Gaeta, E.; Beltrán-Jaunsaras, M.E.; Cea, G.; Spieler, B.; Burton, A.; García-Betances, R.I.; Cabrera-Umpiérrez, M.F.; Brown, D.; Boulton, H.; Waldmeyer, M.T.A. Evaluation of the Create@School Game-Based Learning–Teaching Approach. Sensors 2019, 19, 3251. [Google Scholar] [CrossRef] [Green Version]
  61. Nielsen, J. Why You Only Need to Test with 5 Users. 2000. Available online: http://www.useit.com/alertbox/20000319.html (accessed on 1 March 2021).
  62. Samuels, P. What Is Ideal Sample Size in Qualitative Research? Green Book Directory. 2016. Available online: https://www.greenbook.org/marketing-research/What-is-the-ideal-Sample-Size-in-Qualitative-Research-1022244#:~:text=What%20is%20the%20ideal%20sample%20size%20in%20qualitative%20research%3F,-We’ll%20answer&text=Our%20general%20recommendation%20for%20in,the%20population%20integrity%20in%20recruiting (accessed on 23 January 2021).
  63. Vasileiou, K.; Barnett, J.; Thorpe, S.; Young, T. Characterizing and justifying sample size sufficiency in interview-based studies: Systematic analysis of qualitative health research over a 15-year period. BMC Med. Res. Methodol. 2018, 18, 1–18. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  64. Valencia, K.; Rusu, C.; Quiñones, D.; Jamet, E. The Impact of Technology on People with Autism Spectrum Disorder: A Systematic Literature Review. Sensors 2019, 19, 4485. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  65. Cabero-Almenara, J.; Cejudo, L.M. La aplicación del juicio de experto como técnica de evaluación de las tecnologías de la información y comunicación (TIC). Eduweb 2013, 7, 11–22. [Google Scholar]
  66. Escobar-Pérez, J.; Cuervo-Martínez, Á. Validez De Contenido Y Juicio De Expertos: Una Aproximación a Su Utilización. Av. Med. 2008, 6, 27–36. [Google Scholar]
  67. Delgado-Rico, E.; Carretero-Dios, H.; Ruch, W. Content validity evidences in test development: An applied perspective. Int. J. Clin. Health Psychol. 2012, 12, 449–460. [Google Scholar] [CrossRef]
  68. Steffens, F.; Marczak, S.; Filho, F.F.; Treude, C.; Singer, L.; Redmiles, D.; Alani, B. Using Gamification as a Collaboration Motivator for Software Development Teams: A Preliminary Framework. In Proceedings of the Brazilian Symposium on Collaborative Systems, Salvador, Brazil, 3–6 November 2014. [Google Scholar]
Figure 1. Representation of Core engagement loop model.
Figure 1. Representation of Core engagement loop model.
Sensors 21 02556 g001
Figure 2. Previous evaluation with the Open Card Sorting Method: (a) image of the classification of mechanics made by User 2; (b) image of the classification of mechanics made by User 3.
Figure 2. Previous evaluation with the Open Card Sorting Method: (a) image of the classification of mechanics made by User 2; (b) image of the classification of mechanics made by User 3.
Sensors 21 02556 g002
Figure 3. Percentage of motives related to mechanics.
Figure 3. Percentage of motives related to mechanics.
Sensors 21 02556 g003
Table 1. List of mechanics used in the test.
Table 1. List of mechanics used in the test.
Game Mechanics
1Access30Meaning/Purpose
2Achievements31Milestone unlocks
3Avatar32Miniquests
4Badges33On boarding/Tutorials
5Boss fights34Points/Experience points (XP)
6Branching choices35Progress bar
7Build from scratch36Quest lists
8Caretaking37Real prizes
9Catalogue38Real-time control
10Challenges39Sharing knowledge
11Collection sets40Signposting
12Competition41Social discovery
13Count down42Social network
14Creativity tools43Social status
15Customization44Social treasure/Gifting
16Development tools45Status points
17Easter eggs46Status quo sloth
18Exchangeable points47Step-by-step overlay tutorial
19Exploration48Theme
20Free lunch49Time dependent
21Gifting/Sharing50To attend an appointment
22Group quests51To enhance the identity
23Guilds/Teams52To visualize the progress
24High five53To win a reward
25Innovation platform54Unlockable/Rare content
26Inventory55Virtual currency
27Leader board56Virtual goods
28Levels/Progression57Virtual storytelling
29Lottery/Game of chance58Voting/Voice
Table 2. Correspondence between closeness and avoidance motives.
Table 2. Correspondence between closeness and avoidance motives.
ClosenessAvoidance
AutonomyAffiliation
PowerCooperation
AchievementHedonism
ExplorationCertainty
ContributionConservation
Table 3. Game mechanics selected by the experts. Bold marks mechanics with selection rate ≥50%.
Table 3. Game mechanics selected by the experts. Bold marks mechanics with selection rate ≥50%.
Evaluation of Game Mechanics
Sharing knowledge93%Quest lists36%
Exploration64%Real-time control36%
Gifting/Sharing64%Achievements29%
Voting/Voice64%Creativity tools29%
Boss fights57%Free lunch29%
Competition57%Points/Experience points (XP)29%
Milestone unlocks57%Social treasure/Gifting29%
Miniquests57%Time dependent29%
To attend an appointment57%Avatar21%
To win a reward57%Badges21%
Build from scratch50%Development tools21%
Challenges50%Real prizes21%
Exchangeable points50%Step-by-step overlay tutorial21%
Group quests50%Virtual storytelling21%
To enhance the identity50%Inventory14%
Branching choices43%Leader board14%
Caretaking43%On boarding/Tutorials14%
Collection sets43%Social discovery14%
Customization43%Social network14%
Easter eggs43%Social status14%
High five43%Unlockable/Rare content14%
Levels/progression43%Access7%
Lottery/game of chance43%Catalogue7%
To visualize the progress43%Innovation platform7%
Count down36%Meaning/Purpose7%
Guilds/teams36%Signposting7%
Progress bar36%Virtual goods7%
Table 4. Motivators according to the percentage of links made with the game mechanics.
Table 4. Motivators according to the percentage of links made with the game mechanics.
Motives
Achievement55%
Autonomy28%
Hedonism28%
Affiliation26%
Power26%
Contribution22%
Cooperation19%
Exploration19%
Conservation14%
Certainty10%
Table 5. Motives of Closeness.
Table 5. Motives of Closeness.
AutonomyPowerAchievementExplorationContribution
Sharing knowledge 8% 34%
Exploration12% 13%75%
Gifting/Sharing 13% 50%
Voting/Voice20%40% 40%
Boss fights 50%38%
Competition 67%17% 16%
Milestone unlocks 50% 13%
Miniquests 25%50%
To attend an appointment13% 12%12%
To win a reward 11%56%
Build from scratch25% 37%13%12%
Challenges 13%63%
Exchangeable points 15%14% 14%
Group quests
To enhance the identity37% 13%
Table 6. Motives of Avoidance.
Table 6. Motives of Avoidance.
AffiliationCooperationHedonismCertaintyConservation
Sharing knowledge8%50%
Exploration
Gifting/Sharing 25%12%
Voting/Voice
Boss fights12%
Competition
Milestone unlocks 37%
Miniquests 12% 13%
To attend an appointment50%13%
To win a reward 33%
Build from scratch 13%
Challenges12%12%
Exchangeable points 57%
Group quests 100%
To enhance the identity12% 38%
Table 7. Selected motives for each mechanic.
Table 7. Selected motives for each mechanic.
MechanicsMotives
1Sharing knowledgeCooperation
2ExplorationExploration
3Gifting/SharingContribution
4Voting/VoicePower/Contribution
5Boss fightsPower
6CompetitionPower
7Milestone unlocksAchievement
8MiniquestsExploration
9To attend an appointmentAffiliation
10To win a rewardAchievement
11Build from scratchAchievement
12ChallengesAchievement
13Exchangeable pointsCooperation
14Group questsCooperation
15To enhance the identityAutonomy/Hedonism
Table 8. Mechanics related to the different motivators.
Table 8. Mechanics related to the different motivators.
Mechanics for CooperationMotives
Sharing knowledgeCooperation
Exchangeable pointsCooperation
Group questsCooperation
Mechanics for ExplorationMotives
ExplorationExploration
MiniquestsExploration
Mechanics for ContributionMotives
Gifting/SharingContribution
Voting/VoicePower/Contribution
Mechanics for PowerMotives
Voting/VoicePower/Contribution
Boss fightsPower
CompetitionPower
Mechanics for AchievementMotives
Milestone unlocksAchievement
To win a rewardAchievement
Build from scratchAchievement
ChallengesAchievement
Mechanics for Autonomy/HedonismMotives
To enhance the identityAutonomy/Hedonism
Mechanics for AffiliationMotives
To attend an appointmentAffiliation
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Villegas, E.; Fonseca, D.; Peña, E.; Bonet, P.; Fernández-Guinea, S. Qualitative Assessment of Effective Gamification Design Processes Using Motivators to Identify Game Mechanics. Sensors 2021, 21, 2556. https://doi.org/10.3390/s21072556

AMA Style

Villegas E, Fonseca D, Peña E, Bonet P, Fernández-Guinea S. Qualitative Assessment of Effective Gamification Design Processes Using Motivators to Identify Game Mechanics. Sensors. 2021; 21(7):2556. https://doi.org/10.3390/s21072556

Chicago/Turabian Style

Villegas, Eva, David Fonseca, Enric Peña, Paula Bonet, and Sara Fernández-Guinea. 2021. "Qualitative Assessment of Effective Gamification Design Processes Using Motivators to Identify Game Mechanics" Sensors 21, no. 7: 2556. https://doi.org/10.3390/s21072556

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop