Next Article in Journal
Can Digital Economy Development Facilitate Corporate ESG Performance?
Previous Article in Journal
Changes in Forest Cover of Municipalities in Poland in 1990–2018
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Methodological Framework for Assessing the Agroecological Performance of Farms in Portugal: Integrating TAPE and ACT Approaches

by
Inês Costa-Pereira
1,2,*,
Ana A. R. M. Aguiar
3,
Fernanda Delgado
4,5 and
Cristina A. Costa
1,2
1
IPV-ESA-Polytechnic Institute of Viseu, Agrarian School, Quinta da Alagoa Estrada de Nelas, 3500-606 Viseu, Portugal
2
CERNAS-IPV-Centre for Natural Resources, Environment and Society, Polytechnic Institute of Viseu, Polytechnic Campus, 3504-510 Viseu, Portugal
3
GreenUPorto—Sustainable Agrifood Production Research Centre/Inov4Agro, DGAOT, Faculty of Sciences, Campus de Vairão, University of Porto, Rua da Agrária 747, 4485-646 Vairão, Portugal
4
IPCB-ESA-Polytechnic Institute of Castelo Branco, Agrarian School, Quinta da Senhora de Mércules, Apartado 119, 6001-909 Castelo Branco, Portugal
5
CERNAS-IPCB-Research Centre for Natural Resources, Environment and Society, Polytechnic Institute of Castelo Branco, 6001-909 Castelo Branco, Portugal
*
Author to whom correspondence should be addressed.
Sustainability 2024, 16(10), 3955; https://doi.org/10.3390/su16103955
Submission received: 28 February 2024 / Revised: 2 May 2024 / Accepted: 4 May 2024 / Published: 9 May 2024

Abstract

:
Agroecology integrates science, social movements, and agricultural practices, playing a central role in the sustainability of food systems. It addresses agroecosystems and food systems holistically; however, defining whether a farm is agroecological remains a challenge. This article proposes a methodology to measure farms’ agroecological performance, adapted to the family farming context in Portugal. The aim of the developed methodology is to compare the agroecological performance of family farms (conventional and non-conventional), providing information about anchors for agroecological transition and supporting public policies. A literature review identified existing farm evaluation methodologies, with Tool for Agroecological Performance Evaluation (TAPE) and Agroecology Criteria Tool (ACT) scoring highest in an assessment process. Questions from both were integrated into a questionnaire for family farmers. This field work provided critical insights towards the methodologies: (1) territorial adaptability; (2) transition constraints’ origin; and (3) use of non-academic language. The results were incorporated into the developed methodology, which combines the TAPE indicator matrix and Gliessman’s five levels of food system change, the latter of which provides the framework for the ACT. This study made it possible to identify the most relevant aspects for characterizing family farmers/farms and the importance of how the evaluation criteria/indicators are ordered by element/theme, as it alters the values of each farm’s agroecological performance.

1. Introduction

The impacts of conventional agriculture systems are recognized at the environmental level (biodiversity loss, water pollution, and scarcity of natural resources) [1,2,3,4,5,6], human health level (rates of malnutrition and hunger and intoxication of farmers and consumers) [7,8,9,10], and the level of rural territories (inadequate payments to farmers and rural abandonment) [11,12,13]. As an alternative path, agroecology has gained importance in regard to food systems’ sustainability, and its approaches have come to prominence in technical, scientific, and political discourses [14,15,16]. However, agroecology must be supported by public policy that is co-constructed and adapted to each territory as a tool for the transition to more sustainable food systems [17,18].
Agroecology merges sustainable agricultural practices, social movements, and science; and it is more effective when these three dimensions converge [19,20]. The concept of agroecology is dynamic, holistic, and should be applied to the food system, from production to consumption, by integrating action and change aimed towards economic, ecological, and social sustainability. As a social movement, agroecology focuses on creating local food systems that support rural communities’ sustainability by promoting safe food production practices, short food supply chains, and food sovereignty. As a set of agricultural practices, agroecology aims to improve agricultural systems based on natural processes, enhancing interactions and strengthening beneficial synergies between the components of the agroecosystem, using ecological processes and ecosystem services as tools, and reducing dependence on off-farm inputs. As a science, agroecology integrates research, education, action, and change [21,22].
Most agroecological farmers are smallholders and/or family farmers that use traditional and environmentally friendly farming techniques/technologies, such as crop selection and rotation, intercropping, agroforestry, or mulching. They use inputs produced on the farm, and they do not use synthetic fertilizers or pesticides favoring organic fertilization and biological pest control, among other practices. Frequently, agroecological farmers use innovative practices as reduced tillage, drip irrigation, or direct seeding [22,23]. These farmers frequently connect through social networks for the co-creation and exchange of agroecological knowledge and are involved in local food systems [16,22].
For the purpose of this study, we analyzed family farms, as they represent, in Portugal, more than 90% of the country’s single farmers [24]. FAO & IFAD [25] defined family farms as those managed and operated by a family that lives ond the farm and provide the majority of the farm labor. Moreover, family farming is recognized as going beyond the productive or economic perspective of modern and intensive agriculture because it preserves and transmits local knowledge, protects the natural resources, and ensures food security for the families [26].
Recent studies, carried out in the north and center of Portugal, reveal that family farms maintain a majority of sustainable practices. However, to sustain the agroecological transition, it is necessary to identify and overcome compromising practices that are detrimental to public and environmental health—e.g., the use of synthetic pesticides and fertilizers [16,27,28,29,30]. To support this transition, it is necessary to assess the family farms’ agroecological performance, identifying factors that: (1) can anchor that transition; (2) raise the farmers’ willingness to start the transition process; and (3) advocate for public policies that promote the agroecological transition on Portuguese farms.
Although there are several methodologies to evaluate the farms’ agroecological performance or the farms’ sustainability, their limitations have been identified. The research done by authors such as Widget [31], de Olde [32], Bonisoli [33], or Nicholls [34] state that these methodologies are usually designed to be applied only to a geographical region and/or are based on indicators unable to capture the multifunctionality of the agroecosystem (e.g., economic function or food-production indicators).
Thus, to support the design of public policies that promote the family farms’ agroecological transition in Portugal, a defined methodology is needed to analyze agricultural systems with regard to their territorial context, their role in rural territories, and their pivotal connection with urban territories. It is also necessary to emphasize that, although addressed at a local/national level, the important role of family farming and its lack of support is a global problem that needs to be addressed collectively to give it visibility and strength. This study presents a methodology designed to be used in farms (also) in European contexts, one focused on assessing their agroecological performance by providing information on the anchors for the agroecological transition—the baseline information for the development of co-constructed guidelines for adequate public policies for the agroecological transition.

2. Materials and Methods

To develop the farms agroecological-performance methodology, a systematic literature review was conducted between September and December 2021 using the web platforms and databases Scopus, Web of Science, and Google Scholar. Several combinations of keywords were used, including “agroecology”, “agroecological”, “sustainable”, “transition”, “assessment”, “tool”, and “method”, connected with the boolean operators “AND” and “OR”. This thorough search turned up 12 different combinations.
The main objective of the literature review was to identify the most cited and recognized methodologies for the evaluation of the farms’ agroecological or sustainability performance. A total of 123 records were identified from the referred databases and 27 were selected, based on inclusion and exclusion criteria. The inclusion criteria were: English-language, original articles, published since 2010, focused on methodologies for the evaluation of the agroecological or sustainability performance of farms, and the evaluation of those methodologies. The exclusion criteria were: grey literature on the topics, original articles off topic, and full-texts not available. Of the 27 scientific articles selected, 10 methodologies were compiled: Agroecology Criteria Tool (ACT) and Farm Level Agroecology Criteria Tool (F-ACT), the Indicateurs de Durabilité des Exploitations Agricoles (IDEA), Life Cycle Assessment in Agriculture (LCA-A), Marco para la Evaluacion de los Sistemas de Manejo de Recursos Naturales (MESMIS), Multi-Level Perspective (MLP), Response-Inducing Sustainability Evaluation (RISE), Rural Household Multi-Indicator Survey (RHoMIS), Tool for Agroecology Performance Evaluation (TAPE), and Sustainability Assessment of Food and Agriculture Systems (SAFA).
To analyze the 10 selected methodologies, a procedure for their evaluation was developed based on the studies carried out by Binder [35], de Olde [32], Talukder & Blay-Palmer [36], and Bonisoli [33], related to their normative dimension (focused on the methodology evaluation) and procedural dimension (focused on how the assessment was carried out). The criteria selected were those that best responded to the objective and purpose of the methodology to be developed. For the normative dimension, the goal-setting approach; for the procedural dimension, the methodology simplicity, time requirement, assessment purpose, indicators and attributes, target group, stakeholders’ participation, geographical application, and assessment level; as shown in Table 1.
The evaluation of the 10 selected methodologies, using the normative and procedural dimensions, consisted of assigning a value of 0 (zero) when the criteria was absent and 1 (one) when it was present. The methodologies with the highest scores were those with the presence of most of the criteria selected. The results of the methodologies’ evaluation are presented in Table 2, were each column sums the results obtained from each criterion (e.g., for the criteria “methodology simplicity”, ACT scored 1 in ”graphic visualization of the results”, “free access to software”, “easy access to software”, and “free access to tutorials” resulting in a total score of 4). The methodologies with the highest scores (TAPE and ACT) were the ones selected for the next step.
Based on the content of the selected methodologies (TAPE and ACT), a set of questions was integrated in the questionnaire applied to family farmers. This questionnaire was organized to respond the TAPE Grid of Indicators (Step1) and Evaluation Criteria (Step 2) and to the ACT questions, aiming to verify the suitability of these methodologies to assess Portuguese family farmers’ agroecological performance.
TAPE was created by the Food and Agriculture Organization (FAO) to evaluate different production systems, including forestry, aquaculture, fisheries, and agricultural production, adaptable to different cultural and context circumstances. Four steps make up the TAPE process. STEP 0: gather relevant data on the area of study, important for step 3. STEP 1: evaluation, through the application of a questionnaire to farmers and a grid of 35 indicators, of the FAO’s 10 elements of agroecology: recycling, efficiency, diversity, resilience, synergies, co-creation and sharing of knowledge, cultural and food traditions, human and social values, circular and solidarity economy, and responsible governance. The grid of indicators assessment is based on descriptive scales for evaluation ranging from 0 (indicative of lower agroecological performance) to 4 (indicative of higher agroecological performance). STEP 2: analysis of the 10 Evaluation Criteria: agrobiodiversity, soil health, production, income, added value, exposure to pesticides, dietary diversity, women’s empowerment, youth job opportunities, and land tenure. These criteria are categorized into three levels: desirable, acceptable, and undesirable. STEP 3: participatory analysis of the results together with the farmers.
The ACT was developed by the Foundation for Ecological Development (Biovision). It is rooted in Gliessman’s [37] categorization of the five levels representing the transition of food systems. These levels involve (1) enhancing the efficiency of conventional and industrial practices, (2) substituting conventional or industrial inputs with more sustainable alternatives, (3) redesigning entire agroecosystems, (4) reestablishing connections between growers and consumers through the development of alternative food networks, and ultimately, (5) restructuring the global food system to ensure sustainability and equity for all. These levels are aligned with eleven elements: regulation and balance, plus FAO’s 10 elements of agroecology. The transition criteria defined (62 in total), can be answered with a 0 (if absent) or a 1 (if present). The resulting evaluations can be presented individually or collectively for a range of farms.
The questionnaire was applied, in a face-to-face interview, to eight family farmers between April and August 2022 in the Centre (Fundão, Mangualde, Viseu, and Vouzela municipalities) and South (Arraiolos and Évora municipalities) of Portugal (Figure 1). The contact with the family farmers was done through partnerships with local development organizations and farmers’ associations.

3. Results

In the evaluation of the normative and procedural dimensions of the 10 selected methodologies for the evaluation of the farms’ agroecological or sustainability performance, the highest score was 18 points, achieved by both TAPE and ACT (Table 2).
Table 2. Analysis of the 10 methodologies for farms’ sustainability/agroecology assessment. Valuation criteria were scored as Yes (1)/No (0). Each cell presents the result obtained on each criterion (e.g., on the criterion “methodology simplicity”, ACT scored 1 in ”graphic visualization of the results”, “free access to software”, “easy access to software”, and “free access to tutorials”, making its score 4 in total).
Table 2. Analysis of the 10 methodologies for farms’ sustainability/agroecology assessment. Valuation criteria were scored as Yes (1)/No (0). Each cell presents the result obtained on each criterion (e.g., on the criterion “methodology simplicity”, ACT scored 1 in ”graphic visualization of the results”, “free access to software”, “easy access to software”, and “free access to tutorials”, making its score 4 in total).
Normative DimensionProcedural Dimension
MethodologyGoal Setting Approach: Bottom-Up (Stakeholder) OR Top-Down (Theory)Methodology Simplicity: Graphic Visualization of the Results AND/OR Free Access to the Software AND/OR Easy to Access the Software AND/OR Free Access to the TutorialsTime Requirement: More than 5 h OR between 3 and 5 h OR Less than 3 hAssessment Purpose: Self-Assessment and Guidance OR Assessment and Guidance OR Multiple PurposeIndicators’ Reference Values: Target Values AND/OR Threshold Values AND/OR Relative Values Indicators’ Attributes: Predetermined Indicators AND/OR Specific Criteria for the Indicators’ Selection Presented AND/OR Indicators’ InteractionEnd Users: Farmers AND/OR Policy Makers AND/OR Researchers AND/OR EducatorsStakeholders’ Level of Participation: Whole Process OR Partial OR NoneApplied on: Global North AND/OR Global SouthAssessment Level (Scale): Food System AND/OR Farm System OR Specific ProductionsTotalReferences
ACT (Agroecology Criteria Tool)141113212218[38,39,40]
Farm Level Agroecology
Criteria Tool (F-ACT)
141113111115[41,42]
IDEA (The Indicateurs de Durabilité des Exploitations Agricoles)121211412116[32,33,35,43,44,45,46]
Life Cycle Assessment—Agricultural101112112111[47,48]
MLP (Multi-Level Perspective) on agro-food sustainability transitions101110112210[49,50,51,52,53,54]
MESMIS (Marco para la evaluacion de los sistemas de manejo de recursos naturales)111111311213[33,36,55,56]
RISE (Response-Inducing Sustainability Evaluation)131112312116[32,33,44,46,57]
RHoMIS (Rural Household Multi-Indicator Survey)131112211114[58,59,60,61,62]
TAPE (Tool for Agroecology Performance Evaluation)121123312218[38,63,64,65]
SAFA (Sustainability Assessment of Food and Agriculture Systems)121112302215[32,33,35,44,66]
The questionnaire, prepared with TAPE and ACT questions and criteria, was applied to eight farmers (six men and two women) ranging from 32 to 85 years old. Their educational backgrounds were diverse, ranging from fourth-grade educations to advanced degrees in subjects like philosophy, history, or the arts. Only one farmer had a degree in agronomy (Q5). The farmers had a variety of employment situations: four were retired, two were self-employed with employees, one was self-employed without employees (Q8), and one was an employee in other company (Q2). All farms were polycultural: seven farms included both animals and vegetables, and one included vegetables and olive trees (Q6). One farm does regenerative agriculture (Q8). The size of the farms ranged from 1 to 180 hectares, with the number of parcels ranging from 1 to 30 (Table 3).
Analyzing the results obtained on the eight farms by applying the TAPE Grid of Indicators (Table 4), Farm Q8 stands out in terms of agroecological performance, boasting an average rating of 2.8 (of a possible total of 4.0 values). Following Q8 closely is Farm Q7 (2.4 points). Farm Q8’s distinction lies in its proficiency across a multitude of indicators. It obtained the highest score of 4 points on seven indicators, including ‘Management of Soil Fertility’ and ‘Management of Pest and Diseases’, and the second-highest score of 3 points on 16 indicators. Farm Q7 obtained a maximum score on two indicators, ‘Appropriate Diet and Nutritional Awareness’ and ‘Local or Traditional Identity and Awareness’, and secured a score of 3 on 15 indicators.
On the other hand, Farm Q6 presented the lowest recorded value (1.6), with a score of either 0 or 1 on eight indicators.
The assessment of agroecological performance across the surveyed farms reveals noteworthy trends. The highest average score of 3.0 was observed in two key areas: in ‘Crops indicator from Diversity Element’, indicating a consistent adoption of polycultural practices across all farms; and in ‘Local or Traditional Identity’ and ‘Awareness from the Culture and Food Tradition Element’. The latter, together with the indicator ‘Appropriate Diet and Nutrition Awareness’, garners the second-highest average score of 2.9, emphasize the significant influence of local identity and cultural context on dietary choices. Within the ‘Circular and Solidarity Economy Element’, the indicator measuring ‘Networks of Producers, Relationship with Consumers, and Presence of Intermediaries’ also attains an average score of 2.9. Indeed, the existence of communication channels between producers and consumers, and the participation of agricultural or local development associations, has facilitated the contact with the family farmers interviewed.
Conversely, the lowest average score of 0.6 pertains to the ‘Renewable Energy and Production’ indicator within the ‘Recycling’ element. This suggests limited investment by the surveyed farmers in renewable energy production. Additionally, within the ‘Co-creation and Sharing of Knowledge’ element, two indicators, namely, ‘Platforms for Horizontal Creation and Transfer of Knowledge and Good Practices’ (scoring 0.8), and ‘Access to Agroecological Knowledge and Producers’ Interest in Agroecology’ (scoring 0.9), had the lowest average scores. Despite their participation in producer networks, these farmers do not seem to perceive these platforms as conducive to knowledge exchange or co-creation. This is in line with the general perception that traditional cooperatives have failed, due to structural problems resulting from factors such as the atomization of farms, reduced innovation, low productivity, the advanced age of farmers, low levels of education, and aversion to risk [67].
Moreover, while certain practices closely align with agroecology, such as the adoption of polyculture and the promotion of local culture and traditions, the majority of the interviewed farmers remain unfamiliar with the conceptual framework of agroecology. Similar results were obtained in other Portuguese studies that evaluated the adoption of organic or regenerative practices [28,68,69]. This analysis underscores the fledgling status of agroecology in Portugal, particularly in light of the advanced age demographic of farmers (average age of 64), and their low education level (46.3% only completed primary school and 53.0% have only practical agricultural training) [70]. These demographic characteristics should be taken into consideration when formulating policies, programs, and initiatives, emphasizing the need for targeted efforts to disseminate and promote agroecological principles within the agricultural community.
The values obtained by Farm Q8 reveal important disparities. The lowest values obtained (0 and 1) are related to the lack of governance processes in the area where the farm is located (Mangualde municipality, in the Centre of Portugal). These results reveal the difficulty that farmers, especially family farmers, face in participating in governance structures even when there is still some support from local associations. The highest values (a value of 4) obtained by Farm Q8 are distributed among the elements ‘Diversity’ (the variety of crops and tree species planted is significant), ‘Efficiency’ (the management of soil fertility and of pests and diseases, using biological practices), ‘Resilience’ (income and production are stable and therefore able to increase annually, and there is the ability to recover fully and quickly after shocks/disturbances), ‘Human and Social Values’ (farming family of an young couple who see their future in farming and are keen to continue and improve their activity), and ‘Circular and Solidarity Economy’ (the farmers are part of a network of producers and have their own network of consumers—a Community Supporting Agriculture—CSA—to whom they deliver weekly baskets).
The analysis of the indicators of the FAO’s 10 Elements of Agroecology (Step 1) reveals the intricate array of factors influencing the agroecological performance of a farm. Summarizing the key findings for each of the 10 elements:
(a)
Diversity: As the farms are polycultural, they exhibit high degrees of diversity. However, the reduced diversity of practices, products, and services—in particular, that of Farms Q1, Q2, and Q6—negatively impacts their overall performance in this element.
(b)
Synergies: The results obtained on the eight Farms are variable, meaning that there is some connectivity/interaction between crops/animals/landscape, although this is not consistent on the majority of the farms. The synergies that exist between the different components of production (on and off the farm) are very important and can be the lever for the agroecological transition of a farm.
(c)
Efficiency: The use of synthetic pesticides and fertilizers, and the dependence on outside inputs, results in low values for the ‘Management of Pests and Diseases’ indicator for Farms Q1, Q5, and Q6. On all the farms surveyed, the valorization of residues may be improved.
(d)
Recycling: Most farms have minimal energy production; instead, they often acquire energy from the market. Only two farms (Q7 and Q8) are identified as using water-saving techniques, information that underlines the importance of tackling resource management in the context of agroecological transition.
(e)
Resilience: Most agroecosystems have a good capacity to adapt to climate irregularities, except Farm Q3, which faces challenges in income stability, vulnerability reduction mechanisms, and environmental resilience.
(f)
Culture and Food Tradition: The majority of farmers demonstrate a strong awareness of local traditions and heritage, and a commitment to preserving them through traditional recipes and participation in local fairs and festivities.
(g)
Co-creation and Sharing of Knowledge: While farmers are involved in networks and grassroots organizations, they generally have limited involvement in co-creation and knowledge-sharing initiatives. Awareness of agroecological principles and concepts is low for the majority of the famers interviewed. This factor can be related to the farmers’ age and education levels.
(h)
Human and Social Values: It is difficult to get young people interested in agriculture, and they are rarely present on most farms. Only Farm Q6 has employed a young woman with an interest in working in agriculture, specifically in animal production.
(i)
Circular and Solidarity Economy: Six farms participate in networks of producers and consumers, selling locally and engaging with consumers. Only one farmer (Q8) is part of a CSA.
(j)
Responsible Governance: Farmers rarely participate in governance processes, which points to a lack of local mechanisms for participation.
This detailed analysis provides a comprehensive understanding of the agroecological performance of and challenges faced by the surveyed family farms. It highlights areas where improvements can be made to enhance agroecological practices and sustainability. It also underscores the importance of addressing issues such as knowledge sharing, resource management, and youth engagement in agriculture to promote agroecological transition.
Concerning the application of the TAPE Step 2 (Evaluation of the 10 Criteria), Farms Q2 and Q8 had the most favorable outcomes, or “green lights” in ‘Land Tenure’, ‘Income’, ‘Added Value’, and ‘Dietary Diversity’; Farm Q2 also achieved the best outcomes for ‘Productivity’ and ‘Soil Health’, and Farm Q8 for ‘Pesticide Exposure’ and ‘Agricultural biodiversity’. In contrast, Farm Q5 showed a higher percentage of adverse indicators, or “red lights”, in ‘Income’, ‘Pesticide Exposure’, ‘Women’s Empowerment’, ‘Youth Employment’, and ‘Agricultural biodiversity’ (Table 5).
Summarizing the key findings for each of the 10 criteria:
(a)
Land Tenure: No farms experience insecurity regarding land tenure, but there is a general concern about who will take over the land in the future.
(b)
Productivity: Rather than the size or diversity of the farm, productivity varies. Some farms face challenges in registering their productivity due to the complexity of their activities.
(c)
Income: For most farms, income has either remained stable or improved compared to previous years. Only one large-scale Farm (Q5) experienced a loss in income, most likely as a result of difficulties in the livestock sector.
(d)
Added Value: Only one Farm (Q3) received a red light, indicating challenges in ‘Adding Value’, which can be explained by the farmer’s health problems and the cost of maintaining the animals.
(e)
Exposure to Insecticides: Only Farms Q3 and Q8 received a green light, as they use natural pesticides or implement biological crop protection practices.
(f)
Dietary Diversity: Farm Q4 received a yellow light due to the farmer’s limited diet, likely influenced by their advanced age.
(g)
Women’s Empowerment: Farms (Q3 and Q8) with female interviewees did not get a red light.
(h)
Youth Employment Opportunities: All farms received a red light in this criterion, highlighting a need for providing opportunities for young people.
(i)
Agrobiodiversity: Farms Q7 and Q8, with a higher number of crops, had a green light, while the others, with a red light, need to increase biodiversity.
(j)
Soil Health: No farms received a red light, indicating good soil health. Farms Q1, Q6, and Q8, composed of a single plot, received a yellow light.
At last, with the application of ACT to the assessed farms, Farm Q8 attained the highest ACT score at 82%, whereas Farm Q4 achieved the lowest score at 27% (Table 6). The indicator with the highest score, registering at 94%, pertained to the ‘Culture and Food Traditions’ element. On the opposite end, the ‘Responsible Governance’ element, from Level 5: Rebuilding the Global Food System, scored 18% (Table 6).
Summarizing the key findings for each of the 11 elements of transition:
(a)
Efficiency: Farm Q8 scored the highest, at 86%, while Farms Q4 and Q6 scored the lowest (29%). Farm Q8 has adopted practices such as water consumption reduction techniques, non-use of pesticides and veterinary drugs, efficient animal-feed utilization, solar energy adoption, and product dehydration and drying, as well as the use and conservation of traditional seeds. Farms Q4 and Q6 employed some of these efficient practices, though to a lesser extent.
(b)
Recycling: Farm Q8 garnered the highest score, at 86%, whereas Farm Q6 attained the lowest score, at 0%. Farm Q8 uses alternative soil inputs, incorporates green manure, recycles wastewater, utilizes biomass residue for energy generation, and alternative methods of climate mitigation.
(c)
Regulation and Balance (the element included in addition to the 10 from FAO): Farm Q8 achieved the highest score, at 100%, while Farm Q6 scored the lowest, at 10%. Farm Q8 implements a range of practices, including biological pest management, cover cropping for pest control and improved soil conditions, reduced tillage, adoption of organic and low-input farming, utilization of domesticated pollinators, and improved animal welfare and health. In contrast, Farm Q6 primarily relies on perennial crops.
(d)
Synergies: Farm Q8 attained the highest score, at 88%, and Farm Q6 attained the lowest score, at 0%. Farm Q8’s practices include non-crop plant cultivation, agroforestry, rotational/regenerative grazing, integrated crop–livestock systems, integrated pest management through habitat manipulation, and climate mitigation through system redesign.
(e)
Diversity: Farms Q3, Q5, Q7, and Q8 demonstrated the highest scores, at 89%, and Farm Q4 obtained the lowest score, at 56%. The high-scoring farms implement practices as improving local seed and breed diversity, integrating locally adapted crops and breeds, practicing polycultural cultivation, managing heterogeneous landscapes, and conserving the forest around agricultural lands. In contrast, Q4 places less emphasis on these practices.
(f)
Resilience: Five farms (Q1 to Q5) achieved the lowest score of 33%, by focusing primarily on livelihood resilience through diversified income sources. In contrast, Farm Q8 attained the highest score of 100%, due to its additional emphasis on systemic resilience to extreme weather events and disturbances, as well as its adaptive capacity to changing environmental conditions.
(g)
Circular and Solidarity Economy: Farms Q4 and Q6 received the lowest score of 33%, while Farms Q2, Q3, and Q8 achieved the highest score of 100%. This reflects their active involvement in supporting regional value generation, re-establishing the connection between producers and consumers, and their advocacy for seasonal and regional demand.
(h)
Culture and Food Traditions: All farms except Q4 achieved the highest score of 100%. These farms endorse healthy, diversified, and culturally appropriate food traditions and diets. Farm Q4, however, is not affiliated with farmers’ associations or other platforms for policy support.
(i)
Co-Creation and Sharing of Knowledge: Farm Q8 scored the highest, at 100%, and Farm Q1 obtained the lowest score, at 0%. Farm Q8 actively engages with fellow farmers to exchange knowledge, participates in participatory and multi-stakeholder knowledge-generation approaches, and advocates for formal and informal production and food education.

4. Discussion

Revisiting the results, the indicators that scored the highest on the TAPE grid of indicators were ‘Crops’, from the ‘Diversity’ element, and ‘Local or Traditional identity awareness’, from the ‘Culture and Food Tradition’ element, with both achieving values of 3.0; meanwhile, the ones that scored the lowest were ‘Renewable Energy’ and ‘Production’ from the ‘Recycling’ element, with both obtaining values of 0.6. The criterion of the TAPE 10 Evaluation Criteria that received green lights from all farms was ‘Land Tenure’, and the one that received red lights from all farms was ‘Youth employment opportunities’. Turning to ACT, the indicator that scored the highest was ‘Culture and food traditions’ (94%) and the one that scored the lowest was ‘Responsible Governance’ (18%).
Merging TAPE Grid of indicators, TAPE 10 Evaluation Criteria and ACT results are consistent for the best agroecological performance (Table 7). Farm Q8 scored the highest both in TAPE Grid of Indicators (2.8 values), had the highest number of green lights (six green lights), and scored the highest in ACT (82%), which means that its agroecological performance is better than that of the others. It is a regenerative family farm run by two young designers who transitioned from urban to rural life. They cultivate blueberries, vegetables, fruits, and eggs, distributing their produce through a CSA model. On the other hand, the farm that score the lowest on the TAPE grid of indicators was Farm Q6 (1.6 values), while the farm that had the highest number of red lights using TAPE 10 evaluation criteria was Farm Q5 (five red lights) and the farm that scored the lowest on the ATC was Farm Q4 (27%).
Upon comparing the values across the elements of transition in the TAPE grid of indicators (after converting to percentages) and in ACT, it becomes evident that while ‘Culture and Food Transitions’ received the highest score in both assessments (73% in the TAPE grid of indicators and 94% in ACT), the lowest scoring elements differ (Table 8). Specifically, ‘Co-Creation and Sharing of Knowledge’ achieved 23% in the TAPE grid of indicators (and 54% in ATC), while’ Responsible Governance’ scored 18% in ACT (and 54% in the TAPE grid of indicators), indicating a notable discrepancy.
Nevertheless, several disparities are observed. For instance, when examining parameters related to young people and women, the focus on distinct aspects within the overarching theme leads to differential measurements. Regarding ‘Youth’, the TAPE grid of indicators’ questions focus on youth empowerment and emigration, how young people see their future in agriculture, whether they are happy with the working conditions, or whether they intend to emigrate. The TAPE evaluation criteria add information about education and training, and ACT only mentions women and youth in the criterion ‘Gender and Vulnerable Group Approach’. With regard to women, the TAPE indicator grid includes questions about women’s empowerment, their access to decision-making power over productive resources, and the existence and functionality of women’s organizations. The TAPE evaluation criteria add information on ‘Control over the use of income’; ‘Leadership in the community’; and ‘Use of time’.
The analysis of the questions supporting the evaluation of the elements ‘Culture and Food traditions’, ‘Co-creation and Sharing of Knowledge’, and ‘Responsible Governance’, revealed that ACT incorporates more comprehensive inquiries. For instance, ACT includes questions about the right to adequate and culturally appropriate food, the support for individuals’ decision-making regarding food sourcing and consumption (in ‘Culture and Food traditions’), the farmers networks, the formal and non-formal education networks (in ‘Co-creation and Sharing of Knowledge’), and the intersection of agroecology and global change (in ‘Responsible Governance’), which are not included in the TAPE Grid of Indicators (Table 9).
Contrary to the TAPE grid of indications (based on 35 indicators), the ACT is built around 62 transition criteria. The unique features of ACT are justified by this divergence. As opposed to ACT, which uses a binary “Yes or No” response format that could make it difficult to evaluate how agroecological performance on farms, the TAPE grid of indicators offers a more accurate assessment of indicator status—important information to evaluate the farms agroecological performance.

5. Conclusions

The TAPE grid of indicators, TAPE 10 evaluation criteria, and ACT collectively enable the assessment of agroecological performance of family farms. However, certain questions require adaptation to align with the Portuguese, and other European, cultural and territorial contexts. Examples include inquiries about women’s associations, on-farm employability, local food systems, land inheritance, and emerging opportunities like agrotourism. The findings of this study are aligned with Anthonioz [63] who applied TAPE to livestock production in a region of France, pointing out that the results of some indicators, such as women’s empowerment, may not be significant when applied to European agricultural systems. Marino [71], in their analysis of the food system in the city region of Rome (Italy), applied an adaptation of the TAPE, noting its focus of application in developing countries. Steglich [72] in their work for the Global South, also applied an adaptation of TAPE in which they included indicators for assessing the presence of local non-agricultural sectors such as forestry, nature, and landscape conservation, renewable energies, and tourism In addition, Colbert [38] analyzed both TAPE and ACT within demonstration farms in Kenya and indicated that the high level of detail of TAPE, as well as the time technical knowledge required to study it, makes it less accessible to those not working in research. He claims that with slight modifications, ACT can be an easy tool for demonstration farms (as well as farmers) to assess how their activities are contributing to the agroecological transition, whether at the farm, field, market, or policy level.
In applying TAPE and ACT to Portuguese family farmers, questions pertaining to agricultural biodiversity and soil health pose challenges for farmers due to limited access to organized information. It is crucial to consider whether these constraints stem from factors related to the agroecosystem itself (such as size and cultural diversity), the local food system, or the characteristics of the farmers and stakeholders involved including their age, education, training, and time available. Both formal and informal education on agroecology practices (at the agroecosystem and food system level) are of the utmost importance yet, at present, are practically non-existent in Portugal. In the realm of family farming, the results indicate that the agroecological transition is primarily influenced by the socio-economic attributes of the farmers, rather than the geographic location or size/number of plots of the farms. Despite applying practices considered agroecological, such as polyculture and animal inclusion, most farmers lack familiarity with the concept of agroecology and possess a limited systemic understanding of agriculture and local food dynamics. Evaluating the agroecological performance of farms is just as important for farms already committed to the agroecological transition (consolidating existing efforts) as it is for those unfamiliar with the concept (supporting the transition process).
This study made it possible to identify the most relevant aspects for characterizing family farmers and their farms. It also made it possible to perceive the importance of how the evaluation criteria/indicators are ordered by element/theme, as it alters the values of each farm’s agroecological performance. Thus, based on the analyses conducted and considering that the methodology to be developed aims to support the design of policies for agroecological transition, it was possible to identify a set of questions crucial for evaluating farms’ agroecological performance, which might be organized into 10 topics (within the Agroecosystem and the Local/Global Food System):
Within the Agroecosystem:
(a)
Plant Production: evaluates the diversity of crops over space and time, considering factors like monoculture versus polyculture, as well as the integration of different crops. It also examines the origin of plants and seeds.
(b)
Animal Production: focuses on the presence and diversity of animals on the farm, emphasizing animal welfare. It considers factors such as multiple species, the integration of animals with crops, and their well-being.
(c)
Soil Regeneration: assesses practices related to recycling biomass, incorporating organic matter into the soil, soil cover, and conservation practices. It also considers the quantity of tillage activities.
(d)
Regenerating the Water Cycle: addresses water-related aspects, including the source of water, controlled irrigation, water recovery, and its destination. It also evaluates water quality.
(e)
Pest, Disease, and Weed Management: focuses on how the farm monitors and manages pests, diseases, and weeds. It considers decision-making processes and intervention methods.
(f)
Ecological Synergies (Functional Biodiversity): examines the integration of trees, crops, and animals. Additionally, it assesses the biodiversity on the farm as well as in its surroundings, including nearby farms.
(g)
Economic Synergies (Management of Production Factors/Farm Management): considers the balance between internal and external factors in production. It looks at factors like seeds, plants, fertilizers, and farm machinery. It also includes record-keeping of various activities.
(h)
Social Synergies (Well-Being on the Farm): evaluates aspects related to the well-being of individuals on the farm, including fair compensation, safety, rest time, gender equity, youth empowerment, and participation in decision-making processes. It also considers the farm’s contribution to the community and its adherence to cultural and food traditions.
Within the Local/Global Food System:
(i)
Interactions with the Local Food System: assesses the farm’s relationships with the local community, including proximity to consumers, markets, and institutions. It also considers formal and informal networks between producers and producers and consumers.
(j)
Sharing Local/Global Agroecological Knowledge: focuses on the sharing and co-construction of agroecological knowledge among various actors in the food system, both locally and globally.
The created methodology will involve conducting questionnaires with farmers during on-site visits, mapping out the farm areas, and performing soil analyses. The collected data will then be used to assess a set of indicators, combining elements from both the TAPE Grid of Indicators and ACT Criteria for Transition, positioning the indicators at the agroecosystem level or the food system. Additionally, discussions with respondents about the results will be held, a crucial step for farmers to take ownership of the findings. This process aids in identifying solutions and establishing collective paths forward, enhancing interaction among all involved stakeholders.
Two limitations of this study are important to mention. The first relates to the size of the sample: the questionnaires were applied to just eight farms. Despite the difficulties of applying them to a larger sample, especially due to the duration of the interviews, a larger number of assessed farms would have allowed for better understanding of the advantages and limitations of both TAPE and ACT methodologies in the Portuguese context. The second concerns the non-application of the four steps of the TAPE, which can condition the perception of the purpose of each question. Regarding TAPE Stage 0, due to the fact that the questionnaire was applied in two different regions, the gathering of local information relevant to the agroecological transition was not carried out. This information would be important for TAPE Stage 3, centered on returning to the territories to reflect on the results obtained, together with the farmers, and achieving a better understanding of agroecology. However, the conclusions reached for the creation of the methodology were in line with the results of other studies being carried out simultaneously in Portugal and with the bibliography of similar research being carried out in other countries. A more generalized application of these methodologies in Portugal aligned with other countries is, therefore, necessary in order to understand their adaptability in the context of family farming.

Author Contributions

Conceptualization: I.C.-P. and C.A.C. Investigation: I.C.-P., C.A.C., F.D. and A.A.R.M.A. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by National Funds through the FCT—Foundation for Science and Technology, I.C.-P., within the scope of the individual doctoral research grant reference UI/BD/153087/2022.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Ethics Committee of Polytechnic of Viseu, approval code: Parecer no55/SUB/2021, date of approval: 22 June 2021.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data are contained within the article.

Acknowledgments

We would like to thank CERNAS funded by national funds FCT—Foundation for Science and Technology, I.P., within the scope of the project Ref. UIDB/00681/2020, the GreenUPorto funded by national funds via FCT (Foundation for Science and Technology) through the Strategic Projects UIDB/05748/2020 and UIDP/05748/2020, DOI https://doi.org/10.54499/UIDP/05748/2020 and https://doi.org/10.54499/UIDB/05748/2020 and Valorizar a Agricultura Familiar Project (PDR2020-2024-058135) for the opportunity of applying the questionnaires within the scope of its research.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Tudi, M.; Ruan, H.D.; Wang, L.; Lyu, J.; Sadler, R.; Connell, D.; Chu, C.; Phung, D.T. Agriculture Development, Pesticide Application and Its Impact on the Environment. Int. J. Environ. Res. Public Health 2021, 18, 1112. [Google Scholar] [CrossRef]
  2. van der Sluijs, J.P. Insect decline, an emerging global environmental risk. Curr. Opin. Environ. Sustain. 2020, 46, 39–42. [Google Scholar] [CrossRef]
  3. Beketov, M.A.; Kefford, B.J.; Schäfer, R.B.; Liess, M. Pesticides reduce regional biodiversity of stream invertebrates. Proc. Natl. Acad. Sci. USA 2013, 110, 11039–11043. [Google Scholar] [CrossRef] [PubMed]
  4. Goulson, D. An overview of the environmental risks posed by neonicotinoid insecticides. J. Appl. Ecol. 2013, 50, 977–987. [Google Scholar] [CrossRef]
  5. Geiger, F.; Bengtsson, J.; Berendse, F.; Weisser, W.W.; Emmerson, M.; Morales, M.B.; Ceryngier, P.; Liira, J.; Tscharntke, T.; Winqvist, C.; et al. Persistent negative effects of pesticides on biodiversity and biological control potential on European farmland. Basic Appl. Ecol. 2010, 11, 97–105. [Google Scholar] [CrossRef]
  6. Matson, P.A.; Parton, W.J.; Power, A.G.; Swift, M.J. Agricultural Intensification and Ecosystem Properties. Science 1997, 277, 504–509. [Google Scholar] [CrossRef] [PubMed]
  7. Alif, S.M.; Dharmage, S.C.; Benke, G.; Dennekamp, M.; Burgess, J.A.; Perret, J.L.; Lodge, C.J.; Morrison, S.; Johns, D.P.; Giles, G.G.; et al. Occupational exposure to pesticides are associated with fixed airflow obstruction in middle-age. Thorax 2017, 72, 990–997. [Google Scholar] [CrossRef]
  8. Damalas, C.A.; Koutroubas, S.D. Farmers’ Exposure to Pesticides: Toxicity Types and Ways of Prevention. Toxics 2016, 4, 1. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
  9. Smith, M.R.; Singh, G.M.; Mozaffarian, D.; Myers, S.S. Effects of decreases of animal pollinators on human nutrition and global health: A modelling analysis. Lancet 2015, 386, 1964–1972. [Google Scholar] [CrossRef] [PubMed]
  10. Tilman, D.; Clark, M. Global diets link environmental sustainability and human health. Nature 2014, 515, 518–522. [Google Scholar] [CrossRef]
  11. Quintas-Soriano, C.; Buerkert, A.; Plieninger, T. Effects of land abandonment on nature contributions to people and good quality of life components in the Mediterranean region: A review. Land Use Policy 2022, 116, 106053. [Google Scholar] [CrossRef]
  12. Leal Filho, W.; Mandel, M.; Al-Amin, A.Q.; Feher, A.; Chiappetta Jabbour, C.J. An assessment of the causes and consequences of agricultural land abandonment in Europe. Int. J. Sustain. Dev. World Ecol. 2016, 24, 554–560. [Google Scholar] [CrossRef]
  13. Terres, J.-M.; Scacchiafichi, L.N.; Wania, A.; Ambar, M.; Anguiano, E.; Buckwell, A.; Coppola, A.; Gocht, A.; Källström, H.N.; Pointereau, P.; et al. Farmland abandonment in Europe: Identification of drivers and indicators, and development of a composite indicator of risk. Land Use Policy 2015, 49, 20–34. [Google Scholar] [CrossRef]
  14. Wezel, A.; Herren, B.G.; Kerr, R.B.; Barrios, E.; Gonçalves, A.L.R.; Sinclair, F. Agroecological principles and elements and their implications for transitioning to sustainable food systems. A review. Agron. Sustain. Dev. 2020, 40, 40. [Google Scholar] [CrossRef]
  15. Loconto, A.M.; Fouilleux, E. Defining agroecology: Exploring the circulation of knowledge in FAO’s Global Dialogue. Int. J. Sociol. Agric. Food 2019, 25, 116–137. [Google Scholar] [CrossRef]
  16. Teixeira, H.M.; Van den Berg, L.; Cardoso, I.M.; Vermue, A.J.; Bianchi, F.J.J.A.; Peña-Claros, M.; Tittonell, P. Understanding Farm Diversity to Promote Agroecological Transitions. Sustainability 2018, 10, 4337. [Google Scholar] [CrossRef]
  17. Altieri, M.A.; Nicholls, C.I. Agroecology: Challenges and opportunities for farming in the Anthropocene. Int. J. Agric. Nat. Resour. 2020, 47, 204–215. [Google Scholar] [CrossRef]
  18. Blay-Palmer, A.; Sonnino, R.; Custot, J. A food politics of the possible? Growing sustainable food systems through networks of knowledge. Agric. Hum. Values 2015, 33, 27–43. [Google Scholar] [CrossRef]
  19. Wezel, A.; Bellon, S.; Doré, T.; Francis, C.; Vallod, D.; David, C. Agroecology as a science, a movement and a practice. A review. Agron. Sustain. Dev. 2009, 29, 503–515. [Google Scholar] [CrossRef]
  20. Méndez, V.E.; Caswell, M.; Gliessman, S.R.; Cohen, R. Integrating Agroecology and Participatory Action Research (PAR): Lessons from Central America. Sustainability 2017, 9, 705. [Google Scholar] [CrossRef]
  21. Nicholls, C.I.; Altieri, M.A.; Vazquez, L. Agroecology: Principles for the Conversion and Redesign of Farming Systems. J. Ecosys. Ecograph. 2016, S5, 010. [Google Scholar] [CrossRef]
  22. Wezel, A.; Casagrande, M.; Celette, F.; Vian, J.-F.; Ferrer, A.; Peigné, J. Agroecological practices for sustainable agriculture. A review. Agron. Sustain. Dev. 2013, 34, 1–20. [Google Scholar] [CrossRef]
  23. Gliessman, S.R. Agroecology: The Ecology of Sustainable Food Systems, 3rd ed.; CRC Press/Taylor and Francis: BocaRaton, FL, USA, 2015. [Google Scholar] [CrossRef]
  24. Viegas, M. Construção de um índice sintético aplicado à agricultura familiar no continente português. Rev. Voz Campo 2022, novembro. [Google Scholar]
  25. FAO; IFAD. The Future of Family Farming in the Context of the 2030. 2019. Available online: https://www.ifad.org/documents/38714174/41167968/UNDFF+Background_Document.pdf/f8a7ed38-996b-96a8-9ab4-5c53ab0779f2 (accessed on 30 November 2022).
  26. Garner, E.; De la O Campos, A.P. Identifying the “family farm”: An informal discussion of the concepts and definitions. In ESA Working Paper; No. 14-10; FAO: Rome, Italy, 2014. [Google Scholar] [CrossRef]
  27. Aguiar, A.; Parente, C.; Costa, D.; Correia, H.E.; Guiné, R.; Correia, E.; Chaves, C. (Eds.) Pontes Entre Agricultura Familiar e Agricultura Biológica; Agricultura Familiar no Norte e Centro de Portugal: Práticas de Agricultura Sustentável in Costa, C.A. (Coord); Centro de Estudos Ibéricos, Coleção Iberiografias No. 37: Guarda, Portugal, 2020; pp. 181–184. ISBN 978-972-780-717-8. [Google Scholar]
  28. da Costa, C.A.; Guiné, R.; Correia, H.E.; Costa, D.T.; Costa, T.; Parente, C.; Pais, C.; Gomes, M.; Aguiar, A.A. Agricultura familiar e proteção das culturas: Abordagens tradicionais e proximidade com práticas de agricultura biológica. Rev. Ciências Agrárias 2018, 41, 164–173. [Google Scholar] [CrossRef]
  29. Alvarez, R. Comparing Productivity of Organic and Conventional Farming Systems: A Quantitative Review. Arch. Agron. Soil Sci. 2021, 68, 1947–1958. [Google Scholar] [CrossRef]
  30. Landini, F.; Beramendi, M.R. Agroecology or modern conventional agriculture? Positionings of Argentine rural extension workers. Adv. Mod. Cult. 2020, 46, 352–361. [Google Scholar]
  31. Wiget, M.; Müller, A.; Hilbeck, A. Main challenges and key features of indicator-based agroecological assessment frameworks in the context of international cooperation. Ecol. Soc. 2020, 25, 25. [Google Scholar] [CrossRef]
  32. de Olde, E.M.; Oudshoorn, F.W.; Sørensen, C.A.; Bokkers, E.A.; de Boer, I.J. Assessing sustainability at farm-level: Lessons learned from a comparison of tools in practice. Ecol. Indic. 2016, 66, 391–404. [Google Scholar] [CrossRef]
  33. Bonisoli, L.; Galdeano-Gómez, E.; Piedra-Muñoz, L. Deconstructing criteria and assessment tools to build agri-sustainability indicators and support farmers’ decision-making process. J. Clean. Prod. 2018, 182, 1080–1094. [Google Scholar] [CrossRef]
  34. Nicholls, C.; Altieri, M.; Kobayashi, M.; Tamura, N.; McGreevy, S.; Hitaka, K. Assessing the agroecological status of a farm: A principle-based assessment tool for farmers. Sustain. Agric. 2020, 48, 29–41. [Google Scholar] [CrossRef]
  35. Binder, C.R.; Feola, G.; Steinberger, J.K. Considering the normative, systemic and procedural dimensions in indicator-based sustainability assessments in agriculture. Environ. Impact Assess. Rev. 2010, 30, 71–81. [Google Scholar] [CrossRef]
  36. Talukder, B.; Blay-Palmer, A. Comparison of Methods to Assess Agricultural Sustainability. Sustain. Agric. Rev. 2017, 25, 149–168. [Google Scholar] [CrossRef]
  37. Gliessman, S.R. Transforming food systems with agroecology. Agroecol. Sustain. Food Syst. 2016, 40, 187–189. [Google Scholar] [CrossRef]
  38. Colbert, E. The Role of Demonstration Farms in Agroecological Transitions: Nexus for Scaling up and Scaling out Agroecology. Master’s Thesis, Norwegian University of Life Sciences (NMBU) & Institut Superior d’Agriculture Rhône-Alpes (ISARA), As, Norway, 2020. Available online: https://nmbu.brage.unit.no/nmbu-xmlui/bitstream/handle/11250/2724492/Edd%20Colbert_MSc%20Thesis_2020_NMBU.pdf?sequence=3 (accessed on 3 October 2022).
  39. Achterberg, E.; Quiroz, D. Development Aid Funds for Agroecology Support for Agroecology of Dutch ODA Spending; Profundo: Amsterdam, The Netherlands, 2021; Report Profundo; Available online: https://www.bothends.org/en/ (accessed on 10 January 2023).
  40. ACT (Agroecology Criteria Tool); Biovision: Milpitas, CA, USA, 2015. Methodology|Criteria Tool|Agroecology Info Pool. Available online: https://www.agroecology-pool.org/methodology/ (accessed on 3 October 2022).
  41. Burns, S.; Dittmer, K.M.; Shelton, S.W.; Wollenberg, E.K. Exemplary Features of Digital Tools for Agroecology? A Global Review; Alliance of Bioversity and CIAT: Rome, Italy, 2022; Available online: https://cgspace.cgiar.org/bitstream/handle/10568/126016/ATDT%20Digital%20Tool%20Review_Agroecology%20Brief_Dec2022.pdf?sequence=1 (accessed on 10 January 2023).
  42. F-ACT (Farm Level Agroecology Criteria Tool); Biovision: Milpitas, CA, USA, 2019. Available online: https://www.agroecology-pool.org/fact/ (accessed on 3 October 2022).
  43. Zahm, F.; Viaux, P.; Vilain, L.; Girardin, P.; Mouchet, C. Assessing Farm Sustainability with the IDEA Method—From the Concept of Agriculture Sustainability to Case Studies on Farms. Sustain. Dev. 2008, 16, 271–281. [Google Scholar] [CrossRef]
  44. Valizadeh, N.; Hayati, D. Development and validation of an index to measure agricultural sustainability. J. Clean. Prod. 2020, 280, 123797. [Google Scholar] [CrossRef]
  45. Marchand, F.; Debruyne, L.; Triste, L.; Gerrard, C.; Padel, S.; Lauwers, L. Key characteristics for tool choice in indicator-based sustainability assessment at farm level. Ecol. Soc. 2014, 19, 46. [Google Scholar] [CrossRef]
  46. Trabelsi, M.; Mandart, E.; Le Grusse, P.; Bord, J.-P. How to measure the agroecological performance of farming in order to assist with the transition process. Environ. Sci. Pollut. Res. 2015, 23, 139–156. [Google Scholar] [CrossRef]
  47. Fan, J.; Liu, C.; Xie, J.; Han, L.; Zhang, C.; Guo, D.; Niu, J.; Jin, H.; McConkey, B.G. Life Cycle Assessment on Agricultural Production: A Mini Review on Methodology, Application, and Challenges. Int. J. Environ. Res. Public Health 2022, 19, 9817. [Google Scholar] [CrossRef] [PubMed]
  48. van der Werf, H.M.G.; Knudsen, M.T.; Cederberg, C. Towards better representation of organic agriculture in life cycle assessment. Nat. Sustain. 2020, 3, 419–425. [Google Scholar] [CrossRef]
  49. Geels, F.W. The multi-level perspective on sustainability transitions: Responses to seven criticisms. Environ. Innov. Soc. Transit. 2011, 1, 24–40. [Google Scholar] [CrossRef]
  50. El Bilali, H. Transition heuristic frameworks in research on agro-food sustainability transitions. Environ. Dev. Sustain. 2020, 22, 1693–1728. [Google Scholar] [CrossRef]
  51. El Bilali, H. The Multi-Level Perspective in Research on Sustainability Transitions in Agriculture and Food Systems: A Systematic Review. Agriculture 2019, 9, 74. [Google Scholar] [CrossRef]
  52. López-García, D.; Cuéllar-Padilla, M.; Olival, A.d.A.; Laranjeira, N.P.; Méndez, V.E.; Parada, S.P.Y.; Barbosa, C.A.; Salas, C.B.; Caswell, M.; Cohen, R.; et al. Building agroecology with people. Challenges of participatory methods to deepen on the agroecological transition in different contexts. J. Rural. Stud. 2021, 83, 257–267. [Google Scholar] [CrossRef]
  53. Sarabia, N.; Peris, J.; Segura, S. Transition to agri-food sustainability, assessing accelerators and triggers for transformation: Case study in Valencia, Spain. J. Clean. Prod. 2021, 325, 129228. [Google Scholar] [CrossRef]
  54. Cruz, J.F.; Mena, Y.; Rodríguez-Estévez, V. Methodologies for assessing sustainability in farming systems. Sustain. Assess. Report. 2018, 3, 33–58. [Google Scholar] [CrossRef]
  55. López-Ridaura, S.; Masera, O.; Astier, M. Evaluating the sustainability of complex socio-environmental systems. The MESMIS framework. Ecol. Indic. 2002, 2, 135–148. [Google Scholar] [CrossRef]
  56. RISE (Response-Inducing Sustainability Evaluation); Bern University: Bern, Switzerland, 1999; Available online: https://www.bfh.ch/hafl/en/research/reference-projects/rise/ (accessed on 3 October 2022).
  57. Hammond, J.; Fraval, S.; van Etten, J.; Suchini, J.G.; Mercado, L.; Pagella, T.; Frelat, R.; Lannerstad, M.; Douxchamps, S.; Teufel, N.; et al. The Rural Household Multi-Indicator Survey (RHoMIS) for rapid characterisation of households to inform climate smart agriculture interventions: Description and applications in East Africa and Central America. Agric. Syst. 2017, 151, 225–233. [Google Scholar] [CrossRef]
  58. Périnelle, A.; Scopel, E.; Berre, D.; Meynard, J.-M. Which Innovative Cropping System for Which Farmer? Supporting Farmers’ Choices Through Collective Activities. Front. Sustain. Food Syst. 2022, 6, 753310. [Google Scholar] [CrossRef]
  59. Fraval, S.; Hammond, J.; Wichern, J.; Oosting, S.J.; DE Boer, I.J.M.; Teufel, N.; Lannerstad, M.; Waha, K.; Pagella, T.; Rosenstock, T.S.; et al. Making the most of imperfect data: A critical evaluation of standard information collected in farm household surveys. Exp. Agric. 2018, 55, 230–250. [Google Scholar] [CrossRef]
  60. Ritzema, R.; Douxchamps, S.; Fraval, S.; Bolliger, A.; Hok, L.; Phengsavanh, P.; Long, C.; Hammond, J.; van Wijk, M. Household-level drivers of dietary diversity in transitioning agricultural systems: Evidence from the Greater Mekong Subregion. Agric. Syst. 2019, 176, 102657. [Google Scholar] [CrossRef]
  61. RHoMIS (Rural Household Multi-Indicator Survey); ILRI: Addis Ababa, Ethiopia, 2015. Available online: https://www.rhomis.org/ (accessed on 4 October 2022).
  62. Namirembe, S.; Mhango, W.; Njoroge, R.; Tchuwa, F.; Wellard, K.; Coe, R. Grounding a global tool-Principles and practice for agroecological assessments inspired by TAPE. Elem. Sci. Anthr. 2022, 10, 00022. [Google Scholar] [CrossRef]
  63. Anthonioz, A. The Suitability of the “Tool for Agroecological Performance Evaluation” (TAPE) in a European Context. Master’s Thesis, Norwegian University of Life Sciences & ISARA, As, Norway, 2021. Available online: https://www.agroscope.admin.ch/dam/agroscope/de/dokumente/aktuell/Veranstaltungen/a-nachhaltigkeitstagung/2022/01-mottet.pdf.download.pdf/01_NHT_2022_Anne_Mottet_26012022%20light_update.pdf (accessed on 3 October 2022).
  64. Mottet, A.; Bicksler, A.; Lucantoni, D.; De Rosa, F.; Scherf, B.; Scopel, E.; López-Ridaura, S.; Gemmil-Herren, B.; Kerr, R.B.; Sourisseau, J.-M.; et al. Assessing Transitions to Sustainable Agricultural and Food Systems: A Tool for Agroecology Performance Evaluation (TAPE). Front. Sustain. Food Syst. 2020, 4, 579154. [Google Scholar] [CrossRef]
  65. TAPE (Tool for Agroecology Performance Evaluation); FAO: Rome, Italy, 2018. Tools|Agroecology Knowledge Hub|Food and Agriculture Organization of the United Nations. Available online: https://www.fao.org/agroecology/tools-tape/en/ (accessed on 4 October 2022).
  66. SAFA (Sustainability Assessment of Food and Agriculture Systems); FAO: Rome, Italy, 2014. Available online: https://www.fao.org/nr/sustainability/sustainability-assessments-safa/safa-tool/en/ (accessed on 3 October 2022).
  67. Rebelo, J.; Vaz Caldas, J. Support for Farmers’ Cooperatives; Country Report Portugal; Wageningen UR: Wageningen, The Netherlands, 2012; Available online: https://edepot.wur.nl/244811 (accessed on 15 October 2022).
  68. Guiné, R.P.F.; Costa, C.A. Compliance of Agricultural Practices Used in Family Farms with Those Recommended in Organic Farming. Open Agric. 2018, 3, 368–377. [Google Scholar] [CrossRef]
  69. Coelho, C. A Transição da Agricultura Familiar para Sistemas de Produção Mais Sustentáveis na Região Norte de Portugal. Master’s Thesis, Instituto Politécnico de Viana do Castelo, Ponte de Lima, Portugal, 2024; 79p. [Google Scholar]
  70. INE. Recenseamento Agrícola. Análise dos Principais Resultados: 2019; INE: Lisboa, Portugal, 2021; ISBN 978-989-25-0562-6. Available online: https://www.ine.pt/xurl/pub/437178558 (accessed on 15 October 2022).
  71. Marino, D.; Curcio, F.; Felici, F.B.; Mazzocchi, G. Toward Evidence Based Local Food Policy: An Agroecological Assessment of Urban Agriculture in Rome. Land 2024, 13, 30. [Google Scholar] [CrossRef]
  72. Steglich, M.; Beutler, T.; Kativu, S.N.; Favi, S.G.; Kawira, C.; Grasi, C.; Maalim, A.A.; Kallee, D.; Osho-Abdulgafar, N.F.; Kasali, O.I.; et al. Agroecology and Rural Development: Acting in the Global North—With and for the Global South; Centre for Rural Development: Berlin, Germany, 2020. [Google Scholar] [CrossRef]
Figure 1. Localization of the farms (Q1–Q8) where the selected methodologies were applied.
Figure 1. Localization of the farms (Q1–Q8) where the selected methodologies were applied.
Sustainability 16 03955 g001
Table 1. Methodology analyses framework with the dimensions, criteria valuations, and justifications.
Table 1. Methodology analyses framework with the dimensions, criteria valuations, and justifications.
DimensionCriteria Valuation: Yes (1)/No (0)Criteria JustificationReferences
Normative Dimension: scope of the methodology evaluationGoal setting approach: bottom-up (stakeholder); top-down (theory) The definition of the methodology goals provides the basis of and operationalizes the farms assessment. It is important to understand whether the methodology goals and criteria are: (a) predefined and theoretical, derived from a definition of agroecology/sustainability (top-down approach); (b) defined by stakeholders in a participatory process (bottom-up approach). The combination of top-down and bottom-up approaches was assumed to be a transdisciplinary approach[33,35]
Procedural Dimension: how the assessment was carried outMethodology simplicity: graphic visualization; free access; easy to access; free access to the tutorialsThe methodology simplicity, or its user friendliness, was assessed based on: (a) graphic visualization of the results that simplifies the end users’ (farmers and policy makers) understanding; (b) access to free methodology software that allows a fast and automatic calculation of the results and improves the communication between users; (c) in some cases, the methodologies are available for free, but it is necessary that some procedures are accessible; (d) free access to tutorials to help the simplify the methodology’s application.[36]
Time requirement: more than 5 h; between 3 and 5 h; less than 3 hThe time required for the methodology application is directly connected to the effort needed to get to know and apply the methodology and discuss the results. If a methodology is too time consuming, that it can be an inhibiting factor for its success.[32]
Assessment purpose: self-assessment and guidance; assessment and guidance; multiple purposeRefers to the aim for which the tool was created, which can be for: (1) self-assessment and guidance: intended to be used by farmers themselves; (2) assessment and guidance: developed with the purpose of helping farmers assess and pursue sustainability/agroecology in their farms; (3) multiple purpose: designed for multiple stakeholders or developed with multiple purposes, without a specific sustainability/agroecology target.[35]
Indicators’ attributes: predetermined; specific criteria; selection presented; interaction: The availability of information about the indicators, including whether they are predefined, why they were selected, and whether there is an interaction between indicators, allows for assessing the robustness of the methodology and guarantees its replicability. [33,35]
Indicators’ reference values: target values; threshold values; relative valuesReference values might be defined to assess the level of sustainability for a set of indicators. They can be absolute (target value or threshold) or relative: (1) target values: identify a desirable condition; (2) threshold values: define a minimum and maximum acceptable level; (3) relative values: compare indicators with an initial value, regional or sample average, or desirable trend.[32,36]
Target group: farmers; policy makers; researchers; educatorsTarget groups can range from farmers to educators. It is important to know the target group(s) of the methodology, and to understand if key elements for the analysis may be missing.[35]
Stakeholders’ level of participation: whole process; partial; noneThere are different degrees of stakeholder involvement in the methodology’s application: (1) stakeholders can play a central role in the development, application, and interpretation of the indicators; (2) stakeholders can be consulted in specific parts of the methodology (development, application, or interpretation); (3) or their participation is not taken into account.[35]
Application in: Global North; Global SouthSome methodologies were developed for specific socio-geographic contexts and are not suitable for replication in different socio-geographic contexts (e.g., developed and underdeveloped countries)[32]
Table 3. Farms (Q1 to Q8) and farmers’ characterization.
Table 3. Farms (Q1 to Q8) and farmers’ characterization.
FarmFarmer
Localization (Municipality)Type of ProductsType of Agriculture Farm SizeGenderAgeEducation LevelJob Situation
Q1Vouzela (Centre of Portugal)milk production/subsistence vegetable gardenconventional 1 ha/1 parcelman67basic schoolself-employed with employees
Q2Vouzela (Centre of Portugal)livestock/subsistence vegetable gardenconventional 6 ha/30 parcelsman54primary schoolemployed in another company
Q3Viseu (Centre of Portugal)livestock/subsistence vegetable gardenconventional 6 ha/30 parcelshuman72primary schoolretired
Q4Arraiolos (South of Portugal)vegetables/sheepconventional 3 ha/2 parcelsman85primary schoolretired
Q5Évora (South of Portugal)vegetables/sheepconventional 180 ha/8 parcelsman51degree in agronomic engineeringself-employed with employees
Q6Fundão (Centre of Portugal)vegetables/olivesconventional 3 ha/1 parcelman76degree in philosophyretired
Q7Fundão (Centre of Portugal)vegetables/livestockconventional 2 ha/25 parcelsman66degree in history retired
Q8Mangualde (Centre of Portugal)vegetables/livestockregenerative agriculture 10 ha/1 parcelhuman32degree in artsself-employed with no employees
Table 4. Results of the TAPE grid of indicators’ application in the eight farms in the center and south of Portugal, in 2022. The value scored by each farm varies from 0 (less agroecological) to 4 (more agroecological).
Table 4. Results of the TAPE grid of indicators’ application in the eight farms in the center and south of Portugal, in 2022. The value scored by each farm varies from 0 (less agroecological) to 4 (more agroecological).
FAO 10 Elements of Agroecology IndicatorsQ1Q2Q3Q4Q5Q6Q7Q8Average Value per Indicator
Diversity Crops323333343.0
Animals (including fish and insects)113230231.9
Trees (and other perennials)122322342.4
Diversity of activities, products, and services102121221.4
SynergiesCrop–livestock–aquaculture integration132220221.8
Soil–plants system management432320232.4
Integration with threes 112222231.9
Connectivity between elements of the agroecosystem and the landscape133321232.3
Efficiency Use of external inputs231221232.0
Management of soil fertility441221342.6
Management of pests and diseases041100241.5
Productivity and household needs132232222.1
Recycling Recycling of biomass and nutrients432230132.3
Water saving021122331.8
Management of seeds and breeds133311132.0
Renewable energy and production001010120.6
Resilience Stability of income/production and capacity to recover from perturbations231322342.5
Mechanisms for reducing vulnerability430033322.3
Environmental resilience and capacity to adapt to climate change011222221.5
Culture and Food TraditionAppropriate diet and nutrition awareness332333422.9
Local or traditional identity and awareness332333433.0
Use of local varieties/breeds and traditional knowledge for food preparation223323322.5
Co-creation and Sharing of KnowledgePlatforms for the horizontal creation and transfer of knowledge and good practices 001020030.8
Access to agroecological knowledge and interest of producers in agroecology000011230.9
Participation of producers in networks and grassroots organizations232333322.6
Human and Social ValuesWomen’s empowerment312223232.3
Labor (productive conditions, social inequalities)210232221.8
Youth empowerment and emigration100021141.8
Animal welfare [if applicable]33333NA332.1
Circular and Solidarity EconomyProducts and services marketed locally401430332.3
Networks of producers, relationships with consumers, and presence of intermediaries302443342.9
Local food system321221121.8
Responsible GovernanceProducers’ empowerment111233311.9
Producers’ organizations and associations213133332.4
Participation of producers in governance of land and natural resources023003301.4
Average Value Per Farm1.81.91.72.02.21.62.32.7
Table 5. Results of the application of the 10 Evaluation Criteria of TAPE (STEP 2) on the eight farms, in the center and south of Portugal, in 2022. In the table are the farms (Q1 to Q8). The value scored by each farm varies between 3 levels—desirable (green-G), acceptable (yellow-Y), and undesirable (red-R).
Table 5. Results of the application of the 10 Evaluation Criteria of TAPE (STEP 2) on the eight farms, in the center and south of Portugal, in 2022. In the table are the farms (Q1 to Q8). The value scored by each farm varies between 3 levels—desirable (green-G), acceptable (yellow-Y), and undesirable (red-R).
TAPE Traffic Light ApproachQ1Q2Q3Q4Q5Q6Q7Q8
Secure land tenure GGGGGGGG
ProductivityYGRGYYGR
IncomeGGGYRYYG
Value addedGGRGGGGG
Exposure to pesticidesRRGRRRYG
Dietary diversityGGGYGGGG
Women’s empowermentRRYRRRRY
Youth employment opportunityRRRRRRRR
Agricultural biodiversityRRRRRYGG
Soil healthGGGYGYYY
Table 6. Results of ACT application on the eight farms (Q1 to Q8), in the center and south of Portugal, in 2022. Per-farm ACT provides the score (%) in each element of transition, linked with the levels of transition.
Table 6. Results of ACT application on the eight farms (Q1 to Q8), in the center and south of Portugal, in 2022. Per-farm ACT provides the score (%) in each element of transition, linked with the levels of transition.
Score (%)
Level of TransitionElement of TransitionQ1Q2Q3Q4Q5Q6Q7Q8Medium Value per Indicator
Level 1: Increase efficiency of industrial and conventional practices1.1. Efficiency434343295729578648
Level 2: Substitute industrial or conventional inputs with more sustainable alternatives2.1. Recycling17173317330338329
2.2. Regulation and balance2020502020105010036
Level 3: Redesign whole agro-ecosystems3.1. Synergies25253825500388836
3.2. Diversity786789568978898979
3.3. Resilience3333333333676710050
Level 4: Re-establish connections between growers and eaters; develop alternative food networks4.1. Circular and solidarity economy671001003367336710071
4.2. Culture and food traditions1001001005010010010010094
4.3. Co-creation and sharing of knowledge067673367336710054
Level 5: Rebuild the global food system so that it is sustainable and equitable for all5.1. Human and social value17178308317833342
5.2. Responsible governance0402002020202018
Medium value per farm3648602756356182
Table 7. Results of the TAPE grid of indicators’ average values per farm, TAPE 10 evaluation criteria (number of green lights and number of red lights), and ATC medium value per farm, on eight farms (Q1 to Q8), in the center and south of Portugal, in 2022.
Table 7. Results of the TAPE grid of indicators’ average values per farm, TAPE 10 evaluation criteria (number of green lights and number of red lights), and ATC medium value per farm, on eight farms (Q1 to Q8), in the center and south of Portugal, in 2022.
Q1Q2Q3Q4Q5Q6Q7Q8
Tape Grid of Indicators Average values per farm1.81.91.82.02.31.62.42.8
Tape 10 Evaluation Criteria (number of green lights obtained)56534356
Tape 10 Evaluation Criteria (number of red lights obtained)44445322
ACT medium value per farm3648602756356182
Table 8. Results of the TAPE grid of indicators’ average values, converted into percentages, and the ATC medium score by element of transition, on eight farms evaluated in the center and south of Portugal, in 2022.
Table 8. Results of the TAPE grid of indicators’ average values, converted into percentages, and the ATC medium score by element of transition, on eight farms evaluated in the center and south of Portugal, in 2022.
Elements/Elements of TransitionTAPE Grid of Indicators *ACT
Diversity5379
Synergies5336
Efficiency5348
Recycling4829
Resilience5550
Culture and food traditions7394
Co-creation and sharing of knowledge2354
Human and social value5042
Circular and solidarity economy5871
Responsible governance4818
Regulation and balanceNA36
* values converted in %.
Table 9. Indicators from the TAPE grid and transition criteria from the ACT for the elements Culture and Food Traditions, Co-creation and Sharing of Knowledge, and Responsible Governance.
Table 9. Indicators from the TAPE grid and transition criteria from the ACT for the elements Culture and Food Traditions, Co-creation and Sharing of Knowledge, and Responsible Governance.
ElementsTape Indicators Act Transition Criteria
Culture and food traditionsAppropriate diet and nutrition awarenessSupport healthy, diversified and culturally appropriate food traditions and diets
Local or traditional identity and awarenessSupport the right to adequate and culturally appropriate food
Use of local varieties/breeds and traditional knowledge for food preparation
Co-creation and sharing of knowledgePlatforms for the horizontal creation and transfer of knowledge and good practices Connecting farmers to share knowledge
Access to agroecological knowledge and interest of producers in agroecologyPromote formal and non-formal “production and food” education
Participation of producers in networks and grassroot organizationsPromote participatory and multi-stakeholder approaches in knowledge generation
Responsible governanceProducers’ empowermentPolicy development on producer-consumer links
Producers’ organizations and associationsInclusive policy-making that aim for sustainable and equitable food system
Participation of producers in governance of land and natural resourcesEstablishment of equitable governance and rights over natural resources
Policy development on the links between agroecology and global changes
Policy development that rewards agricultural management that enhances biodiversity and the provision of ecosystem services
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Costa-Pereira, I.; Aguiar, A.A.R.M.; Delgado, F.; Costa, C.A. A Methodological Framework for Assessing the Agroecological Performance of Farms in Portugal: Integrating TAPE and ACT Approaches. Sustainability 2024, 16, 3955. https://doi.org/10.3390/su16103955

AMA Style

Costa-Pereira I, Aguiar AARM, Delgado F, Costa CA. A Methodological Framework for Assessing the Agroecological Performance of Farms in Portugal: Integrating TAPE and ACT Approaches. Sustainability. 2024; 16(10):3955. https://doi.org/10.3390/su16103955

Chicago/Turabian Style

Costa-Pereira, Inês, Ana A. R. M. Aguiar, Fernanda Delgado, and Cristina A. Costa. 2024. "A Methodological Framework for Assessing the Agroecological Performance of Farms in Portugal: Integrating TAPE and ACT Approaches" Sustainability 16, no. 10: 3955. https://doi.org/10.3390/su16103955

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop