Next Article in Journal
The Use of Multi-Geophysical Methods to Determine the Geothermal Potential: A Case Study from the Humenné Unit (The Eastern Slovak Basin)
Previous Article in Journal
Potential for Coastal and Offshore Aquaculture in Portugal: Insights from Physico-Chemical and Oceanographic Conditions
Previous Article in Special Issue
GI Guidelines for the Metropolitan City of Cagliari (Italy): A Method for Implementing Green Areas
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An Analysis of Agricultural Systems Modelling Approaches and Examples to Support Future Policy Development under Disruptive Changes in New Zealand

1
Department of Civil and Natural Resources Engineering, University of Canterbury, Private Bag 4800, Christchurch 8140, New Zealand
2
School of Earth and Environment, University of Canterbury, Private Bag 4800, Christchurch 8140, New Zealand
*
Author to whom correspondence should be addressed.
Appl. Sci. 2022, 12(5), 2746; https://doi.org/10.3390/app12052746
Submission received: 17 January 2022 / Revised: 22 February 2022 / Accepted: 2 March 2022 / Published: 7 March 2022

Abstract

:
Agricultural systems have entered a period of significant disruption due to impacts from change drivers, increasingly stringent environmental regulations and the need to reduce unwanted discharges, and emerging technologies and biotechnologies. Governments and industries are developing strategies to respond to the risks and opportunities associated with these disruptors. Modelling is a useful tool for system conceptualisation, understanding, and scenario testing. Today, New Zealand and other nations need integrated modelling tools at the national scale to help industries and stakeholders plan for future disruptive changes. In this paper, following a scoping review process, we analyse modelling approaches and available agricultural systems’ model examples per thematic applications at the regional to national scale to define the best options for the national policy development. Each modelling approach has specificities, such as stakeholder engagement capacity, complex systems reproduction, predictive or prospective scenario testing, and users should consider coupling approaches for greater added value. The efficiency of spatial decision support tools working with a system dynamics approach can help holistically in stakeholders’ participation and understanding, and for improving land planning and policy. This model combination appears to be the most appropriate for the New Zealand national context.

1. Introduction

The future of agriculture depends on the system’s responses to the global challenges of climate change adaptation, carbon emission reduction, water availability, water quality restoration, and ecosystem services’ provision. Policy, technology and science have a key role to play in addressing these challenges [1,2,3]. Climate change, the most studied of global change challenges, is already causing major disruptions in food supply due to yield losses and subsequent chain reactions on socio-economic systems [4,5]. However, a larger range of disruptions are putting agricultural systems under pressure and could lead to major disruptions to the agro-economical system: diseases or pandemics like the Asian Swine Fever outbreak [6,7], socio economic factors (war, conflict, etc.), trade restrictions/barriers or agreements [8], new food consumption trends [9,10], and disruptive technologies such as cowless milk [11]. Technology can also be a positive factor: precision agriculture to optimise yields and minimise nutrient losses [12,13], biotechnology such as the use of seaweed for reduction of methane emissions [14,15], water/irrigation optimisation, and efficiency improvements [16], and others. The range of potential beneficial and detrimental disruptive elements highlight the urgent need to address long-term sustainability of agricultural systems [17,18].
Since the 2000s, the international community through multilateral agreements and Non-Governmental Organisations (NGOs) have advocated for countries to restore or limit their impacts on the environment, based on policy informed by science. Agricultural activity, that represents almost 40% of global land use worldwide [19], is a significant contributor to Greenhouse Gas (GHG) emissions [20,21], soil and water quality loss [22,23,24], biodiversity loss [25,26,27], and thus environmental sustainability. At the international scale, several institutions have guided recommendations, incentives, and warnings over the past two decades. The Intergovernmental Panel on Climate Change (IPCC) provides assessments of climate change, its impacts and future risks, and recommendations; the Paris Agreement was adopted by 196 countries to limit global warming; the United Nations (UN) adopted the 17 Sustainable Development Goals (SDGs) [28,29], and the Millennium Ecosystem Assessment [30], by the Aichi Biodiversity Targets were formulated for conservation and restoration of biodiversity and ecosystem services by 2020 [31]. These environmental goals need to be synergistic with agricultural productivity and food security goals and thus the Food and Agriculture Organisation (FAO) is leading international efforts to defeat hunger, and provide adequate nutrition for all people. All these international efforts link policy and science at a global scale and incentivise nations to tackle global change challenges, and national governments are the key players in setting policy to enhance sustainability, resilience, productivity, and trade opportunities. Policy implementation often requires global coordination, comprehensive, integrated, and multi-sectoral analyses to support national target-setting [32]. The national scale is thus a key scale to define policy, laws, and regulations, and also to negotiate and organise international market trade especially for food security purposes or national sustainable profitability [33,34]. Agricultural systems need to strive for more flexibility and more adaptation options to gain resilience under economic, environment, and social disruptions [35].
Modelling is a useful tool for system conceptualisation, understanding, projection of future scenarios, and hypothesis testing about the impact of disruptions in a system’s overall behaviour in relation to changes in its components. Models are generally defined by two ways: (1) their approach, i.e., how the internal process is working, and (2) their thematic application, i.e., the thematic question they are being used for. The choice of approaches regarding the thematic questions is crucial for successful modelling processes. Many different modelling approaches exist and each of these have a different degree of complexity, requiring different data and application skill levels, and are not equal for system conceptualisation, analysis, prediction or prospection [36,37]. However, all the approaches provide some level of useful knowledge of agricultural systems and can help decision-making. Most agricultural models were developed from science knowledge for policy development and focus on agricultural sustainability and resilience [38,39,40,41,42]. Some of the available models group a wide range of indicators, such as the integrated Sustainable Development Goals model (iSDG, [40]), which is customisable for all countries, or the Integrated Valuation of Ecosystem Services and Tradeoffs (InVest), a multi-ecosystem-services modelling platform [43]. Other models only focus on one part of the system, such as crop models, water models, energy models, GHG emission calculators, or climate models. The selection of model thus depends on the application scale, the questions needing answers, system complexity, and data availability.
With more than six decades of multidisciplinary contribution to concepts and tools for agricultural systems modelling, the scientific community considers models critical to make informed agricultural decisions [39]. However, today, only few countries seem to have either appropriate agricultural systems models or decision tools to support policy development under disruptive changes (i.e., EU with their CAPRI model, [41]). In New Zealand, but also more widely in other Pacific countries, there is an urgent need for assessing the different pathways and interventions for a sustainable future of the agricultural sector under disruptive changes. Numerical and participative modelling is an option considered by the New Zealand government, and has been requested by the industry and sectoral organisations to gain in global understanding of the future of NZ agriculture and help define efficient long-term policies. As several modelling options are available, there is a need of synthesis knowledge to assist modellers and model users in selecting the most appropriate option for future application.
The aim of this paper is (1) to analyse agricultural system modelling approaches and (2) identify available model examples for thematic applications (3) to help address current NZ needs and support policy development. Agricultural system modelling knowledge is synthesised to help stakeholders with model selection and future model development. Agricultural system modelling approaches are analysed and currently available, and freely accessible (non-commercial) models are listed per thematic application. Model processes are described, as well as requirements in terms of skills and data needs, strengths, weaknesses, and the questions each is intended to answer. Discussion focuses on model usability and limitations.

2. The New Zealand Context

In New Zealand, nearly half of GHG emissions come from agriculture [44]. The main source of agricultural emissions is methane from livestock digestive systems and manure management which makes up around three quarters of the agriculture emissions. The next largest source is nitrous oxide from nitrogen added to soils. Nitrogen also leaches to groundwater and pollutes waterways through runoff. As a result of climate change and the Paris Agreement ratification, and the need to improve degraded water bodies, wetlands, streams, and groundwater, the New Zealand government has set up two major actions in the law, the Zero Carbon Amendment Act (2019), and the National Policy Statement for Freshwater Management (2020).
The NZ food and fiber export revenue represents a third of the country’s total export revenue. However, with a strong market-driven agricultural system, and despite numeric environmental targets and fixed deadlines, the NZ government (i.e., Ministry of Primary Industries, regional councils, policy-makers, regulators), industries (i.e., agritech organisations, lobby groups), and sectoral stakeholders (i.e., from dairy, beef and lamb, fisheries, horticulture, crops, or forestry sectors) still struggle to have a clear vision of the future of agriculture (Figure 1).
A NZ agricultural system model designed for policy-making purposes under disruptive changes should be able to address the key questions from government and industry organisations (Figure 1). For example, climate change disruptions (i.e., recurrent droughts, flooding events, or other extreme events such as storms or spring frosts) raise questions about agricultural production, mechanisms to adapt to changes, or new agricultural opportunities and actions that need to be developed to reduce anthropogenic impact on climate change. Environmental impacts of agricultural production (i.e., the reduction of water quality, the increase of food demand, the loss of biodiversity, and the increase of GHG emissions) raise questions about actions that need to be developed regarding sectoral footprints on the environment and the need for new technology or new infrastructure to address these impacts. New disruptive technologies or the generalisation (i.e., connectivity) of precision agriculture and new biotechnology raise questions on the gain in environment resilience, sustainability, and profitability that can be expected with new developments. Similarly, a model could be used to answer questions on how new policy and incentives limit environmental impacts.

3. Method

We conducted a literature-based scoping review [45], that consists in identification, selection, and synthesis of research studies to ‘map’ relevant knowledge and gaps in the field of interest. Here, the scoping review was conducted to synthesise knowledge about the main agricultural systems modelling approaches and available models. To this end, we identified, selected, and synthesised research studies, methods, and associated modelling tools.
For the analysis of approaches to model agricultural systems (Section 4), a search for bibliographic references was carried out using Google Scholar, ScienceDirect, Open edition, MDPI, and ResearchGate, searching for the following keywords: agricultural modelling, agricultural system modelling, agricultural national framework, and environmental modelling approaches. The following six main types of modelling approaches emerged from the literature review: participatory, deterministic, probabilistic, system dynamics, agent-based, and artificial intelligence. A search of these approaches combined with agriculture modelling in the titles, key words, or abstracts was also carried out. Article reference lists were also checked for other pertinent articles. We focused on recent publications in order to analyse the current scientific modelling knowledge.
For the analysis of existing models by thematic applications (Section 5), research was carried out online with a focus on NGOs’ initiatives like the Food and Agriculture Organisation, the United Nations, the Natural Capital Initiative, or policy support organisations. Governmental websites of primary industries of developed countries were also explored (mainly in USA, Canada, Europe, Australia, and New Zealand, as these provide broad access to data and models). From a methodological point of view, we used a set of key word searches on Google Scholar (related to decision support tools, agricultural modelling, agricultural policy model, agriculture, and ecosystem model, etc.), and a wider literature review of recent agricultural modelling reviews. We focused on developed countries’ model examples that contribute to define national policy developments. Model thematic applications identified through the review process were grouped as follows: Decision Support Tools (DST), crop models, water models, Greenhouse Gas emissions (GHG) calculators, climate models, and multi-ecosystem-services’ modelling platforms.

4. Analysis of Approaches to Modelling Agricultural Systems

Six main modelling approaches with different levels of complexity in terms of skills and data needs were identified (Figure 2), as well as their characteristics. Each approach is further described below, highlighting requirements for application, and their strengths and weaknesses.

4.1. Participatory Approach

The participatory approach is based on the active participation of experts or stakeholders. This approach is particularly useful and powerful when there is a lack of measured data (Figure 2). A conceptual framework of questions and systems thinking allows for the development of theoretical models or design concepts based on expert knowledge or stakeholders’ engagement [46]. This approach is also useful to resolve conflicts of interest [47,48].
Coupling different types of expertise during the process helps strengthen the development of a conceptual model [46] or to initiate other types of more complex modelling and scenario simulations [47,49]. Participatory approaches for system modelling or scenario development are useful to bring together expert and stakeholder knowledge from academic, political, and civil sectors. Engaging stakeholders along with scientists is increasingly used in environmental research for analysing global change impacts [50] or sustainable futures [51,52]. Some tools have been developed to structure the participatory approach and to help follow scientific protocols. For example, the RIO approach (Dutch acronym for Reflexive Interactive Design) aims to structurally address complex trade-offs and to contribute by process and design to change perspectives towards sustainable development avoiding conflict [46,53,54].
While the participatory approach works very well at a fine scale to help farmers on economically viable and environmentally strong decisions related to farm management [55], it is often used as a discussion tool for structuring environmental problems and design solutions (i.e., climate change adaptation roadmap, water management, sustainability of agricultural sector) at a larger scale (regional to national) [46,56,57,58].
Strengths:
  • At a regional to national scale, the participatory approach is well designed for policy- and decision-making if it is sustained by upstream numerical modelling.
  • Expert consultation can be a quicker process than numerical modelling and it does not necessarily need data or modelling skills.
  • When coupled with another approach, participatory process has a real benefit to integrate stakeholders’ participation (no data can fill the “real-world” knowledge gap).
  • When decision-making is the main aim, the participatory process is fundamental to gaining stakeholder buy-in.
Weaknesses:
  • The participatory approach can suffer several biases, including group think, depending on the point of view of experts/stakeholders.
  • It is a qualitative approach and therefore hard to quantify for coupling with other type of approaches.

4.2. Deterministic Approach

The deterministic approach consists of mathematical modelling using measured and known input parameters, with no degree of randomness. Deterministic models are based on the hypothesis that models, once calibrated, are able to project output events and magnitude of consequences (Figure 2). They are mostly based on phenomenological, mechanistic, or functional relationships between physical or biological elements.
Deterministic approaches are widely used for crop models to simulate plant growth under climate/soil/water conditions. For example, the multidisciplinary simulator for standard crops model (Simulateur mulTIdisciplinaire pour les Cultures Standard—STICS) [59,60] has been developed to simulate crop water and nitrogen balance under environmental (climate, soil) and agricultural conditions (cropping system), and to determine best sowing dates or predict yields. Deterministic models are also used in agronomy, for example, to predict sugar concentration of grapes from field observation and temperature-based models [61] that could help farmers to anticipate grape harvesting. Other agricultural-based modelling efforts have been developed using deterministic approaches for land use and crop yields’ mapping [62], crop rotation modelling [63], or environment-ecosystem process simulation [64,65].
Strengths:
  • At a regional to national scale, the deterministic approach is well designed for prediction that is required for decision-making and policy solution design, for example, climate change predictions and government actions [66,67].
  • Many models are freely available, while some are free of charge, free of copyright, and free of restrictions for modification (see Section 5). Many of these models are already parameterised for an easier application.
  • Models based on deterministic approach can be coupled with all other approaches to add stochasticity or stakeholders’ involvement and be part of different scenario modelling.
Weaknesses:
  • Deterministic models can be highly complex and difficult to readily adapt to specific study areas.
  • It requires very specific data to develop precise and complex modelling [59,63,68].
  • Upscaling or downscaling these models is a challenge and requires coupling with multiple source of data [69,70,71].

4.3. Probabilistic Approach

The probabilistic approach consists of adding stochastic components to a deterministic approach. This approach is based on statistical, frequentist, or Bayesian statistical models, using historical dataset to capture variability, and the use of optimisation techniques (Figure 2). Multiple linear regression, logistic regression, Poisson regression, generalised Pareto distribution, Monte Carlo simulation, weights of evidence, and geographically weighted regression are commonly used in probabilistic approaches [72,73]. Probabilistic models are less sensitive than deterministic ones to the non-stationarity of model parameters (i.e., great variations or disruptions). For example, probabilistic approaches work well for flood hazard and estimation of the 1-in-100 year flood extent where the model question is already a probability that needs mapping representation [74]. Many statistical models are developed using quantitative data table that can be coupled with a deterministic system response (i.e., crop yield, milk production, or farmers–consumers’ prices) [39]. The probabilistic approach, however, lacks extrapolation power because of the data dependency for parameterisation.
The probabilistic approach is also useful for understanding statistical relationships between drivers of changes. This type of approach works well for Land Use and Land Cover Change (LULCC) modelling by coupling statistical methods like Markov chain for quantifying change over years, and to integrate probability in changes in maps [75,76], or for agricultural–economic production relationship analysis [77], historical data, and reconstruction of crop sequences [78], or allocation-optimisation based on statistical multi-criteria analysis [79].
Strengths:
  • At a regional to national scale, this approach is well designed for land-use change dynamic analysis and for policy adaptation [75,80,81].
  • With a large amount of data available freely, the probabilistic approach can be easily considered both for statistical and spatial trend analysis.
  • Coupling deterministic and probabilistic approaches can lead to powerful modelling of the climate change adaptation for agriculture and land-use strategies.
Weaknesses:
  • Statistical models are inherently unsuited to predict the impact of major disruptions because of the historical data/parameterisation dependency for this approach.
  • Analysis tools are freely available (R, Q-GIS), but advanced skills in data processing are needed.

4.4. System Dynamics Approach

The system dynamics (SD) approach is a scientific framework for addressing complex and non-linear feedback systems [82]. This systems thinking approach contrasts with probabilistic and deterministic approaches by their ability to describe non-linearity of the changes in system states responding to external drivers [83] (Figure 2). SD models are usually used for energy policy development, environmental policy analysis, innovation impact evaluation, strategic planning, and public policy evaluation [84,85,86]. The SD process is iterative and interactive, and stakeholders can be involved at every stage of the process from question definition, to conceptual/mental model building, formal model development strategy, and scenario testing feedback. SD models are designed to address the “What if?” question of a complex problem and are useful for prospective scenario testing. Consequently, they are widely used to develop efficient Decision Support Tools (DST) to help in policy development and decision-making, and are often coupled with other types of models (see Section 4, and Table 1).
SD approach has been widely used in hydrology and water resources management [87,88,89], agricultural land and soil resources [90,91], or food system resilience [92,93,94,95].
Strengths:
  • At a regional to national scale, the system dynamics approach is well designed for scenario testing and policy prospection.
  • SD approach allows multi-disciplinary and multi-method integration. Other approaches can be coupled/linked with SD (participatory, deterministic, probabilistic approaches) to better emphasise the complexity of agricultural and natural resources issues.
  • SD approach is suitable to reproduce agricultural systems’ organisation and to design new strategies or to experiment management/policy scenarios [96].
Weaknesses:
  • The main difficulty in SD approach is validation. Especially when modelling disruptive scenarios, and when internal (model behaviour) and external (outputs) validation possibilities are limited [97]. However, a range of tools can be used to help for validation: the use of local knowledge (participatory-expertise approach) and historical data for calibration (probabilistic approach); running sensitivity analysis of key variables, or analysing scenarios and results in comparison with expert opinions (expert modellers and expert stakeholders).
  • There is a risk of formulating erroneous policy by trusting simulations of invalidated models [91].

4.5. Agent-Based Approach

The agent-based approach consists in modelling a system with autonomous decision-making entities interacting with their environment [98]. Agent-based models (ABMs) aim to reproduce real-world-like complexity (Figure 2). ABMs are usually based on a parsimonious paradigm [99] that leads to simple models with great explanatory power. This modelling approach is the only multi-level approach, allowing emergence of processes and feedback loops that mean behaviour adaptation of individuals or groups of individuals [99,100,101,102]. This makes the ABMs very useful to simulate behaviour adaptation to new incentives, or new policy, especially for scenario testing [103].
ABMs can be used as spatially explicit models. Using real (i.e., GIS layers or pixel grids) or virtual landscapes accounting for the spatial dimension, distance, and time concepts, ABMs allow coupling with LULCC models to analyse the processes causing the changes [102,104]. For example, farming decisions depend on incentives and interactions at different levels of organisation, such as interactions with other farmers, institutions, associations, markets, or other networks [100,101,104,105]. ABMs are also useful to test individual and collective adaptations to new policy, for example, GHG price effect [102], or adaptation capacity of winegrowers to climate change [106].
Strengths:
  • At a regional to national scale, the ABM approach is well designed to simulate society or stakeholders’ behaviour facing new policy.
  • ABM approach allows coupling of models (using additional physical deterministic models like crop or climate models).
  • ABM approach allows for the development of conceptual models to test simple agent behaviours or the combination of behaviours under different incentives.
  • ABM approach can simulate disruptions and agent adaptation capacities to a system at different organisation levels and scales.
Weaknesses:
  • Like SD, it is difficult to validate ABMs, but a range of tools can be used: the validation of the conceptual framework (by external experts or stakeholders), a robust sensitivity analysis to make sure conclusions fit with the model [104].
  • ABMs are not suitable for prediction but powerful for scenario testing.

4.6. Artificial Intelligence

Artificial Intelligence (AI) is an interdisciplinary approach consisting of a set of algorithms trying to mimic human intelligence. AI is already widely used for fraud detection and prediction models, image recognition patterns, spam filters, speech and audio recognition (Google, Siri, Cortana, Alexa, etc.) and others [107]. Machine learning algorithms and deep learning tools are commonly used to automatically learn from data, such as sensor data or databases, to recognize complex patterns and make intelligent decisions based on data [108]. AI allows for analysing big data quickly [109], regardless of complexity (Figure 2). In agricultural sciences, AI is widely used for predicting crop yields [110], for precision agriculture [107], agriculture automation [111], disease detection, and weed, crop, livestock, water, soil, and irrigation management [112,113] by supporting, for example, better management practices for irrigation as well as pesticide and nutrient application.
Moreover, AI is often used to analyse multi-temporal Remote Sensing data [114], and with new satellite mission initiatives (e.g., the Trishna initiative—Thermal infraRed Imaging Satellite for High-resolution Natural resource Assessment), it is a very promising tool for more systematic use of precision agriculture and a deeper understanding of environmental processes at real-time (e.g., like monitoring water status of continental ecosystems, improving the understanding of crop water requirements and water balances). The analysis of this data has the potential for better irrigation management and earlier potential drought warnings.
Strengths:
  • At a regional to national scale, the AI approach is well designed for big data exploration and sense-making from various datasets that can help to inform policy.
  • AI approach is widely used for prediction and management.
  • AI allows coupling various types of data and is powerful for big data analysis.
  • AI techniques improve classification and prediction.
Weaknesses:
  • AI modelling techniques require high skills, large datasets, and complex training procedures.
  • AI approach allows for learning problems very well, but the generalisation is not possible beyond the boundaries of data and model developed (for anything untrained).

5. Analysis of Existing Models by Thematic Applications

In this section, we analyse existing models focusing on agricultural systems by main thematic applications with an emphasis on models used for agricultural policy development at the national level. The analysis focuses on an existing suite of models, skills and data needed to run the models, and how they are used to address global sustainability and adaptation challenges. A wide range of skills are needed to run the models, such as GIS knowledge, statistical or geostatistical knowledge, crop/soils/climate knowledge, and computer skills like programming. The models selected are organised into six thematic applications where DST directly informs policy and the decision-making process, and other environmental models create knowledge of environmental issues and can be used directly or as inputs of DST to inform policy of decision-making (Table 1):
  • Decision Support Tools (DST) are developed to support decision-makers in addressing policy or conservation questions (Table 1). For example, the Integrated Sustainable Development Goals (iSDG) is a DST that was developed by the UN via the Millennium Institute to analyse the 17 SDG goals and impacts of changes for each country to help in the development of appropriate policies. The European Common Agricultural Policy Regionalised Impact (CAPRI) Modelling System is another DST example that was developed to support decision-making related to the Common Agricultural Policy [41]. The American Trade-Off Analysis-Multidimensional (TOA-MD) impact assessment model simulates economic, environmental, and social impacts of agricultural systems [38]. The Australian Multi-Criteria Analysis Shell (MCAS-S) for Spatial Decision Support allows stakeholders seeing the effects of land-use change decisions [115]. The American Agricultural Conservation Planning Framework (ACPF) identifies site-specific opportunities to install conservation practices across small watersheds [116,117,118]. The Reflexive Interactive Design (RIO) conceptual approach works as an expert consultation guideline [119,120].
  • Crop models are simulation models describing the crop growth processes and development for varying weather, soil, and management conditions. Widely used crop models (Table 1) include the Agricultural Model Intercomparison and Improvement Project (AgMip) linking climate, crop, and economic modelling to improve models and project scenarios under climate change conditions for several agricultural sectors [121]. The Agricultural Production System sIMulator (APSIM) [93], the Decision Support System for Agrotechnology Transfer (DSSAT) [122], or Aquacrop model to assess crop growth, crop yield or food security issues [123]. Other crop models not presented in Table 1 included models that are focussed on enhancing scientific understanding, more complex to use, and required a large amount of data and skills.
  • General water models (Table 1) are developed to understand or manage water quality and quantity of hydrological processes under different physical and management conditions. Two water models provided by FAO are CropWat, that links crop and water modelling to calculate crop water and irrigation requirements based on soil, climate, and crop data [124], and Aquastats, which monitors the SDG 6 (ensure availability and sustainable management of water and sanitation for all), and in particular on water stress and water use efficiency [125]. Other widely used water models include WaterWorld [126], developed to understand hydrological processes and water resources, and the Soil and Water Assessment Tool (SWAT), a small watershed to river basin-scale model used to simulate the quality and quantity of surface and ground water, and predict the environmental impact of land use, land management practices, and climate change [127,128]. Additionally, many multi-service platforms provide general water modelling tools.
  • Greenhouse gas emission (GHG) calculators mostly focus on deterministically estimating carbon and methane emissions (Table 1). Among GHG calculators [129], easy-to-use models that provide great added value on mitigation possibilities include the Ex-Ante Carbon-balance Value Chain Tool (Ex-ACT VC) developed by FAO to increase resilience of populations and ecosystems, and to decarbonize the global economy [130,131], the Agro Chain Greenhouse Gas Emission calculator (ACGE), which estimates total GHG emissions associated with food products [132], and the Climate Change, Agriculture and Food Security-Mitigation Options Tool (CCAFS-MOT), a mitigation options tool estimating GHG emissions from multiple crop and livestock management practices [133].
  • Climate models take into account complex atmosphere–ocean–land surface–cryosphere interactions through physics-based knowledge. A full review of climate models is out of the scope of this paper, but the Climate Analogues model provided by FAO [134] caught our attention for its adaptation-focus approach (Table 1). This model identifies areas that experience statistically similar climatic conditions, but which may be separated temporally and/or spatially. The approach allows locating areas whose climate today is similar to the projected future climate of a place of interest, or vice versa. The approach allows comparing agricultural systems working in “future” climate conditions to help define adaptation strategies.
  • Multi-service platforms are a shell of models related to Ecosystem Services quantification, mapping, and modelling. They group agricultural production, carbon stock, pollination, water quality, and other models together (Table 1). Multi-service platforms include the widely used Integrated Valuation of Ecosystem Services and Tradeoffs (InVest) [43], the Toolkit for Ecosystem Service Site-Based Assessment (TESSA) [135], or the Co$ting Nature platforms developed to explore how changes in ecosystems can lead to changes in the flows of many different benefits to people [136].
Table 1. Examples and thematic applications of national and regional agro-environmental models.
Table 1. Examples and thematic applications of national and regional agro-environmental models.
Model ApplicationModelling ApproachModel NameSpatial ScaleInput Data NeedsModel AimSkills NeededStrengths (+)/
Weaknesses (−)
CommentsReferences
Decision support toolSystem dynamicsIntegrated Sustainable Development Goals (iSDG)
National scale, country-based model.Worldwide data on social, economic, and environmental sectors.Policy simulation tool designed to help policy-makers and stakeholders make sense of interconnections between the SDGs. iSDG focuses the dynamic interactions within the SDG system to reveal the best paths and progression towards achieving the SDGs.Model open for collaboration with the iSDG team to develop own country’s example.+: Already implemented model around the 17 SDGs defined by the Millennium Institute. Developed first for food security issues; also used for other questions like clean energy use in the USA.
Could be interested to develop for a carbon-neutral objective.
[40]
https://www.millennium-institute.org/isdg (accessed on 1 December 2021)
−: Not agricultural system model only. Wider than agricultural sector.
Non-spatial modelling. Indicator scores only.
System dynamicsCommon Agricultural Policy Regionalised Impact (CAPRI) modelling systemEuropean Union (27) +Norway, Western Balkans, Turkey scale, NUTS2 scale (280 regions), and 10 farm types for each region. Economic data, farm/market balance, unit value prices, policy variables. Data provided by FAOSTAT and Eurostat.Economic model developed by EU to support decision-making related to the Common Agricultural Policy based on scientific quantitative analysis.High skills (GIS, programmation). +: Already developed, stable, and complete process for EU. Spatial modelling.Multifunctionality indicators analysis (food security, landscape, environment, rural viability), applied to the agricultural sector, with an economic model. [41]
https://www.capri-model.org/dokuwiki/doku.php (accessed on 1 December 2021)
−: Can be adapted to other countries around the world but with heavy development to plan.
System dynamicsTradeoff Analysis—Multi Dimensional impact assessment
(TOA-MD)
National, regional to local scale.Whole farm system (crops, livestock, aquaculture, income), simulating economic indicators, threshold indicators for any other quantifiable economic, environmental, or social outcome.Model developed to improve the understanding of agricultural system sustainability and inform policy decisions. TOA-MD can be used to analyse technology adoption, payment of ecosystem services, environmental change impact, and adaptation.Medium to high skills.+: Already developed, stable, and complete process.
Free and easy access to the full model. Model link with AgMIP crop model.
Spatial modelling.
Developed by Oregon State University/USA
Can be requested by registration form online.
[38]
https://agsci.oregonstate.edu/tradeoffs/about-toa (accessed on 1 December 2021)
Deterministic/ProbabilisticMulti-Criteria Analysis Shell for Spatial Decision Support
(MCAS-S)
International, national, regional, and catchment scale. GIS data/map layers.MCAS-S informs spatial decision-making and help with stakeholder engagement. Model shows transparently how mapped information can be combined to meet an objective. Model allows stakeholders to see the effects that their decisions may have. Medium to high GIS skills.+: Already developed, stable, and complete process.
Free and easy access to the full model. Already used for several resources management and adaptation.
Spatial and multi-criteria statistical modelling.
Developed by the Australian Department of Agriculture, Water and the Environment.
Download available for free.
[115]
https://www.agriculture.gov.au/abares/aclump/multi-criteria-analysis (accessed on 1 December 2021)
Deterministic/ProbabilisticAgricultural Conservation Planning Framework
(ACPF)
Watershed to regional scale.GIS land use and soils.ACPF informs and engages local producers in agricultural conservation. It helps in engaging with stakeholders and building
conservation solutions.
Medium to high GIS skills.+: ArcGis toolbox module.
Users are able to build their own database.
Spatial and multi-criteria statistical modelling.
Model available for free as an ArcGis module. Already used by conservation planners, project coordinators, agency staff etc. [116,117,118]
https://acpf4watersheds.org/ (accessed on 1 December 2021)
Participatory approachReflexive Interactive Design
(RIO)
Aspatial, conceptual process.Expert consultation approach, need for knowledge, not data.RIO structurally addresses complex trade-offs and contributes by process and design to change towards sustainable development.Low skills, but high field or system knowledge needed.+: First step to design a new system approach. Interesting for stakeholders’ engagement without any skills requested.[119,120]
ActionCatalogue-method (accessed on 1 December 2021)
−: No quantification nor spatial analysis. Only conceptual approach.
Crop ModelPhysical/
Deterministic
Agricultural Model Intercomparison and Improvement Project
(AgMIP)
World to national scale.Worldwide data on climate, crops, and economy.AgMIP was developed to improve agricultural models for assessing impacts of climate variability and change and other driving forces on agriculture, food security, and poverty.Medium to low computational skills.
+: Use worldwide dataset, good for country comparisons. Online model with data translator.Developed for food security issues.
[121]
https://agmip.org/ (accessed on 1 December 2021)
−: Only sectoral applications, no general overview of agricultural systems.
Physical/
Deterministic
Agricultural Production System Simulator
(APSIM)
Global to local scale.Field data and observation needed.APSIM is a highly advanced model for modelling and simulation of agricultural systems. It contains a suite of modules that enable the simulation of systems for a diverse range of plant, animal, soil, climate, and management interactions.High skills on crop modelling needed.+: Very precise farming model.
More than only crops.
Online download available for free.
Based on crop model, with other parameters larger than only crops (like livestock, and climate variability effects). Developed in Australia and New Zealand. [93]
https://www.apsim.info/ (accessed on 1 December 2021)
−: Not easy to use. Require very precise agronomic knowledge.
No spatial component.
Physical/
Deterministic
Decision Support System for Agrotechnology Transfer (DSSAT)Aspatial model.42 crops implemented, database management for soil, weather, crop management, experimental data.The DSSAT crop model simulates growth, development, and yield as a function of the soil–plant–atmosphere dynamics.High skills on crop modelling needed.+: already implemented for 42 crops.Online download available for free.[122]
https://dssat.net/about/ (accessed on 1 December 2021)
−: Crop model only.
Physical/
Deterministic
AquaCrop Aspatial model. Weather data, crop and soil characteristics, management practices.Crop growth model developed by the Land and Water Division of FAO to address food security and to assess the effect of environment and management on crop production. Crop yield prediction model under vertical conditions.Medium to high skills in crop modelling and agronomy.+: Good to assist for management decisions on irrigation or on crop response to environmental changes.Software available online for free. Provided by FAO.[123]
http://www.fao.org/aquacrop/overview/whatisaquacrop/en/ (accessed on 1 December 2021)
−: No spatial component.
Water/Crop modelPhysical/
Deterministic
CropWat Aspatial, farmer to landscape resolution. Crop, soil, climate data. Decade and daily calculation of crop water requirements.Calculation of crop water requirements and irrigation requirements based on soil, climate, and crop data. CROPWAT can also be used to evaluate farmers’ irrigation practices and to estimate crop performance under both rain-fed and irrigated conditions.Medium agronomical skills.+: Software freely available online.
Allow the development of irrigation schedule.
Provided by FAO. [124] http://www.fao.org/land-water/databases-and-software/cropwat/en/ (accessed on 1 December 2021)
−: Work firstly at farm scale; can be used at small catchment scale.
Water/Crop modelPhysical/
Deterministic
Soil and Water Assessment Tool
(SWAT)
Small watershed to river basin.GIS topography, land use, soil, climate data.Simulation of the quality and quantity of surface and ground water. Prediction of the environmental impact of land use, land management practices, and climate change.High water, GIS and, modelling skills.+: Spatial modelling. Already widely used in assessing soil erosion prevention and control, non-point source pollution control, and regional management in watersheds.
Software available for free with a GIS connection.
Data can be provided online from available world data to help build own model.[127,128]
https://swat.tamu.edu/ (accessed on 1 December 2021)
WaterPhysical/
Deterministic
AQUASTATGlobal, regional, national scale.Worldwide data on water resources, water use, and agricultural water management.AQUASTAT is monitoring of the Sustainable Development Goal 6 that sets out to “ensure availability and sustainable management of water and sanitation for all”, and, in particular, on water stress and water use efficiency.Medium data analysis skills to collect and bring together information.+: Model outputs already available. Provided by FAO.[125]
http://www.fao.org/aquastat/en/ (accessed on 1 December 2021)
−: Low resolution, but already processed.
Physical/
Deterministic
WaterWorldLarge to fine scale.Data provided from remote sensing or other global sources. Own data sources can be used.Waterworld aims to understand the hydrological and water resources baseline and water risk factors associated with specific activities under current conditions, and under scenarios for land use, land management, and climate change.Medium to low as default parameters and data are provided. More complicated to use with own data and precise parameterisation at a local scale.+: Quick and relatively easy to use.
Allow scenarios, spatial model, spatial outputs.
Used detailed spatial datasets at 1 km2 and 1 ha resolution for the entire world. Spatial model for biophysical and socio-economic processes along with scenarios for climate, land use, and economic change.[126]
http://www.policysupport.org/waterworld (accessed on 1 December 2021)
GHG emission calculatorPhysical/
Deterministic
Ex-Ante Carbon-balance Tool value chain
(EX-ACT VC)
From local to national scale.Worldwide data provided by FAO. EX-ACT VC aims to develop sustainable and performant food value chain in order to eradicate poverty in rural areas, to increase resilience of populations and ecosystems, and to decarbonize our global economy.Medium to low data skills.+: Works as a decision support tool. Indicators like value added, employment, water use, emissions, food loss and waste, and resilience are monitored by the model.Excel software/indicators open access and free download.
Provided by FAO.
[130,131]
http://www.fao.org/tc/exact/ex-act-vc/en/ (accessed on 1 December 2021)
Physical/
Deterministic
Agro chain greenhouse gas emission
(ACGE)
From world to regional scale, per agricultural production type.Regional data, specific data on transport and packaging.ACGE estimates total GHG emissions associated with a food product. It addresses the most common stages of “linear” agro-food chains (chains for fresh and simple processed products: canned, frozen, packaged, and other minimally processed forms).Low skill, Excel sheet to fill.+: Default data are already implemented. General indices. Large regional indices. Very easy to use Excel sheet. Quick to obtain indices on general GHG emission per agricultural production type. Clear guidelines provided.[132]
https://ccafs.cgiar.org/agro-chain-greenhouse-gas-emissions-acge-calculator#.Xvq6hCgzYuU (accessed on 1 December 2021)
−: Not easy to downscale at national scale.
Physical/
Deterministic
Climate Change, Agriculture and Food Security—Mitigation Options Tool (CCAFS-MOT)Regional to national scale.General data on national climate, soil, crop, and grassland management. Model estimates greenhouse gas emissions from multiple crop and livestock management practices, providing policy-makers with access to reliable information needed to make science-informed decisions about emission reductions from agriculture.Low skill, Excel sheet to fill.+: Easy to use.
FAO data can provide all the needed inputs.
Very efficient tool providing emissions and mitigation potentials for crops, grasslands, and livestock.[133]
https://cgspace.cgiar.org/handle/10568/67027 (accessed on 1 December 2021)
Climate ModelsProbabilisticClimate AnaloguesWorldwide.Use current climate data from WorldClim aggregated to 2 degrees, (1970–2000). Future climate data come from CCAFS-Climate for all CMIP5 and RCPs.The models identify areas that experience statistically similar climatic conditions, but which may be separated temporally and/or spatially. The approach allows locating areas whose climate today is similar to the projected future climate of a place of interest, or vice versa.Medium to low skill.+: Easy to use data are already implemented.
Model is running with R.
Very interesting to compare the future climate of a region of interest with other places in the world and what agriculture can look like. Good for building mitigation options rapidly.
Provided by FAO.
[134]
https://www.ccafs-analogues.org/ (accessed on 1 December 2021)
−: No downscaling allowed.
Multi-service platformPhysical/DeterministicIntegrated Valuation of Ecosystem Services and Tradeoffs
(InVest)
Local to global scale. Spatial resolution and data input are flexible (wide range of environmental modelling).Suite of models used to map and value the goods and services from nature that sustain and fulfill human life. It helps explore how changes in ecosystems can lead to changes in the flows of many different benefits to people.Medium to high. Need GIS and mapping skills to build own data and analyse outputs. +: Spatial modelling of a wide range of ES. Allow spatial inputs and outputs.
Can be used with other model outputs in a GIS.
Almost 20 models available for free such as: carbon, pollination, habitat quality, reservoir hydropower, crop production, habitat risk assessment, sediment retention, water purification, etc.[43]
https://naturalcapitalproject.stanford.edu/software/invest (accessed on 1 December 2021)
Physical/DeterministicToolkit for Ecosystem Service Site-Based Assessment
(TESSA)
Local to global scale.Land-use data, default parameters provided.TESSA aims to understand the impacts on natural capital and ecosystem services of actual and potential changes in state at individual sites. TESSA aims to promote better planning decisions to support both biodiversity conservation and ecosystem service delivery. Medium to low: guides for non-specialist users through various methods for rapidly quantifying a range of ecosystem services.+: Toolkit, multi-indicators, ES-based, developed for decision-making.
Can be used by non-experts.
ES approach, not agricultural approach. Evaluate a range of 10 ES (nutrition, water supply, materials, energy, regulation of biophysical, flow, physico-chemical, biotic environment, 2 cultural ES). [135]
http://tessa.tools/ (accessed on 1 December 2021)
Physical/DeterministicCo$ting NatureWorldwide.Spatial datasets at 1 km2 and 1 ha resolution for the entire world. A web-based tool for natural capital accounting and analysing the ecosystem services provided by natural environments (i.e., nature’s benefits), identifying the beneficiaries of these services, and assessing the impacts of human interventions. Medium to low. +: Online platform with already implemented data. Spatial models for biophysical and socio-economic processes along with scenarios for climate and land use.
[136]
http://www.policysupport.org/self-paced-training/costingnature-english (accessed on 1 December 2021)
−: Target Ecosystem Services, more for conservation and development, less for only agricultural purposes.
No downscaling available.

6. Discussion

6.1. Range of Model Approaches and Thematic Applications

The approaches and model examples presented in Figure 2 and Table 1 show a range of freely and easily accessible tools, which require low to high levels of input data and application skills. That means modelling of agricultural systems does not necessarily require time-consuming data collection or model development for certain levels of application, but only a few models are available for regional or national modelling applications. For example, the FAO models can be used as-is for basic scenario modelling or for feeding another model. The benefits from combined approaches and the use of spatial models for better land planning are also obvious. For example, coupling a participatory approach to a quantitative deterministic or probabilistic approach to include stakeholder engagement for scenario design or to test stakeholder behaviours on an ABM enhances the model outputs.
A range of models are available to address specific questions faced by the NZ government at a national or regional decision-level, related to agricultural systems technology, disruptions, and the environment (Figure 1), but none of the currently available models or approaches can answer all questions by themselves. A combination of several approaches and existing models can help address individual disparate issues (Table 2).
Analysis of modelling approaches and model examples allows for identifying model strengths, weaknesses, data needs, and skill requirements to select the best combination for the NZ needs. A DST, based on an SD approach, can be the most suitable modelling system at a regional to national scale for modelling the agricultural systems to support policy development and anticipate main impacts. For example, the iSDG model developed by the Millennium Institute [40] aims to model the interconnections between a large number of objectives to help identify policy interventions (Table 1). This model focuses on the dynamic interactions within the objectives to reveal the best pathways towards achieving them all. The SD approach used appears to be perfectly suited to the modelling of interconnections even for non-linear relationships of the system between parameters and feedback loops. DST are even more efficient when coupling with a spatial component. For example, the CAPRI model, using an SD approach (Table 1), was specifically developed for the European agricultural system to evaluate the impacts of the Common Agricultural Policy and trade on production, income, markets, trade, and the environment from global to regional scales [41]. The model architecture is organised around a supply model of 280 European regions embedded in a global market model, and uses specific spatial and non-spatial databases. The indicators defined in the model are relevant to addressing agricultural/environmental issues related to Nitrogen and Phosphate balances, GHG emissions, animal stock density, irrigation and water consumption, and the value of nature. In addition, the spatial component from national to regional scales is ideally suited for its intended application. The model allows spatial and temporal analysis of trends and the impacts of new policies. It also takes into account the international market supply and demand chain. One negative point of the CAPRI model is its inability to transpose and calibrate the model to any other country outside the EU without restructuring the model. In comparison, the American Trade-Off Analysis-Multidimensional (TOA-MD, Table 1) impact assessment model is a smart-model easily re-usable, using an SD approach, taking into account economy, technology, policy, crop, livestock, and aquaculture subsystems to simulate adoption, outcome distributions, and impact indicators of new policy [38]. This model, which includes a spatial component, can also be used for analysing ecosystem services, the impacts of climate change, and other environmental changes. The SD approach used for DST in policy development is the most suitable approach to model complex and dynamic systems and allows coupling with other model approaches.
One complementary approach to SD is the spatial Multicriteria Analysis (MCA). Spatial MCA is based on a deterministic or probabilistic modelling approach and is used within a geographic information systems (GIS) spatial platform. Spatial MCA is of added-value for land-use planning optimisation because it allows mapping of model outputs or stakeholder choices. Widely used for quantifying multifunctionality of agriculture [137,138] or ecosystem services trade-off and bundles [139,140], MCA are quantitative and goal-oriented models. An example of this complementary approach is the Australian Multi-Criteria Analysis Shell for Spatial Decision Support (MCAS-S, Table 1), which is designed for decision-makers to combine and meet planning objectives [115]. This model helps with stakeholder engagement by showing the effects of decisions using spatial information. Only basic GIS skills are needed to apply this model because of the user-friendly interface and inbuilt GIS database. On the contrary, the Agricultural Conservation Planning Framework (ACPF, Table 1) is a GIS toolset developed for MCA and requires a high level of GIS skills. This model, however, allows engagement with stakeholders to build conservation solutions in an agricultural context [116,117,118].
Whatever the skills needed and methodological choices, the spatial MCA allows for the SD model to provide a spatial representation of scenarios. MCA can thus help to provide optimal allocation propositions and scenario assessments for any systems models.

6.2. Limits, Margin of Progress, and Recommendations for Future New Zealand Development

With more than six decades of multidisciplinary contribution to concepts and tools for agricultural systems modelling, the scientific community considers models critical to make informed agricultural decisions [39]. However, despite all data and models available, models often fail to inform policy. For example, the European Commission defined a strategy to halt biodiversity loss affected by the agricultural sector by 2020. Those efforts were supported by the Common Agricultural Policy (CAP) subsidies (40% of the EU budget, EUR 362.8 billion) for the 2014–2020 period. However, the agricultural reforms failed on biodiversity, mainly due to underestimation of intensive farming, increasing of chemicals, and machinery use (according to European Court of Auditors). In addition to limited modelling, other reasons for failure include the dilution of ambitions, targeting large farms only, multiple possible exemptions, and abandonment of previous working measures (e.g., reduction of permanent grassland) [27,141]. A large number of other models have been developed since 2014 to understand the failed processes [142,143] and define recommendations for the 2030 strategy. They highlighted the need for more flexibility to regional adaptations and a focus on land-use processes rather than quantity (e.g., connectivity of landscape element to support overall diversity) [141,142]. In the context of a future development of the NZ agricultural system model, the example of the European model limits are to be considered. The chosen or developed model must take into account the complexity of the whole system, but it must also maintain an expert analysis phase downstream from the modelling outputs.
The next generation of models should be led by the use of AI, and should include advances in technology, such as precision agriculture, biotech, and others. During the analysis process, we did not find any national or regional agricultural systems of DST model based on AI, as proper training of AI systems requires large volumes of data, and in a sense, AI is still in its infancy in environmental applications. However, as agricultural systems modelling has always capitalised from technology advances, operating with big data and generalising cloud computing is a major avenue of future development. The current state of agricultural system models’ complexity is sufficient for powerful applications [83].
To select the ideal model or combination of models for future agricultural system modelling initiatives in NZ, modellers and users should consider the following:
  • Clearly identify the question(s) to be answered or the objectives of the modelling initiative.
  • Assess the data available for modelling (qualitative, quantitative, statistical databases, field observations, GIS maps, etc.). The data available will help refine the modelling approach to use and model thematic application, and if needed, help identify what additional data needs to be collected.
  • Evaluate existing models and their adaptation potential to address the modelling requirements. Consideration for the type of approach needed, model thematic application, and model availability will depend on items 1 and 2 above. Furthermore, consideration should be given to a combination of modelling approaches to address all requirements, if necessary.

7. Conclusions

There is currently an urgent need for a national scale agricultural systems modelling in NZ to address key questions of the sector, due to critical global environmental, socio-economic, and technological disruptions. Although there are a number of models available for agricultural systems modelling, none are intended to be used for modelling major national or regional disruptions to agriculture, or their usability outside inbuilt geographic boundaries is low. Furthermore, most models are only intended for targeted applications for understanding the effects of land-use change, climate, or other specific changes. The FAO suite of models are freely globally accessible, provide generalised country-specific input data, and are quickly reusable for specific regional to national modelling initiatives; however, the weakness of these models is in their singular modelling approach, which limits their applicability to address a range of complex disruptions at once.
Six broad modelling approaches were identified, and each of these approaches provides for specific strengths, weaknesses, and application complexities. The participatory approach allows a great stakeholder engagement; deterministic approaches allow for a direct link with field knowledge and physical processes; probabilistic approaches provide statistical modelling to explain uncertainties; system dynamics approaches allow for modelling complex systems and include feedback loops and delay response; agent-based approaches permit behaviour reproduction and testing, and artificial intelligence allows for deep learning of any source of data to provide understanding of previous changes, which can be used as a predictive tool.
To better understand the current complex disruptions affecting the NZ agricultural sector and assess relevant policies to address future disruptions, a suite of physical crop–water–climate models (i.e., FAO models) should be linked to economic, trade, and production models (i.e., CAPRI model), ecosystem health models (i.e., InVest), and target socio-environmental global objectives (i.e., ISDG indices). An SD approach would be an ideal framework to allow for an integration of these models for both temporal and spatial analysis. Furthermore, ABM could be used to understand and test behaviour of stakeholders under various scenarios of disruptions. Free national datasets (i.e., NZ Stats, sectoral statistics Dairy NZ, Beef&Lamb, Irrigation NZ), international datasets (i.e., FAOSTAT) and maps (i.e., Global Land Cover, OurEnvironment NZ), together with data analysis of national or global datasets through Artificial Intelligence could provide for the necessary inputs to drive such models and also be used to calibrate and validate results through comparison to examples of historical disruptions to agriculture.
The complexity of the NZ agricultural system and its economic, social, and environmental implications, requires integrative approaches, particularly at the national scale for policy and decision-making. A single modelling approach has limited usefulness for modelling of complex agricultural disruptions and thus future investment is needed by the NZ government and industry in integrative modelling development. Finally, this analysis suggests the use of a spatial DST, based on an SD approach, as the most suitable modelling system at a regional to national scale for modelling the NZ agricultural system to support policy development and anticipate main impacts and future disruptions.

Author Contributions

Conceptualization, C.V., T.A.C., L.B. and P.Z.R.; methodology, C.V. and T.A.C.; formal analysis, C.V.; data curation, C.V.; writing—original draft preparation, C.V. and T.A.C.; writing—review and editing, T.A.C., L.B. and P.Z.R.; supervision, T.A.C., L.B. and P.Z.R.; project administration, T.A.C.; funding acquisition, T.A.C., L.B. and P.Z.R. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors certify that they have no affiliations with or involvement in any organization or entity with any financial interest in the subject matter or materials discussed in this manuscript.

References

  1. Keith, H.; Vardon, M.; Stein, J.A.; Stein, J.L.; Lindenmayer, D. Ecosystem Accounts Define Explicit and Spatial Trade-Offs for Managing Natural Resources. Nat. Ecol. Evol. 2017, 1, 1683–1692. [Google Scholar] [CrossRef] [PubMed]
  2. Rolnick, D.; Donti, P.L.; Kaack, L.H.; Kochanski, K.; Lacoste, A.; Sankaran, K.; Ross, A.S.; Milojevic-Dupont, N.; Jaques, N.; Waldman-Brown, A.; et al. Tackling Climate Change with Machine Learning. arXiv 2019, arXiv:1906.05433. [Google Scholar] [CrossRef]
  3. Wang, X.; Daigger, G.; Lee, D.-J.; Liu, J.; Ren, N.-Q.; Qu, J.; Liu, G.; Butler, D. Evolving Wastewater Infrastructure Paradigm to Enhance Harmony with Nature. Sci. Adv. 2018, 4, eaaq0210. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Janssens, C.; Havlík, P.; Krisztin, T.; Baker, J.; Frank, S.; Hasegawa, T.; Leclère, D.; Ohrel, S.; Ragnauth, S.; Schmid, E.; et al. Global Hunger and Climate Change Adaptation through International Trade. Nat. Clim. Chang. 2020, 10, 829–835. [Google Scholar] [CrossRef] [PubMed]
  5. Porfirio, L.L.; Newth, D.; Finnigan, J.J.; Cai, Y. Economic Shifts in Agricultural Production and Trade Due to Climate Change. Palgrave Commun. 2018, 4, 111. [Google Scholar] [CrossRef]
  6. Mason-D’Croz, D.; Bogard, J.R.; Herrero, M.; Robinson, S.; Sulser, T.B.; Wiebe, K.; Willenbockel, D.; Godfray, H.C.J. Modelling the Global Economic Consequences of a Major African Swine Fever Outbreak in China. Nat. Food 2020, 1, 221–228. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Tian, X.; von Cramon-Taubadel, S. Economic Consequences of African Swine Fever. Nat. Food 2020, 1, 196–197. [Google Scholar] [CrossRef]
  8. Friel, S.; Schram, A.; Townsend, B. The Nexus between International Trade, Food Systems, Malnutrition and Climate Change. Nat. Food 2020, 1, 51–58. [Google Scholar] [CrossRef] [Green Version]
  9. Burton, R.J.F. The Potential Impact of Synthetic Animal Protein on Livestock Production: The New “War against Agriculture”? J. Rural Stud. 2019, 68, 33–45. [Google Scholar] [CrossRef]
  10. Collins, C.M.; Vaskou, P.; Kountouris, Y. Insect Food Products in the Western World: Assessing the Potential of a New ‘Green’ Market. Ann. Entomol Soc. Am. 2019, 112, 518–528. [Google Scholar] [CrossRef]
  11. Mouat, M.J.; Prince, R. Cultured Meat and Cowless Milk: On Making Markets for Animal-Free Food. J. Cult. Econ. 2018, 11, 315–329. [Google Scholar] [CrossRef]
  12. Wang, X.; Dou, Z.; Shi, X.; Zou, C.; Liu, D.; Wang, Z.; Guan, X.; Sun, Y.; Wu, G.; Zhang, B.; et al. Innovative Management Programme Reduces Environmental Impacts in Chinese Vegetable Production. Nat. Food 2021, 2, 47–53. [Google Scholar] [CrossRef]
  13. Zhang, P.; Guo, Z.; Ullah, S.; Melagraki, G.; Afantitis, A.; Lynch, I. Nanotechnology and Artificial Intelligence to Enable Sustainable and Precision Agriculture. Nat. Plants 2021, 7, 864–876. [Google Scholar] [CrossRef] [PubMed]
  14. Roque, B.M.; Venegas, M.; Kinley, R.D.; de Nys, R.; Duarte, T.L.; Yang, X.; Kebreab, E. Red Seaweed (Asparagopsis Taxiformis) Supplementation Reduces Enteric Methane by over 80 Percent in Beef Steers. PLoS ONE 2021, 16, e0247820. [Google Scholar] [CrossRef] [PubMed]
  15. White, L.N.; White, W.L. Seaweed Utilisation in New Zealand. Bot. Mar. 2020, 63, 303–313. [Google Scholar] [CrossRef]
  16. Greenland, S.J.; Dalrymple, J.; Levin, E.; O’Mahony, B. Improving Agricultural Water Sustainability: Strategies for Effective Farm Water Management and Encouraging the Uptake of Drip Irrigation. In The Goals of Sustainable Development: Responsibility and Governance; Approaches to Global Sustainability, Markets, and Governance; Crowther, D., Seifi, S., Moyeen, A., Eds.; Springer: Singapore, 2018; pp. 111–123. ISBN 978-981-10-5047-3. [Google Scholar]
  17. Knickel, K.; Redman, M.; Darnhofer, I.; Ashkenazy, A.; Calvão Chebach, T.; Šūmane, S.; Tisenkopfs, T.; Zemeckis, R.; Atkociuniene, V.; Rivera, M.; et al. Between Aspirations and Reality: Making Farming, Food Systems and Rural Areas More Resilient, Sustainable and Equitable. J. Rural Stud. 2018, 59, 197–210. [Google Scholar] [CrossRef] [Green Version]
  18. Stephens, E.C.; Martin, G.; van Wijk, M.; Timsina, J.; Snow, V. Editorial: Impacts of COVID-19 on Agricultural and Food Systems Worldwide and on Progress to the Sustainable Development Goals. Agric. Syst. 2020, 183, 102873. [Google Scholar] [CrossRef]
  19. FAO Sustainable Food and Agriculture-News. Available online: http://www.fao.org/sustainability/news/detail/en/c/1274219/ (accessed on 12 April 2021).
  20. Lynch, J.; Cain, M.; Frame, D.; Pierrehumbert, R. Agriculture’s Contribution to Climate Change and Role in Mitigation Is Distinct From Predominantly Fossil CO2-Emitting Sectors. Front. Sustain. Food Syst. 2021, 4, 518039. [Google Scholar] [CrossRef]
  21. Morecroft, M.D.; Duffield, S.; Harley, M.; Pearce-Higgins, J.W.; Stevens, N.; Watts, O.; Whitaker, J. Measuring the Success of Climate Change Adaptation and Mitigation in Terrestrial Ecosystems. Science 2019, 366, eaaw9256. [Google Scholar] [CrossRef] [Green Version]
  22. Fu, B.; Merritt, W.S.; Croke, B.F.W.; Weber, T.R.; Jakeman, A.J. A Review of Catchment-Scale Water Quality and Erosion Models and a Synthesis of Future Prospects. Environ. Model. Softw. 2019, 114, 75–97. [Google Scholar] [CrossRef]
  23. Liu, Y.; Engel, B.A.; Flanagan, D.C.; Gitau, M.W.; McMillan, S.K.; Chaubey, I. A Review on Effectiveness of Best Management Practices in Improving Hydrology and Water Quality: Needs and Opportunities. Sci. Total Environ. 2017, 601–602, 580–593. [Google Scholar] [CrossRef] [PubMed]
  24. Melland, A.R.; Fenton, O.; Jordan, P. Effects of Agricultural Land Management Changes on Surface Water Quality: A Review of Meso-Scale Catchment Research. Environ. Sci. Policy 2018, 84, 19–25. [Google Scholar] [CrossRef]
  25. Dudley, N.; Alexander, S. Agriculture and Biodiversity: A Review. Biodiversity 2017, 18, 45–49. [Google Scholar] [CrossRef]
  26. Ortiz, A.M.D.; Outhwaite, C.L.; Dalin, C.; Newbold, T. A Review of the Interactions between Biodiversity, Agriculture, Climate Change, and International Trade: Research and Policy Priorities. One Earth 2021, 4, 88–101. [Google Scholar] [CrossRef]
  27. Pe’er, G.; Dicks, L.V.; Visconti, P.; Arlettaz, R.; Báldi, A.; Benton, T.G.; Collins, S.; Dieterich, M.; Gregory, R.D.; Hartig, F.; et al. EU Agricultural Reform Fails on Biodiversity. Science 2014, 344, 1090–1092. [Google Scholar] [CrossRef] [PubMed]
  28. Gil, J.D.B.; Reidsma, P.; Giller, K.; Todman, L.; Whitmore, A.; van Ittersum, M. Sustainable Development Goal 2: Improved Targets and Indicators for Agriculture and Food Security. Ambio 2019, 48, 685–698. [Google Scholar] [CrossRef] [Green Version]
  29. Lee, K.-H.; Noh, J.; Khim, J.S. The Blue Economy and the United Nations’ Sustainable Development Goals: Challenges and Opportunities. Environ. Int. 2020, 137, 105528. [Google Scholar] [CrossRef]
  30. MEA. Ecosystems and Human Well-Being: Biodiversity Synthesis; Millennium Ecosystem Assessment: Washington, DC, USA, 2005. [Google Scholar]
  31. CBD (Convention on Biological Diversity). Aichi Biodiversity Targets of the Strategic Plan 2011–2020. Available online: https://www.cbd.int/sp/targets/ (accessed on 20 August 2020).
  32. Gao, L.; Bryan, B.A. Finding Pathways to National-Scale Land-Sector Sustainability. Nature 2017, 544, 217–222. [Google Scholar] [CrossRef]
  33. Bishop, M.L.; Xiaotong, Z. Why Is China a Reluctant Leader of the World Trade Organization? New Political Econ. 2020, 25, 755–772. [Google Scholar] [CrossRef]
  34. Margulis, M.E. The World Trade Organization between Law and Politics: Negotiating a Solution for Public Stockholding for Food Security Purposes. Transnatl. Leg. Theory 2018, 9, 343–360. [Google Scholar] [CrossRef]
  35. Urruty, N.; Tailliez-Lefebvre, D.; Huyghe, C. Stability, Robustness, Vulnerability and Resilience of Agricultural Systems. A Review. Agron. Sustain. Dev. 2016, 36, 15. [Google Scholar] [CrossRef] [Green Version]
  36. Kaddoura, S.; El Khatib, S. Review of Water-Energy-Food Nexus Tools to Improve the Nexus Modelling Approach for Integrated Policy Making. Environ. Sci. Policy 2017, 77, 114–121. [Google Scholar] [CrossRef]
  37. Kelly (Letcher), R.A.; Jakeman, A.J.; Barreteau, O.; Borsuk, M.E.; ElSawah, S.; Hamilton, S.H.; Henriksen, H.J.; Kuikka, S.; Maier, H.R.; Rizzoli, A.E.; et al. Selecting among Five Common Modelling Approaches for Integrated Environmental Assessment and Management. Environ. Model. Softw. 2013, 47, 159–181. [Google Scholar] [CrossRef]
  38. Antle, J.M.; Ray, S. Sustainable Agricultural Development: An Economic Perspective; Palgrave Studies in Agricultural Economics and Food Policy; Palgrave Macmillan: London, UK, 2020; ISBN 978-3-030-34598-3. [Google Scholar]
  39. Jones, J.W.; Antle, J.M.; Basso, B.; Boote, K.J.; Conant, R.T.; Foster, I.; Godfray, H.C.J.; Herrero, M.; Howitt, R.E.; Janssen, S.; et al. Brief History of Agricultural Systems Modeling. Agric. Syst. 2017, 155, 240–254. [Google Scholar] [CrossRef] [PubMed]
  40. Millennium Institute ISDG Model Documentation 2017. Available online: https://isdgdoc.millennium-institute.org/en/ (accessed on 16 January 2022).
  41. Mittenzwei, K.; Fjellstad, W.; Dramstad, W.; Flaten, O.; Gjertsen, A.K.; Loureiro, M.; Prestegard, S.S. Opportunities and Limitations in Assessing the Multifunctionality of Agriculture within the CAPRI Model. Ecol. Indic. 2007, 7, 827–838. [Google Scholar] [CrossRef]
  42. Qu, W.; Shi, W.; Zhang, J.; Liu, T. T21 China 2050: A Tool for National Sustainable Development Planning. Geogr. Sustain. 2020, 1, 33–46. [Google Scholar] [CrossRef]
  43. Sharp, R.; Chaplin-Kramer, R.; Wood, S.; Guerry, A.; Tallis, H.; Ricketts, T.; Nelson, E.; Ennaanay, D.; Wolny, S.; Olwero, N.; et al. InVEST User’s Guide; The Natural Capital Project, Stanford University, University of Minnesota, The Nature Conservancy, and World Wildlife Fund: Arlington, VA, USA, 2018. [Google Scholar]
  44. Ministry for the Environment Agriculture Emissions and Climate Change. Available online: https://environment.govt.nz/guides/agriculture-emissions-climate-change/ (accessed on 14 September 2021).
  45. Arksey, H.; O’Malley, L. Scoping Studies: Towards a Methodological Framework. Int. J. Soc. Res. Methodol. 2005, 8, 19–32. [Google Scholar] [CrossRef] [Green Version]
  46. Romera, A.J.; Bos, A.P.; Neal, M.; Eastwood, C.R.; Chapman, D.; McWilliam, W.; Royds, D.; O’Connor, C.; Brookes, R.; Connolly, J.; et al. Designing Future Dairy Systems for New Zealand Using Reflexive Interactive Design. Agric. Syst. 2020, 181, 102818. [Google Scholar] [CrossRef]
  47. Lamarque, P.; Artaux, A.; Barnaud, C.; Dobremez, L.; Nettier, B.; Lavorel, S. Taking into Account Farmers’ Decision Making to Map Fine-Scale Land Management Adaptation to Climate and Socio-Economic Scenarios. Landsc. Urban. Plan. 2013, 119, 147–157. [Google Scholar] [CrossRef]
  48. Pirotta, E.; New, L.; Marcoux, M. Modelling Beluga Habitat Use and Baseline Exposure to Shipping Traffic to Design Effective Protection against Prospective Industrialization in the Canadian Arctic. Aquat. Conserv. Mar. Freshw. Ecosyst. 2018, 28, 713–722. [Google Scholar] [CrossRef]
  49. Vannier, C.; Bierry, A.; Longaretti, P.-Y.; Nettier, B.; Cordonnier, T.; Chauvin, C.; Bertrand, N.; Quétier, F.; Lasseur, R.; Lavorel, S. Co-Constructing Future Land-Use Scenarios for the Grenoble Region, France. Landsc. Urban. Plan. 2019, 190, 103614. [Google Scholar] [CrossRef] [Green Version]
  50. Harrison, P.A.; Dunford, R.; Savin, C.; Rounsevell, M.D.A.; Holman, I.P.; Kebede, A.S.; Stuch, B. Cross-Sectoral Impacts of Climate Change and Socio-Economic Change for Multiple, European Land- and Water-Based Sectors. Clim. Change 2015, 128, 279–292. [Google Scholar] [CrossRef]
  51. Bohunovsky, L.; Jäger, J.; Omann, I. Participatory Scenario Development for Integrated Sustainability Assessment. Reg. Environ. Change 2011, 11, 271–284. [Google Scholar] [CrossRef]
  52. Nieto-Romero, M.; Milcu, A.; Leventon, J.; Mikulcak, F.; Fischer, J. The Role of Scenarios in Fostering Collective Action for Sustainable Development: Lessons from Central Romania. Land Use Policy 2016, 50, 156–168. [Google Scholar] [CrossRef]
  53. Bos, A.P.; Koerkamp, P.W.G.G.; Gosselink, J.M.J.; Bokma, S. Reflexive Interactive Design and Its Application in a Project on Sustainable Dairy Husbandry Systems. Outlook Agric. 2009, 38, 137–145. [Google Scholar] [CrossRef] [Green Version]
  54. Elzen, B.; Bos, B. The RIO Approach: Design and Anchoring of Sustainable Animal Husbandry Systems. Technol. Forecast. Soc. Change 2019, 145, 141–152. [Google Scholar] [CrossRef]
  55. Yelapure, S.J.; Kulkarni, D.R.V. Literature Review on Expert System in Agriculture. Int. J. Comput. Sci. Inf. Technol. 2012, 3, 5086–5089. [Google Scholar]
  56. Kanter, D.R.; Schwoob, M.-H.; Baethgen, W.E.; Bervejillo, J.E.; Carriquiry, M.; Dobermann, A.; Ferraro, B.; Lanfranco, B.; Mondelli, M.; Penengo, C.; et al. Translating the Sustainable Development Goals into Action: A Participatory Backcasting Approach for Developing National Agricultural Transformation Pathways. Glob. Food Secur. 2016, 10, 71–79. [Google Scholar] [CrossRef]
  57. Kebede, A.S.; Nicholls, R.J.; Allan, A.; Arto, I.; Cazcarro, I.; Fernandes, J.A.; Hill, C.T.; Hutton, C.W.; Kay, S.; Lázár, A.N.; et al. Applying the Global RCP–SSP–SPA Scenario Framework at Sub-National Scale: A Multi-Scale and Participatory Scenario Approach. Sci. Total Environ. 2018, 635, 659–672. [Google Scholar] [CrossRef]
  58. Nyam, Y.S.; Kotir, J.H.; Jordaan, A.J.; Ogundeji, A.A.; Turton, A.R. Drivers of Change in Sustainable Water Management and Agricultural Development in South Africa: A Participatory Approach. Sustain. Water Resour. Manag. 2020, 6, 62. [Google Scholar] [CrossRef]
  59. Bergez, J.E.; Raynal, H.; Launay, M.; Beaudoin, N.; Casellas, E.; Caubel, J.; Chabrier, P.; Coucheney, E.; Dury, J.; Garcia de Cortazar-Atauri, I.; et al. Evolution of the STICS Crop Model to Tackle New Environmental Issues: New Formalisms and Integration in the Modelling and Simulation Platform RECORD. Environ. Model. Softw. 2014, 62, 370–384. [Google Scholar] [CrossRef]
  60. Brisson, N.; Mary, B.; Ripoche, D.; Jeuffroy, M.H.; Ruget, F.; Nicoullaud, B.; Gate, P.; Devienne-Barret, F.; Antonioletti, R.; Durr, C.; et al. STICS: A Generic Model for the Simulation of Crops and Their Water and Nitrogen Balances. I. Theory and Parameterization Applied to Wheat and Corn. Agronomie 1998, 18, 311–346. [Google Scholar] [CrossRef]
  61. Parker, A.K.; García de Cortázar-Atauri, I.; Gény, L.; Spring, J.-L.; Destrac, A.; Schultz, H.; Molitor, D.; Lacombe, T.; Graça, A.; Monamy, C.; et al. Temperature-Based Grapevine Sugar Ripeness Modelling for a Wide Range of Vitis Vinifera L. Cultivars. Agric. For. Meteorol. 2020, 285–286, 107902. [Google Scholar] [CrossRef]
  62. Lasseur, R.; Vannier, C.; Lefebvre, J.; Longaretti, P.-Y.; Lavorel, S. Landscape-Scale Modeling of Agricultural Land Use for the Quantification of Ecosystem Services. J. Appl. Remote Sens. 2018, 12, 046024. [Google Scholar] [CrossRef]
  63. Kollas, C.; Kersebaum, K.C.; Nendel, C.; Manevski, K.; Müller, C.; Palosuo, T.; Armas-Herrera, C.M.; Beaudoin, N.; Bindi, M.; Charfeddine, M.; et al. Crop Rotation Modelling—A European Model Intercomparison. Eur. J. Agron. 2015, 70, 98–111. [Google Scholar] [CrossRef]
  64. Crouzat, E.; Mouchet, M.; Turkelboom, F.; Byczek, C.; Meersmans, J.; Berger, F.; Verkerk, P.J.; Lavorel, S. Assessing Bundles of Ecosystem Services from Regional to Landscape Scale: Insights from the French Alps. J. Appl Ecol. 2015, 52, 1145–1155. [Google Scholar] [CrossRef] [Green Version]
  65. Vannier, C.; Lasseur, R.; Crouzat, E.; Byczek, C.; Lafond, V.; Cordonnier, T.; Longaretti, P.-Y.; Lavorel, S. Mapping Ecosystem Services Bundles in a Heterogeneous Mountain Region. Ecosyst. People 2019, 15, 74–88. [Google Scholar] [CrossRef] [Green Version]
  66. The Intergovernmental Panel on Climate Change (IPCC). History—IPCC. Available online: https://www.ipcc.ch (accessed on 16 January 2022).
  67. Overview of New Zealand’s Climate. Available online: https://niwa.co.nz/education-and-training/schools/resources/climate/overview (accessed on 29 November 2021).
  68. Fraga, H.; Costa, R.; Moutinho-Pereira, J.; Correia, C.M.; Dinis, L.-T.; Gonçalves, I.; Silvestre, J.; Eiras-Dias, J.; Malheiro, A.C.; Santos, J.A. Modeling Phenology, Water Status, and Yield Components of Three Portuguese Grapevines Using the STICS Crop Model. Am. J. Enol Vitic. 2015, 66, 482–491. [Google Scholar] [CrossRef]
  69. Dominique, C.; Hossard, L.; Demarez, V.; Dechatre, H.; Irfan, K.; Baghdadi, N.; Flamain, F.; Ruget, F. STICS Crop Model and Sentinel-2 Images for Monitoring Rice Growth and Yield in the Camargue Region. Agron. Sustain. Dev. 2021, 41, 49. [Google Scholar] [CrossRef]
  70. Jacob, D.; Teichmann, C.; Sobolowski, S.; Katragkou, E.; Anders, I.; Belda, M.; Benestad, R.; Boberg, F.; Buonomo, E.; Cardoso, R.M.; et al. Regional Climate Downscaling over Europe: Perspectives from the EURO-CORDEX Community. Reg. Environ. Chang. 2020, 20, 51. [Google Scholar] [CrossRef]
  71. Le Roux, R.; Katurji, M.; Zawar-Reza, P.; Quénol, H.; Sturman, A. Comparison of Statistical and Dynamical Downscaling Results from the WRF Model. Environ. Model. Softw. 2018, 100, 67–73. [Google Scholar] [CrossRef]
  72. Cornillon, P.-A.; Guyader, A.; Husson, F.; Jegou, N.; Josse, J.; Kloareg, M.; Matzner-Lober, E.; Rouvière, L. R for Statistics; CRC Press: Boca Raton, FL, USA, 2012; ISBN 978-1-4398-8145-3. [Google Scholar]
  73. Sanders, L. Models in Spatial Analysis; ISTE Ltd.: London, UK; Newport Beach, CA, USA, 2007; ISBN 978-1-905209-09-5. [Google Scholar]
  74. Baldassarre, G.D.; Schumann, G.; Bates, P.D.; Freer, J.E.; Beven, K.J. Flood-Plain Mapping: A Critical Discussion of Deterministic and Probabilistic Approaches. Hydrol. Sci. J. 2010, 55, 364–376. [Google Scholar] [CrossRef]
  75. Bacani, V.M.; Sakamoto, A.Y.; Quénol, H.; Vannier, C.; Corgne, S. Markov Chains–Cellular Automata Modeling and Multicriteria Analysis of Land Cover Change in the Lower Nhecolândia Subregion of the Brazilian Pantanal Wetland. J. Appl. Remote Sens. 2016, 10, 016004. [Google Scholar] [CrossRef]
  76. Hyandye, C.; Martz, L.W. A Markovian and Cellular Automata Land-Use Change Predictive Model of the Usangu Catchment. Int. J. Remote Sens. 2017, 38, 64–81. [Google Scholar] [CrossRef]
  77. Courtonne, J.-Y.; Longaretti, P.-Y.; Alapetite, J.; Dupré, D. Environmental Pressures Embodied in the French Cereals Supply Chain. J. Ind. Ecol. 2016, 20, 423–434. [Google Scholar] [CrossRef] [Green Version]
  78. Le Ber, F.; Benoît, M.; Schott, C.; Mari, J.-F.; Mignolet, C. Studying Crop Sequences with CarrotAge, a HMM-Based Data Mining Software. Ecol. Model. 2006, 191, 170–185. [Google Scholar] [CrossRef]
  79. Kaim, A.; Cord, A.F.; Volk, M. A Review of Multi-Criteria Optimization Techniques for Agricultural Land Use Allocation. Environ. Model. Softw. 2018, 105, 79–93. [Google Scholar] [CrossRef]
  80. Kourgialas, N.N.; Karatzas, G.P. A National Scale Flood Hazard Mapping Methodology: The Case of Greece—Protection and Adaptation Policy Approaches. Sci. Total Environ. 2017, 601–602, 441–452. [Google Scholar] [CrossRef]
  81. Martinuzzi, S.; Radeloff, V.C.; Joppa, L.N.; Hamilton, C.M.; Helmers, D.P.; Plantinga, A.J.; Lewis, D.J. Scenarios of Future Land Use Change around United States’ Protected Areas. Biol. Conserv. 2015, 184, 446–455. [Google Scholar] [CrossRef]
  82. Sterman, J. Business Dynamics, 1st ed.; McGraw-Hill, Inc.: New York, NY, USA, 2000; ISBN 978-0-07-231135-8. [Google Scholar]
  83. Jones, J.W.; Antle, J.M.; Basso, B.; Boote, K.J.; Conant, R.T.; Foster, I.; Godfray, H.C.J.; Herrero, M.; Howitt, R.E.; Janssen, S.; et al. Toward a New Generation of Agricultural System Data, Models, and Knowledge Products: State of Agricultural Systems Science. Agric. Syst. 2017, 155, 269–288. [Google Scholar] [CrossRef]
  84. Elsawah, S.; Pierce, S.A.; Hamilton, S.H.; van Delden, H.; Haase, D.; Elmahdi, A.; Jakeman, A.J. An Overview of the System Dynamics Process for Integrated Modelling of Socio-Ecological Systems: Lessons on Good Modelling Practice from Five Case Studies. Environ. Model. Softw. 2017, 93, 127–145. [Google Scholar] [CrossRef]
  85. Liu, H.; Liu, Y.; Wang, H.; Yang, J.; Zhou, X. Research on the Coordinated Development of Greenization and Urbanization Based on System Dynamics and Data Envelopment Analysis—A Case Study of Tianjin. J. Clean. Prod. 2019, 214, 195–208. [Google Scholar] [CrossRef]
  86. Sun, Y.; Liu, N.; Shang, J.; Zhang, J. Sustainable Utilization of Water Resources in China: A System Dynamics Model. J. Clean. Prod. 2017, 142, 613–625. [Google Scholar] [CrossRef]
  87. Beall, A.; Fiedler, F.; Boll, J.; Cosens, B. Sustainable Water Resource Management and Participatory System Dynamics. Case Study: Developing the Palouse Basin Participatory Model. Sustainability 2011, 3, 720–742. [Google Scholar] [CrossRef] [Green Version]
  88. Pasqualino, R.; Jones, A.W.; Monasterolo, I.; Phillips, A. Understanding Global Systems Today—A Calibration of the World3-03 Model between 1995 and 2012. Sustainability 2015, 7, 9864–9889. [Google Scholar] [CrossRef] [Green Version]
  89. Ryu, J.H.; Contor, B.; Johnson, G.; Allen, R.; Tracy, J. System Dynamics to Sustainable Water Resources Management in the Eastern Snake Plain Aquifer Under Water Supply Uncertainty1. JAWRA J. Am. Water Resour. Assoc. 2012, 48, 1204–1220. [Google Scholar] [CrossRef]
  90. Dent, J.B.; Edwards-Jones, G.; McGregor, M.J. Simulation of Ecological, Social and Economic Factors in Agricultural Systems. Agric. Syst. 1995, 49, 337–351. [Google Scholar] [CrossRef]
  91. Turner, B.L.; Wuellner, M.; Nichols, T.; Gates, R.; Tedeschi, L.O.; Dunn, B.H. Development and Evaluation of a System Dynamics Model for Investigating Agriculturally Driven Land Transformation in the North Central United States. Nat. Resour. Model. 2016, 29, 179–228. [Google Scholar] [CrossRef]
  92. Ericksen, P.J. Conceptualizing Food Systems for Global Environmental Change Research. Glob. Environ. Chang. 2008, 18, 234–245. [Google Scholar] [CrossRef]
  93. Holzworth, D.; Huth, N.I.; Fainges, J.; Brown, H.; Zurcher, E.; Cichota, R.; Verrall, S.; Herrmann, N.I.; Zheng, B.; Snow, V. APSIM Next Generation: Overcoming Challenges in Modernising a Farming Systems Model. Environ. Model. Softw. 2018, 103, 43–51. [Google Scholar] [CrossRef]
  94. Monasterolo, I.; Pasqualino, R.; Mollona, E. The Role of System Dynamics Modelling to Understand Food Chain Complexity and Address Challenges for Sustainability Policies. In Proceedings of the SYDIC (System Dynamics Society) and the FAO “Meeting Urban Food Needs” Project, First Mediterranean Conference on Food Supply and Distribution Systems in Urban Environments, Rome, Italy, 6–7 July 2015. [Google Scholar]
  95. Tendall, D.M.; Joerin, J.; Kopainsky, B.; Edwards, P.; Shreck, A.; Le, Q.B.; Kruetli, P.; Grant, M.; Six, J. Food System Resilience: Defining the Concept. Glob. Food Secur. 2015, 6, 17–23. [Google Scholar] [CrossRef]
  96. Turner, B.L.; Menendez, H.M.; Gates, R.; Tedeschi, L.O.; Atzori, A.S. System Dynamics Modeling for Agricultural and Natural Resource Management Issues: Review of Some Past Cases and Forecasting Future Roles. Resources 2016, 5, 40. [Google Scholar] [CrossRef] [Green Version]
  97. Walters, J.P.; Archer, D.W.; Sassenrath, G.F.; Hendrickson, J.R.; Hanson, J.D.; Halloran, J.M.; Vadas, P.; Alarcon, V.J. Exploring Agricultural Production Systems and Their Fundamental Components with System Dynamics Modelling. Ecol. Model. 2016, 333, 51–65. [Google Scholar] [CrossRef] [Green Version]
  98. Bonabeau, E. Agent-Based Modeling: Methods and Techniques for Simulating Human Systems. Proc. Natl. Acad. Sci. USA 2002, 99, 7280–7287. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  99. Kremmydas, D.; Athanasiadis, I.N.; Rozakis, S. A Review of Agent Based Modeling for Agricultural Policy Evaluation. Agric. Syst. 2018, 164, 95–106. [Google Scholar] [CrossRef]
  100. Caillault, S.; Mialhe, F.; Vannier, C.; Delmotte, S.; Kêdowidé, C.; Amblard, F.; Etienne, M.; Bécu, N.; Gautreau, P.; Houet, T. Influence of Incentive Networks on Landscape Changes: A Simple Agent-Based Simulation Approach. Environ. Model. Softw. 2013, 45, 64–73. [Google Scholar] [CrossRef] [Green Version]
  101. Guillem, E.E.; Murray-Rust, D.; Robinson, D.T.; Barnes, A.; Rounsevell, M.D.A. Modelling Farmer Decision-Making to Anticipate Tradeoffs between Provisioning Ecosystem Services and Biodiversity. Agric. Syst. 2015, 137, 12–23. [Google Scholar] [CrossRef]
  102. Morgan, F.J.; Daigneault, A.J. Estimating Impacts of Climate Change Policy on Land Use: An Agent-Based Modelling Approach. PLoS ONE 2015, 10, e0127317. [Google Scholar] [CrossRef]
  103. Le, Q.B.; Park, S.J.; Vlek, P.L.G. Land Use Dynamic Simulator (LUDAS): A Multi-Agent System Model for Simulating Spatio-Temporal Dynamics of Coupled Human–Landscape System: 2. Scenario-Based Application for Impact Assessment of Land-Use Policies. Ecol. Inform. 2010, 5, 203–221. [Google Scholar] [CrossRef]
  104. Parker, D.C.; Manson, S.M.; Janssen, M.A.; Hoffmann, M.J.; Deadman, P. Multi-Agent Systems for the Simulation of Land-Use and Land-Cover Change: A Review. Ann. Assoc. Am. Geogr. 2003, 93, 314–337. [Google Scholar] [CrossRef] [Green Version]
  105. Matthews, R.B.; Gilbert, N.G.; Roach, A.; Polhill, J.G.; Gotts, N.M. Agent-Based Land-Use Models: A Review of Applications. Landsc. Ecol. 2007, 22, 1447–1459. [Google Scholar] [CrossRef] [Green Version]
  106. Tissot, C.; Neethling, E.; Rouan, M.; Barbeau, G.; Quénol, H.; Le Coq, C. Modeling Environmental Impacts on Viticultural Ecosystems: A First Case Study in a Regulated Wine Producing Area. Int. J. Agric. Environ. Inf. Syst. (IJAEIS) 2017, 8, 1–20. [Google Scholar] [CrossRef]
  107. Patrício, D.I.; Rieder, R. Computer Vision and Artificial Intelligence in Precision Agriculture for Grain Crops: A Systematic Review. Comput. Electron. Agric. 2018, 153, 69–81. [Google Scholar] [CrossRef] [Green Version]
  108. Keijsers, N.L.W. Neural Networks. In Encyclopedia of Movement Disorders; Kompoliti, K., Metman, L.V., Eds.; Academic Press: Oxford, UK, 2010; pp. 257–259. ISBN 978-0-12-374105-9. [Google Scholar]
  109. Misra, N.N.; Dixit, Y.; Al-Mallahi, A.; Bhullar, M.S.; Upadhyay, R.; Martynenko, A. IoT, Big Data and Artificial Intelligence in Agriculture and Food Industry. IEEE Internet Things J. 2020, 1. [Google Scholar] [CrossRef]
  110. Kouadio, L.; Deo, R.C.; Byrareddy, V.; Adamowski, J.F.; Mushtaq, S.; Phuong Nguyen, V. Artificial Intelligence Approach for the Prediction of Robusta Coffee Yield Using Soil Fertility Properties. Comput. Electron. Agric. 2018, 155, 324–338. [Google Scholar] [CrossRef]
  111. Jha, K.; Doshi, A.; Patel, P.; Shah, M. A Comprehensive Review on Automation in Agriculture Using Artificial Intelligence. Artif. Intell. Agric. 2019, 2, 1–12. [Google Scholar] [CrossRef]
  112. Bannerjee, G.; Sarkar, U.; Das, S.; Ghosh, I. Artificial Intelligence in Agriculture: A Literature Survey. Int. J. Sci. Res. Comput. Sci. Appl. Manag. Stud. 2018, 7, 6. [Google Scholar]
  113. Liakos, K.G.; Busato, P.; Moshou, D.; Pearson, S.; Bochtis, D. Machine Learning in Agriculture: A Review. Sensors 2018, 18, 2674. [Google Scholar] [CrossRef] [Green Version]
  114. Chlingaryan, A.; Sukkarieh, S.; Whelan, B. Machine Learning Approaches for Crop Yield Prediction and Nitrogen Status Estimation in Precision Agriculture: A Review. Comput. Electron. Agric. 2018, 151, 61–69. [Google Scholar] [CrossRef]
  115. Lesslie, R.G.; Hill, M.J.; Hill, P.; Cresswell, H.P.; Dawson, S. The Application of a Simple Spatial Multi-Criteria Analysis Shell to Natural Resource Management Decision Making. In Landscape Analysis and Visualisation: Spatial Models for Natural Resource Management and Planning; Lecture Notes in Geoinformation and Cartography; Pettit, C., Cartwright, W., Bishop, I., Lowell, K., Pullar, D., Duncan, D., Eds.; Springer: Berlin/Heidelberg, Germany, 2008; pp. 73–95. ISBN 978-3-540-69168-6. [Google Scholar]
  116. Tomer, M.D.; James, D.E.; Sandoval-Green, C.M.J. Agricultural Conservation Planning Framework: 3. Land Use and Field Boundary Database Development and Structure. J. Environ. Qual. 2017, 46, 676–686. [Google Scholar] [CrossRef] [Green Version]
  117. Tomer, M.D.; Boomer, K.M.B.; Porter, S.A.; Gelder, B.K.; James, D.E.; McLellan, E. Agricultural Conservation Planning Framework: 2. Classification of Riparian Buffer Design Types with Application to Assess and Map Stream Corridors. J. Environ. Qual. 2015, 44, 768–779. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  118. Tomer, M.D.; Porter, S.A.; Boomer, K.M.B.; James, D.E.; Kostel, J.A.; Helmers, M.J.; Isenhart, T.M.; McLellan, E. Agricultural Conservation Planning Framework: 1. Developing Multipractice Watershed Planning Scenarios and Assessing Nutrient Reduction Potential. J. Environ. Qual. 2015, 44, 754–767. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  119. Bos, A.P. Reflexive Interactive Design (RIO) = Reflexive Interactive Design (RIO); Wageningen UR Livestock Research: Wageningen, The Netherlands, 2010. [Google Scholar]
  120. Bos, A.P.; Grin, J. Reflexive Interactive Design as an Instrument for Dual Track Governance. In System Innovations, Knowledge Regimes, and Design Practices towards Transitions for Sustainable Agriculture; INRA: Paris, France, 2012; pp. 132–153. [Google Scholar]
  121. Rosenzweig, C.; Jones, J.W.; Hatfield, J.L.; Ruane, A.C.; Boote, K.J.; Thorburn, P.; Antle, J.M.; Nelson, G.C.; Porter, C.; Janssen, S.; et al. The Agricultural Model Intercomparison and Improvement Project (AgMIP): Protocols and Pilot Studies. Agric. For. Meteorol. 2013, 170, 166–182. [Google Scholar] [CrossRef] [Green Version]
  122. Jones, J.W.; Hoogenboom, G.; Porter, C.H.; Boote, K.J.; Batchelor, W.D.; Hunt, L.A.; Wilkens, P.W.; Singh, U.; Gijsman, A.J.; Ritchie, J.T. The DSSAT Cropping System Model. Eur. J. Agron. 2003, 18, 235–265. [Google Scholar] [CrossRef]
  123. Steduto, P.; Hsiao, T.C.; Fereres, E.; Raes, D.; Land and Water Division. Crop Yield Response to Water; FAO Irrigation and Drainage Paper; FAO: Rome, Italy, 2012; ISBN 978-92-5-107274-5. [Google Scholar]
  124. Smith, M.; Nations, F.; Food & Agriculture Organization. CROPWAT: A Computer Program for Irrigation Planning and Management; Food & Agriculture Organization: Rome, Italy, 1992; ISBN 978-92-5-103106-3. [Google Scholar]
  125. Siebert, S.; Döll, P.; Hoogeveen, J.; Faures, J.-M.; Frenken, K.; Feick, S. Development and Validation of the Global Map of Irrigation Areas. Hydrol. Earth Syst. Sci. 2005, 9, 535–547. [Google Scholar] [CrossRef]
  126. Mulligan, M. WaterWorld: A Self-Parameterising, Physically Based Model for Application in Data-Poor but Problem-Rich Environments Globally. Hydrol. Res. 2013, 44, 748–769. [Google Scholar] [CrossRef]
  127. Bieger, K.; Arnold, J.G.; Rathjens, H.; White, M.J.; Bosch, D.D.; Allen, P.M.; Volk, M.; Srinivasan, R. Introduction to SWAT+, A Completely Restructured Version of the Soil and Water Assessment Tool. JAWRA J. Am. Water Resour. Assoc. 2017, 53, 115–130. [Google Scholar] [CrossRef]
  128. Tan, M.L.; Gassman, P.W.; Yang, X.; Haywood, J. A Review of SWAT Applications, Performance and Future Needs for Simulation of Hydro-Climatic Extremes. Adv. Water Resour. 2020, 143, 103662. [Google Scholar] [CrossRef]
  129. Colomb, V.; Bernoux, M.; Bockel, L.; Chotte, J.-L.; Matrin, S.; Martin-Phipps, C.; Mousset, J.; Tinlot, M.; Touchemoulin, O. Review of GHG Calculators in Agriculture and Forestry Sectors. A Guideline for Appropriate Choice and Use of Landscape Based Tools; FAO: Rome, Italy, 2012; p. 49. [Google Scholar]
  130. Bernoux, M.; Branca, G.; Carro, A.; Lipper, L.; Smith, G.; Bockel, L. Ex-Ante Greenhouse Gas Balance of Agriculture and Forestry Development Programs. Sci. Agric. (Piracicaba Braz.) 2010, 67, 31–40. [Google Scholar] [CrossRef]
  131. Milne, E.; Neufeldt, H.; Rosenstock, T.; Smalligan, M.; Cerri, C.E.; Malin, D.; Easter, M.; Bernoux, M.; Ogle, S.; Casarim, F.; et al. Methods for the Quantification of GHG Emissions at the Landscape Level for Developing Countries in Smallholder Contexts. Environ. Res. Lett. 2013, 8, 015019. [Google Scholar] [CrossRef]
  132. Broeze, J. Agro-Chain Greenhouse Gas Emissions (ACGE) Calculator 2019. Available online: https://cgspace.cgiar.org/bitstream/handle/10568/106161/ACGE%20calculator%20guidelines.pdf (accessed on 16 January 2022).
  133. Feliciano; Nayak; Vetter, S.H.; Hillier, J. CCAFS Mitigation Options Tool, Beta Version. 2018. Available online: www.ccafs.cgiar.org (accessed on 16 January 2022).
  134. Arango, D.; Jones, E.; Ramirez-Villegas, J.; Bonilla, O.; Jarvis, A. Climate Analogues_2.0 R Package Installation and User Guide. 2014, p. 13. Available online: https://www.academia.edu/23941035/CLIMATE_ANALOGUES_2_0_R_PACKAGE_INSTALLATION_AND_USER_GUIDE?auto=download (accessed on 16 January 2022).
  135. Peh, K.S.-H.; Balmford, A.; Bradbury, R.B.; Brown, C.; Butchart, S.H.M.; Hughes, F.M.R.; Stattersfield, A.; Thomas, D.H.L.; Walpole, M.; Bayliss, J.; et al. TESSA: A Toolkit for Rapid Assessment of Ecosystem Services at Sites of Biodiversity Conservation Importance. Ecosyst. Serv. 2013, 5, 51–57. [Google Scholar] [CrossRef] [Green Version]
  136. Silvestri, S.; Kershaw, F. Framing the Flow: Innovative Approaches to Understand, Protect. and Value Ecosystem Services across Linked Habitats; UNEP: Nairobi, Kenya, 2010; ISBN 978-92-807-3065-4. [Google Scholar]
  137. Rossing, W.A.H.; Zander, P.; Josien, E.; Groot, J.C.J.; Meyer, B.C.; Knierim, A. Integrative Modelling Approaches for Analysis of Impact of Multifunctional Agriculture: A Review for France, Germany and The Netherlands. Agric. Ecosyst. Environ. 2007, 120, 41–57. [Google Scholar] [CrossRef]
  138. Song, B.; Robinson, G.M.; Bardsley, D.K. Measuring Multifunctional Agricultural Landscapes. Land 2020, 9, 260. [Google Scholar] [CrossRef]
  139. Mouchet, M.A.; Paracchini, M.L.; Schulp, C.J.E.; Stürck, J.; Verkerk, P.J.; Verburg, P.H.; Lavorel, S. Bundles of Ecosystem (Dis)Services and Multifunctionality across European Landscapes. Ecol. Indic. 2017, 73, 23–28. [Google Scholar] [CrossRef] [Green Version]
  140. Queiroz, C.; Meacham, M.; Richter, K.; Norström, A.V.; Andersson, E.; Norberg, J.; Peterson, G. Mapping Bundles of Ecosystem Services Reveals Distinct Types of Multifunctionality within a Swedish Landscape. AMBIO 2015, 44, 89–101. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  141. Hristov, J.; Clough, Y.; Sahlin, U.; Smith, H.G.; Stjernman, M.; Olsson, O.; Sahrbacher, A.; Brady, M.V. Impacts of the EU’s Common Agricultural Policy “Greening” Reform on Agricultural Development, Biodiversity, and Ecosystem Services. Appl. Econ. Perspect. Policy 2020, 42, 716–738. [Google Scholar] [CrossRef] [Green Version]
  142. Concepción, E.D.; Aneva, I.; Jay, M.; Lukanov, S.; Marsden, K.; Moreno, G.; Oppermann, R.; Pardo, A.; Piskol, S.; Rolo, V.; et al. Optimizing Biodiversity Gain of European Agriculture through Regional Targeting and Adaptive Management of Conservation Tools. Biol. Conserv. 2020, 241, 108384. [Google Scholar] [CrossRef]
  143. Cormont, A.; Siepel, H.; Clement, J.; Melman, T.C.P.; WallisDeVries, M.F.; van Turnhout, C.A.M.; Sparrius, L.B.; Reemer, M.; Biesmeijer, J.C.; Berendse, F.; et al. Landscape Complexity and Farmland Biodiversity: Evaluating the CAP Target on Natural Elements. J. Nat. Conserv. 2016, 30, 19–26. [Google Scholar] [CrossRef]
Figure 1. Flow chart from disruption of NZ agricultural system, modelling need, to solution design. Surrounding in red, where an analysis and synthesis of knowledge is proposed.
Figure 1. Flow chart from disruption of NZ agricultural system, modelling need, to solution design. Surrounding in red, where an analysis and synthesis of knowledge is proposed.
Applsci 12 02746 g001
Figure 2. Modelling approaches and associated complexity.
Figure 2. Modelling approaches and associated complexity.
Applsci 12 02746 g002
Table 2. Synthesis of example questions and modelling process options.
Table 2. Synthesis of example questions and modelling process options.
Question ExamplesModelling Process Options
  • How will anthropogenic climate disruption affect agricultural systems?
-
Deterministic approach to understand physical processes (climate, crop, milk yields models, economic models);
-
Probabilistic approach to define vulnerability (land-use model);
-
Participatory approach to draw opportunities and adaptation strategies;
-
Agent-based approach with Decision Support Tools to design incentives, regulations or policies.
-
  • How will disruptive technologies change future agriculture pathways?
-
Systems Dynamics approach to simulate a new technology disruption (non-linear system);
-
Agent-based approach with Decision Support Tools to understand new technology adoption, and scaling up and out opportunities;
-
Multi-Criteria Analysis to spatially understand and predict consequences on land use, ecosystems, and environment.
-
  • How can technology be best used to improve the profitability, resilience and sustainability of agriculture?
-
Systems Dynamics approach to simulate a new technology disruption (non-linear system);
-
Deterministic and probabilistic approaches to evaluate environmental consequences (GHG emission calculators, Ecosystem Services models, water models, economic models);
-
Multi-Criteria Analysis to spatially understand and evaluate consequences of change.
-
  • How can agricultural infrastructure be redesigned and improved to efficiently supply food products for a country and around the world?
-
Systems Dynamics approach to simulate a system change and its disruption;
-
Deterministic and probabilistic approaches to evaluate socio-economic consequences on food supply;
-
Artificial Intelligence to simulate demand and supply capacity in real-time.
-
  • How can policy be used to improve governance of agritech and sectoral disruptions?
-
Agent-Based approach to understand behaviours against decision levels;
-
Decision Support Tools to design optimal changes in governance system;
-
Deterministic and probabilistic approaches to evaluate economic consequences on a sector disruption (economic models).
-
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Vannier, C.; Cochrane, T.A.; Zawar Reza, P.; Bellamy, L. An Analysis of Agricultural Systems Modelling Approaches and Examples to Support Future Policy Development under Disruptive Changes in New Zealand. Appl. Sci. 2022, 12, 2746. https://doi.org/10.3390/app12052746

AMA Style

Vannier C, Cochrane TA, Zawar Reza P, Bellamy L. An Analysis of Agricultural Systems Modelling Approaches and Examples to Support Future Policy Development under Disruptive Changes in New Zealand. Applied Sciences. 2022; 12(5):2746. https://doi.org/10.3390/app12052746

Chicago/Turabian Style

Vannier, Clémence, Thomas A. Cochrane, Peyman Zawar Reza, and Larry Bellamy. 2022. "An Analysis of Agricultural Systems Modelling Approaches and Examples to Support Future Policy Development under Disruptive Changes in New Zealand" Applied Sciences 12, no. 5: 2746. https://doi.org/10.3390/app12052746

APA Style

Vannier, C., Cochrane, T. A., Zawar Reza, P., & Bellamy, L. (2022). An Analysis of Agricultural Systems Modelling Approaches and Examples to Support Future Policy Development under Disruptive Changes in New Zealand. Applied Sciences, 12(5), 2746. https://doi.org/10.3390/app12052746

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop