Next Article in Journal
Orchid Micropropagation Using Conventional Semi-Solid and Temporary Immersion Systems: A Review
Previous Article in Journal
Response of Juvenile Saccharina japonica to the Combined Stressors of Elevated pCO2 and Excess Copper
Previous Article in Special Issue
Characterization of Leaf Rust Resistance in International Barley Germplasm Using Genome-Wide Association Studies
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Accuracy of Selection in Early Generations of Field Pea Breeding Increases by Exploiting the Information Contained in Correlated Traits

by
Felipe A. Castro-Urrea
1,2,
Maria P. Urricariet
2,3,
Katia T. Stefanova
1,4,
Li Li
5,
Wesley M. Moss
6,7,
Andrew L. Guzzomi
1,6,7,
Olaf Sass
8,
Kadambot H. M. Siddique
1,2 and
Wallace A. Cowling
1,2,*
1
The UWA Institute of Agriculture, The University of Western Australia, Perth, WA 6009, Australia
2
School of Agriculture and Environment, The University of Western Australia, Perth, WA 6009, Australia
3
General Genetics Unit, Pontificia Universidad Católica Argentina, Buenos Aires C1107AAZ, Argentina
4
SAGI West, School of Molecular and Life Sciences, Curtin University, Perth, WA 6845, Australia
5
Animal Genetics and Breeding Unit, University of New England, Armidale, NSW 2351, Australia
6
Centre for Engineering Innovation: Agriculture & Ecological Restoration, The University of Western Australia, Shenton Park, WA 6008, Australia
7
School of Engineering, The University of Western Australia, Perth, WA 6009, Australia
8
Norddeutsche Pflanzenzucht Hans-Georg Lembke KG, Hohenlieth-Hof 1, 24363 Holtsee, Germany
*
Author to whom correspondence should be addressed.
Plants 2023, 12(5), 1141; https://doi.org/10.3390/plants12051141
Submission received: 18 January 2023 / Revised: 21 February 2023 / Accepted: 27 February 2023 / Published: 2 March 2023
(This article belongs to the Special Issue Genetics and Breeding of Crops)

Abstract

:
Accuracy of predicted breeding values (PBV) for low heritability traits may be increased in early generations by exploiting the information available in correlated traits. We compared the accuracy of PBV for 10 correlated traits with low to medium narrow-sense heritability ( h 2 ) in a genetically diverse field pea (Pisum sativum L.) population after univariate or multivariate linear mixed model (MLMM) analysis with pedigree information. In the contra-season, we crossed and selfed S1 parent plants, and in the main season we evaluated spaced plants of S0 cross progeny and S2+ (S2 or higher) self progeny of parent plants for the 10 traits. Stem strength traits included stem buckling (SB) ( h 2 = 0.05), compressed stem thickness (CST) ( h 2 = 0.12), internode length (IL) ( h 2 = 0.61) and angle of the main stem above horizontal at first flower (EAngle) ( h 2 = 0.46). Significant genetic correlations of the additive effects occurred between SB and CST (0.61), IL and EAngle (−0.90) and IL and CST (−0.36). The average accuracy of PBVs in S0 progeny increased from 0.799 to 0.841 and in S2+ progeny increased from 0.835 to 0.875 in univariate vs MLMM, respectively. An optimized mating design was constructed with optimal contribution selection based on an index of PBV for the 10 traits, and predicted genetic gain in the next cycle ranged from 1.4% (SB), 5.0% (CST), 10.5% (EAngle) and −10.5% (IL), with low achieved parental coancestry of 0.12. MLMM improved the potential genetic gain in annual cycles of early generation selection in field pea by increasing the accuracy of PBV.

1. Introduction

It is important to increase the rate of genetic gain in self-pollinating crops to meet future demand for grains, and the most promising way to increase the rate of gain is to shorten selection cycles [1]. This may be achieved through selection on early generation non-inbred progeny [1]. However, selection on non-inbred progeny is less accurate than on inbred lines [2,3,4], and therefore crop breeders normally prefer to self to purity before choosing parents for crossing. This extends selection cycles and reduces the potential rate of genetic gain. In this study, we explore methods which increase the accuracy of predicted breeding values (PBVs) for low to medium heritability traits in non-inbred progeny. The goal was to shorten selection cycles and potentially accelerate genetic gain.
One of the most important grain legume crops worldwide is field pea (Pisum sativum L.), with production of over 14 million tonnes on more than seven million hectares globally [5]. Peas are highly adaptable to a wide range of soils and are used for both animal feed and human consumption. The fiber, vitamin, and protein content in pea grains makes them particularly desirable for human diets and it is likely that this crop will play a key role in securing future food production and human nutrition [6,7].
One of the main limiting factors in field pea production is its susceptibility to ascochyta blight disease complex, reported to reduce yields by as much as 70% in some regions [8,9,10,11]. Breeding for resistance to this complex trait has not been highly successful, due to the different fungal pathogens involved [12,13], the low level of resistance available, and polygenic inheritance of resistance [8]. So far, released varieties do not show an adequate level of resistance [8,10,14,15]. Moderate levels of resistance were observed in some wild relatives and breeding populations of field pea [14,16,17]. Low to moderate narrow-sense heritability was reported for ascochyta blight resistance in an experimental pea population based on diverse sources of partial resistance [9]. Breeding schemes based on pedigree information [18] and, if available, genomic tools [13,19] will increase the potential for future genetic gain in ascochyta blight resistance.
Another constraint in pea production is canopy lodging, which not only promotes disease spread but also reduces harvestability, leading to yield loss and higher costs for farmers [20,21]. Improvements in lodging resistance have been mostly achieved by modifying pea architecture with dwarf semi-leafless varieties [7,15,22] which improve the standability of the crop thanks to tendrils holding the canopy together [23]. However this trait depends on plant-to-plant interaction in the crop and may not reflect stem strength of individual pea plants. Lodging resistance has been associated also with thicker stem walls and higher kinetic energy required to cut stems [24]. Stem strength in field pea, measured as flexion and force at breaking point, was correlated with compressed stem thickness and stem diameter, but heritability for these traits was low [20,25].
The rate of genetic gain for major crops is around 1% per annum and is insufficient to meet global food demands by 2050 [26] and must be at least doubled to meet the increasing global demand for food production [27,28,29]. Cobb et al. [1] reviewed the effect of changes in components of the breeder’s equation and concluded that the most likely way to improve the rate of genetic gain in crop breeding programs is to reduce cycle length. This can be done by shortening selfing generations to rapidly generate inbred lines [30,31], or by selecting non-inbred progeny as parents to begin the next cycle [1]. It should be possible to improve accuracy of PBVs for low heritability traits in non-inbred progeny by exploiting information gained from correlated traits and pedigree and/or genomic information [2,3,32,33].
Multivariate maximum likelihood models were developed for animal breeding in the 1980s, and were shown to improve the data structure and increase the accuracy of PBV for correlated traits compared to univariate models [34]. A single-step multivariate linear mixed model (MLMM) with pedigree information was developed in a cross-pollinating tree species and combined structured variance-covariance matrices at the treatment and residual levels to improve accuracy of PBV [35]. Multivariate analysis in crops has so far been applied to improve model prediction accuracy in inbred wheat and barley lines [36,37,38,39] and doubled haploid maize lines [40], but this is the first study to evaluate accuracy of PBV with MLMM in non-inbred progeny of a self-pollinating crop.
The exploitation of correlated traits is useful when one of the traits is difficult or expensive to measure [41] or has lower heritability [2,42]. Additionally, the measurements may be components of one trait, such as disease severity measured by two correlated traits, crop density before and after disease development, and bivariate analysis was shown to improve the accuracy of genetic values for both traits [43]. The benefits of MLMM over univariate analysis will depend on the heritabilities and correlations between traits and environments [2]. A strong correlation between traits will improve model prediction, even if the correlation is unfavourable [39]. However, a multivariate model based on many traits with low or no correlation may have no benefits over univariate models [2,38].
Significant gains were made in ascochyta blight resistance across two cycles of recurrent selection based on non-inbred progeny of field pea in an animal model analysis across cycles [18]. Here, we re-analyze the data from Cowling et al. [18] to select parents to begin the next cycle of this experimental pea population, and we apply MLMM to select non-inbred progeny for several low to moderate heritability traits. We combine random and/or fixed spatial effects and covariances of additive, non-additive and residual effects in the analysis of ascochyta blight resistance, flowering time, stem strength traits, grain yield, biomass, and other important agronomic traits.
The aim of this paper is to improve accuracy of PBV in non-inbred progeny of field pea by exploiting the information available in correlated low to moderate heritability traits. This is one of the first studies to use MLMM in crop breeding for this purpose. We hypothesize that accuracy of PBVs for these correlated low to medium heritability traits will be higher in MLMM than in a univariate linear mixed model (LMM), and compare the accuracy of PBVs in S0 progeny with self progeny of parent plants (S2 or higher selfing level) evaluated in the same experiment. In a novel approach to test the value of the PBV generated by MLMM, we predict the genetic gain of traits and achieved parental coancestry in the next cycle with optimal contribution selection (OCS) [44] based on an index of MLMM-derived PBVs weighted to achieve desired genetic gains.

2. Results

For definition of abbreviations, please see Section 4 Materials and Methods.

2.1. Re-Analysis of 2015 Data (Cycle 2) and Mating Design for Cycle 3

The bivariate LMM analysis of ABS and DTF in Cycle 2 2015 revealed a negative genetic correlation of additive effects ( r = −0. 64) between ABS and DTF (Supplemental Table S1A,B). Narrow-sense heritability ( h 2 ) for ABS was 0.377 and average accuracy ± standard deviation of PBV for ABS in S0 progeny was 0.826 ± 0.04, which is slightly higher than 0.805 reported from univariate analysis in Cowling et al. [18]. h 2 for DTF was 0.555 and average accuracy in S0 progeny was 0.850 ± 0.04. The PBVs obtained from this model were given appropriate economic weights in a selection index, and the index was used to generate an optimised mating design for Cycle 3 based on OCS (Supplemental Table S1C,D).

2.2. 2019(Cycle 3) Trial Data Preparation

Data for 10 traits and 1600 entries were assessed in Cycle 3 2019 (Figure 1a, Supplemental Table S2A,B). EAngle was measured before flowering, when stem bending began to occur in plots (Figure 1b). DTF, ABS and Br were measured throughout the season. GY and BM were measured after harvest on dry plants. SD, IL, CST (Figure 2a), and SB (Figure 2b) were measured on dry main stems after harvest as described in Section 4 Materials and Methods.

2.3. Univariate Linear Mixed Model Analyses of 2019 Data (Cycle 3)

Single traits were analysed first in univariate LMM without pedigree information, providing estimates of the total genotype and residual variance for each trait, and then with pedigree information to estimate additive (and potentially non-additive) variance components and narrow-sense heritability for each trait (Table 1, Supplemental Table S3). In all univariate models, linear fixed effects for range and row were not significant. h 2 for GY, BM, SB, SD, CST, and ABS was low ( h 2 ≤ 0.15), low to moderate for Br and EAngle ( h 2 ≤ 0.36) and moderate for DTF and IL ( h 2 > 0.50) (Table 1).

2.4. Multivariate Linear Mixed Model Analyses

2.4.1. 10-Trait Model

The analysis of all 10 traits in the MLMM in ASReml-R achieved convergence with a US variance structure for additive genetic effects and residual effects, while omitting any other form of random effect. However, US variance structures were modified in all iterations of the run to maintain positive definite values (Supplemental Table S4A). Hence, the optimised MLMM was completed in the stand-alone version of ASReml by first adding the significant components for each trait identified in the univariate LMM and later removing those components that became non-significant under the new variance structure in the MLMM. In the optimized MLMM, variance components for additive genetic effects increased for GY, BM, Br, DTF, EAngle, and IL (Table 2) compared to the estimates of the univariate model (Table 1). ABS had a slightly smaller variance component for the additive genetic effect. The variance components of residual effects increased for all traits in the optimized MLMM, except for EAngle (Table 2). In the optimized MLMM, non-additive genetic effects were significant only for GY and DTF, and these effects were assumed independent (DIAG variance structure was used for non-additive effects). Compared to the univariate models (Table 1), h 2 in the MLMM (Table 2) improved considerably for DTF (increased by 0.10 compared to univariate LMM), EAngle (increased by 0.23) and IL (increased by 0.08) and increased slightly for GY (increased by 0.01). In contrast, h 2 decreased slightly for the other traits (−0.01 to −0.02) (Table 1 and Table 2). The standard errors of h 2 were similar for all traits in univariate LMM and MLMM except for EAngle, where the standard error of h 2 increased from 0.04 to 0.12 (full model components can be seen in Supplemental Table S4B).

2.4.2. Trait Correlations

The optimized MLMM allowed for covariance of additive genetic effects and residual effects between traits. Covariances of additive effects were converted to correlations (Figure 3). Correlations of residual effects were also significant between many traits and are presented in Supplemental Figure S1.
Strong positive additive genetic correlations were found among traits BM, Br, and DTF (≥0.54) and among the stem strength traits SB, CST, and SD (≥0.59), whereas the strongest negative correlations occurred between EAngle and IL (−0.90) and between IL and SD (−0.58), that is, shorter internodes were associated more upright growth and with broader stems (Figure 3). Lower ABS (higher resistance to ascochyta blight disease) was associated with higher basal branching (Br) (−0.53). ABS showed moderate positive correlations with SB and CST (≥0.47). GY had a moderate correlation with BM (0.44) (Figure 3).
The positive genetic correlations between ABS and SB, and ABS and CST, indicate that stronger stems were associated with higher disease levels, which hinders selection for both strong stems and ABS resistance. SB was positively correlated with DTF which indicates that stronger stems were associated with later flowering.

2.5. Accuracy of Predicted Breeding Values

The average accuracy of PBV across all traits in S0 progeny significantly increased from 0.799 in the univariate LMM to 0.841 in the optimized MLMM (Table 3) (t = −189.9, p < 0.001), which was slightly higher than accuracy of PBV in S2+ progeny in univariate LMM (0.835) and demonstrates a significant benefit of MLMM over univariate LMM for S0 progeny. Furthermore, the average accuracy of PBV for S2+ progeny significantly increased to 0.875 in the optimized MLMM (Table 3).

2.6. Prediction of Genetic Gain in the Next Cycle with OCS

PBVs for each trait from the optimized MLMM were weighted for desired genetic gains and summed to generate a selection index for each individual. Trait weightings were chosen to increase predicted genetic gains in GY, BM, SB, CST, SD, and EAngle, to reduce DTF and ABS, and to maintain Br and IL (Table 4). The index, pedigree information and list of genotypes available for crossing were submitted to MateSel for OCS with conservative parameters for improving genetic gain in Cycle 4 while minimising the loss in genetic diversity in the population (Table 4). Fine-tuning of the trait weightings occurred in MateSel for ABS and CST to decrease ABS and increase CST. The run achieved predicted genetic gain in GY, BM, and stem strength traits of 0.9 to 9.4% (Table 4) while reducing DTF by 2.5% and ABS by 3.8%. Despite a weighting to maintain IL, the predicted PBV of IL decreased by 10.5% in the next cycle (Table 4). The achieved parental coancestry in Cycle 4 was very low at 0.12.

3. Discussion

Multivariate linear mixed models improved the accuracy of predicted breeding values in non-inbred progeny of an experimental field pea population for several traits with low to moderate heritability compared to univariate models. This research shows the value of exploiting the information in correlated traits to improve the accuracy of PBV in non-inbred progeny. Accurate selection in early generations of field pea breeding can accelerate annual genetic gain for these traits.
A bivariate LMM of ABS and DTF in Cowling et al. [18] showed a strong negative correlation between the additive genetic effects for ABS and DTF in Cycle 2 (Supplemental Table S1B), which confirmed a previous report that late flowering field peas tended to have lower ABS (i.e., were more resistant to Ascochyta blight) than early types [9]. The bivariate analysis improved the h 2 values and accuracy of PBV for ABS over the univariate analysis presented in Cowling et al. [18], and therefore it was used to generate an optimised crossing design to being Cycle 3.
In 2019, the Cycle 3 progeny were evaluated as spaced single S0 and S2+ plants sown into a weed-suppression mat. This is clearly different from the conditions in which field pea crops are normally grown, but this design permitted an unbiased assessment of trait values on individual progeny plants. The sowing of spaced single plants in a weed mat may affect the growth of the root system and stem due to higher soil temperatures. However, the monthly average temperature of the region ranged from 14 to 20 °C during the winter-spring months in which the trial was grown, and therefore it is unlikely that the weed mat resulted in detrimental effects on root systems due to high soil temperatures. Similarly, sowing of blueberries into a weed mat or sawdust mulch had no negative impact on growth and yield in most years [46]. Wide spacing of single plants was useful to record EAngle and to achieve an unbiased estimate of all traits on individual progeny plants. Similar designs were used in previous studies where high levels of ascochyta blight disease and low to moderate heritability for ABS resistance were recorded [9,18].
Previously, improvements in lodging resistance in field peas resulted from the breeding of dwarf semi-leafless varieties [7,15,22] which have better standability due to tendrils which hold the crop together [23]. Semi-leafless pea plants have weak stems and there has been little or no genetic progress in improving their stem strength. We measured several traits related to stem strength (SB, CST, SD, EAngle, and IL), all of which contribute to stem structure and standability of individual plants, with the goal of making significant genetic progress for stronger stems.
In previous studies, CST and SD were shown to be correlated with physical measures of stem strength such as flexion and force at breaking point [47] and both traits responded to selection [9]. Smitchger and Weeden [20] also found a genetic relationship between lodging resistance and CST and SD, and Smitchger et al. [48] suggested that SD should be the major focus of breeding to increase lodging tolerance. We improved the reliability of CST measurement method over previous methods [20,47] by standardizing the displacement in the stem at a fixed load of 10 N (Figure 2a).
We included a new measurement of stem strength, stem buckling (SB), where the base of the stem was fixed and the top was pressed downwards by the flat end of the force gauge, following the methods in Niklas [49]. SB has been proposed as a good stem strength predictor in plants [50], however, Smitchger et al. [48] considered that pea stems normally do not fail by stem buckling since plants do not usually grow in a vertical position, and attributed an increased lodging tendency to stem angles closer to the horizontal. Hence, we also measured EAngle on individual plants. We found that shorter IL was strongly correlated with higher EAngle (more upright growth), but extremely short internodes are not desirable as this results in short plants and poor harvestability [48]. Our results suggest that it should be possible to breed a more compact pea crop with slightly shorter internodes, with stronger stems and better lodging resistance as predicted by higher EAngle, SB, CST, and SD.
Another component of theoretical column buckling strength is the second moment of area [49]. Future work could include this measurement as an additional indicator of stem strength. It will likely be correlated with SB and indicate the expected buckling type (i.e., Euler or Brazier), which is associated with the wall thickness ratio [51]. However, CST is expected to be a good proxy of second moment of area due to its relationship with stem wall thickness.
In this population, SB, SD, and CST had low narrow-sense heritability (Table 2), but there were moderate to high additive genetic correlations between these traits in the optimized MLMM (Figure 3). Hence, the average accuracy of PBVs in S0 progeny from 0.799 to 0.841 across all traits in the optimized MLMM over the corresponding univariate LMM (Table 3). To put this into perspective, the accuracy of PBVs for S0 progeny in multivariate models was higher than the accuracy of PBVs in selfed (S2+) progeny in univariate models. We conclude that selfing to S2 or higher within breeding cycles is not essential to achieve significant genetic gain for these low heritability traits. We achieved annual cycles of S0 recurrent selection with high accuracy of PBV based on an optimized MLMM of several correlated low to medium heritability traits. Recurrent selection on S0 progeny avoids the cost of selfing and longer breeding cycles when selection occurs on inbred lines. This supports the suggestion of Cobb et al. [1] that shorter cycles and selection on non-inbred progeny should be explored as an option for improving genetic gain in crop breeding.
The optimised MLMM benefited from correlations among additive effects and residuals across traits which improved the data structure in the model and increased the accuracy of PBV, as originally shown by Thompson and Meyer [34]. Similar benefits were obtained with MLMM in Eucalyptus tree breeding [35], where self-pollination does not occur (or is very rare) and all progeny were S0 or clones thereof. Benefits of MLMM were also shown in genomic prediction in inbred wheat lines [52].
Our study is one of the first applications of the single step MLMM with pedigree information in self-pollinating crops, and our results support the use of MLMM for several low to medium heritability traits measured on non-inbred progeny to help achieve rapid genetic gain. In this study, we achieved a predicted genetic gain in the next cycle of −3.8% in ABS, +5.0% in CST, +5.1% in SD, and +7.8% in EAngle, while controlling DTF and IL and achieving low parental coancestry of 0.12 (Table 4). Rapid and sustained genetic gain for several traits was predicted in stochastic models of S0,1 family selection [53,54], and validated in the field over several cycles of recurrent selection in spring canola for grain yield and several other low to moderate heritability traits [55].
S0 recurrent selection [3] may be augmented by including self progeny of parent plants at S2 or higher selfing generations (S2+). Augmenting S0 recurrent selection with S2+ selfs of parent plants improved connectivity of genetic relationships between and within cycles, and improved the accuracy of PBV [55]. It is also of practical and commercial value to include S2+ selfs of parent plants in augmented S0 recurrent selection, as this provides inbred lines ready for commercial evaluation after two cycles. This simplifies the proposed two-part strategy (population improvement and product development) for breeding self-pollinating crops [56] by combining the two parts into a single breeding program.
Our study was based on measurements made in the field, but the accuracy of PBV in non-inbred progeny could also be increased by including additional traits from high-throughput phenotyping in controlled environments to improve the accuracy of PBV for all traits [57].
Genomic relationship information is expected to improve accuracy of PBV especially when combined with pedigree information [52,56,58,59]. It will be relatively simple to combine genomic analysis (GBLUP) and pedigree analysis (ABLUP) in single-step or hybrid BLUP (HBLUP) analysis [60,61,62,63]. GBLUP was used for selection of non-inbred progeny of wheat by Bonnett et al. [64], and we expect that accuracy of PBV on non-inbred progeny will be improved further when pedigree and genomic information are combined in HBLUP.
The inclusion of multiple correlated traits increases the complexity and number of calculations required to converge the MLMM. In this study, we ran our models outside the R environment to overcome the CPU limitations that appeared in the 10-trait model with ASReml-R. Attempting to fit a model with more traits will likely result in convergence errors, so it is worth exploring different approaches of multivariate analysis for large datasets. One alternative would be to divide the analysis into two stages, where estimates of the fixed effects of genotypes (BLUES) are obtained in univariate analyses and are later analyzed in a multivariate BLUP analysis e.g., [65]. In animal breeding studies, correlations between traits in large datasets are sometimes estimated through pair-wise bivariate analyses of all trait combinations e.g., [66]. In theory, if correlations are known beforehand, it would be possible to adjust the multivariate model so that it includes all traits but assumes a value of zero for low and non-significant covariances between traits. In this way, fewer parameters need to be estimated in the model, which should result in easier computation and potentially could achieve convergence in a challenging dataset.
Animal breeders increased the rate of genetic gain by exploiting BLUP models which improved the accuracy of PBV in highly heterozygous individuals [27], but BLUP-based breeding also increased the rate of population inbreeding over cycles. As a result, OCS was implemented in animal breeding to maximize genetic gain whilst controlling the rate of inbreeding [67]. Recently, crop breeders have adopted OCS or similar optimized selection frameworks that retain genetic variability of the population under selection to improve the long-term genetic response [1,55,58,65,68,69,70,71]. OCS was valuable in this study to predict the outcome of MLMM on genetic response for several traits in the next generation based on an optimised mating design.
The MLMM that we implemented here is relatively simple to adopt and involves little additional cost to the breeding program. Pedigree information can be recorded and recalled in an appropriate data base at low cost. Genomic data can be added in the form of a genomic relationship matrix if and when available. The challenge remains to implement MLMM in small plot trials grown at many sites per cycle across multiple cycles of selection, with measurements of GY, lodging, and other commercial traits. So far, this has only been achieved with univariate analyses, one trait at a time, across all sites and cycles [55].

4. Materials and Methods

4.1. Crossing to Begin Cycle 3

Progeny evaluated in the previous cycle (Cycle 2) of this field pea experimental population [18] were selfed, harvested and stored for later use as parent plants to generate Cycle 3 progeny for evaluation in this study. Cycle 2 data for ascochyta blight score (ABS) [18] and days from sowing to first flower (DTF) (Supplemental Table S1A) were re-analyzed in a bivariate model with pedigree information to generate predicted breeding values (PBVs) for each trait (Supplemental Table S1B). A selection index was constructed with economic weights on PBVs which aimed to reduce ABS while maintaining DTF (Supplemental Table S1C).
Optimal contribution selection (OCS) based on this selection index was implemented in software MateSel [45] (Supplemental Table S1C), which is based on an evolutionary algorithm with constraints easily invoked to ensure practical relevance and precise control of selection response and other outcomes. MateSel dictates which individuals to select and the actual crossing allocations and/or selfings to be made in a crossing design that balances genetic gain for the selection index under the constraint of a maximum permissible target inbreeding rate [44,45,67]. Retained S1 seed harvested from S0 individuals was used for crossing and selfing of each parent plant, and each crossing and selfing was recorded explicitly in the pedigree at the individual plant level [18].
The resulting mating list generated by MateSel comprised 150 crosses and was based on 60 Cycle 2 parental genotypes (Supplemental Table S1D). Crosses for Cycle 3 were carried out in a glasshouse at The University of Western Australia (UWA) Field Station, Shenton Park, Western Australia, during the summer and autumn months (December 2018 to April 2019). Cycle 3 cross progeny seed (S0) along with selfs of the parent plants at S2 or higher selfing generations (S2+) were harvested and prepared for the Cycle 3 field trial, which forms the basis of this study.

4.2. Field Trial and Trait Assessment

In early June 2019, Cycle 3 progeny were grown in a field trial at UWA Field Station. Single plants were sown 90 cm apart in a square grid design 20 rows wide by 80 ranges (columns) deep, based on a spatially-optimized partially replicated design using the R package DiGGer [72]. The population included 668 S0 genotypes (from crosses), 612 S2+ genotypes (selfs of parents used in crosses) and 320 control plants (replicates of 15 control varieties), resulting in a trial with 1600 single plants (Figure 1a). The field was covered with black plastic weed mat to assist with weed control. One week after germination, infected pea straw with ascochyta blight disease from the previous cycle was spread across the trial to promote even disease infection.
Plants were scored for several traits during the growing season from June to November 2019. Ascochyta blight score (ABS) was measured as the number of nodes on the main stem from the base of the plant with stipules or leaves showing ascochyta blight disease symptoms at first flower, with lower values indicating higher resistance. Other recorded traits included days to first flower (DTF) and number of basal branches (Br). Stem angle above horizontal (EAngle) was assessed before the flowering stage (Figure 1b). After harvest, plants were collected, dried, and weighed for above-ground biomass (BM) and single plant grain yield (GY).
To assess stem strength, the first 15 cm of each main stem was detached at harvest and measured for mean internode length of the first four nodes (IL) and stem diameter (SD) at the center of the third stem internode. Compressed stem thickness (CST) was measured using a digital force gauge (Starr FGD-100, Starr Instruments, Melbourne, VIC, Australia) to apply a force of 10 N at the center of the third stem internode, recording CST as SD less displacement (mm) at 10 N (Figure 2a). Lastly, the top 10 cm of each stem piece was used to assess the stem buckling critical load (SB) in a setup where both ends of the stem were essentially fixed by restricting the base of the stem to the bottom of the digital force gauge with a clamp and pressing the top with the flat attachment of the device (Figure 2b). SB was recorded as the peak force (N) required to produce the structure failure when the force gauge was actuated downwards [49].

4.3. Statistical Methods

4.3.1. Univariate Linear Mixed Model

First, all traits were analyzed in a univariate linear mixed model (LMM) where the baseline model accounts for the randomization and is further extended to account for spatial variability in the field trial. Design blocks and genotypes were treated as random effects, and the residual model assumed independent and identically distributed error effects. To account for spatial variability within the trial, in particular the local stationary trend, a first-order separable autoregressive correlation process (AR1 × AR1) for ranges and rows was included, if significant, in the model, following Gilmour et al. [73]. In the model used here, we did not fit the AR1 × AR1 structure in the residual term but as a random effect to maintain a comparable model structure to the multivariate models, where it is not possible to fit the AR1 × AR1 structure in the residual term. In addition, as concluded by De Faveri et al. [74], the separable AR1 × AR1 structure in the residual term may not be adequate for multivariate models, and as a random term this can be dropped if it is found to be not significant. Additional linear fixed and random range and/or row effects were considered and included in each model if the term was significant and did not overfit the data.
The initial LMM was defined as:
y = X β + Z g u g + Z o u o + e
where y is the vector of individual plot observations for a given trait, β is the vector of fixed effects with associated design matrix X , u g is the vector of random genotype effects with associated design matrix Z g , u o is the vector of significant random effects other than genotype (AR1 × AR1 structure, range and/or row), with associated design matrix Z o , and e corresponds to the vector of plot residual effects. Vectors   u g , u o , and e , representing random effects, are assumed to follow a Gaussian distribution with zero-mean vector and pairwise independence, so that u g ~ N ( 0 , I G g ) , u o ~ N ( 0 , I G o ) , and e ~ N ( 0 , I R ) , where I is an identity matrix and   G g , G o and R are diagonal type variance-covariance matrices.
A complete pedigree file of the population back to founders was based on the pedigree in Cowling et al. [18] and updated with new crosses and progeny in Cycle 3 (Supplemental Table S2A). A pedigree relationship matrix (A-matrix) was included in the analysis to estimate additive genetic effects (PBV) in each model as previously described [18]. In addition, it was possible to fit a variance component for the non-additive or residual genetic effects. This non-additive term was included only if it was significant and if inclusion increased the log-likelihood of the model. Thus, the LMM with pedigree information was defined as follows:
y = X β + Z g u g a + Z g u g n + Z o u o + e  
where the model is equivalent to Equation (1), following the same assumptions, but the component u g is partitioned into u g a as the vector of random additive genetic effects and u g n as the vector of random non-additive genetic effects with u g a ~ N ( 0 , A G g ) and u g n ~ N ( 0 , I G g ) , where A corresponds to the A-matrix of pedigree relationship information.
Each successive model was evaluated based on changes in log-likelihood, Akaike information criterion (AIC), and Bayesian information criterion (BIC). Comparisons between models were made through a log-likelihood ratio test. The significance of fixed effects was assessed by a Wald test. Random terms were retained when they significantly improved the log-likelihood of the model. Narrow-sense heritability ( h 2 ) for each trait was calculated from the estimated variance components from the respective LMM with pedigree information, where h 2 equals the additive variance component divided by the sum of the additive, non-additive and residual variance components.

4.3.2. Multivariate Linear Mixed Model

The second approach was to fit a multivariate linear mixed model (MLMM) across traits, constructed by specifying a matrix of combined traits as the response [75]. Different variance structures can be fitted for each random and residual term specified inside the MLMM, thus, it is possible to obtain independent variances for the different effects of each trait and covariances between trait effects. This allows for a greater level of fine-tuning when modelling because the covariance between trait effects can be allowed or omitted independently for the different terms in the model.
In MLMM, the process began by fitting a baseline multi-trait model, using diagonal variance structures (DIAG) for the genotype and residual terms, which assumes that traits are independent (covariance between traits is zero) and have separate variances. This is comparable to fitting parallel univariate models. Second, the MLMM was improved by assuming an unstructured covariance model (US), instead of a DIAG variance structure, for the genotype and residual terms, permitting the estimation of covariances for these terms between traits [75]. Finally, pedigree relationship information in the form of an A-matrix was added to the MLMM, enabling the estimation of PBV, as in the univariate step.
For each trait present in the model, the AR1 × AR1 structure and other range or row random effects for each trait were fitted separately and retained in the final model only if significant. This means that it was possible to test and fit these terms in a trait-by-trait case. For example, the AR1 × AR1 structure was modelled only for ABS, DTF had a random row effect and GY had both a random row and range effect. Likewise, the non-additive genetic term was included in the MLMM or omitted depending on its significance for each trait and was included as either a US or DIAG structure, based on the significance of the covariance term (meaning that it was possible to create a model with covariance between additive genetic effects, but non-additive genetic effects were assumed independent). The final multivariate model was defined as:
Y = X B + Z g U g a + Z g U g n + Z o U o + E
where terms are as per the univariate model in Equation (2) but expanded for additional traits, so that for N traits
Y = [ Y 1 Y N ]
and Y is the combined vector of line observations for N traits included in the model, B is the matrix of combined vectors of significant fixed effects for each trait identified in the univariate analyses with associated design matrix X , U g a is the combined vector of random additive genetic effects with associated design matrix Z g , with U g a ~ N ( 0 , A T a ) , U g n is the combined vector of random non-additive genetic effects with associated design matrix Z g , with U g n ~ N ( 0 , I T n ) , U o is the combined vector of significant random effects other than genotype for each trait, with associated design matrix Z o , and E corresponds to the matrix of residual effects with E ~ N ( 0 , I R ) . A is the A-matrix of pedigree relationship information, I is an identity matrix and T a , T n , and R are the trait variance-covariance matrices of additive, non-additive, and residual effects, respectively.
T a and R were modeled with a US variance structure resulting in the additive genetic and residual covariance of trait effects such as
T a = [ σ G a 11 2 σ G a 1 N σ G a 1 N σ G a N N 2 ]   and   R = [ σ R 11 2 σ R 1 N σ R 1 N σ R N N 2 ]
However, T n assumed a US variance structure only if the covariance of non-additive genetic effects between traits was significant, otherwise a DIAG variance structure was specified and non-additive genetic effects were assumed independent, resulting in either
T n = [ σ G n 11 2 σ G n 1 N σ G n 1 N σ G n N N 2 ]   or   T n = [ σ G n 11 2 0 0 σ G n N N 2 ]
for US variance structure and DIAG variance structure, respectively.
The covariances of trait effects estimated in the model were transformed to correlations using the variance value for each trait and their covariance:
ρ X Y = σ X Y σ X 2 * σ Y 2  
where ρ X Y is the correlation coefficient between the effect of traits X and Y , σ X Y is the covariance between the effects of traits X and Y , and σ X 2 and σ Y 2 , are the variances of traits X and Y , respectively.
As in the univariate process, all fitted MLMM were evaluated in terms of log-likelihood, AIC, and BIC, using a log-likelihood ratio test to compare models. The significance of fixed effect terms was assessed by a Wald test. Random terms were retained if they produced a significant improvement in the log-likelihood of the model. h 2 for each trait was calculated using the estimated variance components of the MLMM as the additive variance component divided by the sum of the additive, non-additive (if present), and residual variance components for each trait.
The models presented in this study were fitted using the R package ASReml-R version 4 (VSN International Ltd., Hemel Hempstead, UK) [75]. For the more complex models, the MLMM was optimized in the stand-alone version of ASReml version 4.2 (VSN International Ltd., Hemel Hempstead, UK) [76] due to its ability to use more CPU cores in the run.

4.3.3. Model Accuracy

The accuracy of PBV obtained from the final models was calculated as the correlation between the true and predicted breeding values based on the approach of Mrode [77]:
r p i = 1 s i 2 ( 1 + f i ) σ A 2
where the accuracy r p i of prediction for the individual I, s i 2 is the squared standard error that accompanies the breeding value of individual i obtained from the model prediction, f i is the inbreeding coefficient calculated based on the pedigree for individual i and σ A 2 is the trait additive genetic variance estimated from the model [76].
The average accuracy of PBV of groups of progeny S0 and S2+ were compared across models.

4.4. Prediction of Progeny Performance in Cycle 4

PBVs for each trait were obtained from the optimized MLMM. An optimized selection index for each individual was calculated from the sum of weighted PBVs across traits, where the weights for each trait were based on the tactical desired gains approach [78] and calculated in the program DESIRE [79]. The selection index and the PBVs for each trait for each individual were submitted to software MateSel to generate an optimized mating design with 170 crosses to begin the fourth cycle. The simulation ran with a weight against progeny inbreeding of −0.01 and a conservative target of 50 degrees in the response frontier of the population to promote a moderate increase in index while minimizing achieved population coancestry [45]. The output summary included predicted changes in mean index value, PBVs and achieved parental coancestry in the matings to begin the fourth cycle.

5. Conclusions

The accuracy of predicted breeding values for 10 low to medium heritability traits in non-inbred progeny of field pea increased in an optimized multivariate linear mixed model over a univariate model, making it feasible to undertake annual cycles of S0 recurrent selection on non-inbred progeny. Significant genetic gains in several low heritability traits were predicted in the next cycle with low rates of population inbreeding based on a mating design generated with optimal contribution selection. The results show that the information contained in correlated traits can be exploited to increase accuracy of selection in early generations of field pea breeding.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/plants12051141/s1, Supplemental Table S1A. List of genotypes and phenotypic records in Cycle 2. Supplemental Table S1B. Cycle 2 bivariate model. Supplemental Table S1C. Cycle 2 MateSel model output. Supplemental Table S1D. Cycle 2 mating list for Cycle 3. Supplemental Table S2A. List of genotypes and phenotypic records in Cycle 3. Supplemental Table S2B. Cycle 3 phenotypic data summary. Supplemental Table S3. Cycle 3 univariate models. Supplemental Table S4A. Cycle 3 base multivariate model. Supplemental Table S4B. Cycle 3 optimized multivariate model. Supplemental Figure S1. Correlation of residuals from Cycle 3 optimized multivariate model.

Author Contributions

The study was conceived by W.A.C. Trial management and data collection were done by F.A.C.-U. and M.P.U., W.M.M. and A.L.G. help developing the stem measurement protocol. Statistical analyses were carried out by F.A.C.-U., K.T.S., L.L. and W.A.C. Breeding was supervised by W.A.C. and O.S., F.A.C.-U. and W.A.C. wrote the manuscript. K.H.M.S. reviewed and edited the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Norddeutsche Pflanzenzucht Hans-Georg Lembke KG (N.P.Z.) under contract agreement with The University of Western Australia. Additional cash and in-kind support was provided by The University of Western Australia and University of New England.

Data Availability Statement

The authors affirm that all data necessary for confirming the conclusions of the article are present within the article, figures, tables and supplemental information.

Acknowledgments

We thank The University of Western Australia for supporting F.A.C-U. with the Charles and Annie Neumann PhD Fellowship in Agriculture and The University of Western Australia International Fee Scholarship. We thank Jasenka Vuksic, Rozlyn Ezzy and Paulina Godoy-Jalil at The University of Western Australia for their help and support with the field trials.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Cobb, J.N.; Juma, R.U.; Biswas, P.S.; Arbelaez, J.D.; Rutkoski, J.; Atlin, G.; Hagen, T.; Quinn, M.; Ng, E.H. Enhancing the rate of genetic gain in public-sector plant breeding programs: Lessons from the breeder’s equation. Theor. Appl. Genet. 2019, 132, 627–645. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Falconer, D.S.; Mackay, T.F.C. Introduction to Quantitative Genetics, 4th ed.; Pearson/Longman: Harlow, UK, 1996. [Google Scholar]
  3. Walsh, B.; Lynch, M. Evolution and Selection of Quantitative Traits; Oxford University Press: New York, NY, USA, 2018; p. 1496. [Google Scholar]
  4. Wricke, G.; Weber, E. Quantitative Genetics and Selection in Plant Breeding; W. de Gruyter: Berlin, Germany, 1986. [Google Scholar]
  5. Food and Agriculture Organization of the United Nations. FAOSTAT Statistical Database; FAO: Rome, Italy, 2023. [Google Scholar]
  6. Foyer, C.H.; Lam, H.M.; Nguyen, H.T.; Siddique, K.H.; Varshney, R.K.; Colmer, T.D.; Cowling, W.; Bramley, H.; Mori, T.A.; Hodgson, J.M.; et al. Neglecting legumes has compromised human health and sustainable food production. Nat. Plants 2016, 2, 16112. [Google Scholar] [CrossRef] [PubMed]
  7. Khan, T.N.; Mdeldrum, A.; Croser, J.S. Pea: Overview. In Encyclopedia of Food Grains, 2nd ed.; Wrigley, C., Corke, H., Seetharaman, K., Faubion, J., Eds.; Academic Press: Oxford, UK, 2016; Volume 1, pp. 324–333. [Google Scholar]
  8. Adhikari, K.N.; Khan, T.N.; Stefanova, K.; Pritchard, I. Recurrent breeding method enhances the level of blackspot (Didymella pinodes (Berk. & Blox.) Vestergr.) resistance in field pea (Pisum sativum L.) in southern Australia. Plant Breed. 2014, 133, 508–514. [Google Scholar] [CrossRef]
  9. Beeck, C.P.; Wroth, J.M.; Falk, D.E.; Khan, T.; Cowling, W.A. Two cycles of recurrent selection lead to simultaneous improvement in black spot resistance and stem strength in field pea. Crop Sci. 2008, 48, 2235–2244. [Google Scholar] [CrossRef]
  10. Salam, M.; MacLeod, W.; Maling, T.; Prichard, I.; Seymour, M.; Barbetti, M. A meta-analysis of severity and yield loss from ascochyta blight on field pea in Western Australia. Australas. Plant Pathol. 2011, 40, 591–600. [Google Scholar] [CrossRef]
  11. Khan, T.N.; Timmerman-Vaughan, G.M.; Rubiales, D.; Warkentin, T.D.; Siddique, K.H.M.; Erskine, W.; Barbetti, M.J. Didymella pinodes and its management in field pea: Challenges and opportunities. Field Crop Res. 2013, 148, 61–77. [Google Scholar] [CrossRef] [Green Version]
  12. Martins, L.B.; Balint-Kurti, P.; Reberg-Horton, S.C. Genome-wide association study for morphological traits and resistance to Peryonella pinodes in the USDA pea single-plant plus collection. G3-Genes Genom. Genet. 2022, 12, jkac168. [Google Scholar] [CrossRef]
  13. Parihar, A.K.; Kumar, J.; Gupta, D.S.; Lamichaney, A.; Naik Sj, S.; Singh, A.K.; Dixit, G.P.; Gupta, S.; Toklu, F. Genomics Enabled Breeding Strategies for Major Biotic Stresses in Pea (Pisum sativum L.). Front. Plant Sci. 2022, 13, 861191. [Google Scholar] [CrossRef]
  14. Fondevilla, S.; Almeida, N.F.; Satovic, Z.; Rubiales, D.; Vaz Patto, M.C.; Cubero, J.I.; Torres, A.M. Identification of common genomic regions controlling resistance to Mycosphaerella pinodes, earliness and architectural traits in different pea genetic backgrounds. Euphytica 2011, 182, 43–52. [Google Scholar] [CrossRef]
  15. Siddique, K.H.M.; Erskine, W.; Hobson, K.; Knights, E.J.; Leonforte, A.; Khan, T.N.; Paull, J.G.; Redden, R.; Materne, M. Cool-season grain legume improvement in Australia—Use of genetic resources. Crop Pasture Sci. 2013, 64, 347–360. [Google Scholar] [CrossRef]
  16. Jha, A.B.; Gali, K.K.; Tar’an, B.; Warkentin, T.D. Fine Mapping of QTLs for Ascochyta Blight Resistance in Pea Using Heterogeneous Inbred Families. Front. Plant Sci. 2017, 8, 765. [Google Scholar] [CrossRef] [Green Version]
  17. Wroth, J.M. Possible role for wild genotypes of Pisum spp. to enhance ascochyta blight resistance in pea. Aust. J. Exp. Agric. 1998, 38, 469–479. [Google Scholar] [CrossRef]
  18. Cowling, W.A.; Stefanova, K.T.; Beeck, C.P.; Nelson, M.N.; Hargreaves, B.L.; Sass, O.; Gilmour, A.R.; Siddique, K.H. Using the animal model to accelerate response to selection in a self-pollinating crop. G3-Genes Genom. Genet. 2015, 5, 1419–1428. [Google Scholar] [CrossRef] [Green Version]
  19. Carpenter, M.A.; Goulden, D.S.; Woods, C.J.; Thomson, S.J.; Kenel, F.; Frew, T.J.; Cooper, R.D.; Timmerman-Vaughan, G.M. Genomic Selection for Ascochyta Blight Resistance in Pea. Front. Plant Sci. 2018, 9, 1878. [Google Scholar] [CrossRef] [Green Version]
  20. Smitchger, J.; Weeden, N. Quantitative trait loci controlling lodging resistance and other important agronomic traits in dry field peas. Crop Sci. 2019, 59, 1442–1456. [Google Scholar] [CrossRef]
  21. Tar’an, B.; Warkentin, T.; Somers, D.J.; Miranda, D.; Vandenberg, A.; Blade, S.; Woods, S.; Bing, D.; Xue, A.; DeKoeyer, D.; et al. Quantitative trait loci for lodging resistance, plant height and partial resistance to mycosphaerella blight in field pea (Pisum sativum L.). Theor. Appl. Genet. 2003, 107, 1482–1491. [Google Scholar] [CrossRef]
  22. Warkentin, T.D.; Smýkal, P.; Coyne, C.J.; Weeden, N.; Domoney, C.; Bing, D.-J.; Leonforte, A.; Xuxiao, Z.; Dixit, G.P.; Boros, L.; et al. Grain Legumes; De Ron, A.M., Ed.; Springer: New York, NY, USA, 2015; pp. 37–83. [Google Scholar]
  23. Mikić, A.; Mihailović, V.; Ćupina, B.; Kosev, V.; Warkentin, T.; McPhee, K.; Ambrose, M.; Hofer, J.; Ellis, N. Genetic background and agronomic value of leaf types in pea (Pisum sativum). Ratar. i Povrt. 2011, 48, 275–284. [Google Scholar] [CrossRef]
  24. Skubisz, G.; Kravtsova, T.I.; Velikanov, L.P. Analysis of the strength properties of pea stems. Int. Agrophys. 2007, 21, 189–197. [Google Scholar]
  25. Beeck, C.P.; Wroth, J.M.; Cowling, W.A. Additive genetic variance for stem strength in field pea (Pisum sativum). Aust. J. Agric. Res. 2008, 59, 80–85. [Google Scholar] [CrossRef]
  26. Lenaerts, B.; Collard, B.C.Y.; Demont, M. Review: Improving global food security through accelerated plant breeding. Plant Sci. 2019, 287, 110207. [Google Scholar] [CrossRef]
  27. Hickey, J.M.; Chiurugwi, T.; Mackay, I.; Powell, W.; Implementing Genomic Selection in CGIAR Breeding Programs Workshop Participants. Genomic prediction unifies animal and plant breeding programs to form platforms for biological discovery. Nat. Genet. 2017, 49, 1297–1303. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Li, H.; Rasheed, A.; Hickey, L.T.; He, Z. Fast-forwarding genetic gain. Trends Plant Sci. 2018, 23, 184–186. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Voss-Fels, K.P.; Stahl, A.; Hickey, L.T. Q&A: Modern crop breeding for future food security. BMC Biol. 2019, 17, 18. [Google Scholar] [CrossRef] [Green Version]
  30. Liu, H.; Zwer, P.; Wang, H.; Liu, C.; Lu, Z.; Wang, Y.; Yan, G.; Miedaner, T. A fast generation cycling system for oat and triticale breeding. Plant Breed. 2016, 135, 574–579. [Google Scholar] [CrossRef]
  31. Watson, A.; Ghosh, S.; Williams, M.J.; Cuddy, W.S.; Simmonds, J.; Rey, M.D.; Asyraf Md Hatta, M.; Hinchliffe, A.; Steed, A.; Reynolds, D.; et al. Speed breeding is a powerful tool to accelerate crop research and breeding. Nat. Plants 2018, 4, 23–29. [Google Scholar] [CrossRef] [Green Version]
  32. Bauer, A.M.; Léon, J. Multiple-trait breeding values for parental selection in self-pollinating crops. Theor. Appl. Genet. 2008, 116, 235–242. [Google Scholar] [CrossRef]
  33. Piepho, H.P.; Möhring, J.; Melchinger, A.E.; Büchse, A. BLUP for phenotypic selection in plant breeding and variety testing. Euphytica 2007, 161, 209–228. [Google Scholar] [CrossRef]
  34. Thompson, R.; Meyer, K. A review of theoretical aspects in the estimation of breeding values for multi-trait selection. Livest. Prod. Sci. 1986, 15, 299–313. [Google Scholar] [CrossRef]
  35. Hardner, C.M.; Healey, A.L.; Downes, G.; Herberling, M.; Gore, P.L. Improving prediction accuracy and selection of open-pollinated seed-lots in Eucalyptus dunnii Maiden using a multivariate mixed model approach. Ann. For. Sci. 2016, 73, 1035–1046. [Google Scholar] [CrossRef] [Green Version]
  36. Montesinos-López, A.; Runcie, D.E.; Ibba, M.I.; Pérez-Rodríguez, P.; Montesinos-López, O.A.; Crespo, L.A.; Bentley, A.R.; Crossa, J. Multi-trait genomic-enabled prediction enhances accuracy in multi-year wheat breeding trials. G3-Genes Genom. Genet. 2021, 11, jkab270. [Google Scholar] [CrossRef]
  37. Schulthess, A.W.; Zhao, Y.; Longin, C.F.H.; Reif, J.C. Advantages and limitations of multiple-trait genomic prediction for Fusarium head blight severity in hybrid wheat (Triticum aestivum L.). Theor. Appl. Genet. 2018, 131, 685–701. [Google Scholar] [CrossRef]
  38. Montesinos-López, O.A.; Montesinos-López, J.C.; Montesinos-López, A.; Ramírez-Alcaraz, J.M.; Poland, J.; Singh, R.; Dreisigacker, S.; Crespo, L.; Mondal, S.; Govidan, V.; et al. Bayesian multitrait kernel methods improve multienvironment genome-based prediction. G3-Genes Genom. Genet. 2022, 12, jkab406. [Google Scholar] [CrossRef]
  39. Neyhart, J.L.; Lorenz, A.J.; Smith, K.P. Multi-trait improvement by predicting genetic correlations in breeding crosses. G3-Genes Genom. Genet. 2019, 9, 3153–3165. [Google Scholar] [CrossRef] [Green Version]
  40. Montesinos-López, O.A.; Montesinos-López, A.; Crossa, J.; Toledo, F.H.; Pérez-Hernández, O.; Eskridge, K.M.; Rutkoski, J. A genomic bayesian multi-trait and multi-environment model. G3-Genes Genom. Genet. 2016, 6, 2725–2744. [Google Scholar] [CrossRef] [Green Version]
  41. Lado, B.; Vázquez, D.; Quincke, M.; Silva, P.; Aguilar, I.; Gutiérrez, L. Resource allocation optimization with multi-trait genomic prediction for bread wheat (Triticum aestivum L.) baking quality. Theor. Appl. Genet. 2018, 131, 2719–2731. [Google Scholar] [CrossRef] [Green Version]
  42. Jia, Y.; Jannink, J.L. Multiple-trait genomic selection methods increase genetic value prediction accuracy. Genetics 2012, 192, 1513–1522. [Google Scholar] [CrossRef] [Green Version]
  43. Ganesalingam, A.; Smith, A.B.; Beeck, C.P.; Cowling, W.A.; Thompson, R.; Cullis, B.R. A bivariate mixed model approach for the analysis of plant survival data. Euphytica 2013, 190, 371–383. [Google Scholar] [CrossRef]
  44. Kinghorn, B.P. An algorithm for efficient constrained mate selection. Genet. Sel. Evol. 2011, 43, 4–9. [Google Scholar] [CrossRef] [Green Version]
  45. Kinghorn, B.P.; Kinghorn, A.J. Instructions for MateSel ver 7.6. 2022. Available online: https://www.matesel.com/Website/Support (accessed on 5 January 2023).
  46. Strik, B.C.; Davis, A.J.; Bryla, D.R.; Orr, S.T. Individual and Combined Use of Sawdust and Weed Mat Mulch in a New Planting of Northern Highbush Blueberry I. Impacts on Plant Growth and Soil and Canopy Temperature. HortScience 2020, 55, 1280–1287. [Google Scholar] [CrossRef]
  47. Beeck, C.P.; Wroth, J.M.; Cowling, W.A. Genetic variation in stem strength in field pea (Pisum sativum L.) and its association with compressed stem thickness. Aust. J. Agric. Res. 2006, 57, 193–199. [Google Scholar] [CrossRef]
  48. Smitchger, J.; Weeden, N.; Akin, I.; Warkentin, T. Stress equation for a cantilever beam: A model of lodging resistance in field pea. Int. Agrophys. 2020, 34, 213–222. [Google Scholar] [CrossRef] [PubMed]
  49. Niklas, K.J. Plant Biomechanics: An Engineering Approach to Plant Form and Function; University of Chicago Press: Chicago, IL, USA, 1992. [Google Scholar]
  50. Shah, D.U.; Reynolds, T.P.S.; Ramage, M.H. The strength of plants: Theory and experimental methods to measure the mechanical properties of stems. J. Exp. Bot. 2017, 68, 4497–4516. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  51. Spatz, H.C.; Niklas, K.J. Modes of failure in tubular plant organs. Am. J. Bot. 2013, 100, 332–336. [Google Scholar] [CrossRef] [PubMed]
  52. Semagn, K.; Crossa, J.; Cuevas, J.; Iqbal, M.; Ciechanowska, I.; Henriquez, M.A.; Randhawa, H.; Beres, B.L.; Aboukhaddour, R.; McCallum, B.D.; et al. Comparison of single-trait and multi-trait genomic predictions on agronomic and disease resistance traits in spring wheat. Theor. Appl. Genet. 2022, 135, 2747–2767. [Google Scholar] [CrossRef] [PubMed]
  53. Cowling, W.A.; Li, L.; Siddique, K.H.M.; Henryon, M.; Berg, P.; Banks, R.G.; Kinghorn, B.P. Evolving gene banks: Improving diverse populations of crop and exotic germplasm with optimal contribution selection. J. Exp. Bot. 2017, 68, 1927–1939. [Google Scholar] [CrossRef] [Green Version]
  54. Cowling, W.A.; Li, L.; Siddique, K.H.M.; Banks, R.G.; Kinghorn, B.P. Modeling crop breeding for global food security during climate change. Food Energy Secur. 2019, 8, e00157. [Google Scholar] [CrossRef]
  55. Cowling, W.A.; Castro-Urrea, F.A.; Stefanova, K.T.; Li, L.; Banks, R.G.; Saradadevi, R.; Sass, O.; Kinghorn, B.P.; Siddique, K.H.M. Optimal Contribution Selection Improves the Rate of Genetic Gain in Grain Yield and Yield Stability in Spring Canola in Australia and Canada. Plants 2023, 12, 383. [Google Scholar] [CrossRef]
  56. Gaynor, R.C.; Gorjanc, G.; Bentley, A.R.; Ober, E.S.; Howell, P.; Jackson, R.; Mackay, I.J.; Hickey, J.M. A two-part strategy for using genomic selection to develop inbred lines. Crop Sci. 2017, 57, 2372–2386. [Google Scholar] [CrossRef] [Green Version]
  57. Krause, M.R.; Mondal, S.; Crossa, J.; Singh, R.P.; Pinto, F.; Haghighattalab, A.; Shrestha, S.; Rutkoski, J.; Gore, M.A.; Sorrells, M.E.; et al. Aerial high-throughput phenotyping enables indirect selection for grain yield at the early generation, seed-limited stages in breeding programs. Crop Sci. 2020, 60, 3096–3114. [Google Scholar] [CrossRef]
  58. Gorjanc, G.; Gaynor, R.C.; Hickey, J.M. Optimal cross selection for long-term genetic gain in two-part programs with rapid recurrent genomic selection. Theor. Appl. Genet. 2018, 131, 1953–1966. [Google Scholar] [CrossRef] [Green Version]
  59. Hayes, B.J.; Wei, X.; Joyce, P.; Atkin, F.; Deomano, E.; Yue, J.; Nguyen, L.; Ross, E.M.; Cavallaro, T.; Aitken, K.S.; et al. Accuracy of genomic prediction of complex traits in sugarcane. Theor. Appl. Genet. 2021, 134, 1455–1462. [Google Scholar] [CrossRef]
  60. Michel, S.; Löschenberger, F.; Sparry, E.; Ametz, C.; Bürstmayr, H. Multi-year dynamics of single-step genomic prediction in an spplied wheat breeding program. Agronomy 2020, 10, 1591. [Google Scholar] [CrossRef]
  61. Pérez-Rodríguez, P.; Crossa, J.; Rutkoski, J.; Poland, J.; Singh, R.; Legarra, A.; Autrique, E.; Campos, G.d.L.; Burgueño, J.; Dreisigacker, S. Single-step genomic and pedigree genotype x environment interaction models for predicting wheat lines in international environments. Plant Genome 2017, 10, plantgenome2016.09.0089. [Google Scholar] [CrossRef] [Green Version]
  62. Ratcliffe, B.; El-Dien, O.G.; Cappa, E.P.; Porth, I.; Klapste, J.; Chen, C.; El-Kassaby, Y.A. Single-Step BLUP with varying genotyping effort in open-pollinated Picea glauca. G3-Genes Genom. Genet. 2017, 7, 935–942. [Google Scholar] [CrossRef] [Green Version]
  63. Velazco, J.G.; Malosetti, M.; Hunt, C.H.; Mace, E.S.; Jordan, D.R.; van Eeuwijk, F.A. Combining pedigree and genomic information to improve prediction quality: An example in sorghum. Theor. Appl. Genet. 2019, 132, 2055–2067. [Google Scholar] [CrossRef] [Green Version]
  64. Bonnett, D.; Li, Y.; Crossa, J.; Dreisigacker, S.; Basnet, B.; Pérez-Rodríguez, P.; Alvarado, G.; Jannink, J.L.; Poland, J.; Sorrells, M. Response to Early Generation Genomic Selection for Yield in Wheat. Front. Plant Sci. 2022, 12, 718611. [Google Scholar] [CrossRef]
  65. Saradadevi, R.; Mukankusi, C.; Li, L.; Amongi, W.; Mbiu, J.P.; Raatz, B.; Ariza, D.; Beebe, S.; Varshney, R.K.; Huttner, E.; et al. Multivariate genomic analysis and optimal contributions selection predicts high genetic gains in cooking time, iron, zinc, and grain yield in common beans in East Africa. Plant Genome 2021, 14, e20156. [Google Scholar] [CrossRef]
  66. Mortimer, S.I.; van der Werf, J.H.; Jacob, R.H.; Hopkins, D.L.; Pannier, L.; Pearce, K.L.; Gardner, G.E.; Warner, R.D.; Geesink, G.H.; Edwards, J.E.; et al. Genetic parameters for meat quality traits of Australian lamb meat. Meat Sci. 2014, 96, 1016–1024. [Google Scholar] [CrossRef]
  67. Woolliams, J.A.; Berg, P.; Dagnachew, B.S.; Meuwissen, T.H. Genetic contributions and their optimization. J. Anim. Breed. Genet. 2015, 132, 89–99. [Google Scholar] [CrossRef]
  68. Akdemir, D.; Beavis, W.; Fritsche-Neto, R.; Singh, A.K.; Isidro-Sanchez, J. Multi-objective optimized genomic breeding strategies for sustainable food improvement. Heredity 2019, 122, 672–683. [Google Scholar] [CrossRef] [Green Version]
  69. Allier, A.; Teyssedre, S.; Lehermeier, C.; Moreau, L.; Charcosset, A. Optimized breeding strategies to harness genetic resources with different performance levels. BMC Genom. 2020, 21, 349. [Google Scholar] [CrossRef] [PubMed]
  70. Labroo, M.R.; Studer, A.J.; Rutkoski, J.E. Heterosis and hybrid crop breeding: A multidisciplinary review. Front. Genet. 2021, 12, 643761. [Google Scholar] [CrossRef] [PubMed]
  71. Varshney, R.K.; Roorkiwal, M.; Sun, S.; Bajaj, P.; Chitikineni, A.; Thudi, M.; Singh, N.P.; Du, X.; Upadhyaya, H.D.; Khan, A.W.; et al. A chickpea genetic variation map based on the sequencing of 3366 genomes. Nature 2021, 599, 622–627. [Google Scholar] [CrossRef] [PubMed]
  72. Coombes, N.E. DiGGer, a Spatial Design Program. Biometric Bulletin; NSW Department of Primary Industries: Orange, Australia, 2009; Available online: https://www.nswdpibiom.org/austatgen/software/ (accessed on 1 August 2022).
  73. Gilmour, A.R.; Cullis, B.R.; Verbyla, A.P. Accounting for natural and extraneous variation in the analysis of field experiments. J. Agric. Biol. Environ. Stat. 1997, 2, 269–293. [Google Scholar] [CrossRef] [Green Version]
  74. De Faveri, J.; Verbyla, A.P.; Cullis, B.R.; Pitchford, W.S.; Thompson, R. Residual variance–covariance modelling in analysis of multivariate data from variety selection trials. J. Agric. Biol. Environ. Stat. 2016, 22, 1–22. [Google Scholar] [CrossRef]
  75. Butler, D.; Cullis, B.; Gilmour, A.; Gogel, B.; Thompson, R. ASReml-R Reference Manual Version 4; VSN International Ltd.: Hemel Hempstead, UK, 2018; Available online: https://asreml.kb.vsni.co.uk/article-categories/asreml-r-resources (accessed on 23 August 2022).
  76. Gilmour, A.R.; Gogel, B.J.; Cullis, B.R.; Welham, S.J.; Thompson, R. ASReml User Guide Release 4.2 Functional Specification; VSN International Ltd.: Hemel Hempstead, UK, 2021; Available online: https://asreml.kb.vsni.co.uk/article-categories/asreml-documentation (accessed on 23 August 2022).
  77. Mrode, R.A. Linear Models for the Prediction of Animal Breeding Values, 2nd ed.; CAB International: Wallingford, UK, 2005. [Google Scholar]
  78. Brascamp, E.W. Selection indices with constraints. Anim. Breed. Abstr. 1984, 52, 645–654. [Google Scholar]
  79. Kinghorn, B.P. DESIRE ver. 2.42. 2013. Available online: https://bkinghor.une.edu.au/desire.htm (accessed on 5 January 2023).
Figure 1. Field trial of Cycle 3 experimental field pea population in UWA field station, Shenton Park 6008, Western Australia in June 2019. (a) 1600 single plant plots sown in a square grid design partially replicated trial, comprising 668 S0 genotypes, 612 S2+ genotypes and 320 control plants (replicates of 15 control varieties); (b) close-up of a single plant immediately before first flower showing the stem angle above horizontal (EAngle) measured in degrees above horizontal (α).
Figure 1. Field trial of Cycle 3 experimental field pea population in UWA field station, Shenton Park 6008, Western Australia in June 2019. (a) 1600 single plant plots sown in a square grid design partially replicated trial, comprising 668 S0 genotypes, 612 S2+ genotypes and 320 control plants (replicates of 15 control varieties); (b) close-up of a single plant immediately before first flower showing the stem angle above horizontal (EAngle) measured in degrees above horizontal (α).
Plants 12 01141 g001
Figure 2. Diagram of measurement conditions for (a) compressed stem thickness (CST) and (b) stem buckling (SB) in dry field pea stems. In both settings the force gauge was actuated downwards, applying a load over the pea stem. In (a) a displacement meter was used to measure the displacement of the stem from its natural stem diameter (SD) to the CST after applying a load of 10 N. For (b) the bottom of the stem was restricted with a clamp and the top was fixed under the flat end of the force gauge. SB was measured as the peak force recorded at stem failure.
Figure 2. Diagram of measurement conditions for (a) compressed stem thickness (CST) and (b) stem buckling (SB) in dry field pea stems. In both settings the force gauge was actuated downwards, applying a load over the pea stem. In (a) a displacement meter was used to measure the displacement of the stem from its natural stem diameter (SD) to the CST after applying a load of 10 N. For (b) the bottom of the stem was restricted with a clamp and the top was fixed under the flat end of the force gauge. SB was measured as the peak force recorded at stem failure.
Plants 12 01141 g002
Figure 3. Additive genetic correlations calculated from the additive variance and covariance components from the optimized multivariate linear mixed model of 10 traits: single plant grain yield (GY), dry biomass (BM), basal branches (Br; square root transformed), days to flower (DTF), ascochyta blight score (ABS), stem buckling (SB), compressed stem thickness (CST), stem diameter (SD), early stem angle (EAngle), and internode length (IL). Actual values of the genetic correlations are shown above the diagonal.
Figure 3. Additive genetic correlations calculated from the additive variance and covariance components from the optimized multivariate linear mixed model of 10 traits: single plant grain yield (GY), dry biomass (BM), basal branches (Br; square root transformed), days to flower (DTF), ascochyta blight score (ABS), stem buckling (SB), compressed stem thickness (CST), stem diameter (SD), early stem angle (EAngle), and internode length (IL). Actual values of the genetic correlations are shown above the diagonal.
Plants 12 01141 g003
Table 1. Additive genetic, non-additive genetic, and residual variance components from univariate linear mixed model analyses (LMM) for 10 traits scored in Cycle 3 of the experimental field pea breeding population.
Table 1. Additive genetic, non-additive genetic, and residual variance components from univariate linear mixed model analyses (LMM) for 10 traits scored in Cycle 3 of the experimental field pea breeding population.
Trait AbbreviationUnivariate LMM Variance Components ± SEh2 ± SE
AdditiveNon-AdditiveResidual
GY22.79 ± 8.15103.77 ± 14.6479.60 ± 10.980.11 ± 0.04
BM77.79 ± 26.55232.02 ± 46.36279.74 ± 37.210.13 ± 0.04
Br0.08 ± 0.01ns0.14 ± 0.010.36 ± 0.05
DTF24.14 ± 3.8911.05 ± 1.348.46 ± 0.720.55 ± 0.05
ABS0.62 ± 0.16ns5.81 ± 0.240.10 ± 0.02
SB2.01 ± 0.71ns31.39 ± 1.460.06 ± 0.02
CST0.04 ± 0.010.07 ± 0.030.19 ± 0.030.13 ± 0.04
SD0.04 ± 0.01ns0.23 ± 0.020.15 ± 0.04
EAngle98.76 ± 21.05ns327.06 ± 13.440.23 ± 0.04
IL0.48 ± 0.080.11 ± 0.040.31 ± 0.030.53 ± 0.05
Abbreviations: GY, single plant grain yield; BM, dry whole plant biomass at maturity; Br, number of basal branches (square root transformed); DTF, days to flower; ABS, ascochyta blight score; SB, stem buckling; CST, compressed stem thickness; SD, stem diameter; EAngle, early stem angle from horizontal; IL, internode length; LMM, linear mixed model; h2, narrow-sense heritability; ns, not significant; SE, standard error.
Table 2. Additive genetic, non-additive genetic, and residual variance components from the optimized multivariate linear mixed model (MLMM) analysis for 10 traits scored in Cycle 3 of the experimental field pea breeding population.
Table 2. Additive genetic, non-additive genetic, and residual variance components from the optimized multivariate linear mixed model (MLMM) analysis for 10 traits scored in Cycle 3 of the experimental field pea breeding population.
Trait AbbreviationMLMM Variance Components ± SEh2 ± SE
AdditiveNon-AdditiveResidual
GY35.90 ± 10.2318.78 ± 4.62245.70 ± 12.160.12 ± 0.03
BM99.43 ± 29.24ns797.45 ± 54.540.11 ± 0.03
Br0.09 ± 0.02ns0.17 ± 0.010.35 ± 0.04
DTF32.22 ± 4.507.51 ± 1.2010.00 ± 0.820.65 ± 0.04
ABS0.61 ± 0.14ns5.90 ± 0.240.09 ± 0.02
SB1.81 ± 0.61ns32.96 ± 1.460.05 ± 0.02
CST0.04 ± 0.01ns0.28 ± 0.010.12 ± 0.03
SD0.04 ± 0.01ns0.28 ± 0.010.14 ± 0.03
EAngle125.04 ± 21.52ns146.15 ± 62.460.46 ± 0.12
IL0.62 ± 0.09ns0.39 ± 0.020.61 ± 0.04
Abbreviations: GY, single plant grain yield; BM, dry whole plant biomass at maturity; Br, number of basal branches (square root transformed); DTF, days to flower; ABS, ascochyta blight score; SB, stem buckling; CST, compressed stem thickness; SD, stem diameter; EAngle, early stem angle from horizontal; IL, internode length; MLMM, multivariate linear mixed model; h2, narrow-sense heritability; ns, not significant; SE, standard error.
Table 3. Comparison of mean accuracy of predicted breeding values (PBV) ± standard deviation between univariate and optimized multivariate linear mixed models for cross progeny (S0) and selfed lines (S2+).
Table 3. Comparison of mean accuracy of predicted breeding values (PBV) ± standard deviation between univariate and optimized multivariate linear mixed models for cross progeny (S0) and selfed lines (S2+).
TraitS0S2+
UnivariateMultivariateUnivariateMultivariate
GY0.75 ± 0.060.80 ± 0.040.79 ± 0.080.84 ± 0.06
BM0.77 ± 0.050.81 ± 0.040.80 ± 0.080.84 ± 0.05
Br0.86 ± 0.030.88 ± 0.020.89 ± 0.050.91 ± 0.04
DTF0.88 ± 0.020.90 ± 0.020.92 ± 0.040.94 ± 0.03
ABS0.77 ± 0.050.83 ± 0.040.81 ± 0.070.86 ± 0.05
SB0.71 ± 0.060.77 ± 0.050.74 ± 0.090.81 ± 0.06
CST0.76 ± 0.050.81 ± 0.040.80 ± 0.070.84 ± 0.05
SD0.78 ± 0.050.83 ± 0.040.82 ± 0.070.86 ± 0.04
EAngle0.84 ± 0.040.88 ± 0.020.88 ± 0.040.92 ± 0.02
IL0.87 ± 0.030.90 ± 0.020.91 ± 0.030.93 ± 0.02
Average0.7990.8410.8350.875
Abbreviations in table: GY, single plant grain yield; BM, dry whole plant biomass at maturity; Br, number of basal branches (square root transformed); DTF, days to flower; ABS, ascochyta blight score; SB, stem buckling; CST, compressed stem thickness; SD, stem diameter; EAngle, early stem angle from horizontal; IL, internode length.
Table 4. Predictions of genetic gains in index and PBVs in the next cycle of the experimental field pea population, from optimal contribution selection using MateSel [45]. The population phenotypic means for each trait are shown in Supplemental Table S2B.
Table 4. Predictions of genetic gains in index and PBVs in the next cycle of the experimental field pea population, from optimal contribution selection using MateSel [45]. The population phenotypic means for each trait are shown in Supplemental Table S2B.
ParameterUnitsSelection GoalSelection Index WeightsMean PBV in CandidatesPrediction of Mean PBV in Next CycleChange in Mean PBV in Next CycleChange in Mean PBV in Next Cycle as % of Phenotypic Mean
Index Increase 2.304.552.25
GYgIncrease−0.0282.875.462.60+9.4
BMgIncrease0.1502.212.760.55+1.0
BrnumberDecrease−6.0000.120.140.02+0.9
DTFdaysDecrease−0.200−2.26−4.04−1.79−2.5
ABSnumberDecrease−2.900−0.51−0.71−0.20−3.8
SBNIncrease1.2000.130.260.13+1.4
CSTmmIncrease1.7000.020.130.11+5.0
SDmmIncrease2.0000.080.220.14+5.1
EAngledegreesIncrease0.1503.248.435.19+7.8
ILcmMaintain−0.030−0.05−0.33−0.28−10.5
Abbreviations: PBV, predicted breeding value; GY, single plant grain yield; BM, dry whole plant biomass at maturity; Br, number of basal branches (square root transformed); DTF, days to flower; ABS, ascochyta blight score; SB, stem buckling; CST, compressed stem thickness; SD, stem diameter; EAngle, early stem angle from horizontal; IL, internode length.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Castro-Urrea, F.A.; Urricariet, M.P.; Stefanova, K.T.; Li, L.; Moss, W.M.; Guzzomi, A.L.; Sass, O.; Siddique, K.H.M.; Cowling, W.A. Accuracy of Selection in Early Generations of Field Pea Breeding Increases by Exploiting the Information Contained in Correlated Traits. Plants 2023, 12, 1141. https://doi.org/10.3390/plants12051141

AMA Style

Castro-Urrea FA, Urricariet MP, Stefanova KT, Li L, Moss WM, Guzzomi AL, Sass O, Siddique KHM, Cowling WA. Accuracy of Selection in Early Generations of Field Pea Breeding Increases by Exploiting the Information Contained in Correlated Traits. Plants. 2023; 12(5):1141. https://doi.org/10.3390/plants12051141

Chicago/Turabian Style

Castro-Urrea, Felipe A., Maria P. Urricariet, Katia T. Stefanova, Li Li, Wesley M. Moss, Andrew L. Guzzomi, Olaf Sass, Kadambot H. M. Siddique, and Wallace A. Cowling. 2023. "Accuracy of Selection in Early Generations of Field Pea Breeding Increases by Exploiting the Information Contained in Correlated Traits" Plants 12, no. 5: 1141. https://doi.org/10.3390/plants12051141

APA Style

Castro-Urrea, F. A., Urricariet, M. P., Stefanova, K. T., Li, L., Moss, W. M., Guzzomi, A. L., Sass, O., Siddique, K. H. M., & Cowling, W. A. (2023). Accuracy of Selection in Early Generations of Field Pea Breeding Increases by Exploiting the Information Contained in Correlated Traits. Plants, 12(5), 1141. https://doi.org/10.3390/plants12051141

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop