Next Article in Journal
Testing the Aquatic Toxicity of 2D Few-Layer Graphene Inks Using Rainbow Trout (Oncorhynchus mykiss): In Vivo and In Vitro Approaches to Support an SSbD Assessment
Next Article in Special Issue
Exposure to Plasticiser DEHP Affects Eggs Spawned by Blue Mussels: A Possible Risk to Fertilisation?
Previous Article in Journal
Geochemical Distribution and Environmental Risks of Radionuclides in Soils and Sediments Runoff of a Uranium Mining Area in South China
Previous Article in Special Issue
Investigating the Impact of Humic Acid on Copper Accumulation in Sinonovacula constricta Using a Toxicokinetic–Toxicodynamic Model
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Developing a Novel Read-Across Concept for Ecotoxicological Risk Assessment of Phosphate Chemicals: A Case Study

1
Geum River Environment Research Center, National Institute of Environmental Research, Okcheon-gun 29027, Chungbuk, Republic of Korea
2
Department of Environmental Fate and Modelling, Knoell Korea Ltd., Seoul 07327, Republic of Korea
3
Department of Marine Sciences and Convergent Engineering, Hanyang University, Ansan 15588, Republic of Korea
4
Department of Nano, Chemical and Biological Engineering, College of Engineering, Seokyeong University, Seoul 02173, Republic of Korea
5
Regulatory Chemical Analysis & Risk Assessment Center, Korea Institute of Industrial Technology (KITECH), Ansan 15588, Republic of Korea
*
Authors to whom correspondence should be addressed.
These authors contributed equally to this work.
Toxics 2024, 12(1), 96; https://doi.org/10.3390/toxics12010096
Submission received: 7 December 2023 / Revised: 17 January 2024 / Accepted: 18 January 2024 / Published: 22 January 2024

Abstract

:
This study introduces a novel concept approach for a read-across assessment, considering species sensitivity differences among phosphate chemicals within structurally similar compound groups. Twenty-five organic chemicals, with a log Kow of 5 or less, were categorized into three functional groups based on acetylcholinesterase (AChE) inhibition as a specific mode of action (MOA). The short-term aquatic toxicity data (LC50) for fish, crustaceans, and insects were collected from the U.S. EPA Ecotoxicology (ECOTOX) Knowledgebase. A geometric mean calculation method was applied for multiple toxic endpoints. Performance metrics for the new read-across concept, including correlation coefficient, bias, precision, and accuracy, were calculated. Overall, a slightly higher overestimation (49.2%) than underestimation (48.4%) in toxicity predictions was observed in two case studies. In Case study I, a strong positive correlation (r = 0.93) between the predicted and known toxicity values of target chemicals was observed, while in Case study II, with limited information on species and their ecotoxicity, showed a moderate correlation (r = 0.75). Overall, the bias and precision for Case study I were 0.32 ± 0.01, while Case study II showed 0.65 ± 0.06; however, the relative bias (%) increased from 37.65% (Case study I) to 91.94% (Case study II). Bland–Altman plots highlight the mean differences of 1.33 (Case study I) and 1.24 (Case study II), respectively. The new read-across concept, focusing on AChE inhibition and structural similarity, demonstrated good reliability, applicability, and accuracy with minimal bias. Future studies are needed to evaluate various types of chemical substances, diverse modes of action, functional groups, toxic endpoints, and test species to ensure overall comprehensiveness and robustness in toxicity predictions.

1. Introduction

Over 84,000 chemicals are used in commerce around the globe, and new chemicals are produced every single day. Many chemicals have contributed to the development of various industries that improve our quality of life but, at the same time, increase the potential risk to human health and the environment, requiring rigorous approaches to ensure their safe use. The EU and U.S. introduced chemical regulations to assess toxicological effects and risks for the safer use of chemicals [1,2]. Risk assessment is a process designed to characterize potential risks and hazards of chemicals to human health and the environment upon exposure. The evaluation of chemical hazards is associated with information on physicochemical properties, structural similarity, and toxicity [3].
To assess the impact of chemical exposures on human and environmental health, animal testing data are generally necessary to gain insights into various biological systems [4]. In the context of the aquatic environment, toxicity data are used to derive the predicted no-effect concentration (PNEC), representing the concentration below which adverse effects are unlikely to occur during either long- or short-term exposure. However, due to the increasing number of chemicals, reliance on animal testing for the identification of chemical hazards and risks has become substantially limited. Ethical concerns, along with factors such as high cost, time constraints, and manpower, further contribute to these limitations [5]. Animal testing is also considered a poor predictor for humans [6]. Given these challenges and circumstances, non-animal testing techniques have been proposed in the field of environmental risk assessment and have been widely accepted all over the globe.
The EU, recognizing the need to minimize animal testing, considers it a last resort in chemical risk assessment and advocates for alternative methods. In recent decades, many countries, including South Korea, European nations, and the U.S., have also aimed to reduce their reliance on animal testing in chemical risk assessments. Read-across stands out as one of the alternative methods used to estimate various toxic endpoints for hazard assessment purposes. This approach predicts toxicological endpoints using the endpoint data of another chemical, provided that they are classified within the same analog chemical group. Chemicals are typically grouped based on structural similarity and other parameters related to the endpoint. The EU, U.S., and OECD have jointly published several technical guidance perspectives for the application of the read-across approach. In the context of aquatic toxicity, the structural similarity, chemical functional groups (FGs), mode of toxic actions (MOAs), and octanol–water partition coefficient (Kow) were considered [7,8,9].
In the traditional read-across approach, the aquatic toxicity value of a target chemical (with no available data) is simply predicted using the toxicity value of a source chemical within the same species when they belong to the same analog group. In a preliminary study, we assessed the performance of the traditional read-across approach for aromatic amines, a group considered for use in the read-across approach by the U.S. EPA for hazard assessments [10]. However, the differences between predicted and observed toxic values were up to 3.2 times greater in fish (Pimephales promelas) and 5.1 times greater in crustaceans (Daphnia magna), indicating potential limitations in terms of hazard assessment when using that approach.
According to the grouping method based on MOAs and FGs [11,12], we identified that these aromatic amines are mostly classified as a neutral organic group, their narcosis as a mode of toxic action. Given that narcosis is recognized as an unspecific mode of toxic action, there would be variations in the sensitivities among aquatic species, which are also affected by other factors [13]. Consequently, the traditional read-across approach, relying on the predicted toxicity values, may introduce potential uncertainty and lack reliability. To ensure high reliability and accuracy in toxicity predictions, using the read-across approach requires consideration of specific MOAs and species sensitivities. Furthermore, the correlation between MOAs and variations in aquatic species sensitivity has been extensively explored in ecological effect assessments, often employed for the estimation of species sensitivity distributions (SSDs) [14,15,16].
Therefore, in this study, we aimed to introduce a new concept approach for read-across assessments, considering the differences in species sensitivity to phosphate chemicals within structurally similar chemical compounds of the same category group and the specific mode of toxic action effects. We also evaluated the performance of a new read-across concept by calculating various statistical metrics, including the correlation coefficient, bias, relative bias, precision, and accuracy, and compared the differences between the log-transformed predictions and known toxicity values.

2. Materials and Methods

2.1. Selection of Chemicals in New Read-Across Concept Development

The subject chemicals were selected based on the parameters that are generally used for a chemical grouping of traditional read-across assessments of acute aquatic toxicity. The parameters were defined as the mode of toxic actions (MOAs), functional groups (FGs), and octanol–water partition coefficient (Kow) [7,8,9]. Among MOAs, we considered acetylcholinesterase (AChE) inhibition rather than unspecific MOAs (e.g., narcosis, etc.) because AChE inhibition exhibits a neuro route toxicity on particular biological molecules after chemical exposure [17,18]. An unspecific route of MOA may have limitations in its acute effects on aquatic species. Regarding the three FGs, ester (phosphate), oxime carbamate ester, and mono (or di) thiophosphate were considered, as they contribute to AChE inhibition through a neurotoxic mechanism [17,18]. If the chemicals possessed other functional groups unrelated to neurotoxic toxicity, they were not taken into consideration for chemical grouping. The MOAs and FGs of the chemicals were classified according to previous studies [11,12]. To determine the cut-off level of acute effect concentrations (LC50) in aquatic toxicity, log Kow, a factor of baseline toxicity, was employed. In general, aquatic toxicity tends to increase with the increased log Kow values reaching up to 5 to 6 [19,20]. In this log Kow range, the aquatic toxicity may be mainly affected by MOA together with the baseline toxicity. A total of twenty-five organic chemicals belonging to phosphate chemicals (n = 25) were selected based on the following specific criteria: a log Kow of less than 5, AChE inhibition, and being classified into three functional groups (Table 1).

2.2. Selection of Aquatic Species and Toxicity Data Collection

Target aquatic species were selected by considering the phylogenetic information related to AChE inhibition. According to phylogenetic proximity, aquatic species were classified into groups of similarity in terms of their nervous systems [21], and the classified species could be expected to show similar effects concerning the use of phosphate chemicals. Therefore, we considered fish, crustaceans, and insects as they also demonstrate AChE inhibition through specific neurotoxicity after chemical exposure [18,22,23]. We collected short-term (LC50) toxicity data for each of the three aquatic taxonomies through the U.S. EPA ECOTOX Knowledgebase [10]. The aquatic toxicity data were applied to calculate the geometric mean if more than three toxicity data were available for the same species in each taxonomy. In the process of collecting the toxicity data, we considered the water solubility limit, which explains the relationship between the dissolved concentration and uptake by aquatic species. Hence, we used an LC50 value less than the water solubility value.

2.3. Development of New Concept in Read-Across Assessment

In this study, we developed a novel concept relating to the read-across assessment method to address the limitations observed in traditional read-across approaches by considering species sensitivity factors, i.e., the differences in species sensitivity to the structurally similar chemical compounds that share a common mode of toxic action within the same category. We classified the target chemicals into three functional groups: ester (phosphate), carbamate, and thiophosphate, as those contributing to the neurotoxic mode of action (AChE inhibition) and toxicological mechanisms. A total of 25 organic chemicals with a log Kow of five or less were selected for chemical pairing, and then fish, crustaceans, insects, and amphibians were selected as the target species organisms for ecological risk assessment. Utilizing this new read-across approach, we predicted acute toxicity concentrations via pairwise matching of each chemical substance in a 1:1 manner.

2.4. Chemical Pairing for a New Read-Across Assessment

We paired a couple of chemicals to perform a new concept in the read-across assessment. In each paired couple, the two chemicals consisted of one source and another target chemical based on the log Kow difference. A chemical with a relatively higher log Kow than a source chemical was selected as a target chemical, while the paired source chemical was selected due to a lower log Kow than the target chemical. In this study, only the aquatic species with a high log Kow and increased ecotoxicity observed in the target chemical were included. Accordingly, we conducted a comparison concerning the differing levels of toxic concentrations for the common species among the chemicals to validate the variation in ecotoxicity corresponding to the increased log Kow values. In cases where toxicological information on the aquatic species was available (accessible), we identified a paired chemical group matching and then conducted the new read-across assessment concept. The toxicity data of each chemical were listed and matched with each other, whether the couple chemicals had the same species data or not. If the paired matching species data appeared to have higher toxic sensitivity to the source chemicals, it was not considered in our new read-across concept because the aquatic toxicity might be affected by a specific MOA and log Kow rather than other factors. The pairing of a couple of chemicals in the new read-across concept used one species from each taxonomy. According to this process, 25 target chemicals were applied to make a pairing couple of combinations to perform the new read-across concepts. Case study I limited the scenario, where the ecotoxicity data were only available for at least three of the four target aquatic species, and Case study II also limited the scenario, where the ecotoxicity data for at least two out of four aquatic species could be collected for use in the read-across assessment using the paired couple chemicals.

2.5. Introduction of a New Concept in the Read-Across Method with the Species Sensitivity Factor

We introduced the species sensitivity factor (SSF) to the new read-across concept, which includes a couple of specific factors. SSF represents the geometric mean of species sensitivity ratios (SSRs), which are species-specific toxicity ratios for each paired matching chemical. The SSR of each species in the couple is derived by dividing the smaller LC50 value of the target chemical by the larger LC50 value of the source chemical. We developed two scenarios (i.e., Case studies I and II) for the new read-across concept according to the number of matched species between the source and the targeted coupled chemicals (Figure 1). We needed more than two species with known toxicity data in both the source and target chemicals and one species for the source chemicals, where we calculated SSR-1 and SSR-2 and further processed them for SSF, as in the Case study I approach. On the other hand, we needed one or more than one species (or simply uses a species showing the closest toxicity to the target species) with known toxicity data in the source and target chemicals and one species for the source chemical, as in the Case study II approach. The calculated SSF was applied to the toxicity value of the target species in the source chemical to predict the toxicity value of the target species in the target chemical. The results of the predicted toxicity value in the target chemical were assigned to either overestimation or underestimation by comparing the results to the observed toxicity data, which is assumed to be a data gap (Figure 2). Overestimation means that the predicted toxicity value shows the lowest toxicity value, i.e., greater toxic sensitivity than indicated in the observed toxicity data. Likewise, underestimation means that the predicted toxicity value is located between the observed toxicity data of the target chemical and the source chemical.

2.6. Calculation of Lack of Agreement

The lack of agreement (bias, relative bias, precision, and accuracy) was calculated to evaluate the performance of a new read-across concept approach to assess whether the predicted toxicity outcomes were over- or underestimated. Equations (1)–(3) are defined as follows [24]:
B i a s =   1 n   j = 1 n E j A
R e l a t i v e   b i a s =   e b i a s 1 × 100 % ,   w h e r e   e b i a s   i s   e x p j = 1 n ( E j A ) n
P r e c i s i o n =   1 n 1   j = 1 n E j A b i a s 2
where E j is the log-transformed predicted toxicity when using the new read-across concept for the J t h sample. A is the log-transformed known toxicity value collected from the ECOTOX Knowledgebase. n is the number of the toxicity value present in the data set.
We also calculated the accuracy, defined as the mean absolute error (MAE), using Equation (4), which reveals the average distance between the predicted and known toxicity values. It is also known to be a less sensitive and more robust measure of accuracy [24]. We used the mean values of the predicted toxicity compared to the known toxicity values.
A c c u r a c y =   1 n   j = 1 n E j A
Residuals, which are the differences between the log-transformed predictions and known toxicity values, were also calculated using Equation (5), as follows:
R e s i d u a l =   E j A
We produced Bland–Altman plots showing the mean differences between the predicted and known toxicity values with 95% upper and lower limits of agreement. Finally, we calculated the Pearson’s correlation coefficients (r) between the log-transformed prediction and known toxicity values, and scatter plots with a fitted linear line with corresponding 95% confidence intervals (CIs) were also drawn for Case studies I and II.

2.7. Statistical Analysis

We statistically compared the predicted toxicity with the observed toxicity to examine the applicability of the new read-across concept approach. All read-across predicted and aquatic toxicity values were log-transformed after performing the Anderson–Darling normality test. Lack of agreement (bias, relative bias, precision, and accuracy), residuals, SSR, SSF, and Pearson’s correlation coefficients were calculated, and scatter plots with the fitted linear line and Bland–Altman plots were also drawn. All statistical analyses were performed using R statistical software version 4.2.2 (R Core Team, Vienna, Austria, 2023) with Rstudio version 2023.03.1+446 (Rstudio Inc., Boston, MA, USA), and a p value less than 0.05 was considered statistically significant.

3. Results

Table 1 shows the information on the toxicological mechanisms, physicochemical properties, and ecological toxicity classification for the 25 target chemicals related to AcheE inhibition included in this study. The three functional groups of chemical substances were classified as esters (phosphate), carbamates (subdivided into carbamate esters, phenyl, and oxime carbamate esters), and thiophosphates (mono or di). According to the classification criteria of Verhaar et al. (1992) [13], 19 chemicals were identified as Class 4 (specific-acting chemicals), while the rest of the chemicals were Class 5 (not considered). Furthermore, 22 chemicals (e.g., Dichlorvos, Mevinphos, etc.) were classified under aquatic acute hazard Category 1 (H400, H410) due to their chronic and acute toxic effects. One substance, Oxamyl (CAS no. 23135-22-0), was categorized as aquatic chronic hazard Category 2 (H411). Acephate (CAS no. 30560-19-1) and Dimethoate (CAS no. 60-51-5), on the other hand, were not classified as having aquatic hazard toxicity (Supplementary Table S1).
Table 2 shows the range of ecotoxicity values for each target chemical collected in this study. The concentration range of 24 h, 48 h, or 96 h LC50 of 72 species of fish such as Oncorhynchus mykiss, Morone sapatilis, and Cyprinus carpio was at least 6.93 × 10−7 to a maximum of 3.08 × 103 mg/L, and the concentrations of 72 species of crustaceans, including Daphnia magna, Palaemonetes pugio, Gammarus pulex, etc., ranged from 7.28 × 10−11 to 2.35 × 103 mg/L, respectively. The concentration range of 85 insect species, including Aedes aegypti, Chauliodes sp., and Peltodytes sp., was from 6.94 × 10−7 to 6.50 × 102 mg/L, and the concentration range of 17 species of amphibians, such as Ambystoma gracile, Microhylanata, and Rana boylii, ranged from 9.40 × 10−3 to 8.82 × 103 mg/L. The aquatic toxicity values of insect and amphibian species were not collected for some of the target chemicals, whereas all of the toxicity values on fish and crustaceans were collected from the U.S. EPA ECOTOX Knowledgebase for all 25 chemical substances.
In Table 3, the information concerning SSR across different species, known reference toxicity values collected from the U.S. EPA ECOTOX Knowledgebase, SSF, and predicted toxicities derived using the new read-across concept were summarized for seven target chemicals paired with source chemicals in the Case study I scenario. The predicted toxicity values showed a slightly higher percentage of overestimation (49.2%) than underestimation (48.4%), and in three substances, Carbaryl, Malathion, and Chlorpyrifos, the outcomes in over- and underestimations in terms of species were the same: thus, the decision concerning either over- or underestimation was not made. In Table 4, the predicted toxicity values and over- or underestimation decisions are shown for 10 target chemicals using the new read-across approach. In the Case study II scenario, however, the predicted toxicity values showed a higher overestimation percentage (52%) than underestimation (48%). Therefore, the predicted toxicity values using the new read-across concept presented a tendency toward overestimation when comparing the known toxicity values in both scenarios (Case studies I and II).
In Table 5, the results yielded from calculating the overall bias, relative bias, precision, and accuracy are shown. The overall bias and precision were 0.32 ± 0.01 for Case study I and 0.65 ± 0.06 for Case study II, respectively. Relative bias (%) was 37.65% for Case study I and 91.94% for Case study II, indicating that both Case studies I and II scenarios showed overestimation. The overall accuracy was 0.01 for Case study I and 0.05 for Case study II, indicating that both of the case studies had high accuracy. In Case study I, the bias and precision for a functional group of thiophosphates were as high as 0.01 ± 0.01, with an accuracy of 0.004. Figure 3 also shows scatter plots demonstrating the linear relationships between the predicted and known toxicity values in the target chemicals derived using a new read-across concept approach. The Pearson correlation coefficient was r = 0.93 for Case study I, indicating a strong positive correlation (Figure 3a), and a moderate correlation (r = 0.75), which is relatively lower than that for the Case study I scenario, was observed in Case study II (Figure 3b).
In Figure 4, the Bland–Altman plots were drawn to demonstrate the mean differences between the predicted and known toxicity values. For the Case study I scenario, the mean difference was 1.33, and most of the predicted values were within a 95% upper and lower limits range (+1.96 SD 2.32~−1.96 SD 0.35); however, some appeared to be outside of the range. On the other hand, the mean difference was 1.24 for the Case study II scenario, which was lower than the Case study I. Nonetheless, the 95% upper and lower limits ranged from +1.96 SD 3.11 to −1.96 SD −0.64, which is relatively wider than that of Case study I. Only eight values exceeded the 95% upper limit value in all of the datasets.

4. Discussion

In this present study, we developed a novel read-across concept approach to assess predicted toxicity by considering differences in species-specific sensitivity, known as species sensitivity factors. We used a dataset of 25 organic chemicals with AChE inhibition (MOA). To account for interspecies variation, we collected known reference toxicity values for fish, crustaceans, and insects from the U.S. EPA ECOTOX Knowledgebase. In the first scenario (Case study I), we had a minimum of one or more toxicity data values available per species (i.e., at least three or more species’ toxicity information can be collected and used in common), and the predicted outcomes revealed a strong positive correlation (r = 0.93) with known toxicity values. In the second scenario, however, where toxicity-related information was limited for some species (i.e., only available for some species), we observed a moderate correlation (r = 0.75), indicating that the first scenario (Case study I) had higher predictability and reliability.
Generally, there are four types of read-across assessment approaches, each contingent on data availability: one-to-one, one-to-many, many-to-one, and many-to-many read-across. For this study, we adopted a one-to-one approach, anticipating the toxicity of target chemicals based on the toxicity of the source chemicals. As outlined in this study, we endeavored to enhance the reliability of our findings by incorporating other aquatic species with known toxicity values that exhibit biologically or genetically similar toxic mechanisms. In Case study I, we employed two or more different species, while in Case study II, we utilized only one species. The key distinction between these two approaches lies in the number of species with known toxicity values. We posit that a higher number of such species improves prediction accuracy, aligning with our assumptions. It is important to note the variability in toxicity values of biological origin, which can differ significantly across laboratories or experiments. Occasionally, such disparities are so pronounced that scientists may omit certain values as outliers. While this issue falls outside the scope of our study, as experimental errors are inherently present in the existing toxicity values, it is worth recognizing that the pattern of toxicity values may conform to a normal distribution with a larger volume of increased datasets. In this regard, our study does not set boundaries based on the number of preexisting datasets in aquatic species, but the inclusion of a greater variety of species may contribute to the overall reliability of our findings.
Furthermore, the predicted outcomes from the two scenarios generally demonstrated a tendency toward overestimation. In Case study I, the overestimated values of acute aquatic toxicity were approximately 40% higher than the known reference values. However, in Case study II, this overestimation was much higher, at approximately 90%. Therefore, the newly developed read-across approach demonstrates good accuracy, precision, and high reliability in predicting acute aquatic toxicity for organic chemicals at a screening level. In fact, the prediction of aquatic toxicity using a new read-across concept approach was based on the hypothesis that toxicity is primarily caused by structural similarity, the mode of toxic action, toxicological mechanisms, and log Kow, among other parameters. In this study, the mode of toxic action for organic substances was based on one of the neurotoxic mechanisms, AChE inhibition. Colovic et al. (2013) [18] reported that irreversible AChE inhibition is associated with specific chemical functional groups, including ester (phosphate), carbamates, and mono- or di-thiophosphates, i.e., organophosphorus compounds.
Nagai and Taya [16] observed a relationship between the average sensitivity of algae and EC50 values for herbicides. They reported that when the specific MOA information within the same category was taken into consideration, the accuracy of predicting sensitivity variation, known as species sensitivity distribution (SSD), significantly improved. In this present study, we similarly considered the differences in toxicity sensitivity among various aquatic species for organic substances exhibiting AChE inhibition as their common mode of action. Our study indicates that the accuracy of the predicted results was high, which is consistent with that found in the previous studies. In addition, a study conducted by Lambert et al. [25] performed acute toxicity concentration (LC50) predictions for 617 organic substances, considering the log Kow values. The study found that the accuracy of the toxicity prediction results was significantly higher in the specific MOA-based QSAR models compared to a wide range of general MOA groupings. Therefore, the authors of this study have provided sufficient evidence that log Kow, one of the fundamental physicochemical characteristics, is significantly correlated with the acute toxicity of organic matter across diverse ranges of MOA categories, which is similar to two previous studies [25,26]. Belanger et al. [27] also noted a robust linear correlation between the acute toxicity of short- and long-chain alcohols to fish and log Kow (hydrophobicity).
In line with previous studies, our current study identified that the log Kow values of the organic substances selected for the newly developed read-across assessment fell within the range of −0.85 to 4.96 rather than exceeding a cutoff range. Furthermore, we also observed a correlation whereby the average toxicity value of each species was associated with an increase in the log Kow values (resulting in lower toxicity values) for organic substances. Suter and Lizarraga [28] provided evidence for read-across assessments, which were classified into four broad categories: structural features of chemicals, physicochemical properties, toxicokinetics, and toxicodynamics. In particular, they emphasized that source–target chemical analogs should be evaluated for similarity across various parameters, including taxonomy, toxic endpoint, exposure route, structural features, toxicokinetic or toxicodynamic pathways and processes, structure–activity relationships, mechanisms of toxicity, etc. Therefore, a Weight of Evidence (WoE) assessment for read-across assessments should be conducted to examine whether there is relevance, strength, or reliability among these parameters, ultimately enhancing the credibility and validity of the entire assessment process and results.
In the present study, we quantitatively predicted the LC50 concentrations of target substances by pairing source and target chemicals with one-on-one (1:1) couple matching based on similar functional groups with respect to structurally similar characteristics, toxic mode of action (AChE inhibition), functional groups, octanol–water partition coefficient (Kow), toxicity effects, and endpoints (i.e., acute aquatic toxicity). Therefore, prior to our new read-across concept applied to aquatic toxicity prediction and assessment, our hypothesis satisfied the results reported in several previous studies, thus leading to a high level of reliability in terms of the predicted results with high confidence. Therefore, it can be concluded that a new read-across concept could be relevant to predicting aquatic toxicity with high reliability, accuracy, and less bias. Several previous studies have also reported predictions of acute toxicity for various organic substances using the refined read-across methods, which are similar to the read-across concept approach employed in this study.
For instance, Kühne et al. [29] utilized a read-across approach applying Kow- and LSER-based methods to predict the acute toxicity concentration (48 h-LC50) for water fleas, and they observed a strong correlation between their predictions and experimental data, indicating that their predictions were within the applicability domain. Chavan et al. [30] used a k-nearest neighbor (k-NN) classification method that they developed to determine the most optimal k value. Then, they classified the substances into two classes (e.g., highly toxic or non-harmful) based on their LD50 values and predicted repeated dose toxicity (LOEL) values. These model predictions demonstrated good applicability, with approximately 74% within an order of magnitude of the experimental LOEL values. In another study, Paul et al. [31] collected soil pEC50 values of F. candida for various classes of organic compounds from the U.S. ECOTOX Knowledgebase and used diverse prediction models to estimate the toxicity values. In particular, when using the chemical read-across method to predict unknown toxicity values of similar substances based on known toxicity values of substances within the same category, the results showed much better-predicted values in terms of validation metrics compared to the intelligent consensus model (i.e., the partial least square PLS model). This read-across approach was reported to be a practical tool for predicting toxicity, using small datasets, and was found to be simple, accurate, and reliable.
Furthermore, Lizarraga et al. [32] recently introduced a modified, revised read-across framework based on key principles, evaluation experience, and new approach methodologies (NAMs) data. The revised read-across framework particularly emphasizes evaluating biological similarity as a means of identifying groups of similar substances. The sequence of read-across assessment has five steps, and in the third step, the structural similarity, toxicokinetic/toxicodynamic properties, similar toxic pathways and effects, and candidate similar substances are compiled or grouped within the same category (i.e., similar functional groups). Therefore, we anticipate that the results obtained by applying our new read-across concept approach, appropriately incorporating the key principles and steps in our new read-across assessment process and methodology, will provide scientifically valid evidence to predict the acute aquatic toxicity of organic substances focusing on AChE inhibition.
However, there are some limitations to this study. First, the sample size of the selected organic chemicals for the read-across assessment was relatively small (n < 30) since we established three hypotheses for the study goal: a range of log Kow less than 5, a specific MOA of AChE inhibition, and a category for chemical functional groups. Secondly, some of the aquatic species in each taxonomy show higher toxicity to the source chemicals that have a lower log Kow value than the target chemicals. This suggests that other species may have different sensitivities to chemicals, even though the same MOA contributes significantly to species sensitivity. In fact, the available toxicity information was collected and evaluated considering the physicochemical characteristics of specific organic substances and their toxic mode of action only. Therefore, it is difficult to generalize and apply this new read-across concept to all other chemical substances, various toxic modes of action, different toxic endpoints, and circumstances. The other types of MOAs for aquatic species should also be applied to assess aquatic toxicity using the new read-across approach. Apart from AChE inhibition, other types of MOAs with specific endpoints and toxic effects have also been widely studied in previous studies concerning respiratory blocking [17,33], irritants [17], central nervous system seizing [34], and inhibiting oxidative phosphorylation [35,36]. Most studies provided sufficient evidence of the relationship between MOAs and variations in species sensitivity based on chemical functional groups [14,15,16]. Thus, further studies are necessary to consider other well-known MOAs to apply this new concept to diverse functional groups and different types of chemical substances and validate this new read-across concept approach using a larger number of predicted toxicity values in various situations in the future.
Despite these limitations, this study has several strengths. First, we fully satisfied the assessment process, steps, and key principles of the newly revised read-across framework. We collected all the available data for predicting the aquatic toxicity of target chemicals by using a large-scale dataset from the globally recognized and well-known U.S. EPA ECOTOX Knowledgebase. In this study, we performed one-on-one (1:1) couple pairing of the source and target chemicals, with the collection of large groups of known acute toxicity (LC50) values for various test species widely used in the OECD test guidelines, such as Danio rerio, Oryzias latipes, etc., for fish, Daphnia magna, etc., for crustaceans, and Chironomus sp., etc., for insects in Case study I (n = 1095) and II (n = 218), respectively. Therefore, our new read-across concept introduced highly reliable performances in toxicity prediction by applying a sufficient large-scale dataset of aquatic toxicity, which is essential for the statistical evaluation of accuracy, bias, precision, and reliability in this study. However, it is unable to quantitatively compare our study results with previous studies due to the unavailability of raw data. If possible, a new pooled analysis using all combined data and related information acquired from the previous and current studies should be performed to increase the credibility, accuracy, and validity of the new read-across concept.
Moreover, the U.S. EPA ECOTOX Knowledgebase, which we used to collect toxicity information, offers a strong advantage in terms of the comprehensive and transparent curation of detailed aquatic toxicity datasets from the latest study results, following a rigorous process of literature search and systematic review. It also provides extensive updates and encompasses a wide range of documents, including all endpoints and other related toxic effects, rendering it a reliable and comprehensive source of aquatic toxicity data. This database is made readily accessible to all stakeholders, including government officials, academic researchers, and industrial experts, by ensuring ease of use, free of charge, accessibility, and a high level of data quality.
In a recent review, Olker et al. [37] reported that the ECOTOX database (Version 5) included the ecotoxicity data for over 12,000 chemicals and 13,000 species with over one million testing results in the last decade and a higher volume of data updates. All toxicity data underwent internal review and were subjected to quality assurance (QA) processes. More importantly, this database serves as a curated source of toxicity data that offers high reliability and applicability for various chemical risk assessments and related validation studies. It can also be interoperable with other available toxicity databases, continuously evolving into a state-of-the-art source of information and practices around the globe.
Most importantly, this study considered inter-species sensitivity using the aquatic toxicity information for various organisms collected from the recently published references and toxicity databases. We also proposed a new concept approach of read-across assessment that enables the simple and rational prediction of acute aquatic toxicity concentrations of specific target substances at a screening level. Using this method, further studies can be conducted to predict, evaluate, and be applied to diverse chemical substances, different toxic mechanisms (MOAs), and other toxic endpoints and effects, thus enabling further cross-validations of this method (prediction model) of the new read-across assessment that we have introduced in the present study.
In particular, further studies should focus on using AI-based toxicity prediction techniques to predict aquatic toxicity values for various toxic endpoints of organic substances in various MOA groups, as indicated by the recent trends in the published literature. A comprehensive review conducted by Jeong and Choi [38], covering research papers on toxicity prediction and risk assessment from 1990 to 2020, highlighted the increasing use of machine and deep learning models. These advanced models, including algorithms such as random forest, support vector machines, and deep neural networks, can be employed to predict various toxicity endpoints in aquatic environments. Given that AI-based prediction models can handle large volumes of toxicity data, it is anticipated that they will play an important role in read-across approaches and validation as larger datasets can be collected in the future.
Certainly, while models developed using artificial neural networks (ANNs) may not fully replace experimental toxicity data, they are expected to serve as valuable screening tools in situations where experimental data are lacking or insufficient [39]. In addition, similarity-based machine learning models successfully predicted acute toxicity concentrations for various organic chemicals in two species, D. magna and O. latipes, demonstrating a high correlation with experimental data [40]. The application of the newly developed read-across structure–activity relationship (RASAR) model demonstrated more accurate, consistent, and reproducible predictions of aquatic acute toxicity values, with the species identified as the most crucial input feature [41].
Although it is nearly impossible to fully predict exposure scenarios for chemical mixtures or complexes in real-world environments, machine learning-based models would be applicable. Recently, a modeling study conducted by Schür et al. using the ADORE datasets extracted from the U.S. EPA ECOTOX database utilized machine learning techniques to predict acute ecotoxicity. The detailed modeling processes, approaches, and predicted outcomes, including model performance and best practices, were also described [42]. Therefore, it is highly expected that further studies on machine learning-based techniques for ecotoxicity predictions will provide evidence of model improvement and cross-validation with less uncertainty in the future.

5. Conclusions

In this study, the new read-across assessment concept demonstrated a strong correlation with known reference toxicity, indicating high reliability and accuracy in predicting aquatic toxicity for target substances with minimal bias. We focused on AChE inhibition as a specific mode of action (MOA) and structural similarity (functional groups) across three aquatic species, including fish, crustaceans, and amphibians. Our concept followed a modified read-across framework, considering important elements, such as source–target chemical paring, species sensitivity factors, species sensitivity ratio (SSR), and the species sensitivity factor (SSF). Future studies should emphasize different substances, diverse toxic action modes, various functional group categories, additional toxic endpoints, and effects on various test species. Further validation of the read-across concept approach is crucial, and comparative studies using machine learning-based models should be conducted to ensure overall comprehensiveness and robustness in ecotoxicity predictions.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/toxics12010096/s1, Table S1: Physicochemical properties and classification of aquatic toxicity for 25 target chemical substances included in this study. Table S2: Acute aquatic toxicity data collected from the ECOTOXicology Knowledgebase (ECOTOX, Version 5, US EPA, 2022) for 25 target chemicals.

Author Contributions

Conceptualization, S.L., S.-Y.O., S.-C.S. and J.-S.R.; methodology, S.-Y.O. and J.-S.R.; software, S.L. and S.-Y.O.; validation, H.-B.M., S.-C.S. and J.-S.R.; formal analysis, S.L. and S.-Y.O.; investigation, S.L. and S.-Y.O.; resources, S.-Y.O., H.-B.M. and J.-S.R.; data curation, S.L. and S.-Y.O.; writing—original draft preparation, S.L. and S.-Y.O.; writing—review and editing, S.L., S.-Y.O., H.-B.M., S.-C.S. and J.-S.R.; visualization, S.L. and S.-Y.O.; supervision, S.-C.S. and J.-S.R.; project administration, S.-C.S. and J.-S.R.; funding acquisition, S.L. and J.-S.R. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by a grant from the National Institute of Environment Research (NIER), funded by the Ministry of Environment (ME) of the Republic of Korea (No. NIER-2023-01-01-181), and the National Research Council of Science & Technology (NST) grant by the Korea government (MSIP) (No. CAP-17-01-KIST Europe).

Institutional Review Board Statement

The ethical review and approval were waived for this study due to the use of existing datasets, which are publicly available to collect and utilize.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data will be made available upon request by means of a project agreement from the authors. Requests should be sent to [email protected] or [email protected] and are subject to approval by all named authors participating in this study.

Conflicts of Interest

Author Seung-Yeop Ok is affiliated with the company Department of Environmental Fate and Modelling, Knoell Korea Ltd. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

  1. EC. Regulation (EC) No 1907/2006 of the European Parliament and of the Council on the Registration, Evaluation, Authorisation and Restriction of Chemicals (REACH), Establishing a European Chemicals Agency, Amending Directive 1999/45/EC and Repealing Council Regulation (EEC) No. 793/93 and Commission Regulation (EC) No. 1488/94 as Well as Council Directive 76/769/EEC and Commission Directives 91/155/EEC, 93/67/EEC, 93/105/EC and 2000/21/EC. Off. J. Eur. Union 2006. Available online: https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX%3A02006R1907-20140410 (accessed on 1 December 2023).
  2. United States Environmental Protection Agency. Compliance Guide for the Chemical Import Requirements of the Toxic Substances Control Act (TSCA). No. EPA 305-B-08-001. 2008. Available online: https://www.epa.gov/compliance/compliance-guide-chemical-import-requirements-toxic-substances-control-act (accessed on 1 December 2023).
  3. EC. Technical Guidance Document Part I in Support of the Commission Directive 93/67/EEC on Risk Assessment for New Notified Substances and Commission Regulation No. 1488/94 on Risk Assessment for Existing Substances; Office for Publications of the European Communities: Luxembourg, 2003. [Google Scholar]
  4. National Research Council. Committee on the Use of Laboratory Animals in Biomedical and Behavioral Research. In Use of Laboratory Animals in Biomedical and Behavioral Research; National Academy of Sciences: Washington, DC, USA, 1988. [Google Scholar]
  5. Doke, S.K.; Dhawale, S.C. Alternatives to animal testing: A review. Saudi Pharm. J. 2015, 23, 223–229. [Google Scholar] [CrossRef]
  6. Bracken, M.B. Why animal studies are often poor predictors of human reactions to exposure. J. R. Soc. Med. 2009, 102, 120–122. [Google Scholar] [CrossRef] [PubMed]
  7. ECHA. Guidance on Information Requirements and Chemical Safety Assessment Chapter R.6: QSARs and Grouping of Chemicals. 2008. Available online: https://echa.europa.eu/documents/10162/17224/information_requirements_r6_en.pdf (accessed on 1 December 2023).
  8. OECD. Guidance on Grouping of Chemicals, Second Edition. 2017. Available online: https://www.oecd.org/publications/guidance-on-grouping-of-chemicals-second-edition-9789264274679-en.htm (accessed on 1 December 2023).
  9. ECHA. The Use of Alternatives to Testing on Animals for the REACH Regulation. Fifth Report under Article 117(3) of the REACH Regulation. 2023. Available online: https://echa.europa.eu/documents/10162/23919267/230530_117_3_alternatives_test_animals_2023_en.pdf (accessed on 1 December 2023).
  10. United States Environmental Protection Agency. Screening-Level Hazard Characterization: Monocyclic Aromatic Amines Category. Hazard Characterization Document. National Service Center for Environmental Publications (NSCEP). 2009. Available online: https://nepis.epa.gov/Exe/ZyPDF.cgi/P1013BBW.PDF?Dockey=P1013BBW.PDF (accessed on 1 December 2023).
  11. Hermens, J. Electrophiles and acute toxicity to fish. Environ. Health Perspect. 1990, 87, 219–225. [Google Scholar] [CrossRef] [PubMed]
  12. Russom, C.L.; Bradbury, S.P.; Broderius, S.J.; Hammermeister, D.E.; Drummond, R.A. Predicting modes of toxic action from chemical structure: Acute toxicity in the fathead minnow (Pimephales promelas). Environ. Toxicol. Chem. Int. J. 1997, 16, 948–967. [Google Scholar] [CrossRef]
  13. Verhaar, H.J.; Van Leeuwen, C.J.; Hermens, J.L. Classifying environmental pollutants. Chemosphere 1992, 25, 471–491. [Google Scholar] [CrossRef]
  14. Vaal, M.; van der Wal, J.T.; Hoekstra, J.; Hermens, J. Variation in the sensitivity of aquatic species in relation to the classification of environmental pollutants. Chemosphere 1997, 35, 1311–1327. [Google Scholar] [CrossRef] [PubMed]
  15. Sala, S.; Migliorati, S.; Monti, G.S.; Vighi, M. SSD-based rating system for the classification of pesticide risk on biodiversity. Ecotoxicology 2012, 21, 1050–1062. [Google Scholar] [CrossRef]
  16. Nagai, T.; Taya, K. Estimation of herbicide species sensitivity distribution using single-species algal toxicity data and information on the mode of action. Environ. Toxicol. Chem. 2015, 34, 677–684. [Google Scholar] [CrossRef]
  17. Fukuto, T.R. Mechanism of action of organophosphorus and carbamate insecticides. Environ. Health Perspect. 1990, 87, 245–254. [Google Scholar] [CrossRef]
  18. Colovic, M.B.; Krstic, D.Z.; Lazarevic-Pasti, T.D.; Bondzic, A.M.; Vasic, V.M. Acetylcholinesterase inhibitors: Pharmacology and toxicology. Curr. Neuropharmacol. 2013, 11, 315–335. [Google Scholar] [CrossRef] [PubMed]
  19. Könemann, H. Quantitative structure-activity relationships in fish toxicity studies Part 1: Relationship for 50 industrial pollutants. Toxicology 1981, 19, 209–221. [Google Scholar] [CrossRef] [PubMed]
  20. Mayer, P.; Reichenberg, F. Can highly hydrophobic organic substances cause aquatic baseline toxicity and can they contribute to mixture toxicity? Environ. Toxicol. Chem. Int. J. 2006, 25, 2639–2644. [Google Scholar] [CrossRef] [PubMed]
  21. Theobald, D.L. 29+ evidences for macroevolution: The scientific case for common descent. Talk Orig. Arch. 2009, 20–23. [Google Scholar]
  22. Guilhermino, L.; Diamantino, T.; Silva, M.C.; Soares, A. Acute toxicity test with Daphnia magna: An alternative to mammals in the prescreening of chemical toxicity? Ecotoxicol. Environ. Saf. 2000, 46, 357–362. [Google Scholar] [CrossRef]
  23. De la Torre, F.; Ferrari, L.; Salibián, A. Freshwater pollution biomarker: Response of brain acetylcholinesterase activity in two fish species. Comp. Biochem. Physiol. Part C Toxicol. Pharmacol. 2002, 131, 271–280. [Google Scholar] [CrossRef]
  24. Walther, B.A.; Moore, J.L. The concepts of bias, precision and accuracy, and their use in testing the performance of species richness estimators, with a literature review of estimator performance. Ecography 2005, 28, 815–829. [Google Scholar] [CrossRef]
  25. Lambert, F.N.; Vivian, D.N.; Raimondo, S.; Tebes-Stevens, C.T.; Barron, M.G. Relationships Between Aquatic Toxicity, Chemical Hydrophobicity, and Mode of Action: Log Kow Revisited. Arch. Environ. Contam. Toxicol. 2022, 83, 326–338. [Google Scholar] [CrossRef]
  26. Cherkasov, A.; Muratov, E.N.; Fourches, D.; Varnek, A.; Baskin, I.I.; Cronin, M.; Dearden, J.; Gramatica, P.; Martin, Y.C.; Todeschini, R. QSAR modeling: Where have you been? Where are you going to? J. Med. Chem. 2014, 57, 4977–5010. [Google Scholar] [CrossRef]
  27. Belanger, S.E.; Rawlings, J.M.; Stackhouse, R. Advances in understanding the response of fish to linear alcohols in the environment. Chemosphere 2018, 206, 539–548. [Google Scholar] [CrossRef]
  28. Suter, G.W.; Lizarraga, L.E. Clearly weighing the evidence in read-across can improve assessments of data-poor chemicals. Regul. Toxicol. Pharmacol. 2022, 129, 105111. [Google Scholar] [CrossRef] [PubMed]
  29. Kühne, R.; Ebert, R.-U.; von der Ohe, P.C.; Ulrich, N.; Brack, W.; Schüürmann, G. Read-across prediction of the acute toxicity of organic compounds toward the water flea Daphnia magna. Mol. Inform. 2013, 32, 108–120. [Google Scholar] [CrossRef] [PubMed]
  30. Chavan, S.; Friedman, R.; Nicholls, I.A. Acute toxicity-supported chronic toxicity prediction: A k-nearest neighbor coupled read-across strategy. Int. J. Mol. Sci. 2015, 16, 11659–11677. [Google Scholar] [CrossRef] [PubMed]
  31. Paul, R.; Chatterjee, M.; Roy, K. First report on soil ecotoxicity prediction against Folsomia candida using intelligent consensus predictions and chemical read-across. Environ. Sci. Pollut. Res. 2022, 29, 88302–88317. [Google Scholar] [CrossRef] [PubMed]
  32. Lizarraga, L.E.; Suter, G.W.; Lambert, J.C.; Patlewicz, G.; Zhao, J.Q.; Dean, J.L.; Kaiser, P. Advancing the science of a read-across framework for evaluation of data-poor chemicals incorporating systematic and new approach methods. Regul. Toxicol. Pharmacol. 2022, 137, 105293. [Google Scholar] [CrossRef] [PubMed]
  33. Stannard, J.; Horecker, B. The in vitro inhibition of cytochrome oxidase by azide and cyanide. J. Biol. Chem. 1948, 172, 599–608. [Google Scholar] [CrossRef] [PubMed]
  34. Bradbury, S.P.; Carlson, R.W.; Niemi, G.J.; Henry, T.R. Use of respiratory-cardiovascular responses of rainbow trout (Oncorhynchus mykiss) in identifying acute toxicity syndromes in fish: Part 4. Central nervous system seizure agents. Environ. Toxicol. Chem. Int. J. 1991, 10, 115–131. [Google Scholar]
  35. McKim, J.M.; Schmieder, P.K.; Carlson, R.W.; Hunt, E.P.; Niemi, G.J. Use of respiratory-cardiovascular responses of rainbow trout (Salmo gairdneri) in identifying acute toxicity syndromes in fish: Part 1. pentachlorophenol, 2, 4-dinitrophenol, tricaine methanesulfonate and 1-octanol. Environ. Toxicol. Chem. 1987, 6, 295–312. [Google Scholar]
  36. Terada, H. Uncouplers of oxidative phosphorylation. Environ. Health Perspect. 1990, 87, 213–218. [Google Scholar] [CrossRef]
  37. Olker, J.H.; Elonen, C.M.; Pilli, A.; Anderson, A.; Kinziger, B.; Erickson, S.; Skopinski, M.; Pomplun, A.; LaLone, C.A.; Russom, C.L.; et al. The ECOTOXicology knowledgebase: A curated database of ecologically relevant toxicity tests to support environmental research and risk assessment. Environ. Toxicol. Chem. 2022, 41, 1520–1539. [Google Scholar] [CrossRef]
  38. Jeong, J.; Choi, J. Artificial intelligence-based toxicity prediction of environmental chemicals: Future directions for chemical management applications. Environ. Sci. Technol. 2022, 56, 7532–7543. [Google Scholar] [CrossRef]
  39. Song, R.; Li, D.; Chang, A.; Tao, M.; Qin, Y.; Keller, A.A.; Suh, S. Accelerating the pace of ecotoxicological assessment using artificial intelligence. Ambio 2022, 51, 598–610. [Google Scholar] [CrossRef]
  40. Gajewicz-Skretna, A.; Furuhama, A.; Yamamoto, H.; Suzuki, N. Generating accurate in silico predictions of acute aquatic toxicity for a range of organic chemicals: Towards similarity-based machine learning methods. Chemosphere 2021, 280, 130681. [Google Scholar] [CrossRef]
  41. Wu, J.; D’Ambrosi, S.; Ammann, L.; Stadnicka-Michalak, J.; Schirmer, K.; Baity-Jesi, M. Predicting chemical hazard across taxa through machine learning. Environ. Int. 2022, 163, 107184. [Google Scholar] [CrossRef]
  42. Schür, C.; Gasser, L.; Perez-Cruz, F.; Schirmer, K.; Baity-Jesi, M. A benchmark dataset for machine learning in ecotoxicology. Sci. Data 2023, 10, 718. [Google Scholar] [CrossRef] [PubMed]
Figure 1. A flow chart diagram on the process of developing a new read-across assessment concept.
Figure 1. A flow chart diagram on the process of developing a new read-across assessment concept.
Toxics 12 00096 g001
Figure 2. A conceptual framework designed for a newly developed read-across concept in assessing acute aquatic toxicity from source to target chemicals.
Figure 2. A conceptual framework designed for a newly developed read-across concept in assessing acute aquatic toxicity from source to target chemicals.
Toxics 12 00096 g002
Figure 3. Scatter plots for the log-transformed predicted and known toxicity values in the fitted line with 95% confidence intervals (CIs) (grey-colored): (a) Case study I (n = 1095, r = 0.93); (b) Case study II (n = 218, r = 0.75).
Figure 3. Scatter plots for the log-transformed predicted and known toxicity values in the fitted line with 95% confidence intervals (CIs) (grey-colored): (a) Case study I (n = 1095, r = 0.93); (b) Case study II (n = 218, r = 0.75).
Toxics 12 00096 g003
Figure 4. Bland–Altman plots for differences between the predicted and known toxicity data. The mean differences with 95% upper and lower limits of agreement are marked with the dashed lines: (a) Case study I (n = 1095): Mean = 1.33, +1.96 SD = 2.32, −1.96 SD = 0.35; (b) Case study II (n = 218): Mean = 1.24, +1.96 SD = 3.11, −1.96 SD = −0.64.
Figure 4. Bland–Altman plots for differences between the predicted and known toxicity data. The mean differences with 95% upper and lower limits of agreement are marked with the dashed lines: (a) Case study I (n = 1095): Mean = 1.33, +1.96 SD = 2.32, −1.96 SD = 0.35; (b) Case study II (n = 218): Mean = 1.24, +1.96 SD = 3.11, −1.96 SD = −0.64.
Toxics 12 00096 g004
Table 1. Physicochemical properties and classification of aquatic toxicity for 25 target chemical substances included in this study. [All pictures of chemical structures were downloaded from the official website of PubChem (https://pubchem.ncbi.nlm.nih.gov/, accessed on 1 September 2023)].
Table 1. Physicochemical properties and classification of aquatic toxicity for 25 target chemical substances included in this study. [All pictures of chemical structures were downloaded from the official website of PubChem (https://pubchem.ncbi.nlm.nih.gov/, accessed on 1 September 2023)].
NoMode of Action (MOA)Chemical Functional GroupSubgroupChemical NameCAS no.Molecular Weight
(g/mol)
Log KowWater Solubility (mg/L)Activity Class
1AChE inhibitionEsters (phosphate)-Acephate30560-19-1183.16−0.85818.00Class 5
2Dichlorvos62-73-7220.971.438.00Class 5
3Methamidophos10265-92-6141.13−0.801000.00Class 5
4Mevinphos7786-34-7224.150.13600.00Class 5
5Nemacur22224-92-6303.363.230.33Class 5
6Profenofos41198-08-7373.634.680.03Class 5
7CarbamateCarbamate Esters, PhenylAminocarb2032-59-9208.261.900.92Class 4
8Carbaryl63-25-2201.222.360.11Class 4
9Carbofuran1563-66-2221.252.320.32Class 4
10Propoxur114-26-1209.241.521.86Class 4
11Oxime Carbamate EsterAldicarb116-06-3190.261.136.03Class 4
12Methomyl16752-77-5162.210.6058.00Class 4
13Oxamyl23135-22-0219.26−0.47280.00Class 4
14ThiophosphateMonoChlorpyrifos2921-88-2350.594.960.001Class 4
15Diazinon333-41-5304.353.810.04Class 4
16EPN2104-64-5323.314.780.003Class 4
17Fensulfothion115-90-2308.352.232.00Class 4
18Fenthion55-38-9278.324.090.01Class 4
19Methyl parathion298-00-0263.212.860.04Class 4
20DiAzinphos-methyl86-50-0317.322.750.02Class 4
21Dimethoate60-51-5229.250.7823.30Class 4
22Disulfoton298-04-4274.394.020.02Class 4
23Dyfonate944-22-9246.323.940.02Class 4
24Malathion121-75-5330.352.360.14Class 4
25Terbufos13071-79-9288.424.480.01Class 4
Table 2. Acute aquatic toxicity data were collected from the ECOTOXicology Knowledgebase (ECOTOX, Version 5, U.S. EPA, 2022) for 25 target chemicals. * LC50 (mg/L): All of the available toxicity values (either 24 h, 48 h, or 96 h-LC50) were selected and collected from the ECOTOX database.
Table 2. Acute aquatic toxicity data were collected from the ECOTOXicology Knowledgebase (ECOTOX, Version 5, U.S. EPA, 2022) for 25 target chemicals. * LC50 (mg/L): All of the available toxicity values (either 24 h, 48 h, or 96 h-LC50) were selected and collected from the ECOTOX database.
NoChemical Functional GroupChemical NameFishCrustaceanInsectAmphibian
nLC50 *
(mg/L)
nLC50 *
(mg/L)
nLC50 *
(mg/L)
nLC50 *
(mg/L)
1Esters (phosphate)Acephate121.46 × 10−3~3.08 × 10373.50 × 10−1~2.35 × 10391.14 × 10−1~6.50 × 10226.43 × 103~8.82 × 103
2Dichlorvos386.41 × 10−3~1.67 × 102251.30 × 10−4~1.29 × 102241.00 × 10−4~2.38 × 10257.80 × 10−1~7.89 × 10
3Methamidophos85.36 × 10 ~1.12 × 10241.61 × 10−6~1.46--12.72 × 10
4Mevinphos122.23 × 10−2~4.00 × 1099.50 × 10−4~1.30 × 10−114.95 × 10−3--
5Nemacur31.75 × 10−2~1.40 × 10−162.65 × 10−3~1.50 × 10−1----
6Profenofos172.55 × 10−3~2.02114.10 × 10−5~7.7161.18 × 10−2~3.7015.80 × 10−1
7CarbamateAminocarb125.24 × 10−1 ~1.00 × 10281.20 × 10−2~3.27 × 1072.25 × 10−2~2.86--
8Carbaryl606.93 × 10−7~1.08 × 102413.75 × 10−3~9.65426.94 × 10−7~4.79171.64~5.53 × 10
9Carbofuran284.23 × 10−2~7.90153.32 × 10−4~2.7081.19 × 10−4~1.5931.12 × 10~1.13 × 102
10Propoxur121.30~4.25 × 1071.50 × 10−2~1.43221.80 × 10−2~8.00--
11Aldicarb96.56 × 10−2~4.50 × 10161.20 × 10−2~1.73 × 1052.00 × 10−2~2.80 × 10−1--
12Methomyl143.40 × 10−1~5.25196.40 × 10−3~7.2046.43 × 10−2~8.79 × 10−135.55 × 10~6.16 × 102
13Oxamyl62.60~2.75 × 1042.20 × 10−1~2.30 × 10----
14ThiophosphateChlorpyrifos405.80 × 10−4~5.98 × 10−1477.28 × 10−1~ 4.57 × 10−1855.00 × 10−5~3.80 × 10−161.90 × 10−2~5.62 × 10−1
15Diazinon537.00 × 10−5~4.00 × 10203.87 × 10−4~1.25235.67 × 10−4~2.20 × 10−153.43~1.48 × 10
16EPN111.81 × 10−2~4.20 × 10−162.90 × 10−4~4.38 × 10−221.10 × 10−3~7.40 × 10−3--
17Fensulfothion37.20 × 10−2~4.31 × 1021.00 × 10−2~5.07 × 10−2----
18Fenthion214.53 × 10−1~3.10161.52 × 10−4~1.80575.00 × 10−4~1.1019.40 × 10−4
19Methyl parathion425.00 × 10−3~1.90 × 10282.05 × 10−4~4.00125.40 × 10−4~2.74 × 10−143.70~9.59
20Azinphos-methyl263.60 × 10−4~4.06101.61 × 10−4~1.38 × 1063.70 × 10−4~8.85 × 10−2--
21Dimethoate261.30 × 10−1~4.20 × 10142.00 × 10−3~1.50 × 10131.29 × 10−3~9.6057.82 × 10−3~3.75 × 10
22Disulfoton103.70 × 10−2~7.2033.90 × 10−3~1.00 × 10−115.00 × 10−3--
23Dyfonate51.60 × 10−2~1.0924.90 × 10−4~2.70 × 10−323.90 × 10−2~5.40 × 10−2--
24Malathion721.95 × 10−2~1.70 × 10469.70 × 10−5~8.15 × 10671.00 × 10−3~2.69 × 1095.90 × 10−4~3.32 × 10
25Terbufos82.90 × 10−3 ~1.31 × 10−152.97 × 10−4~1.00 × 10−2----
Table 3. (Case study I) The example of results of the predicted values of acute aquatic toxicity (in read-across) for target chemicals using known toxicity data of source chemicals. * n: Number of species in fish/crustacean/insect, ** ND: Not determined for either over- or underestimation of predicted toxicity.
Table 3. (Case study I) The example of results of the predicted values of acute aquatic toxicity (in read-across) for target chemicals using known toxicity data of source chemicals. * n: Number of species in fish/crustacean/insect, ** ND: Not determined for either over- or underestimation of predicted toxicity.
NoChemical Functional Groupn *SpeciesSource ChemicalTarget
Chemical
Known Toxicity
of Target Chemical
(ug/L)
Predicted Toxicity
of Target Chemical (Read-Across) (ug/L)
Known/Predicted Toxicity Decision Ratio of ExampleKnown/Predicted Toxicity
Decision Ratio of Each Species
MinMaxOverestimation
(n)
Underestimation
(n)
DecisionDecision
of Over estimation (n)
Decision
of Under estimation (n)
Decision of ND ** (n)
1Esters (phosphate)1/3/1Fish (e.g., Gambusia affinis)AcephateProfenofos3.48 × 1021.82 × 1035.79 × 10303Under010
Crustacean (e.g., Americamysis bahia)2.377.85 × 10-01Under030
Insect (e.g., Culex quinquefasciatus)1.18 × 106.84 × 10−22.18 × 10−130Over100
2Esters (phosphate)2/4/3Fish (e.g., Gambusia affinis)DichlorvosProfenofos3.48 × 1027.57 × 102.91 × 10357Under020
Crustacean (e.g., Americamysis bahia)1.718.93 × 10−2 5.7224Under220
Insect (e.g., Culex pipiens ssp. Pallens)7.45 × 101.852.56 × 1080Over210
3Carbamate4/1/1Fish (e.g., Oncorhynchus mykiss)PropoxurCarbaryl1.21 × 1036.50 × 103-01Under220
Crustacean (e.g., Daphnia magna)2.07 × 1028.47 × 102.17 × 10231Over100
Insect (e.g., Aedes aegypti)7.08 × 1023.21 × 1028.22 × 10222ND **001
4Carbamate4/1/1Fish (e.g., Salvelinus fontinalis)AminocarbCarbaryl1.88 × 1037.09 × 102-10Over220
Crustacean (e.g., Gammarus pseudolimnaeus)1.53 × 106.39 × 101.15 × 10204Under010
Insect (e.g., Pteronarcella badia)1.53 × 103.295.8840Over100
5Thiophosphate3/2/1Fish (e.g., Cyprinus carpio)DimethoateMalathion2.65 × 1035.80 × 107.03 × 10220Over201
Crustacean (e.g., Daphnia magna)7.283.51 × 102.12 × 10203Under110
Insect (e.g., Aedes aegypti)1.06 × 1023.56 × 102.60 × 10315Under010
6Thiophosphate4/1/1Fish (e.g., Oreochromis niloticus)DimethoateChlorpyrifos1.25 × 1023.63-10Over220
Crustacean (e.g., Daphnia magna)8.041.822.67 × 1022ND**001
Insect (e.g., Aedes aegypti)7.024.967.28 × 1013Under010
7Thiophosphate1/2/1Fish (e.g., Pimephales promelas)MalathionMethyl parathion7.14 × 1038.41 × 1021.31 × 10320Over100
Crustacean (e.g., Americamysis bahia)6.92 × 10−19.08 × 10−1-01Under020
Insect (e.g., Culex pipiens ssp.)3.078.211.28 × 1002Under010
8Thiophosphate3/2/1Fish (e.g., Channa punctata)MalathionDiazinon1.44 × 1034.25 × 1025.41 × 10220Over300
Crustacean (e.g., Daphnia magna)1.221.742.3003Under020
Insect (e.g., Culex quinquefasciatus)6.679.101.53 × 1006Under010
9Thiophosphate1/1/10Fish (e.g., Pimephales promelas)MalathionFenthion2.75 × 1032.28 × 1022.43 × 103100Over100
Crustacean (e.g., Americamysis bahia)2.65 × 10−11.58 × 10−11.6919Under010
Insect (e.g., Aedes aegypti)2.35 × 101.04 × 10-10Over550
10Thiophosphate7/2/14Fish (e.g., Lepomis macrochirus)MalathionChlorpyrifos5.722.86 × 10−19.82226Over610
Crustacean (e.g., Americamysis bahia)4.00 × 10−21.90 × 10−21.42593Under020
Insect (e.g., Aedes aegypti)7.021.054.29140Over770
11Thiophosphate3/4/1Fish (e.g., Lepomis macrochirus)Methyl parathionChlorpyrifos5.723.22 × 1021.38 × 10304Under030
Crustacean (e.g., Americamysis bahia)4.00 × 10−21.65 × 10−26.46 × 10−221Over310
Insect (e.g., Culex pipiens ssp.)1.042.05 × 10−23.45 × 10−1120Over100
12Thiophosphate3/1/1Fish (e.g., Oncorhynchus mykiss)DiazinonFenthion7.95 × 1025.88 × 10-10Over300
Crustacean (e.g., Americamysis bahia)2.65 × 10−19.99 × 10−11.1903Under010
Insect (e.g., Culex pipiens ssp.)5.071.29 × 101.53 × 1003Under010
13Thiophosphate6/3/2Fish (e.g., Lepomis macrochirus)DiazinonChlorpyrifos5.721.808.05 × 1015Under150
Crustacean (e.g., Americamysis bahia)4.00 × 10−24.61 × 10−21.26012Under210
Insect (e.g., Culex pipiens ssp.)1.045.13 × 10−12.23 × 10315Under110
14Thiophosphate5/1/11Fish (e.g., Oncorhynchus mykiss)FenthionChlorpyrifos1.82 × 105.86 × 101.77 × 102011Under050
Crustacean (e.g., Americamysis bahia)4.00 × 10−22.67 × 10−34.73 × 10−2523Over100
Insect (e.g., Aedes aegypti)7.024.86 × 10−12.8450Over920
Table 4. (Case study II) The example of results of the predicted values of acute aquatic toxicity (in read-across) for target chemicals using known toxicity data of source chemicals. * n: Number of species in fish/crustacean/insect.
Table 4. (Case study II) The example of results of the predicted values of acute aquatic toxicity (in read-across) for target chemicals using known toxicity data of source chemicals. * n: Number of species in fish/crustacean/insect.
NoChemical
Functional
Group
n *SpeciesSource
Chemical
Target
Chemical
Known Toxicity of Target Chemical (ug/L)Predicted Toxicity of Target Chemical (Read-Across) (ug/L)Known/
Predicted Toxicity Decision Ratio of Example
Known/Predicted Toxicity Decision Ratio of Each Species
Overestimation (n)Underestimation (n)
1Esters (phosphate)3/2/0Fish (e.g., Lepomis macrochirus)AcephateMethamidophos4.13 × 1041.31 × 105Under12
Crustacean (e.g., Americamysis bahia)1.05 × 1031.01 × 103Over11
2Esters (phosphate)4/1/0Fish (e.g., Oncorhynchus mykiss)AcephateMevinphos2.23 × 101.51 × 102Under04
Crustacean (e.g., Americamysis bahia)1.301.92 × 10−1Over10
3Esters (phosphate)1/2/0Fish (e.g., Gambusia affinis)AcephateDichlorvos5.27 × 1039.72 × 102Over10
Crustacean (e.g., Americamysis bahia)2.26 × 101.23 × 102Under02
4Esters (phosphate)2/1/0Fish (e.g., Oncorhynchus mykiss)AcephateNemacur1.40 × 1027.91 × 102Under02
Crustacean (e.g., Americamysis bahia)6.801.21Over10
5Esters (phosphate)1/3/1Fish (e.g., Gambusia affinis)AcephateProfenofos3.48 × 1021.02 × 102Over10
Crustacean (e.g., Penaeus duorarum)4.603.95 × 102Under12
Insect (e.g, Culex quinquefasciatus)1.18 × 101.38 × 10−1Over10
6Esters (phosphate)0/8/1Crustacean (e.g., Daphnia magna)MethamidophosDichlorvos3.712.92 × 10Under08
Insect (e.g, Pteronarcys californica)2.50 × 101.79Over10
7Esters (phosphate)2/4/3Fish (e.g., Gambusia affinis)DichlorvosProfenofos3.48 × 1022.00 × 10Over20
Crustacean (e.g, Ceriodaphnia dubia)4.10 × 10−21.26 × 10−1Under13
Insect (e.g, Culex pipiens)6.23 × 104.88Over21
8Carbamate2/1/0Fish (e.g., Pimephales promelas)MethomylAminocarb7.39 × 1023.72 × 102Over11
Crustacean (e.g, Gammarus pseudolimnaeus)1.63 × 1022.42 × 102Under01
9Carbamate1/2/0Fish (e.g., Oncorhynchus mykiss)MethomylCarbaryl1.21 × 1032.11 × 10Over10
Crustacean (e.g., Americamysis bahia)1.01 × 105.67 × 10Under02
10Carbamate4/1/1Fish (e.g., Cyprinus carpio)PropoxurCarbaryl2.95 × 1033.27 × 103Under22
Crustacean (e.g., Daphnia magna)2.07 × 1021.94 × 102Over10
Insect (e.g., Aedes aegypti)7.08 × 1027.58 × 102Under01
11Carbamate4/1/1Fish (e.g., Salvelinus fontinalis)AminocarbCarbaryl1.88 × 1032.64 × 102Under40
Crustacean (e.g., Gammarus pseudolimnaeus)1.53 × 101.11 × 102Over01
Insect (e.g., Pteronarcella badia)1.53 × 102.12Under10
12Thiophosphate3/2/1Fish (e.g., Cyprinus carpio)DimethoateMalathion2.65 × 1031.39 × 102Over21
Crustacean (e.g., Daphnia magna)7.284.23 × 10Under11
Insect (e.g., Aedes aegypti)7.89 × 102.00 × 103Under01
13Thiophosphate1/1/0Fish (e.g., Oncorhynchus mykiss)DimethoateAldicarb5.83 × 1021.32 × 103Under01
Crustacean (e.g., Daphnia magna)3.19 × 1021.40 × 102Over10
14Thiophosphate0/2/1Crustacean (e.g., Daphnia magna)DimethoateDichlorvos3.712.41 × 10Under11
Insect (e.g., Aedes aegypti)4.50 × 101.21 × 103Under01
15Thiophosphate2/1/1Fish (e.g., Heteropneustes fossilis)DimethoatePropoxur6.48 × 1033.80 × 103Over11
Crustacean (e.g., Daphnia magna)3.76 × 1027.37 × 102Under01
Insect (e.g., Aedes aegypti)1.37 × 1037.00 × 102Over10
16Thiophosphate3/2/1Fish (e.g., Cyprinus carpio)DimethoateCarbaryl2.95 × 1031.24 × 103Over12
Crustacean (e.g., Daphnia magna)2.07 × 1023.80 × 102Under02
Insect (e.g., Aedes aegypti)7.08 × 1023.40 × 10Over10
17Thiophosphate2/2/0Fish (e.g., Channa orientalis)DimethoateMethyl parathion3.32 × 1032.05 × 102Over20
Crustacean (e.g., Daphnia magna)1.65 × 101.28 × 103Under02
18Thiophosphate3/1/0Fish (e.g., Cyprinus carpio)DimethoateDiazinon8.72 × 1024.01Over30
Crustacean (e.g., Daphnia magna)1.222.67 × 102Under01
19Thiophosphate1/0/1Fish (e.g., Oncorhynchus mykiss)DimethoateFenthion7.95 × 1025.25 × 10Over10
Insect (e.g., Aedes aegypti)2.35 × 103.56 × 102Under01
20Thiophosphate4/1/1Fish (e.g., Oreochromis niloticus)DimethoateChlorpyrifos1.25 × 1025.30Over31
Crustacean (e.g., Daphnia magna)8.041.90 × 102Under01
Insect (e.g., Aedes aegypti)7.021.50 × 10Under01
21Thiophosphate8/3/0Fish (e.g., Cyprinodon variegatus)MalathionAzinphos-methyl2.282.98Under53
Crustacean (e.g., Gammarus fasciatus)2.01 × 10−13.60 × 10−2Over30
22Thiophosphate1/2/1Fish (e.g., Pimephales promelas)MalathionMethyl parathion7.14 × 1037.93 × 102Over10
Crustacean (e.g., Americamysis bahia)6.92 × 10−13.21 × 10−1Over11
Insect (e.g., Culex pipiens ssp. Quinquefasciata)3.076.63Under01
23Thiophosphate3/2/1Fish (e.g., Channa punctata)MalathionDiazinon1.44 × 1034.31 × 102Over30
Crustacean (e.g., Ceriodaphnia dubia)4.23 × 10−12.68 × 10−1Over11
Insect (e.g., Culex quinquefasciatus)6.676.50Over10
24Thiophosphate1/1/10Fish (e.g., Pimephales promelas)MalathionFenthion2.75 × 1037.03 × 10Over10
Crustacean (e.g, Americamysis bahia)2.65 × 10−15.29 × 10−1Under01
Insect (e.g., Culex pipiens ssp. Quinquefasciata)5.072.54Over73
25Thiophosphate7/3/16Fish (e.g., Lepomis macrochirus)MalathionChlorpyrifos5.726.70Under61
Crustacean (e.g., Ceriodaphnia dubia)6.74 × 10−28.65 × 10−1Under03
Insect (e.g., Chironomus utahensis)1.983.66 × 10−2Over97
26Thiophosphate2/2/0Fish (e.g., Lepomis macrochirus)Azinphos-methylChlorpyrifos5.724.90Over11
Crustacean (e.g., Americamysis bahia)4.00 × 10−21.07 × 10−1Under02
27Thiophosphate3/2/0Fish (e.g., Lepomis macrochirus)Methyl parathionDiazinon2.00 × 1022.53 × 102Under21
Crustacean (e.g., Ceriodaphnia dubia)4.23 × 10−11.49 × 10−1Over20
28Thiophosphate4/1/0Fish (e.g., Morone saxatilis)Methyl parathionFenthion4.53 × 1028.89 × 102Under22
Crustacean (e.g., Americamysis bahia)2.65 × 10−11.35 × 10−1Over10
29Thiophosphate3/4/1Fish (e.g., Lepomis macrochirus)Methyl parathionChlorpyrifos5.723.74 × 102Under03
Crustacean (e.g., Americamysis bahia)4.00 × 10−22.33 × 10−1Under22
Insect (e.g., Culex pipiens ssp. Quinquefasciata)1.048.15 × 10−2Over10
30Thiophosphate3/1/1Fish (e.g., Oncorhynchus mykiss)DiazinonFenthion7.95 × 1026.70 × 10Over30
Crustacean (e.g., Americamysis bahia)2.65 × 10−13.44 × 10−1Under01
Insect (e.g., Culex pipiens ssp. Quinquefasciata)5.073.91Over10
31Thiophosphate3/1/0Fish (e.g., Lepomis macrochirus)DiazinonEPN1.36 × 1021.57 × 102Under03
Crustacean (e.g., Americamysis bahia)4.634.00Over10
32Thiophosphate6/3/2Fish (e.g., Lepomis macrochirus)DiazinonChlorpyrifos5.722.38Over42
Crustacean (e.g., Ceriodaphnia dubia)5.69 × 10−21.30 × 10−1Under12
Insect (e.g., Culex quinquefasciatus)2.254.54 × 10−2Over20
33Thiophosphate2/1/0Fish (e.g., Pimephales promelas)DisulfotonEPN8.81 × 108.30 × 102Under02
Crustacean (e.g., Gammarus fasciatus)6.877.29 × 10−1Over10
34Thiophosphate5/1/11Fish (e.g., Oncorhynchus mykiss)FenthionChlorpyrifos1.82 × 102.86 × 10Under23
Crustacean (e.g., Americamysis bahia)4.00 × 10−28.19 × 10−2Under01
Insect (e.g., Culex tarsalis)5.30 × 10−12.59 × 10−1Over56
35Thiophosphate2/1/0Fish (e.g., Lepomis macrochirus)EPNChlorpyrifos5.721.17Over20
Crustacean (e.g., Americamysis bahia)4.00 × 10−21.95 × 10−1Under01
Table 5. Lack of agreement (bias, relative bias, precision, and accuracy) for a new read-across concept approach in Case study I and II.
Table 5. Lack of agreement (bias, relative bias, precision, and accuracy) for a new read-across concept approach in Case study I and II.
Chemical Functional GroupnNew Read-Across Concept
BiasRelative Bias (%)PrecisionAccuracy
Case study I
   Overall10950.3237.650.010.010
   Esters (phosphate)810.1515.700.050.050
   Carbamate240.1617.510.010.050
   Thiophosphate9900.011.240.010.004
Case study II
   Overall2180.6591.940.060.050
   Esters (phosphate)390.3643.180.150.150
   Carbamate180.2325.260.030.080
   Thiophosphate1610.077.020.020.020
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Lee, S.; Ok, S.-Y.; Moon, H.-B.; Seo, S.-C.; Ra, J.-S. Developing a Novel Read-Across Concept for Ecotoxicological Risk Assessment of Phosphate Chemicals: A Case Study. Toxics 2024, 12, 96. https://doi.org/10.3390/toxics12010096

AMA Style

Lee S, Ok S-Y, Moon H-B, Seo S-C, Ra J-S. Developing a Novel Read-Across Concept for Ecotoxicological Risk Assessment of Phosphate Chemicals: A Case Study. Toxics. 2024; 12(1):96. https://doi.org/10.3390/toxics12010096

Chicago/Turabian Style

Lee, Seokwon, Seung-Yeop Ok, Hyo-Bang Moon, Sung-Chul Seo, and Jin-Sung Ra. 2024. "Developing a Novel Read-Across Concept for Ecotoxicological Risk Assessment of Phosphate Chemicals: A Case Study" Toxics 12, no. 1: 96. https://doi.org/10.3390/toxics12010096

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop