DMD Simcyp

Home Help [Feedback] [For Subscribers] [Archive] [Search] [Contents]
 QUICK SEARCH:   [advanced]


     


Drug Metabolism and Disposition Fast Forward
First published on August 30, 2007; DOI: 10.1124/dmd.107.016444


0090-9556/07/3512-2139-2142$20.00
DMD 35:2139-2142, 2007

This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow All Versions of this Article:
dmd.107.016444v1
35/12/2139    most recent
Right arrow Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Tang, H.
Right arrow Articles by Mayersohn, M.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Tang, H.
Right arrow Articles by Mayersohn, M.
SHORT COMMUNICATION

Utility of the Coefficient of Determination (r2) in Assessing the Accuracy of Interspecies Allometric Predictions: Illumination or Illusion?

Huadong Tang, and Michael Mayersohn

Bioanalytical R&D, Drug Safety and Metabolism, Wyeth Research, Pearl River, New York (H.T.); and Department of Pharmaceutical Sciences, College of Pharmacy, The University of Arizona, Tucson, Arizona (M.M.)

(Received May 14, 2007; Accepted August 28, 2007)


    Abstract
 Top
 Abstract
 Materials and Methods
 Results and Discussion
 Appendix
 References
 
The appropriateness of relying on the coefficient of determination (r2) as a statistical metric for judging the predictability of human clearance (CL) based on interspecies animal data was assessed. An explicit mathematical expression was derived for r2 as a function of species body weight and the corresponding measured value of CL. The derived mathematical function demonstrated that r2 is numerically large in most instances. Simulations using random CL generated from a common combination of species of mouse, rat, and monkey resulted in an r2 of 0.75 as the minimum, and 0.95 and 0.98 at 50th and 75th percentiles, respectively, given that total CL values increase with increasing species body weight. Analysis of literature data also indicated that the prediction accuracy of human CL was not correlated with values of r2. Therefore, it is concluded that r2 is a limited statistical measure when assessing allometric scaling for the purpose of predicting human CL.


Allometric scaling has been widely used in predicting human pharmacokinetic (PK) parameters, although the allometric approach is empirical and numerous examples of substantial prediction errors have been observed (Boxenbaum 1982Go; Mahmood and Balian, 1996Go; Nagilla and Ward, 2004Go; Tang and Mayersohn, 2006Go). The allometric relationship for PK parameters across animal species and the confidence in extrapolation of this relationship to humans are often assessed with use of the coefficient of determination (r2). The latter is obtained from linear regression of log-transformed animal body weights and the corresponding measured values of (log) PK parameters. High r2 values (ca. greater than 0.90) have been cited for most of the allometric relationships reported in the literature (Mahmood and Balian, 1996Go; Hu and Hayton, 2001Go). By definition, r2 is the fraction of the total squared error explained by the model. It is generally recognized that r2 is not a good statistical measure for nonlinear models. For example, overparameterized models could easily lead to high r2 values, whereas such models usually have little predictive value. It has also been long recognized that the log-log transformation of the allometric power function (P = a · Wb) would minimize deviations from the regression line (Smith, 1984Go). Therefore, it is reasonable to speculate that r2 may not offer a good measure for examining the predictive quality of the allometric relationship. We report here an explicit mathematical function of r2 derived to quantitatively assess the appropriateness of using r2 as a statistical measure in allometric scaling. Literature data were also evaluated to assess the relationship between r2 and the prediction performance by allometric scaling.


    Materials and Methods
 Top
 Abstract
 Materials and Methods
 Results and Discussion
 Appendix
 References
 
Theory. Expression of predicted PK parameters among species. The function relating predicted PK parameters (P) in humans or animal species to animal body weights (Wi, i = 1 to n, where n is the number of animal species) and observed animal PK parameters (Pi) has been described previously (Tang and Mayersohn, 2005Go). The following highlights the major mathematical functions needed in the subsequent derivations.

Formula(1)

Formula(2)

Formula(3)
where

Formula(4)

Formula(5)
The predicted PK parameter value, P, in the species of interest is obtained from

Formula(6)

Expression for r2. The log-log transformation of P = a · Wb gives

Formula(7)
Let

Formula
Then, eq. 7 can be simplified to

Formula(8)
r2, by definition, is expressed as

Formula(9)
where

Formula(10)

Formula(11)

Formula(12)
Although r2 can be explicitly expressed when eqs. 10 to 12 are placed into eq. 9, a visually clearer form is not readily available. Therefore, a common combination of animal species (mouse, rat, and monkey, with body weights assigned as 0.03, 0.3, and 3 kg, respectively), was used for illustration purposes.

Formula(13)

Formula(14)

Formula(15)

Formula(16)
Substituting eqs. 13 to 16 into eq. 9 results in

Formula(17)

Formula(18)
Note that, and this is true most of the time, values for total CL in mouse, rat, and monkey follow the corresponding order of body weight. Let CLmonkey = L · CLrat, CLrat = M · CLmouse, where L, M > 1, r2 will be equal to

Formula(19)

Simulating r2 values. Although a wide range of CL values for each species is considered here for simulation purposes, in reality CL values usually do not exceed certain limits in each species. The values ranged from 0.001 times liver blood flow (LBF) at the low end to 5 times LBF at the high end, for each species. In total, 10,000 random values of CL from each species were generated from a uniform distribution of [0.001x LBF to 5x LBF], in each species, where the LBF for mouse, rat, and monkey was 5.40, 3.31, and 2.62 l/h · kg, respectively (Davies and Morris, 1993Go). Thus, 10,000 r2 values were computed. In reality, the magnitude of CL follows the order of species body weight; therefore, the r2 values obtained were further constrained under the expected order of CL: CLmonkey > CLrat > CLmouse. All calculations and simulations were performed using MATLAB, version 6.5 (MathWorks Inc., Natick, MA).

Literature Data Evaluation. A large set of allometric data including CL values in rat, monkey, dog, and human is available (Jolivette and Ward, 2006Go). The combination of animal species in this data set was different from the combination of species in the above-mentioned example developed under Theory. Due to the close body weights of monkey and dog, it is expected that some CL values in those species will not strictly follow the order of body weights. Therefore, lower r2 values are expected from that combination than from simulations obtained from the combination of mouse, rat, and monkey. Nevertheless, the correlation between the prediction performance and the r2 values can still be assessed.


    Results and Discussion
 Top
 Abstract
 Materials and Methods
 Results and Discussion
 Appendix
 References
 
Values for r2 obtained from the species combination mouse, rat, and monkey are derived from eq. 19. Notice that Formula ≥ 2, r2 is, therefore, always greater than 0.75 (when Formula -> {infty}), and equal to 1 (when Formula = 2, or log L = log M). Furthermore, due to the existence of an approximate allometric relationship, that is,

Formula(20)

Formula(21)
the value of L is usually close to that of M. Therefore, one expects that for most of the cases, r2 is high and close to 1. Even in some extreme situations, for example, when L = 10 and M = 1000, that is, the CL in rat is 1000-fold higher than that in mouse, whereas the CL in monkey is only 10-fold higher than that in rat, given the same 10-fold of difference in body weights between rat and mouse, or monkey and rat, the resulting r2 is still as high as 0.92.

The results from the simulations also indicated that r2 values were high in the majority of cases based on the random values for CL in each species. The r2 values were highly right-skewed toward larger values (Fig. 1). The r2 values for the 50th and 75th percentiles are 0.95 and 0.98, respectively. These results clearly demonstrate that the common use of r2, whose values are often considered to be "good" if they are greater than 0.90 or 0.95, is misleading.


Figure 1
View larger version (15K):
[in this window]
[in a new window]

 
FIG. 1. Distribution of r2 values computed by random CL generated from a uniform distribution of [0.001x LBF to 5x LBF] in mouse, rat, and monkey.

 
The literature data indicated that there was no correlation between r2 and prediction performance (Fig. 2). This result suggests that r2 cannot serve as an indicator for predicting human values. This may be the case for several reasons. First, there exists great uncertainty associated with values in humans due to the complexity of biological systems; good r2 or even a perfect r2 does not necessarily mean that the human value will be on the allometric line of regression. Second, we have shown that r2 is not an appropriate measure gauging the quality of an allometric relationship; CL randomly sampled from animal species can result in good r2 values. Finally, the change in r2 is asymmetrical with respect to the values of CL. The procedure of log-log transformation followed by linear regression assumes a log-normal distribution of CL. Differentiating r2 (eq. 9) with regard to log CL in the monkey, for example, resulted in an asymmetrical function with respect to log CL (the resulting function, [{partial}(r2)]/[{partial}(log CLmonkey)], is not shown here because of its complexity). Assume there is a perfect allometric relationship for mouse, rat, and monkey, with CL values of 0.130, 0.730, and 4.10 l/h (r2 = 1). Now, changing log CL in monkeys by–0.699 and +0.699 (or 5-fold higher and lower, respectively) results in r2 values of 0.797 and 0.967, respectively. It is apparent that the same probability for the occurrence of–0.699 and +0.699 log CL resulted in striking differences in r2 values.


Figure 2
View larger version (12K):
[in this window]
[in a new window]

 
FIG. 2. Correlation between the r2 values and the prediction -fold value for human CL (CLpredicted divided by CLobserved). Based on the allometric data from rat, monkey, and dog (n = 103; Jolivette and Ward, 2006Go). Values for r2 greater than 0.5 (n = 94) are shown in A, and values greater than 0.90 (n = 64) are shown in B.

 

In summary, r2 has been shown to not be an appropriate statistical measure for allometric scaling. We are not aware of another simple statistical measure that would serve in its place. The purpose of this communication was not to discourage reporting of r2 values for allometric relationships. However, we caution that use of r2 as a measure for the quality of an allometric relationship is not appropriate. Claiming a good allometric relationship based on r2 values greater than 0.90 or 0.95 is not appropriate, and more practically important is the degree of confidence that one has in the predicted human value.


    Appendix
 Top
 Abstract
 Materials and Methods
 Results and Discussion
 Appendix
 References
 
Symbols Used in Derivations under Materials and Methods a: The coefficient of the allometric power function, P = a · Wb

Ai: Equal to

Formula
and used in

Formula
which calculates the coefficient (a) of the allometric power function. Note, the PK parameter, Pi, observed in one animal species (i) is raised to its specific exponent, Ai, which is only dependent on the body weights across animal species and bears no relation to observed Pi.

b: The exponent of the allometric power function, P = a · Wb

Bi: Equal to

Formula
and used in

Formula
which calculates the exponent (b) of the allometric power function. Note, the log Pi is multiplied by its specific scalar, Bi, which is only dependent on the body weights across animal species and bears no relation to observed Pi.

L: Equal to

Formula

M: Equal to

Formula

n: The number of animal species

Pi: The PK parameter observed in species i

Pi: The PK parameter predicted in species i

Wi: The body weight of species i

Xi: Equal to log Wi, and used to transform the allometric power function, P = a · Wb, to linear function, Y = {alpha} + ß · X

Yi: Equal to log Pi, and used to transform the allometric power function, P = a · Wb, to linear function, Y = {alpha} + ß · X

Y: Mean of Yi

Y:Predicted Yi

{alpha}: Equal to log a, and used to transform the allometric power function, P = a · Wb, to linear function, Y = {alpha} + ß · X

ß: Equal to b, and used to transform the allometric power function, P = a · Wb, to linear function, Y = {alpha} + ß · X


    Footnotes
 
Article, publication date, and citation information can be found at http://dmd.aspetjournals.org.

doi:10.1124/dmd.107.016444.

ABBREVIATIONS: PK, pharmacokinetics; CL, clearance; LBF, liver blood flow.

Address correspondence to: Dr. Huadong Tang, Bioanalytical R&D, Drug Safety and Metabolism, Wyeth Research, 401 N. Middletown Rd., Pearl River, NY 10965. E-mail: tangh3{at}wyeth.com


    References
 Top
 Abstract
 Materials and Methods
 Results and Discussion
 Appendix
 References
 


Boxenbaum H (1982) Interspecies scaling, allometry, physiological time, and the ground plan of pharmacokinetics. J Pharmacokinet Biopharm 10: 201–227.[CrossRef][Medline]

Davies B and Morris T (1993) Physiological parameters in laboratory animals and humans. Pharmacol Res 10: 1093–1095.[CrossRef]

Hu TM and Hayton WL (2001) Allometric scaling of xenobiotic clearance: uncertainty versus university. AAPS PharmSci 3: 1–14.[CrossRef][Medline]

Jolivette LJ and Ward KW (2006) Extrapolation of human pharmacokinetic parameters from rat, dog, and monkey data: molecular properties associated with extrapolative success or failure. J Pharm Sci 94: 467–483.

Mahmood I and Balian JD (1996) Interspecies scaling: predicting clearance of drugs in humans. Three different approaches. Xenobiotica 26: 887–895.[Medline]

Nagilla R and Ward KW (2004) A comprehensive analysis of the role of correction factors in the allometric predictivity of clearance from rat, dog and monkey to humans. J Pharm Sci 93: 2522–2534.[CrossRef][Medline]

Smith RJ (1984) Allometric scaling in comparative biology: problems of concept and method. Am J Physiol 246: R152–R160.[Medline]

Tang H and Mayersohn M (2005) Accuracy of allometrically predicted pharmacokinetic parameters in humans: role of species selection. Drug Metab Dispos 33: 1288–1293.[Abstract/Free Full Text]

Tang H and Mayersohn M (2006) A global examination of allometric scaling for predicting human drug clearance and the prediction of large vertical allometry. J Pharm Sci 95: 1783–1799.[CrossRef][Medline]


This article has been cited by other articles:


Home page
J Clin PharmacolHome page
N. A. Hosea, W. T. Collard, S. Cole, T. S. Maurer, R. X. Fang, H. Jones, S. M. Kakar, Y. Nakai, B. J. Smith, R. Webster, et al.
Prediction of Human Pharmacokinetics From Preclinical Information: Comparative Accuracy of Quantitative Prediction Approaches
J. Clin. Pharmacol., May 1, 2009; 49(5): 513 - 533.
[Abstract] [Full Text] [PDF]


Home page
Drug Metab. Dispos.Home page
R. Laufer, O. G. Paz, A. Di Marco, F. Bonelli, E. Monteagudo, V. Summa, and M. Rowley
Quantitative Prediction of Human Clearance Guiding the Development of Raltegravir (MK-0518, Isentress) and Related HIV Integrase Inhibitors
Drug Metab. Dispos., April 1, 2009; 37(4): 873 - 883.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow All Versions of this Article:
dmd.107.016444v1
35/12/2139    most recent
Right arrow Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Tang, H.
Right arrow Articles by Mayersohn, M.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Tang, H.
Right arrow Articles by Mayersohn, M.


Home Help [Feedback] [For Subscribers] [Archive] [Search] [Contents]
All ASPET Journals Molecular Pharmacology Pharmacological Reviews
 Molecular Interventions Drug Metabolism and Disposition