![]() |
|
|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Cancer Research UK, Molecular Pharmacology Unit, Biomedical Research Centre, University of Dundee, Ninewells Hospital and Medical School, Dundee, United Kingdom
(Received March 3, 2008; Accepted April 16, 2008)
| Abstract |
|---|
|
|
|---|
Several murine P450 knockout models have been generated, as well as a conditional deletion of hepatic NADPH-cytochrome P450 reductase (POR) (Henderson et al., 2003
; Henderson and Wolf, 2003
; Wu et al., 2003
), the redox partner of microsomal P450s, which have proved to be invaluable for the study of P450 functions in vivo. In general terms, these experiments demonstrated that ablation of a P450 gene that is involved in a vital endogenous pathway (e.g., the cholesterol 7
hydroxylase, Cyp7a1) lead to either embryonic or perinatal lethality (Ishibashi et al., 1996
), whereas knockout of a purely xenobiotic metabolizing enzyme (e.g., Cyp1a1) caused little difference in phenotype until a chemical challenge occurred (Dalton et al., 2000
; Henderson and Wolf, 2003
). Further investigation using transgenic animal models coupled with classical biochemical analysis has shed some light on the preferred substrates of some of the more conserved murine xenobiotic metabolizing P450s. The complication of multiplicity in several P450 families makes it extremely difficult to identify the in vivo function of any one particular enzyme. For example, the mouse Cyp2c, -2d, and Cyp3a subfamilies have 15, 9, and 8 members, respectively.
Of particular interest are murine Cyp1a1, Cyp1a2, Cyp1b1, Cyp2a4, Cyp2b20, Cyp2c29, Cyp2d22, Cyp2e1, and Cyp3a11. These isoforms are either orthologs of, or are closely related to (by phylogeny and expression patterns), the key human xenobiotic metabolizing P450s (Table 1; Supplemental Data). Since the substrate specificities of the human enzymes have been investigated in detail, the same types of chemical compounds have been used to screen the murine enzymes. The majority of work has focused on Cyp1a1, Cyp1a2, Cyp1b1, and Cyp2e1, which are reasonably well conserved between species and have also been knocked out in mouse models available for in vivo studies (Pineau et al., 1995
; Lee et al., 1996
; Buters et al., 1999
; Dalton et al., 2000
). The known substrates of these particular enzymes (Table 1; Supplemental Data) tally well with the data for the human orthologs (Guengerich, 2005
), indicating similar substrate specificities. However, it is difficult to find data in the literature that compare metabolic profiles or ligand binding of particular compounds with what is considered to be equivalent murine and human P450.
|
In response to this, we have heterologously coexpressed a panel of nine murine P450s with human POR in Escherichia coli, thus creating functional monooxygenase systems for enzyme characterization. For each P450, we have identified a fluorogenic probe substrate and determined the apparent kinetic parameters. These probe substrates were then used to determine the IC50 of 31 test compounds for each murine enzyme, allowing us to compare inhibitory potencies. Furthermore, we have screened human CYP2C9, CYP2D6, and CYP3A4 with the same panel of test compounds, allowing direct comparison of inhibitory potencies between human and mouse enzymes.
| Materials and Methods |
|---|
|
|
|---|
-aminolevulinic acid were from Melford Laboratories (Ipswich, UK). Competent E. coli JM109 and DH5
cells were purchased from Promega (Southampton, UK) and Invitrogen (Paisley, UK). 3-[2-(N,N-Diethyl-N-methylammonium)-ethyl]-7-methoxy-4-methylcoumarin (AMMC), dibenzyl fluorescein (DBF), 7-methoxy-4-trifluoromethylcoumarin (MFC), 7-benzyloxyquinoline (BQ), and 7-benzyloxy-4-trifluoromethylcoumarin (BFC) were purchased from BD Gentest (Cowley, UK), whereas VIVID CYP2D6 Cyan, VIVID 3A4 Red, VIVID 2C9 Red, and VIVID 3A4 Green were from Invitrogen. cDNA Clones. Where available, the mouse P450 cDNA clones were purchased as I.M.A.G.E. clones from MRC Geneservice (Cambridge, UK). Cyp1a1 and Cyp2b20 cDNAs were generated by RT-PCR from 3-methylcholanthrene-induced mouse liver RNA using Superscript 1st Strand Synthesis Kit (Invitrogen) to perform the reverse transcription [oligo(dT) primer] and Pfu DNA polymerase (Promega) to isolate the specific full-length cDNA clones. Details of oligonucleotides used are shown in Table 1. The isolated cDNAs were cloned into pCR-Blunt (Promega) and sequenced to confirm identity.
Bacterial Expression Constructs. cDNAs, with the exception of Cyp2d22 and Cyp2a4, were modified at the 5' end by mutating position +2 to alanine, and fusion by PCR to a bacterial OmpA (+2) leader sequence using an OmpA forward primer containing either an NdeI or BamHI restriction site, a reverse OmpA-cDNA fusion primer, and a reverse primer containing the 3' end of the cDNA, His6-tag, and a unique restriction site. The oligos used are listed in Table 2. PCR was performed as previously described (Pritchard et al., 1997
; Pritchard et al., 1998
). Modified cDNAs were cloned into pB13, a modified version of pCW (Pritchard et al., 1997
), using the appropriate restriction sites. Cyp2d22 was modified essentially as described, but without the His6-tag. Cyp2a4 was cloned as full-length His6-tagged PCR product into pB13, which had been modified to contain the OmpA sequence. All constructs were confirmed by DNA sequencing. The plasmids used to express CYP2C9, -2D6, and -3A4 have been previously described (Pritchard et al., 1997
; Pritchard et al., 1998
; Flanagan et al., 2003
).
|
Heterologous Coexpression in E. coli. Competent E. coli JM109 or DH5
cells were cotransformed with an individual P450 and pJR7, a plasmid which expresses human POR (Blake et al., 1996
; Pritchard et al., 1997
; Pritchard et al., 1998
). Bacterial expression, membrane isolation, and determination of P450 content were carried out as previously described (Pritchard et al., 1998
). The rate of reduction of cytochrome c, determined spectrophotometrically, was used as a measure of POR activity in membrane fractions.
Fluorogenic Probe Selection and Enzyme Kinetics. A panel of 12 fluorogenic substrates [ethoxyresorufin (ER), methoxyresorufin (MR), pentoxyresorufin (PR), benzyloxyresorufin (BR), AMMC, DBF, MFC, BQ, BFC, VIVID CYP2C9 Red, VIVID CYP2D6 Cyan, and VIVID CYP3A4 Red] was used in an initial screen to determine catalytic ability of the mouse P450s. Assays were performed in white 96-well plates (Thermo Labsystems, Basingtoke, UK) in a final volume of 200 µl containing 50 mM potassium phosphate buffer, pH 7.4, test substrate, 20 pmol of P450, and 125 µM NADPH. Reactions were initiated with the addition of the NADPH to the prewarmed plate. Substrate concentrations used were: DBF, 1 µM; ER, PR, MR, and BR, 2 µM; AMMC, 20 µM; MFC, 75 µM; BQ, 40 µM; BFC, 50 µM; VIVID CYP2D6 Cyan and VIVID CYP3A4 Red, 15 µM; and VIVID CYP2C9 Red, 10 µM. Reactions were measured in real time (10-s intervals) for 2 to 3 min at the published excitation and emission wavelengths for each probe using a Fluoroskan Ascent FL plate reading fluorimeter (Labsystems).
The probe substrates that gave the highest turnovers in the screening assay were used to determine the apparent kinetic parameters for the respective P450. Assays were performed under conditions of linearity for time and protein (data not shown) using the same buffer/NADPH conditions described in the previous paragraph, with the following concentrations of P450 and substrates (10 concentration points per determination): Cyp1a1 (0.25 pmol/well) and ER (0–1 µM); Cyp1a2 (5 pmol/well) and ER (0–0.5 µM); Cyp1B1 (2 pmol/well) and ER (0–1.2 µM); Cyp2b20 (1 pmol/well) and BR (0–1.25 µM); Cyp2a4 (1.5 pmol/well) and VIVID CYP3A4 Red (0–7.5 µM); Cyp2c29 (5 pmol/well) and VIVID CYP2C9 Red (0–20 µM); CYP2C9 (7.5 pmol/well) and VIVID CYP2C9 Red (0–15 µM); Cyp2d22 (3 pmol/well) and VIVID CYP3A4 Red (0–5 µM); CYP2D6 (15 pmol/well) and AMMC (0–50 µM); Cyp2e1 (20 pmol/well) and VIVID CYPA4 Red (0–7.5 µM); Cyp3a11 (5 pmol/well) and DBF (0–3 µM); and CYP3A4 (5 pmol/well) and DBF (0–0.5 µM). For ER and MR assays, turnover rates were calculated using an authentic resorufin standard curve, whereas, for all other probes, rates were calculated as average change in fluorescence per minute as calculated by the Fluoroskan Ascent software. Assays were run in duplicate, and in all cases variability was less than 10%. The data generated were analyzed by nonlinear regression using the Michaelis-Menten equation (GraFit version 5; Erithacus Software, Horley, UK).
Ligand IC50 Determination. For each IC50 determination, 386 µlofan enzyme/substrate master-mix containing 50 mM potassium phosphate, pH 7.4, probe substrate at a concentration equivalent to the Km calculated for the P450 isoform being tested, and X pmol of P450 (see above for specific details) were added to well A1 of a white 96-well plate. Test ligand (4 µl) dissolved in methanol (for the majority of ligands) or dimethyl sulfoxide was then added. Whichever solvent the test ligand was dissolved in was then added to the remaining enzyme/substrate master-mix to give a final concentration of solvent of 1%, and 195 µl of this solution was added to wells A2–A12. Well A1 was thoroughly mixed and 195 µl removed serially diluted to well A11, and the excess 195 µl was discarded. Well A12 acted as a "no-ligand" control. Determinations were run in duplicate for 2 min measuring every 10 sec, allowing four compounds to be tested per plate. Plates were preincubated at 37°C for 3 min and reactions initiated with NADPH as before. Test compounds were used at a final concentration range of 0 to 100 µM. IC50 curves were plotted and values calculated using GraFit version 5. The concentration of solvent used was identical for both control and inhibited reactions, caused negligible inhibition of enzyme activities, and did not effect the IC50 values generated.
| Results |
|---|
|
|
|---|
|
Ligand IC50 Determination. With the aim of obtaining a ligand profile and thus a potential substrate and inhibitor profile for each murine isoform, a wide range of structurally diverse compounds were screened (Table 3) for inhibitory potential. The IC50 data generated for each P450 isoform are detailed in Table 4 and ranged from examples of very strong inhibition [e.g., Cyp2a4/methoxychlor and Cyp1a1/quercetin (IC50: 10 nM)] to no inhibition (e.g., Cyp2e1/dihydroergotamine) and also activation (e.g., Cyp2d22/cholesterol). As a control, known benchmark substrates/inhibitors of the human P450s (e.g., CYP2C9/diclofenac, CYP2D6/quinidine, and CYP3A4/midazolam) gave IC50 values within the expected ranges.
|
|
In general, the "natural compounds" were found to strongly inhibit Cyp1a1, Cyp1a2, Cyp1b1, and Cyp2b20 and, to a lesser extent, Cyp2a4 and Cyp2c29. Cyp2d22 and -3a11 followed a similar pattern but were not inhibited by either dihydroergotamine or 5-methoxyindole. Cyp2e1 was the exception to this, showing inhibition only with quercetin. The three human P450s were inhibited by all the natural product compounds, with CYP2C9 activity inhibited to the greatest extent. With respect to the pesticide compound set, warfarin did not markedly inhibit any P450 other than CYP2C9 (IC50: 3.5 µM) and Cyp2b20 (IC50: 30.7 µM), whereas glyphosate was either noninhibitory or caused activation of the substrate metabolism. P450s 2b20, 2c29, 2C9, 2d22, 2e1, 3a11, and 3A4 were either weakly inhibited or not inhibited by isoproturon, whereas the remainder of the isoforms exhibited IC50sof <11 µM. Surprisingly, the comparatively large molecule ivermectin inhibited all of the P450 isoforms with the exception of Cyp1a2, giving IC50 values in the range of 0.2 to 52.8 µM. The insecticides methoxychlor and cypermethrin were potent inhibitors of P450s 1a1, 2a4, 2b20, 2c29, and 2C9 but did not, however, inhibit Cyp1a2.
The "endogenous compounds" set produced a broad range of inhibition profiles. With the exception of Cyp2e1 and, to a lesser extent, CYP2D6, retinoic acid efficiently inhibited the metabolic capability of all P450 isoforms (IC50 values ranging from 1.3–16.6 µM). Although vitamin D3 was noninhibitory for the majority of murine enzymes, it significantly inhibited the activity of all three human P450s. The neurotransmitter dopamine significantly inhibited only Cyp1a2, Cyp1b1, and CYP2C9-mediated metabolism, whereas the bile acid lithocholic acid was capable of inhibiting all P450s, except CYP2D6, with varying degrees of potency. The murine testosterone hydroxylase Cyp2a4 bound testosterone with the lowest IC50 of 2.1 µM followed by CYP3A4 (IC50:5 µM) and Cyp2d22 (IC50: 8.1 µM), whereas the other known testosterone hydroxylases, Cyp2b20 and Cyp3a11, showed 15- to 20-fold higher IC50s. With respect to both species, cholesterol was a weak inhibitor, with Cyp2b20 giving the lowest IC50 of 29.6 µM.
The "drugs" compound set also produced a variety of inhibition patterns. Midazolam was noninhibitory toward P450 1a2, 2d22, and 2e1 activities but showed reasonably strong inhibition with the other enzymes (IC50 < 18 µM). In contrast to ivermectin, only Cyp2d22, CYP2C9, and CYP3A4 were able to bind erythromycin, a similarly large molecule. Ketoconazole was a potent inhibitor of all enzymes except Cyp2d22 and Cyp2e1. Only CYP2C9 was significantly inhibited by the acidic compound diclofenac, with Cyp2c29 exhibiting approximately 36-fold weaker inhibition (IC50: 0.7 versus 25 µM). Tamoxifen and nifedipine were found to be universal inhibitors with reasonable potency (IC50 <60 or <40 µM, respectively). Interestingly, quinidine, a very potent inhibitor of human CYP2D6, did not strongly inhibit the activity of the mouse ortholog Cyp2d22 (IC50: 85.8 µM).
Taking a broader view of the IC50 data, CYP2C9 and Cyp1a1 proved to be the most promiscuous enzymes, with only 3.2 and 12.9% of compounds tested being noninhibitors, respectively (Table 4). Cyp2e1 lay at the opposite end of the spectrum, where almost 50% of compounds were noninhibitory and no single compound exhibited particularly strong inhibition. Most surprisingly, Cyp2d22 was the enzyme that most frequently exhibited cooperative behavior, with 23% of the ligands causing substrate activation. Furthermore, this enzyme was also able to bind the three largest ligands, dihydroergotamine, ivermectin, and erythromycin, potentially indicating a larger active site than the other murine enzymes.
Correlation Analysis. When the correlation coefficients (cc) of the IC50 data were calculated (Table 5), the ligand bindings of Cyp1a1 and Cyp1b1 were most closely related (cc: 0.88). Strikingly, Cyp2d22 shows virtually no significant correlation with any murine P450 with the exception of Cyp2e1 and, to a lesser extent, Cyp1b1. Furthermore, Cyp2d22 shows an inversely correlated relationship with Cyp2c29. The remaining murine and human P450s, with the exception of Cyp1a2, demonstrated significant interenzyme binding correlations. A very marked correlation was observed between Cyp3a11 and CYP3A4 (cc: 0.81) and Cyp2c29 and CYP2C9 (cc: 0.77), whereas there was no correlation between Cyp2d22 and CYP2D6 inhibition.
|
No relationship between correlation coefficients and protein identity was observed, even within members of the same families (Table 6). For example, Cyp1a1 and Cyp1a2 have a high degree of sequence identity with P450s 1b1, 2b20, 2c29, and 2e1; however, their IC50 correlation coefficients indicate that these enzymes are extremely different. Another striking example is that of CYP2D6 and Cyp2d22 which, although 77% identical at the protein level, exhibit no similarities in binding capacity.
|
| Discussion |
|---|
|
|
|---|
Due to the problem of gene multiplicity masking the activities of the individual isoform, the most straightforward method of defining substrate specificity is by heterologous expression and subsequent characterization of individual P450s. We therefore used a previously developed strategy (Blake et al., 1996
; Pritchard et al., 1997
; Pritchard et al., 1998
) that enabled the efficient coexpression of POR and nine murine P450s in E. coli. Rather than establishing individual assays for all the compounds, we established instead a fluorogenic assay for each murine P450 to determine the inhibitory potential of a set of test compounds, allowing us to compare inhibitory potencies of several test compounds. The range of readily available fluorogenic probe compounds enabled a substrate to be found for all the murine P450s tested in this study, resulting in an efficient and robust basis for inhibition screening. Surprisingly, the CYP3A4 specific substrate VIVID CYP3A4 Red proved to be a suitable probe for Cyp2d22, whereas the CYP2D6-specific probes VIVID CYP2D6 Cyan and AMMC were not metabolized. This "un-CYP2D6-like" behavior is supported by work carried out by Yu and Haining (2006
), who suggest that Cyp2d22 is not the murine enzyme responsible for CYP2D6-like activity, behaving instead with a more "CYP3A4-like" tendency.
Four general sets of ligands were chosen for the inhibition screen— natural product compounds, pesticides, endogenous compounds, and common drugs—many of which are known to undergo P450-mediated metabolism. Analysis of the inhibition data has confirmed a major difference between Cyp2d22 and CYP2D6 ligand preference. Aside from this, some interesting similarities and differences between human and mouse P450 activity inhibition were noted. For example, resveratrol, quercetin, and daidzein strongly inhibited the Cyp1 family, data which are mirrored by experiments done with the human homologs (Obach, 2000
; Chang et al., 2001
; Roberts et al., 2004
). Also, there were considerable similarities between the data generated for Cyp2a4 with literature values for CYP2A6 (Draper et al., 1997
), whereas the well characterized CYP2C9 substrate warfarin showed 43-fold lower inhibition with Cyp2c29 than with CYP2C9. Other notable differences include the well known CYP2B6 substrate cyclophosphamide (Chang et al., 1993
), demonstrating no inhibition of Cyp2b20 activity; the CYP3A4 substrate erythromycin, having no effect on Cyp3a11 activity, perhaps indicating a smaller or less flexible active site to CYP3A4; and methoxychlor, a known substrate of CYP1A2, CYP2B, and CYP2C9 (Stresser et al., 1996
; Stresser and Kupfer, 1998
), potently inhibiting Cyp2b20 and Cyp2c29 but having no effect on Cyp1a2. Broadly speaking, however, the Cyp2c29 and Cyp3a11 data correlated well with the human equivalents, although, on a compound-by-compound basis, human CYP2C9 and CYP3A4 tended to be more markedly inhibited than the mouse Cyp2c29 and Cyp3a11.
Although Cyp2d22 and CYP2D6 are considered orthologs, exhibiting 77% identity at the protein level, the vastly different inhibition profiles indicate that the active site of Cyp2d22 is most likely distinct from CYP2D6. Structure-based sequence alignment of the two proteins (Fig. 2) indicate that, although the residues which are key determinants of substrate specificity in CYP2D6, Glu216, and Asp301 (Paine et al., 2003
) are conserved in Cyp2d22, two further residues, Phe120 and Phe483 (Smith et al., 1998
; Flanagan et al., 2004
), which also play crucial roles in CYP2D6 structure activity relationships, are not similarly conserved. Site-directed mutation of these residues in CYP2D6 results in altered substrate specificity and regioselectivity (Flanagan et al., 2004
; McLaughlin et al., 2005
), which may explain in part the striking differences observed between the two enzymes observed by our lab and others (Yu and Haining, 2006
). Furthermore, there are several nonconservative amino acid substitutions in the SRS-2 and SRS-3 of Cyp2d22 as compared with CYP2D6, which may also contribute to the differing substrate specificity and inhibition profiles obtained. Perhaps the most surprising characteristic of Cyp2d22 observed in this study is its ability to exhibit heterotropic cooperativity as demonstrated by activation of substrate turnover (Table 5). This is suggestive of a fundamental mechanistic difference between Cyp2d22 and members of other mammalian 2D subfamilies. To date, there have been no conclusive reports of cooperative behavior in CYP2D enzymes, and this gives further weight to the theory that Cyp2d22 is "CYP3A4-like" (Yu and Haining, 2006
). Given that Cyp2d22 is one of the most abundant Cyp2d isoforms in mouse liver (Choudhary et al., 2003
; Jenkins et al., 2006
), these unusual traits could lead to possible misinterpretation of mouse liver microsome metabolism data and have potential implications for pharmacokinetic studies.
|
One drawback in using inhibition screening to profile the active sites of particular P450s is that it is indicative of the binding capacity of the active site but does not differentiate between the types of inhibition occurring and, obviously, does not indicate whether a compound will be a substrate or not. For example, nifedipine inhibited all P450s tested with IC50s of <40 µM; however, it was only metabolized by CYP3A4 and Cyp3a11 (data not shown). The data generated in this study were designed to be an initial step in the profiling of murine P450 substrate specificity and are currently being followed up with more extensive metabolism studies.
In summary, we have functionally coexpressed nine murine P450 enzymes (Cyp1a1, Cyp1a2, Cyp1b1, Cyp2a4, Cyp2b20, Cyp2c29, Cyp2d22, Cyp2e1, and Cyp3a11) with POR and identified and kinetically characterized a fluorogenic probe for each enzyme, which was then used to produce a self-consistent matrix of IC50 values for 31 compounds. We have used correlation analysis to compare the inhibition profiles of these nine enzymes with each other and also with three human P450s (CYP2C9, CYP2D6, and CYP3A4) and shown that, in general, with the exception of Cyp2d22, there is reasonable agreement in P450 inhibition profiles between murine and human P450 orthologs. Furthermore, we have demonstrated that Cyp2d22 is remarkably unlike CYP2D6, showing differences in metabolism, inhibition, and allosteric behavior, which could have wide-ranging implications for the interpretation of pharmacokinetic data.
| Footnotes |
|---|
Article, publication date, and citation information can be found at http://dmd.aspetjournals.org.
ABBREVIATIONS: P450, cytochrome P450; AMMC, 3-[2-(N,N-diethyl-N-methylammonium)-ethyl]-7-methoxy-4-methylcoumarin; BFC, 7-benzyloxy-4-trifluoromethylcoumarin; BQ, 7-benzyloxyquinoline; BR, benzyloxyresorufin; cc, correlation coefficient; ER, ethoxyresorufin; DBF, dibenzyl fluorescein; MFC, 7-methoxy-4-trifluoromethylcoumarin; MR, methoxyresorufin; POR, P450 oxidoreductase; PR, pentoxyresorufin; RT-PCR, reverse transcriptase-polymerase chain reaction; CHAPS, 3-[(3-cholamidopropyl)dimethylammonio]-1-propanesulfonic acid.
The online version of this article (available at http://dmd.aspetjournals.org) contains supplemental material. ![]()
1 Current affiliation: Biochemistry and Biophysics Group, Pharmacokinetics and Drug Metabolism, Amgen, Inc., Seattle, WA. ![]()
Address correspondence to: Dr. Colin J. Henderson, Biomedical Research Centre, University of Dundee, Ninewells Hospital and Medical School, Dundee DD1 9SY, UK. E-mail: c.j.henderson{at}dundee.ac.uk
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
Y. Tang, E. A. Scheef, S. Wang, C. M. Sorenson, C. B. Marcus, C. R. Jefcoate, and N. Sheibani CYP1B1 expression promotes the proangiogenic phenotype of endothelium through decreased intracellular oxidative stress and thrombospondin-2 expression Blood, January 15, 2009; 113(3): 744 - 754. [Abstract] [Full Text] [PDF] |
||||
![]() |
A.-M. Yu, J. Qu, M. A. Felmlee, J. Cao, and X.-L. Jiang Quantitation of Human Cytochrome P450 2D6 Protein with Immunoblot and Mass Spectrometry Analysis Drug Metab. Dispos., January 1, 2009; 37(1): 170 - 177. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. D. Finn, L. A. McLaughlin, S. Ronseaux, I. Rosewell, J. B. Houston, C. J. Henderson, and C. R. Wolf Defining the in Vivo Role for Cytochrome b5 in Cytochrome P450 Function through the Conditional Hepatic Deletion of Microsomal Cytochrome b5 J. Biol. Chem., November 14, 2008; 283(46): 31385 - 31393. [Abstract] [Full Text] [PDF] |
||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||