Early Intracellular Events During Internalization of Listeria monocytogenes by J774 CellsPaul Websteraa House Ear Institute, Los Angeles, California Correspondence to: Paul Webster, House Ear Institute, 2100 West Third Street, Los Angeles, CA 90057. E-mail: pwebster@hei.org
The gram-positive bacillus Listeria monocytogenes gains entry into host cells through a phagosome membrane that forms around entering bacteria. During the early stages of internalization the invading bacteria appear to modify the protein composition of the forming phagosome membrane in J774 cells. MHC class II molecules on the cell surface and exposed surface molecules available for biotinylation are excluded from the bacteriahost cell membrane interface and from the forming phagosome. This exclusion of MHC class II molecules from the early phagosome may partially help to explain previous reports suggesting that L. monocytogenes is able to interfere with antigen presentation. Inside the host cell, MHC class II molecules are delivered to the phagosome membrane. This is followed by delivery of LAMP 1, a marker of late endocytic compartments, and fusion with low-pH compartments. The bacteria then escape into the cell cytoplasm, possibly assisted by rapid delivery of this low-pH environment. (J Histochem Cytochem 50:503517, 2002) Key Words: electron microscopy, phagocytosis, macrophages, MHC class II, immunocytochemistry, lysosomes
INTRACELLULAR PATHOGENS such as bacteria and protozoa enter mammalian cells using processes initiated by either the host cell or by the invading organism. Inside the cell, internalized microorganisms usually enter a membrane-bound phagosome (
The gram-positive bacterium Listeria monocytogenes enters and is able to survive in mammalian cells. This organism is a contaminant of the food we eat (
Experimental listeriosis in mice is a widely studied model for intracellular bacterial infections. With this model, it has been shown that L. monocytogenes is able to generate responses from both the MHC class I and class II pathways (
In contrast, viable L. monocytogenes exhibit a fine control over phagosome maturation. Newly formed phagosomes accumulate rab 5 and N-ethylmaleimide (NEM)-sensitive factor (NSF), which causes upregulation of fusion with early endosomes ( Although events occurring during the early stages of L. monocytogenes internalization are better understood than for most pathogenic bacteria, many questions remain unanswered. The interactions between viable bacteria and host cell plasma membranes have not yet been fully investigated. Similarly, intracellular events during the initial internalization of bacteria are only currently being elucidated. For this reason, a preliminary immunocytochemical study of the early phagosome formation process is reported here. In this study the processes of phagosome maturation are visualized during the critical early stages of infection when bacteria first associate with and enter host cells.
Cells
Bacteria
Western Blotting
Invasion Assays After 2 days of incubation at 37C, the J774 cells were counted (approximately 1 x 105 per dish) and infected with 20 mid-log phase bacteria (OD 0.6 at 660 nm) bacteria per cell (2 x 106). The cells and bacteria were left at 37C for 5 min, washed with DMEM, and then either fixed immediately or incubated in DMEM with 10% FCS for increasing time intervals. They were then fixed in buffered aldehyde and prepared for examination by either light or electron microscopy. Infection times were recorded from the time the bacteria were first added to the cells as time zero.
For some control experiments, cells were incubated for 10 min with 1-µm diameter latex beads coated with avidin (
Surface Biotinylation and Incubation with DAMP
For some experiments, the J774 cells were incubated in DMEM containing 10% FCS and 20 µM 3-(2,4-dinitroanilino)-3'-amino-N-methyldipropylamine (DAMP) at 37C (
Antibodies
BSAGold Incubation
Light and Electron Microscopy
For immunocytochemistry, some cell monolayers were fixed for 1 hr in 0.5% glutaraldehyde buffered in 100 mM sodium phosphate (pH 7.4). Other cells were fixed in 4% phosphate buffered-formaldehyde for 1 hr and then left overnight in 8% formaldehyde in the same buffer. After fixation, the cells were prepared for cryosectioning and immunocytochemistry using previously described methods ( For routine morphological examination, cell monolayers were fixed in 2.5% glutaraldehyde buffered in 100 mM sodium cacodylate (pH 7.4), scraped from the culture dish as described, pelleted, postfixed in osmium tetroxide, en bloc-stained in 1% uranyl acetate in 50 mM sodium maleate (pH 5.2), dehydrated in ethanol, and embedded in epoxy resin. Sections were examined and photographed using a transmission electron microscope (FEI-Philips; Hillsboro, OR) operating at 80 kV.
Quantification
Stereological estimates of anti-biotin labeling density over J774 cell membranes were performed on sequentially sampled electron micrographs using cross-lattice overlays. Gold particle numbers were combined with numbers of intersects between the membrane under investigation and a test line of known length (
Viability of L. monocytogenes
The numbers of actin tails associated with internalized L. monocytogenes, visualized with fluorescent phalloidin, were first detected 2 hr p.i. The mean number of actin tails was slightly less than the number of bacteria per cell but increased over time (Table 1). Adding L. monocytogenes to J774 cell cultures had no obvious effect on the subcellular morphology of the cells. Intracellular bacteria were easily detected by light and electron microscopy and sufficient bacteria were found by electron microscopy to give unbiased overviews of early intracellular events.
Nonspecific Antibody Binding
Interaction of L. monocytogenes with Host Cell Surface In cryosections, the MHC class II labeling of J774 cells could be easily detected on the cell surface and in intracellular structures. At the site where L. monocytogenes were attached to the plasma membrane of cells expressing surface MHC class II, an exclusion of labeling from the J774 cell surface was observed (Fig 2A). This suggested that L. monocytogenes was able to exclude some surface proteins from the plasma membrane during the binding phase before internalization. To confirm this, J774 cells were surface-biotinylated and then infected with L. monocytogenes. Biotinylation on the cell membrane can be detected by applying specific anti-biotin antibodies and PAG. In sections, this label was present on the whole length of the surface membrane. However, at the site where L. monocytogenes attached to the plasma membrane an exclusion of the specific biotin labeling from the interface between bacterium and cell surface was observed (Fig 2B and Fig 2C). The biotin signal was excluded when there was a tight apposition of bacterial and host cell membranes (Fig 2B) and when the association appeared to be a loose one (Fig 2C). Quantification of the labeling density of anti-biotin antibody at this site showed a significant reduction in the signal compared to plasma membrane where L. monocytogenes was not attached (Table 2).
It is possible that the absence of labeling between the L. monocytogenes and the host cell was because the antigens at this site were inaccessible for antibody binding. For this reason, sections were probed with antibodies that recognized bacterial surface antigens. These antibodies did label the interface between bacteria and host cell membrane (Fig 2D). To confirm that antigens at this site were accessible for antibody binding, bacteria were biotinylated, bound to cells, sectioned, and probed with anti-biotin antibodies. The anti-biotin antibodies bound to the zone of contact between the biotinylated L. monocytogenes and the J774 cell membrane (Fig 2E). Both experiments clearly demonstrate that the site of bacterial and host cell membrane apposition was easily accessible to antibodies. To further investigate the plasma membrane site where particles bind as a first step to internalization, J774 cells were incubated for 10 min with avidin-coated latex beads. Sections through aldehyde-fixed cells with attached latex beads were probed with anti-MHC class II antibody. Antibody binding was detected at the interface where the plasma membrane and latex bead surface were interacting (Fig 3). The method of internalization appeared to be very different from that occurring during L. monocytogenes internalization. For each bead examined associating with a cell membrane, there was a close apposition of membrane to the bead surface, with the cell membrane wrapping completely around the latex bead (Fig 3). In contrast, L. monocytogenes did not appear to stimulate the long phagocytic processes on the J774 cell membrane that engulfed latex beads.
Expression of MHC Class II by J774 Cells To confirm the expression of MHC class II by the J774 cells, Western blots of homogenized cells were probed with antibodies to class II MHC antigens. A polypeptide pattern consistent with MHC class II expression in J774 cells was recorded (Fig 4). This pattern was similar to that seen in Western blots of A20 ß-lymphocytes, a known MHC class II-expressing cell line, probed with the same antibodies (Fig 4).
Cells probed with antibodies to I-Ed epitopes specific to MHC class II molecules from Balb/c mice (the original source of the J774 cell line) and subjected to a fluorescently activated cell sorter (FACS) analysis demonstrated a positive signal on approximately 65% of the cells (Fig 5). In contrast, a less specific epitope, I-Ad, was seen on only 5% of the cells (Fig 5).
The Early Phagosome and Intracellular Organelles
After 10-min exposure to bacteria, some L. monocytogenes-containing phagosomes still did not label with the anti-MHC class II antibodies. Structures in close proximity to the early L. monocytogenes-containing phagosomes did show MHC class II labeling (Fig 7A). In other cells, it appeared that MHC class II-positive structures were fusing with the phagosome membrane (Fig 7B). Although many of the internalized bacteria had escaped into the cytoplasm at the 25-min time point (data not shown), phagosomes still containing bacteria were present and showed increased labeling with the MHC class II antibodies (Fig 7C). In multiple-label experiments the phagosome membranes showed variable labeling with antibodies to LAMP 1 and MHC class II. Although many phagosomes that labeled with anti-class II antibodies had little or no LAMP 1 label (Fig 7D and Fig 7E), some were present that did label with this marker (Fig 7E). In some cells, LAMP 1-positive structures were seen close to L. monocytogenes-containing phagosomes (Fig 8).
The variable association of LAMP 1 and MHC class II labeling with L. monocytogenes-containing phagosomes observed by TEM was quantified by light microscopy. Co-localization of bacteria with either LAMP 1 or MHC class II antibodies was quantified on cells fixed at regular intervals after exposure to bacteria. At the first time point, when bacteria were first added to the cells, no co-localization of bacteria with MHC class II or LAMP 1 was observed (data not shown). However, after the 5-min p.i. time point, approximately 50% of the cell associated bacteria co-localized with MHC class II (Fig 8). After 10 min the number of bacteria co-localized with MHC class II had risen to 70%. This number dropped to just over 20% at 15 min p.i. and steadily dropped, until by 2 hr p.i. there was only approximately 10% co-localization (Fig 9).
In comparison, co-localization with LAMP 1 was first observed 15 min p.i. with
Anti-MHC Class II Antibodies Do Not Bind to Surface Fc Receptors
Interaction of Phagosomes with Low-pH Compartments
Exposure of J774 cells to a large inoculum of bacteria for short incubation times has made it possible to examine early synchronous events of L. monocytogenes internalization using immunocytochemical methods. In this way it has been possible to demonstrate that, during the early stages of L. monocytogenes association with J774 cells, the initial binding to host plasma membrane is accompanied by a rearrangement of some surface proteins on the host cell surface. This results in the formation of an early phagosome membrane inside the cell with a peptide profile different from that of the plasma membrane. Surface molecules available for biotinylation, and MHC class II molecules at the site of attachment, are excluded from the phagosome membrane. The exclusion of biotin signal and MHC class II molecules from between the bacterium and the host cell membrane suggests that manipulation of the cell surface by the bacteria is occurring either before or during the binding event. This hypothesis is supported by the observation that MHC class II molecules are not excluded from the interface between cell membrane and phagocytosed latex beads and by an exclusion of surface molecules from the membranes of early phagosomes containing L. monocytogenes. Once inside the cells the L. monocytogenes are again exposed to MHC class II molecules when organelles containing MHC class II are delivered to and fuse with the phagosome membrane just before the bacteria escape into the cell cytoplasm. The phagosome membrane also acquires lysosomal glycoproteins from organelles that fuse at this early internalization stage. Organelles with low luminal pH also fuse with the L. monocytogenes-containing phagosome during the first 25 min after exposure to bacteria. The technical limitations of the labeling methods used in this study could lead to conclusions that some of the observations are the result of technical artifacts. For this reason it was important to perform extensive control experiments to demonstrate specificity. It is possible that the exclusion of label at sites where L. monocytogenes is bound to the cell membrane was a result of antigen inaccessibility for antibody binding. To exclude this possibility, sites with loosely bound bacteria on the cell membrane were examined. These sites showed exclusion of MHC class II and biotin label even though antibody accessibility appeared possible. In addition, antibodies that recognized antigens on the bacterial surface were used to label the site of binding between plasma membrane and attached bacteria. These antibodies were able to label this site. Biotin on the bacterial surface was also accessible to antibody binding. Finally, anti-MHC class II labeling was detected at the interface where latex beads bound to J774 cells before internalization. Together, these observations suggest that the loss of labeling on the host plasma membrane was probably a result of a bacterial effect and not the result of physical exclusion of labeling. This is supported by the modified peptide profiles observed on early phagosomes that appear similar to those observed on the cell membrane. The use of antibodies that recognize mouse Igs could also be a source of incorrectly observed immunolabeling on mouse macrophages. However, the control experiments that show only a limited amount of signal on these cells effectively rule out this possibility. Similarly, control experiments rule out the possibility that nonspecific binding of antibody to Fc receptors is playing a role in the labeling experiments.
Although J774 cells have previously been considered to be a non-MHC class II-expressing cell, it appears that approximately 6070% of the cells in culture do express MHC class II molecules on their cell surface and at intracellular sites. The peptide profile produced on blots and the presence of a Balb/c-specific MHC class II epitope associated with the J774 cells support the observation that these cells express MHC class II molecules. It remains to be determined whether infected J774 cells are good candidates for stimulation and presentation of L. monocytogenes antigens. However, presentation of antigen using the class II MHC pathway has been reported to occur in these cells (
When living L. monocytogenes are used to infect bone marrow macrophages, most of the intracellular bacteria are destroyed before escape from the phagosome has been accomplished (
Internalized L. monocytogenes appear to encounter MHC class II molecules only after they have entered the cells and before they have escaped into the cell cytoplasm. Once in the cytoplasm the L. monocytogenes pass into adjacent cells via LAMP 1-positive compartments (this study and (
In antigen-presenting cells, the exact site where peptide-MHC class II complexes are formed is still undetermined. Newly synthesized MHC class II molecules pass from the Golgi complex to specialized MHC class II-containing endosomal compartments (CIIVs) (
The ability of pathogens to modify phagosome membranes appears to be a common event (
It is commonly accepted that, during phagocytosis, newly formed phagosomes have a polypeptide profile similar to that of the plasma membrane (
In conclusion, intracellular pathogens must utilize host cell processes for the regulation of pathogenesis. The results of this work suggest that L. monocytogenes enters cells through a route that is different from the phagocytic pathway. In this way the organism can partially limit exposure to MHC class II by excluding this molecule from the phagocytic vacuole as it is formed. The subsequent proteolysis of the organism resulting from exposure to lysosomes is negated by a rapid escape into the cell cytoplasm, possibly assisted by rapid delivery of low pH organelles to the phagosome. Peritoneal macrophages are able to destroy most of the intracellular bacteria before they can escape from the phagosome (
I thank Linda Chicoine for excellent technical assistance, Dan Portnoy for the L. monocytogenes cultures, Ira Mellman for immunoreagents, and Gareth Griffiths for advice on incubating latex beads with J774 cells. Received for publication May 16, 2001; accepted November 21, 2001.
AlvarezDominguez C, Barbieri AM, Berón W, WandinerNess A, Stahl PD (1996) Phagocytosed live Listeria monocytogenes influences rab5-regulated in vitro phagosome endosome fusion. J Biol Chem 271:13834-13843 AlvarezDominguez C, Roberts R, Stahl PD (1997) Internalized Listeria monocytogenes modulates intracellular trafficking and delays maturation of the phagosome. J Cell Sci 110:731-743[Abstract]
AlvarezDominguez C, Stahl PD (1999) Increased expression of Rab5a correlates directly with accelerated maturation of Listeria monocytogenes phagosomes. J Biol Chem 274:11459-11462 Amigorena S, Drake J, Webster P, Mellman I (1994) Transient accumulation of new class II MHC molecules in a novel endocytic compartment in B lymphocytes. Nature 369:113-120[Medline]
Anderson RG, Falck JR, Goldstein JL, Brown MS (1984) Visualization of acidic organelles in intact cells by electron microscopy. Proc Natl Acad Sci USA 81:4838-4842 Andrews NW, Webster P (1991) Phagolysosomal escape by intracellular pathogens. Parasitol Today 7:335-340[Medline] Bielecki J, Youngman P, Connelly P, Portnoy DA (1990) Bacillus subtilis expressing a haemolysin gene from Listeria monocytogenes can grow in mammalian cells. Nature 345:175-176[Medline]
Clemens DL, Horwitz MA (1993) Hypoexpression of major histocompatibility complex molecules on Legionella pneumophila phagosomes and phagolysosomes. Infect Immun 61:2803-2812
Clemens DL, Horwitz MA (1995) Characterization of the Mycobacterium tuberculosis phagosome and evidence that phagosomal maturation is inhibited. J Exp Med 181:257-270
Cluff CW, Garcia M, Ziegler HK (1990) Intracellular hemolysin-producing Listeria monocytogenes strains inhibit macrophage-mediated antigen processing. Infect Immun 58:3601-3612 Collins HL, Schaible UE, Ernst JD, Russell DG (1997) Transfer of phagocytosed particles to the parasitophorous vacuole of Leishmania mexicana is a transient phenomenon preceding the acquisition of annexin I by the phagosome. J Cell Sci 110:191-200[Abstract] Cossart P, Mengaud J (1989) Listeria monocytogenes: a model system for the molecular study of intracellular parasitism. Mol Biol Med 6:5164-5171
Cossart P, Vicente MF, Mengaud J, Baquero F, PerezDiaz JC, Berche P (1989) Listeriolysin O is essential for virulence of Listeria monocytogenes: direct evidence obtained by gene complementation. Infect Immun 57:3629-3636
Crowle AJ, Dahl R, Ross E, May MH (1991) Evidence that vesicles containing living, virulent Mycobacterium tuberculosis or Mycobacterium avium in cultured human macrophages are not acidic. Infect Immun 59:1823-1831
de Chastellier C, Berche P (1994) Fate of Listeria monocytogenes in murine macrophages: evidence for simultaneous killing and survival of intracellular bacteria. Infect Immun 62:543-553 Garciadel Portillo F, Finley BB (1995) The varied lifestyles of intracellular pathogens within eukaryotic vacuolar compartments. Trends Microbiol 3:373-380[Medline] Griffiths G (1993) Fine Structure Immunocytochemistry. Heidelberg, Berlin, Springer-Verlag
Harding CV, Geuze HJ (1992) Class II MHC molecules are present in macrophage lysosomes and phagolysosomes that function in the phagocytic processing of Listeria monocytogenes for presenting to T cells. J Cell Biol 119:531-542
Hart PD, Young MR (1991) Ammonium chloride, an inhibitor of phagosome-lysosome fusion in macrophages, concurrently induces phagosome-endosome fusion, and opens a novel pathway: studies of a pathogenic mycobacterium and a nonpathogenic yeast. J Exp Med 174:881-889 Horwitz MA (1988) Intracellular parasitism. Curr Opin Immunol 1:14-46
Jahraus A, Tjelle TE, Berg T, Haberman A, Storrie B, Ullrich O, Griffiths G (1998) In vitro fusion of phagoseomes with different endocytic organelles from J774 macrophages. J Biol Chem 273:30379-30390
Jones S, Portnoy DA (1994) Characterization of Listeria monocytogenes pathogenesis in a strain expressing perfringolysin O in place of listeriolysin O. Infect Immun 62:5608-5613 Kaufman SHE (1988) Listeriosis: new findings, current concern. Microbial Pathogen 5:225-231 Kaufman SHE (1993) Immunity to intracellular bacteria. Annu Rev Immunol 11:129-163[Medline]
Keilian MC, Cohn ZA (1980) Phagosome-lysosome fusion. Characterization of intracellular membrane fusion in mouse macrophages. J Cell Biol 85:754-765 Laemmli UK (1970) Cleavage of structural proteins during the assembly of the head of bacteriophage T4. Nature 227:680-685[Medline] Lang T, Chastellier C, Ryter A, Thilo L (1988) Endocytic membrane traffic with respect to phagosomes in macrophages infected with non-pathogenic bacteria: phagosomal membrane acquires the same composition as lysosomal membrane. Eur J Cell Biol 46:39-50[Medline] LeyvaCobian F, Unanue ER (1988) Intracellular interference with antigen presentation. J Immunol 141:1445-1450[Abstract] Lotteau V, Teyton L, Pelareaux A, Nilsson T, Karlson L, Schmid SL, Quaranta V, Peterson PA (1990) Intracellular transport of class II MHC molecules directed by invariant chain. Nature 348:600-605[Medline] Mackaness GB (1962) Cellular resistance to infection. J Exp Med 116:381-406[Abstract]
Marquis H, Goldfine H, Portnoy DA (1997) Proteolytic pathways of activation and degradation of a bacterial phospholipase C during intracellular infection by Listeria monocytogenes. J Cell Biol 137:1381-1392
Maurin M, Benoliel AM, Bongrand P, Raoult D (1992) Phagolysosomes of Coxiella burnetii-infected cell lines maintain an acidic pH during persistent infection. Infect Immun 60:5013-5016
Mayorga LS, Bertini F, Stahl PD (1991) Fusion of newly formed phagosomes with endosomes in intact cells and in a cell-free system. J Biol Chem 266:6511-6517
Muller WA, Steinman RM, Cohn ZA (1980a) The membrane proteins of the vacuolar system I. Analysis by a novel method of intralysosomal iodination. J Cell Biol 86:292-303
Muller WA, Steinman RM, Cohn ZA (1980b) The membrane proteins of the vacuolar system II. Bidirecional flow between secondary lysosomes and plasma membrane. J Cell Biol 86:304-313 Muno D, Kominami E, Mizuochi T (2000) Generation of both MHC class I- and class II-restricted antigenic peptides from exogenously added ovalbumin in murine phagosomes. FEBS Lett 478:178-182[Medline] Pamer EG, Harty JT, Bevan MJ (1991) Precise prediction of a dominant class I MHC-restricted epitope of Listeria monocytogenes. Nature 353:852-855[Medline]
Pitt A, Mayorga LS, Schwartz AL, Stahl PD (1992a) Transport of phagosomal components compartments to an endosomal compartment. J Biol Chem 267:126-132 Pitt A, Mayorga LS, Stahl PD, Schwartz AL (1992b) Alterations in the protein composition of maturing phagosomes. J Clin Invest 90:1978-1983
Rabinowitz S, Horsmann H, Gordon S, Griffiths G (1992) Immunocytochemical characterization of the endocytic and phagolysosomal compartments in peritoneal macrophages. J Cell Biol 116:95-112 Russell DG, Dant J, Sturgill-Koszycki S (1996) Mycobacterium avium- and Mycobacterium tuberculosis-containing vacuoles are dynamic, fusion-competent vesicles that are accessible to glycosphingolipids from the host cell plasmalemma. J Immunol 156:4764-4773[Abstract]
Russell DG, Xu S, Chakraborty P (1992) Intracellular trafficking and the parasitophorous vacuole of Leishmania mexicana-infected macrophages. J Cell Sci 103:1193-1210 Sinai A, Joiner KA (1997) Safe haven: the cell biology of nonfusogenic pathogen vacuoles. Annu Rev Microbiol 51:415-462[Medline] Sinai A, Webster P, Joiner KA (1997) Association of host cell endoplasmic reticulum and mitochondria with the Toxoplasma gondii parasitophorous vacuole membraneevidence for a protein-protein interaction. J Cell Sci 110:2099-2107[Abstract]
Slot JW, Geuze HJ (1981) Sizing of protein A-colloidal gold probes for immunoelectron microscopy. J Cell Biol 90:533-536 Slot JW, Geuze HJ (1985) A new method of preparing gold probes for multiple-labeling cytochemistry. Eur J Cell Biol 38:87-93[Medline]
SturgillKoszycki S, Schlesinger PH, Chakraborty P, Haddix PL, Collins HL, Fok AK, Allen RD, Gluck SL, Heuser J, Russell DG (1994) Lack of acidification in Mycobacterium phagosomes produced by exclusion of the vesicular proton-ATPase. Science 263:678-681. [published erratum appears in Science 1994 Mar 11;263(5152):1359]
Tilney LG, Portnoy DA (1989) Actin filaments and the growth movement and spread of the intracellular bacterial parasite, Listeria monocytogenes. J Cell Biol 109:1597-1608 Tuomanen EI, Masure HR (1997) Molecular and cellular biology of pneumococcal infection. Microbial Drug Resistance 3:297-308 Webster P (1999) The production of cryosections through fixed and cryoprotected biological material and their use in immunocytochemistry. Methods Mol Biol 117:49-76[Medline] West M, Lucocq J, Watts C (1994) Antigen processing and class II MHC peptide-loading compartments in human B lymphoblastoid cells. Nature 369:113-120 Ziegler HK, Unanue ER (1981) Identification of a macrophage antigen-processing event required for I region-restricted antigen presentation to T lymphocytes. J Immunol 127:1869-1875[Abstract]
This article has been cited by other articles:
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||