- Research
- Open access
- Published:
Toxicity of oxidized phospholipids in cultured macrophages
Lipids in Health and Disease volumeĀ 11, ArticleĀ number:Ā 110 (2012)
Abstract
Background
The interactions of oxidized low-density lipoprotein (LDL) and macrophages are hallmarks in the development of atherosclerosis. The biological activities of the modified particle in these cells are due to the content of lipid oxidation products and apolipoprotein modification by oxidized phospholipids.
Results
It was the aim of this study to determine the role of short-chain oxidized phospholipids as components of modified LDL in cultured macrophages. For this purpose we investigated the effects of the following oxidized phospholipids on cell viability and apoptosis: 1-palmitoyl-2-glutaroyl-sn-glycero-3-phosphocholine (PGPC), 1-palmitoyl-2-(5-oxovaleroyl)-sn-glycero-3-phosphocholine (POVPC) and oxidized alkylacyl phospholipids including 1-O-hexadecyl-2-glutaroyl-sn-glycero-3-phosphocholine (E-PGPC) and 1-O-hexadecyl-2-(5-oxovaleroyl)-sn-glycero-3-phosphocholine (E-POVPC). We found that these compounds induced apoptosis in RAW264.7 and bone marrow-derived macrophages. The sn- 2 carboxyacyl lipid PGPC was more toxic than POVPC which carries a reactive aldehyde function in position sn- 2 of glycerol. The alkylacyl phospholipids (E-PGPC and E-POVPC) and the respective diacyl analogs show similar activities. Apoptosis induced by POVPC and its alkylether derivative could be causally linked to the fast activation of an acid sphingomyelinase, generating the apoptotic second messenger ceramide. In contrast, PGPC and its ether analog only negligibly affected this enzyme pointing to an entirely different mechanism of lipid toxicity. The higher toxicity of PGPC is underscored by more efficient membrane blebbing from apoptotic cells. In addition, the protein pattern of PGPC-induced microparticles is different from the vesicles generated by POPVC.
Conclusions
In summary, our data reveal that oxidized phospholipids induce apoptosis in cultured macrophages. The mechanism of lipid toxicity, however, largely depends on the structural features of the oxidized sn- 2 chain.
Background
Macrophages are prominent cells in atherosclerotic lesions. Within the fraction of lesional macrophages in a proliferating state, a subset becomes apoptotic or necrotic[1]. Studies of advanced atherosclerotic lesions revealed a strong correlation between macrophage cell death and the incidence of plaque rupture associated with acute vascular events[2]. A very early and presumably initiating event in atherogenesis is the focal retention of modified low-density lipoprotein (e.g. oxidized (ox)LDL) in the subendothelial space. Some of the particles that accumulate within macrophages of atherosclerotic lesions are thought to be oxidized either prior to uptake into the arterial wall or subsequently due to intracellular chemical processes, e.g. free radical-mediated modifications. The modified lipoprotein particles can inhibit or induce cell death, depending on the extent of lipoprotein oxidation and lipoprotein dose[3]. In cell culture, apoptosis of macrophages can be initiated by minimally (e.g. by Fe2+) modified LDL (mmLDL), in which the lipids but not the apolipoproteins are oxidized[4]. From this observation it can be inferred that the oxidized lipids are largely responsible for the toxic effects of this particle. It has been shown that the toxicity of oxidized phospholipids (oxPL) is increased in cells undergoing ER stress due to other (lipo)toxic agents[5].
mmLDL stimulates acid sphingomyelinase (aSMase) activity within minutes leading to the formation of the second messenger ceramide, which mediates the apoptotic signal in vascular cells including macrophages, endothelial cells and vascular smooth muscle cells[3, 6ā8]. Ceramide activates several apoptotic signaling pathways. In vascular smooth muscle cells, the stress-induced protein kinases JNK and p38 MAPK have been identified as such components of cells exposed to mmLDL[7].
It has already been shown that ceramide-mediated apoptosis can also be induced in these cells by oxPL[7]. These compounds are generated from polyunsaturated phosphatidylcholines in LDL under the conditions of oxidative stress. Among a plethora of lipid oxidation products, oxPL, such as 1-palmitoyl-2-(5-oxovaleroyl)-sn-glycero-3-phosphocholine (POVPC) and 1-palmitoyl-2-glutaroyl-sn-glycero-3-phosphocholine (PGPC), are present in mmLDL[9]. They show a high capacity to induce apoptosis in vascular smooth cells[10] and macrophages, especially if the latter cells sense ER stress[5]. Both compounds are oxidation products of phosphatidylcholines containing arachidonic acid in the sn- 2 position of glycerol. They are characterized by a short fatty acyl chain in position sn- 2 and a hydrophobic, long-chain, fatty acid in the sn- 1 position of glycerol. In addition to diacyl-phospholipids, LDL contains the 1-O-alk(en)yl-2-acyl-analogs which are also modified by radical-mediated oxidation[11]. The truncated diacyl and alk(en)ylacyl phospholipids share similar structural features with two highly bioactive lipoprotein and membrane components, namely platelet-activating factor (PAF) and lysolecithin[12, 13]. They are more polar than unmodified membrane or lipoprotein phospholipids. Since they contain only one long hydrophobic sn- 1 acyl or alkyl chain, they exchange easily between tissues, cells, and lipoproteins[14, 15].
Exposure of vascular smooth muscle cells to POVPC and to a lesser extent PGPC elicited fast activation of an aSMase in these cells[7, 10] pointing to an effect on the protein level. Although both oxPL lead to the same endpoint (apoptosis), their mechanisms of toxicity are likely different. The sn- 2-aldehydoacyl phospholipid POVPC chemically interacts with the free amino groups of proteins or phospholipids via Schiff base formation[16]. After cellular uptake, most of the lipid is retained in the cell surface. In contrast, PGPC containing a carboxyacyl residue in position sn-2 can only physically interact with the molecules in its close vicinity and is rapidly internalized by the cells[14, 15].
It was the aim of this study to find out whether and to what extent the apoptotic effects of mmLDL are mediated by truncated diacylphospholipids and the corresponding alkylacyl phospholipids in cultured macrophages. For this purpose, we used chemically defined PGPC and POVPC as well as their 1-O-hexadecyl analogs and determined their toxicity in the murine macrophage-like cell line RAW264.7 and bone marrow-derived mouse macrophages (BMM). Although the latter cells proved to be more sensitive towards the oxPL, both cell types showed the same tendencies. The four lipids under investigation mainly induced apoptosis in these cells. PGPC was more toxic than POVPC. The alkylacyl phospholipids and the respective diacyl analogs show very similar activities. Apoptosis induced by POVPC and its alkylether derivative could be causally linked to the activity of aSMase. The more toxic lipids PGPC and its ether analog hardly showed any effect on this enzyme pointing to an entirely different mechanism of lipid toxicity. The higher toxicity of PGPC is underscored by more efficient membrane blebbing from the apoptotic cells producing lots of lipid particles that in turn contain high amounts of oxPL that propagate the toxic phospholipids effects to other cells (and organs).
Methods
Materials
Oxidized phospholipids (PGPC and POVPC) were synthesized in our laboratory as previously described[17]. 1-O-alkyl-ether analogs were prepared starting from 1-O-hexadecyl-sn- glycero-3-phosphocholine and glutaric acid anhydride as described for the acylation of the 1-acyl-phospholipid[17]. 1-palmitoyl-2-oleoyl-sn- glycero-3-phosphocholine (POPC) was synthesized according to the procedure of Hermetter A., Stutz H., Franzmaier R., Paltauf F. (1989)[18]. 1-palmitoyl-sn- glycero-3-phosphocholine (PLPC) was purchased from Bachem (Bubendorf, Switzerland). Chemicals for gel electrophoresis were from BioRad Laboratories (Hercules, CA), unless otherwise noted. NB19 was kindly provided by Dr. Hans-Peter Deigner (Frauenhofer EXIM/CEOS, Rostock, Germany). Organic solvents and all other chemicals were purchased from Carl Roth (Karlsruhe, Germany), Sigma-Aldrich (Steinheim, Germany) or Merck (Darmstadt, Germany). Tissue culture materials were obtained from Sarstedt (NĆ¼rnbrecht, Germany) or Greiner (KremsmĆ¼nster, Austria). Dulbeccoās modified Eagle medium (DMEM, 4,5 g/l Glucose) with and without phenol red and heat-inactivated fetal bovine serum, VybrantĀ® MTT Cell proliferation Assay kit (V-13154), VybrantĀ® apoptosis assay kit#2 (V-13241), F4/80 antibody and matching isotype control and staurosporine were from Invitrogen (Leek, Netherlands). PBS and cell culture supplements were obtained from PAA (Linz, Austria) unless otherwise indicated. āFluidsā for flow cytometry, FACS tubes, solutions and cells strainers were from BD Biosciences (Heidelberg, Germany).
Cell culture
The macrophage-like cell line RAW264.7 (ATCC No. TIB-71, American Type Culture collection, Rockville, MD, USA) was routinely grown in DMEM (4,5 g/l glucose, 25 mM HEPES, 4 mM L-glutamine, without sodium pyruvate) supplemented with 10% heat-inactivated fetal calf serum (FCS) and 100 U/ml penicillin/streptomycin at 37Ā°C in humidified CO2 (5%) atmosphere. Bone marrow-derived macrophages (BMM) were isolated according to a slightly modified standard protocol provided by Invitrogen (Leek, Netherlands). Briefly, femur and tibia of C57Bl/6 mice were separated and placed on ice in sterile PBS. The excess muscle was removed and the ends of the bones were cut off on both sides. Cells were washed out with a 26-G needle attached to a sterile syringe, filled with 3 ml DMEM (4,5 g/l D-glucose, 4 mM glutamine, 110 mg/l sodium pyruvate) and transferred via a cell strainer into a 50 ml Falcon tube. Subsequently the cell suspension was centrifuged at 500Ćg for 15 minutes and the supernatant was discarded. The cell pellet was carefully resuspended in DMEM supplemented with 10% LPDS and 500 U/ml penicillin/streptomycin and transferred into a culture flask (175 cm2/3 mice) followed by incubation at 37 Ā°C in a humidified 5% CO2 atmosphere for 24 h. Nonadherent cells were removed the next day, counted and resuspended in DMEM containing 10 ng/ml MCSF (R&D Systems, Minneapolis, USA). Cells were seeded in 96 well plates (106 cells/100 Ī¼l) for the MTT assay or in 24 well plates (4*106 cells/500 Ī¼l) for apoptosis assays. After 3 and 5 days the medium was replaced with fresh, supplemented DMEM containing 10 ng/ml MCSF.
Assessment of BMM differentiation
Monocyte differentiation was proven with rat anti-mouse F4/80-R-PE antibody and rat anti-mouse IgG2a R-PE isotype control using flow cytometry. The former monoclonal antibody reacts with the mouse F4/80 antigen, which is a macrophage-specific glycoprotein. Monocyte differentiation was analyzed on the first and seventh day using RAW264.7 macrophages as a reference. 106 cells were transferred into a FACS tube and centrifuged at 300Ćg for 3 minutes. Cells were resuspended in PBS containing 2 mg/ml glucose. 2,5 Ī¼g/ml of the antibody or the isotype control were added followed by incubation at room temperature in the dark for 15 minutes. Stained samples were analyzed using a FACSCalibur instrument (BD Biosciences, Heidelberg, Germany). The red fluorescence emission was measured on channel FL2 above 575 nm upon excitation with a 488 nm laser. Analysis was performed on the amplitude (heigh, H) of the fluorescence signal in log scale. The percentage of differentiated cells was calculated using WinMDI 2.8 software. A content of 90-95% differentiated (F4/80 positive) cells was considered as appropriate for further experiments.
Incubation of cells with oxPL
Aqueous lipid dispersions containing 0ā200 Ī¼M oxPL, POPC or PLPC were prepared using the ethanol injection method[19]. Cells were incubated with lipid dispersions in PBS or culture media without phenol red containing 0-10% (v/v) serum concentrations. The final ethanol concentration in the incubation mixtures did not exceed 1% (v/v) of total volume. Culture media or PBS containing the same ethanol concentration was routinely used as controls.
MTT viability assay
To determine the cytotoxic effect of oxPL in macrophages VybrantĀ® MTT Cell proliferation Assay kit was used according to the manufacturerās recommendations. The MTT assay involves the conversion of the water soluble MTT (3-(4,5-dimethylthiazol-2-yl)-2,5-diphenyltetrazolium bromide) to an insoluble formazan by viable cells. The formazan is solubilized, and its concentration is determined from the optical density at 570ā600 nm. The protocol was optimized for RAW264.7 and BMM according to cell number, MTT concentration and incubation times. In brief, 1,25*105 RAW264.7 cells or 106 monocytes were seeded in 96 well plates in culture medium with varying FCS or LPDS concentrations. Monocytes were differentiated before incubation as described above. RAW264.7 cells were left in the wells for 2ā3 h to ensure attachment to the substrate. The medium was removed and the lipid dispersions or control substances (1% v/v EtOH, 2,5 mM H2O2, 1 Ī¼M staurosporin) in PBS or culture medium were added. After incubation, the lipid-containing medium was replaced by 100 Ī¼l fresh medium and 10 Ī¼l MTT (1 mg/ml stock) solution were added prior to incubation at 37Ā°C in a humidified 5% CO2 atmosphere for 2 h. Subsequently, 100 Ī¼l 10% (w/v) SDS in 0,01% (v/v) HCl was added. The cells were incubated under the same conditions for 4 h. The mixture was solubilized to homogeneity and optical density was measured at 595 nm using an Anthos plate reader driven by WinRead 2.3 software.
Flow cytometric apoptosis assay
Samples were prepared as described for the MTT assay (see above), except for the cell number and plate format. Specifically, 6,5 *105 RAW264.7 or 4*106 monocytes were initially seeded in a 24 well plate (volume 3 ml). After incubation, cells were harvested by scraping and washed with cold PBS containing 2 mg/ml glucose prior to resuspension in Annexin V binding buffer. 3*105 cells/100 Ī¼l were transferred into a FACS tube. Five Ī¼l AlexaFluorĀ®488 Annexin V and 5,5 Ī¼l propidium iodide (PI; 1 mg/ml stock solution) were added and allowed to incubate at room temperature in the dark for 15 minutes. Prior to FACS measurement, samples were diluted in 400 Ī¼l PBS containing 2 mg/ml glucose, gently mixed and kept on ice until analysis. Stained samples were then analyzed using a FACSCalibur flow cytometer (BD Biosciences, Heidelberg, Germany). The green and red fluorescences were measured at 530 nm and 575 nm, respectively (excitation: 488 nm laser). The [FSC,FL3H] diagram was applied for gating out the debris and the gated cells were analyzed in [FL1H, FL2H] log scale dot plots. Auto-fluorescence of the cells positioned in first decade, and compensation for AlexaFluorĀ®488 fluorescence in FL2 channel was applied. The percentage of apoptotic cells (AnnexinV-positive), necrotic cells (PI-positive) and late apoptotic/early necrotic cell (double-stained) were calculated using WinMDI 2.8 software package. Apoptotic effects of 1-O-alkylether lipids and NB19 were compared with PGPC and POVPC-induced apoptosis under the same conditions except for the cell number. For these experiments, cells were left overnight in the multi-well plate and as a consequence, cell numbers were twice as high. Cells were pre-incubated with 10 Ī¼M NB19 in order to determine the effect of aSMase on apoptosis. NB19 was dissolved in EtOH before addition to the culture medium (10 nmol NB19/ml) for 30 minutes. The final ethanol concentrations in the incubation mixtures did not exceed 1% (v/v) of total volume.
Morphological studies
Monolayer cultures of RAW 264.7(1x105) cells were seeded in chamber slides (Imaging chamber CG 8 wells, PAA, Linz, Austria) and grown to 60ā80% confluency over night. Cells were then incubated with 300 Ī¼l aqueous dispersions of 50 Ī¼M oxPLs or reference compounds (1% v/v EtOH) in DMEM without phenol red under low serum conditions (0,1% FCS) for 2 h. After incubation cells were observed with an Axiovert 35 inverted microscope (magnification: 1000 x) equipped with a CCD camera, driven by AxioVision software package (Carl Zeiss, Germany).
Proteins of apoptotic blebs
RAW264.7 macrophages were grown to 80% confluency in Petri-dishes (10 cm diameter) and incubated with an aqueous dispersion of 50 Ī¼M oxPL or 1% (v/v) EtOH in DMEM under low serum conditions (0,1% FCS) for 18 h. Membrane vesicles and apoptotic blebs were harvested as described previously[20]. Briefly, culture supernatants containing the membrane vesicles were isolated and cleared from debris and detached cells by centrifugation at 500Ćg for 10 minutes. Blebs were isolated by ultracentrifugation (100000Ćg for 90 minutes at 4Ā°C). The pellet was washed and resuspended in 30 Ī¼l PBS prior to protein determination using a plate assay according to the method of Bradford[21]. Twenty Ī¼l of pellet suspensions or supernatants (20 Ī¼g protein) were separated by SDS gel electrophoresis (4,5% stacking gel, 10% resolving gel) as previously described[22]. Total proteins were stained with Sypro Rubyā¢ and detected using a BioRad laser scanner (Ex. 488 nm, Em. 530/30 nm).
Time-dependent stability of oxPL
Stability of oxPL in serum-containing media was determined as previously described[10]. Solvent was removed from 100 Ī¼M oxPL under a stream of nitrogen. Two hundred Ī¼l DMEM containing 10% or 0,1% FCS were added followed by incubation under shaking (575 rpm) for 2, 4, 6 or 20 h. After incubation, phospholipids were extracted with chloroform/methanol 2/1 (v/v) at room temperature. The organic phase was removed under a gentle stream of nitrogen. The lipids were then dissolved in chloroform/methanol 2/1 (v/v) and analyzed by thin-layer chromatography on silica plates. The mobile phase was chloroform/methanol/acetone/glacial acetic acid/water 20/40/10/10/10 (v/v/v/v/v) for PGPC and E-PGPC and chloroform/methanol/water 50/30/10 (v/v/v) for POVPC and E-POVPC, respectively. Lipid spots were detected with molybdenum blue reagent, which specifically stains phospholipids[23].
Acid sphingomyelinase activity
Cultured RAW264.7 macrophages were harvested and counted using Countess System (Invitrogen). 1,3*106 cells were plated in 6 well plates followed by incubation at 37Ā°C in a humidified 5% CO2 atmosphere for 24 h. Subsequently, cells were washed with DMEM containing 0,1% FCS. OxPL containing media was prepared by adding ethanolic lipid solutions to DMEM at room temperature under stirring. Cells were incubated with 25 Ī¼M oxPL in DMEM at 37Ā°C in a humidified 5% CO2 atmosphere for 0ā15 minutes. Control cells were incubated with 1% ethanol (v/v) in DMEM under the same conditions. After incubation, all steps were carried out at 4Ā°C. Cells were scraped into 1 ml PBS and the cell suspensions were transferred into 15 ml Falcon tubes followed by centrifugation at 1500 rpm for 10 minutes. The supernatant was discarded and the cell pellet was resuspended in 50 Ī¼l acid lysis buffer for the determination of aSMase activity as described previously[24]. Briefly, protein concentration of the cell lysates was determined using a plate assay according to the method of Bradford[21] and aliquots containing 20 Ī¼g protein were incubated with NBD-sphingomyelin substrate as described[24]. Substrate and product were separated by TLC. The fluorescent lipids were quantified with a CCD camera (Herolab, Vienna) (excitation wavelength: 365 nm) using EasyWin software.
Statistical analysis
Results are expressed as means +/ā standard deviation (SD). Two-tailed unpaired Studentās t-test was used to determine the significance of the differences. p-Valuesāā¤ā0,05 were considered significant.
Results
The oxPL PGPC and POVPC are components of oxLDL which is causally involved in the onset and progression of atherosclerosis[25]. We have already shown that the toxicity of oxLDL in cultured vascular smooth muscle cells is largely due to its oxPL components. PGPC, POVPC and oxLDL induce apoptosis in these cells, which is mediated by aSMase generating the second messenger ceramide[7]. It was the aim of this study to find out whether and to what extent PGPC and POVPC (Figure1) induce (programmed) cell death in macrophages, which is a hallmark in atherogenesis.
For this purpose, we used the established RAW264.7 macrophage-like cell line and cultured murine BMM. In a pre-screen, the effects of both oxPL on cell viability were studied using the photometric MTT assay (Figure2). From the decrease in optical density of the marker dye it can be concluded that both compounds decreased the viability of RAW264.7 cells in a concentration- and for PGPC in a time-dependent manner (Figure2A and B) with PGPC being more toxic than POVPC. Notably, BMM were more sensitive towards the oxPL than RAW264.7 cells (Figure2C and D).
Lysophosphatidylcholine (PLPC) showed comparable effects on viability as PGPC (Figure2). PLPC and the oxPL show similar structural features since they contain only one long-chain fatty acyl residue in position sn- 1 and a polar group in position sn- 2 of glycerol. Since PLPC is formed upon hydrolytic degradation of PGPC and POVPC (see also Figure3), it can be expected that it contributes to the toxicities of these lipids to some extent, especially after long incubation times.
Cell damage detected by the MTT assay is in line with the morphological changes that are observed under the microscope (Figure4). Upon treatment with oxPL RAW264.7 cells show morphological changes such as rounding and shrinking and are eventually released from the solid substratum.
The detrimental effects of both oxPL on cell viability are associated with an increase in apoptosis. Programmed cell death under the influence of PGPC and POVPC was determined from cell staining with fluorescent Annexin V followed by FACS analysis. In addition, the capacity of the oxPL to induce necrosis was measured in the same experiment using PI as dye that stains the DNA in cells with permeabilized membranes. Staurosporine and hydrogen peroxide were used as control toxins to assess apoptosis and necrosis, respectively. PGPC and POVPC induced apoptosis in both cell types with PGPC being again more toxic than POVPC (Figure5A and B). Cells incubated with either oxPL hardly showed any signs of necrosis (data not shown). As observed before, BMM were more sensitive to the oxPL than RAW264.7 macrophages. We also studied apoptosis of both cell types under the influence of the 1-O-alkyl-2-acyl analogs of PGPC and POVPC (Figure1). The respective compounds are oxidation products of ether choline phospholipids that are also found in LDL and cell membranes of animals and humans[26]. The ether analogs of PGPC and POVPC and their diacyl counterparts showed very similar apoptotic effects in RAW264.7 cells, with the PGPC analog being more toxic than the POVPC analog (Figure5C). It is obvious that the toxicities of the diacyl and alkylacyl oxPL depend on the small structural difference in the oxidized sn-2 acyl chain. The (ether) POVPC contains an aldehyde group which can react with the amino groups of phospholipids and proteins, whereas PGPC can only undergo physical interactions with the molecules in its close vicinity. As a consequence, cellular lipid uptake, membrane effects, signaling platforms and the outcome, cell death, are different.
Toxicity of oxPL in macrophages depends on lipid stability inside the cells and in the culture medium prior to cellular uptake. The cell viability and apoptosis experiments were performed under low (0,1%) serum conditions. In order to determine the stability of the oxPL, PGPC, POVPC and their ether analogs were incubated in the culture medium, followed by solvent extraction and TLC analysis. Under low serum conditions (0,1% FCS), POVPC (Figure3A) and ether-POVPC (Figure3B) were stable for 2 h, whereas PGPC (Figure3A) and ether-PGPC (Figure3B) remained intact for 6 h. This difference can help explain at least in part the higher toxicities of the PGPC versus the POVPC-derived lipids. Addition of 10% serum to the culture medium efficiently catalyzed the hydrolysis of PGPC, POVPC (Figure3A) and their ether analogs (Figure3B) to the formation of PLPC. After 2 h of incubation, the entire amount of lipid has gone under these high serum conditions.
Apoptosis is associated with a series of profound changes in cellular structure and integrity. Membrane blebbing, the release of vesicular bodies (blebs) from the plasma membrane, is one of the hallmarks of this process[27ā29]. To measure the capacity of the oxPL to induce membrane blebbing in RAW264.7 macrophages, cells were incubated with 50 Ī¼M PGPC or POVPC for 18 h (Figure6). The vesicle pellets (P) were isolated from the supernatant (SN) by ultracentrifugation and analyzed for their protein patterns and contents. The protein patterns of the apoptotic vesicles (P) slightly depended on the oxPL. However, the efficiency as determined from the protein amount in the membrane fraction (P) differed to a great extent depending on the lipid. Concerning the protein content we found that PGPC led to a much more pronounced release of apoptotic vesicles than POVPC.
In a previous study, we found that POVPC and (to a lesser extent) PGPC-induced apoptosis was mediated by the fast activation of an aSMase in cultured vascular smooth muscle cells[7]. This enzyme generates ceramide from sphingomyelin, which propagates the apoptotic signal. The data presented in this work provide evidence that both oxPL induce apoptosis also in cultured macrophages, but the role of aSMase seems to be different in the latter cells. POVPC and ether-POVPC activate aSMase within minutes (Figure7A). The ether-POVPC stimulates the enzyme more efficiently. This result is in line with the slightly higher, toxicity of the ether-POVPC. FACS analysis of apoptosis in RAW264.7 macrophages provided evidence that aSMase activity is directly linked to the toxicity of POVPC. Pre-incubation of the cells with an enzyme inhibitor (NB19) reduced the amount of apoptotic cells after exposure to the oxPL (Figure7B). NB 19 did not influence the basal level of apoptosis in control cells without (ether-) POVPC. PGPC and ether-PGPC show an opposite effect as they inhibit aSMase in macrophages (Figure7A). We have evidence that PGPC utilizes enzymes of the de novo pathway for ceramide production and signaling (unpublished). Interestingly, inhibition of aSMase expression by NB19 protects cells against the toxicity of PGPC (Figure7B), although there is no direct effect of the oxPL on enzyme activity. According to these data, there must be at least one indirect relationship between aSMase and PGPC-induced cell death. This open question will be subject to further clarification.
Discussion
Apoptosis of macrophages in the arterial wall is a hallmark in the development of atherosclerosis[29]. Accumulation of apoptotic cells along with a transition to cell necrosis contribute to the destabilization of atherosclerotic plaques followed by plaque rupture and thrombus formation[30]. The endpoint of the development of this chronic disease may be myocardial infarction or stroke. From in vitro experiments it is known that the interaction of oxidized lipoproteins with cultured macrophages is responsible for the various facets of cell fate under pathophysiological conditions[25]. oxLDL, characterized by a high content of modified lipid and protein components, is incorporated into the cells via scavenger receptors without regulatory feedback mechanisms. As a consequence, lipids accumulate inside the cells and foam cells are formed. In mmLDL, a significant fraction of cholesterol and (phospho) lipid esters containing polyunsaturated fatty acids are modified or fragmented, whereas apolipoprotein B (apoB) is hardly affected[29]. These particles are also very toxic to macrophages and other cells of the vascular wall, depending on the extent of lipoprotein modification, dose and incubation time. mmLDL is still recognized by the apoB receptor, but its toxicity does not depend on receptor-mediated uptake of the entire particle[31]. OxPL and especially those containing fragmented acyl chains are more polar and can be efficiently transferred to cell plasma membranes through the aqueous phase[14, 15]. Sustained exposure to mmLDL induces apoptosis in cultured vascular cells and macrophages[3, 4, 7], which is mediated by the activation of an aSMase generating the apoptotic lipid messenger ceramide. We have already shown that the truncated phospholipids PGPC and POVPC mimic the toxic effects of mmLDL in cultured vascular smooth muscle cells[7]. Here we provide evidence that both oxPL induce apoptosis in cultured macrophages. In these studies, we investigated RAW264.7 macrophage-like cells and BMM. The tendencies of PGPC and POVPC to induce apoptosis were the same in both cell types with BMM being slightly more susceptible to oxPL toxicity than RAW264.7 macrophages. Despite the fact that primary bone marrow-derived cells were included in our study it has to be noted that the results obtained in vitro cannot be directly translated in vivo, in particular not to human conditions.
The mechanisms of oxPL toxicity in RAW264.7 cells were studied in more detail and seem to differ from the pathways observed in cultured smooth muscle cells. POVPC rapidly activated aSMase in cultured RAW264.7 macrophages. When aSMase activity was inhibited by NB19, cells became more resistant to POVPC-induced apoptosis, indicating that the activity of this enzyme is causally linked to POVPC toxicity in macrophages. Similarly, apoptosis induced by Jurkat cell-derived microparticles in RAW 264.7 macrophages was reduced when the cells were treated with an aSMase inhibitor[32]. However, it has to be emphasized that the (oxidized) lipid composition of microparticles is complex and therefore it is not possible to attribute toxic effects to discrete molecular species. PGPC showed a small inhibitory effect on aSMase after 15 minutes incubation. Data from preliminary experiments support the assumption that PGPC interferes with the enzymes of de novo ceramide synthesis localizing to intracellular membranes (ER), whereas aSMase likely generates ceramide in the plasma membrane (Koller D., Marlingapla Halasiddappa L., Hermetter A., unpublished). The obviously different roles of ceramide-generating pathways in PGPC- and POVPC-induced macrophage apoptosis are due to the small structural differences in the short-chain carboxylic acids that are the remnants of arachidonic acid oxidation in position sn- 2 of the parent glycerophospholipids. PGPC contains a carboxylic function at the Ļ-position of the truncated acyl chain, whereas POVPC contains a chemically reactive aldehyde group. PGPC can only physically interact with the biomolecules in its immediate vicinity. It is rapidly internalized by the cells[33] and thus can influence the metabolic activities (ceramide synthesis) inside the cells. In contrast, POVPC is retained in the plasma membrane due to covalent Schiff base formation with the free amino groups of proteins and aminophospholipids[14, 15]. This behaviour is in line with the observation that POVPC rapidly activates aSMase, which localizes at least in part to the cell surface. After long exposure time, POVPC can also reach the intracellular compartments where it modifies numerous cytosolic and membrane proteins[14]. In this regard, it behaves similarly as 4-hydroxynonenal (HNE) which is the fragment released from the Ļ-end of polyunsaturated fatty acids under oxidative stress[34]. Notably, HNE is more polar than POVPC and therefore partitions more easily into the cytosol and eventually the intracellular membranes where it covalently modifies proteins thereby triggering apoptosis, necrosis and inflammation[35, 36] HNE is currently considered the major biomarker of lipid peroxidation[37].
In addition to diacylglycerophospholipids (mainly phosphatidylcholine), LDL also contains small amounts of alk(en)yl-acyl-analogs. Animal and human cell membranes, except the liver, may even contain large amounts of this phospholipid subclass[26, 38ā40]. Most alk(en)ylacyl phospholipid species (mainly containing phosphocholine- and ethanolamine head groups) also contain polyunsaturated fatty acyl chains in position sn- 2 of glycerol and therefore are subject to modification by reactive oxygen species[11]. Here we show that the alkylacyl analogs of PGPC and POVPC are also potent inducers of apoptosis in RAW264.7 macrophages. The same effects were also observed in cultured vascular smooth muscle cells (unpublished). Currently, we do not know the reason for the higher ether lipid toxicities, which may be due to differences in biochemical stability and biophysical properties in the cell[41]. The sn- 1 alkylether bond is resistant to hydrolytic cleavage and thus increases biochemical stability of the lipid molecule. From biophysical studies it is known that alkylacyl phospholipids are more densely packed[42] and increase the tendency of the membrane or some membrane areas to adopt nonbilayer lipid phases leading to membrane destabilization and alterations of membrane-associated enzyme functions.
One of the most striking phenomena of apoptosis is the controlled disintegration of cell (membrane) structures as a consequence of membrane blebbing, which is the release of microparticles (apoptotic blebs) into the immediate environments or the circulation. These particles are enriched in oxPL (mainly PGPC, POVPC and PEIPC)[20, 43] and thus must be considered vehicles of toxic compounds that trigger detrimental effects far from the site of their formation. As a consequence they can propagate apoptotic and inflammatory processes within the same tissues or other organs[44, 45]. The formation of microparticles may be favoured by the physical properties of the truncated phospholipids themselves[33] and/or the ceramide that is formed during the progress of apoptosis[46]. We found that PGPC leads to massive microparticle formation, whereas POVPC induced less vesicle release. The molecular shape of PGPC is conical and therefore it can directly induce high membrane curvature, a prerequisite for membrane vesiculation. The role of ceramide in PGPC-induced membrane blebbing is not obvious. PGPC seems to affect intracellular ceramide formation and to date it is unclear how the sphingolipid can reach the plasma membrane and contribute to cell surface-associated membrane effects under oxPL stress. A role of ceramide in POVPC-induced membrane blebbing is more plausible. The latter phospholipid stimulates aSMase and as a consequence ceramide can directly be generated in the plasma membrane. A direct contribution of POVPC to microparticle formation cannot be inferred from the currently available information. The preparation of typical lipid-lipid and lipid-protein conjugates of POVPC, which forms Schiff bases with free amino groups of proteins and aminophospholipids, is under way in our laboratory in order to characterize the biophysical properties and cellular effects of these membrane-associated components.
Conclusions
In summary, PGPC, POVPC and their 1-O-alkyl analogs induce apoptosis in cultured macrophages with PGPC and ether-PGPC being more toxic than the POVPC counterparts. The higher toxicities are associated with more severe consequences to the cells. Loss of plasma membrane vesicles is more efficient if cells are exposed to PGPC. This result is physiologically highly relevant since apoptotic blebs contain large amounts of oxPL and carry these toxic compounds far away from the site of formation[20]. Thus the biological activity of oxPL is potentiated by this process. We conclude that the apoptotic effects of POVPC and its ether analog are coupled to the activity of aSMase. It remains to be elucidated, which pathway accounts for the formation of toxic ceramide under the influence of PGPC.
Abbreviations
- aSMase:
-
Acid sphingomyelinase
- BMM:
-
Bone marrow-derived macrophages
- DMEM:
-
Dulbeccoās modified Eagle medium
- E-PGPC:
-
1-O-hexadecyl-2-glutaroyl-sn- glycero-3-phosohcholine
- E-POVPC:
-
1-O-hexadecyl-2-(5-oxovaleroyl)-sn- glycero-3-phosohcholine
- EtOH:
-
Ethanol
- FACS:
-
Fluorescence activated cell sorting
- FCS:
-
Fetal calf serum
- JNK:
-
c-Jun N-terminal kinase
- LDL:
-
Low-density lipoprotein
- LPDS:
-
Lipoprotein deficient serum
- MAPK:
-
Mitogen-activated protein kinase
- MCSF:
-
Macrophage colony-stimulating factor
- mmLDL:
-
Minimally modified low-density lipoprotein
- MTT:
-
3-(4,5-dimethylthiazol-2-yl)-2,5-diphenyltetrazolium bromide
- NBD:
-
Nitrobenzoxadiazole
- oxLDL:
-
Oxidized low-density lipoprotein
- oxPL:
-
Oxidized phospholipids
- PAF:
-
Platelet-activating factor
- PEIPC:
-
1- palmitoyl-2-(5,6-epoxyisoprostane)-sn-glycero-3-phosphocholine
- PGPC:
-
1- palmitoyl-2-glutaroyl-sn- glycero-3-phosphocholine
- PLPC:
-
1- palmitoyl-sn-glycero-3-phosphocholine
- POPC:
-
1- palmitoyl-2-oleoyl-sn-glycero-3-phosphocholine
- POVPC:
-
1- palmitoyl-2-(5-oxovaleroyl)-sn- glycero-3-phosphocholine
- TLC:
-
Thin-layer chromatography.
References
Watson AD, Leitinger N, Navab M, Faull KF, Horkko S, Witztum JL, Palinski W, Schwenke D, Salomon RG, Sha W, Subbanagounder G, Fogelman AM, Berliner JA: Structural identification by mass spectrometry of oxidized phospholipids in minimally oxidized low density lipoprotein that induce monocyte/endothelial interactions and evidence for their presence in vivo. J Biol Chem. 1997, 272: 13597-13607. 10.1074/jbc.272.21.13597
Kolodgie FD, Narula J, Burke AP, Haider N, Farb A, Hui-Liang Y, Smialek J, Virmani R: Localization of apoptotic macrophages at the site of plaque rupture in sudden coronary death. Am J Pathol. 2000, 157: 1259-1268. 10.1016/S0002-9440(10)64641-X
Steinbrecher UP, Gomez-Munoz A, Duronio V: Acid sphingomyelinase in macrophage apoptosis. Curr Opin Lipidol. 2004, 15: 531-537. 10.1097/00041433-200410000-00006
Deigner HP, Claus R, Bonaterra GA, Gehrke C, Bibak N, Blaess M, Cantz M, Metz J, Kinscherf R: Ceramide induces aSMase expression: implications for oxLDL-induced apoptosis. FASEB J. 2001, 15: 807-814. 10.1096/fj.15.3.807
Seimon TA, Nadolski MJ, Liao X, Magallon J, Nguyen M, Feric NT, Koschinsky ML, Harkewicz R, Witztum JL, Tsimikas S, Golenbock D, Moore KJ, Tabas I: Atherogenic lipids and lipoproteins trigger CD36-TLR2-dependent apoptosis in macrophages undergoing endoplasmic reticulum stress. Cell Metab. 2010, 12: 467-482. 10.1016/j.cmet.2010.09.010
Kinscherf R, Claus R, Deigner HP, Nauen O, Gehrke C, Hermetter A, Russwurm S, Daniel V, Hack V, Metz J: Modified low density lipoprotein delivers substrate for ceramide formation and stimulates the sphingomyelin-ceramide pathway in human macrophages. FEBS Lett. 1997, 405: 55-59. 10.1016/S0014-5793(97)00157-9
Loidl A, Sevcsik E, Riesenhuber G, Deigner HP, Hermetter A: Oxidized phospholipids in minimally modified low density lipoprotein induce apoptotic signaling via activation of acid sphingomyelinase in arterial smooth muscle cells. J Biol Chem. 2003, 278: 32921-32928. 10.1074/jbc.M306088200
Ohanian J, Liu G, Ohanian V, Heagerty AM: Lipid second messengers derived from glycerolipids and sphingolipids, and their role in smooth muscle function. Acta Physiol Scand. 1998, 164: 533-548.
Subbanagounder G, Watson AD, Berliner JA: Bioactive products of phospholipid oxidation: isolation, identification, measurement and activities. Free Radic Biol Med. 2000, 28: 1751-1761. 10.1016/S0891-5849(00)00233-1
Fruhwirth GO, Moumtzi A, Loidl A, Ingolic E, Hermetter A: The oxidized phospholipids POVPC and PGPC inhibit growth and induce apoptosis in vascular smooth muscle cells. Biochim Biophys Acta. 2006, 1761: 1060-1069. 10.1016/j.bbalip.2006.06.001
Marathe GK, Davies SS, Harrison KA, Silva AR, Murphy RC, Castro-Faria-Neto H, Prescott SM, Zimmerman GA, McIntyre TM: Inflammatory platelet-activating factor-like phospholipids in oxidized low density lipoproteins are fragmented alkyl phosphatidylcholines. J Biol Chem. 1999, 274: 28395-28404. 10.1074/jbc.274.40.28395
Deigner HP, Hermetter A: Oxidized phospholipids: emerging lipid mediators in pathophysiology. Curr Opin Lipidol. 2008, 19: 289-294. 10.1097/MOL.0b013e3282fe1d0e
Fruhwirth GO, Loidl A, Hermetter A: Oxidized phospholipids: from molecular properties to disease. Biochim Biophys Acta. 2007, 1772: 718-736. 10.1016/j.bbadis.2007.04.009
Stemmer U, Ramprecht C, Zenzmaier E, StojÄiÄ B, Rechberger G, Kollroser M, Hermetter A: Uptake and protein targeting of fluorescent oxidized phospholipids in cultured RWA 264.7 macrophages. Biochim Biophys Acta. 2012, 1821: 706-18. 10.1016/j.bbalip.2012.01.014
Stemmer U and Hermetter A: Protein modification by aldehydophospholipids and its functional consequences. Biochim.Biophys.Acta. 2012, 1818: 2436-2445. 10.1016/j.bbamem.2012.03.006
Friedman P, Horkko S, Steinberg D, Witztum JL, Dennis EA: Correlation of antiphospholipid antibody recognition with the structure of synthetic oxidized phospholipids. Importance of Schiff base formation and aldol condensation. J Biol Chem. 2002, 277: 7010-7020. 10.1074/jbc.M108860200
Moumtzi A, Trenker M, Flicker K, Zenzmaier E, Saf R, Hermetter A: Import and fate of fluorescent analogs of oxidized phospholipids in vascular smooth muscle cells. J Lipid Res. 2007, 48: 565-582.
Hermetter A, Stutz H, Franzmair R, Paltauf F: 1-O-Trityl-Sn-Glycero-3-Phosphocholine - A New Intermediate for the Facile Preparation of Mixed-Acid 1, 2-Diacylglycerophosphocholines. Chemistry and Physics of Lipids. 1989, 50: 57-62. 10.1016/0009-3084(89)90026-1.
Batzri S, Korn ED: Single bilayer liposomes prepared without sonication. Biochim Biophys Acta. 1973, 298: 1015-1019. 10.1016/0005-2736(73)90408-2
Huber J, Vales A, Mitulovic G, Blumer M, Schmid R, Witztum JL, Binder BR, Leitinger N: Oxidized membrane vesicles and blebs from apoptotic cells contain biologically active oxidized phospholipids that induce monocyte-endothelial interactions. Arterioscler Thromb Vasc Biol. 2002, 22: 101-107. 10.1161/hq0102.101525
Bradford MM: A rapid and sensitive method for the quantitation of microgram quantities of protein utilizing the principle of protein-dye binding. Anal Biochem. 1976, 72: 248-254. 10.1016/0003-2697(76)90527-3
Fling SP, Gregerson DS: Peptide and protein molecular weight determination by electrophoresis using a high-molarity tris buffer system without urea. Anal Biochem. 1986, 155: 83-88. 10.1016/0003-2697(86)90228-9
Vaskovsky VE, Kostetsky EY: Modified spray for the detection of phospholipids on thin-layer chromatograms. J Lipid Res. 1968, 9: 396-
Loidl A, Claus R, Deigner HP, Hermetter A: High-precision fluorescence assay for sphingomyelinase activity of isolated enzymes and cell lysates. J Lipid Res. 2002, 43: 815-823.
Glass CK, Witztum JL: Atherosclerosis. the road ahead. Cell. 2001, 104: 503-516. 10.1016/S0092-8674(01)00238-0
Schmid HH, Takahashi T: The alk-i-enyl ether and alkyl ether lipids of bovine heart muscle. Biochim Biophys Acta. 1968, 164: 141-147. 10.1016/0005-2760(68)90140-9
Aupeix K, Hugel B, Martin T, Bischoff P, Lill H, Pasquali JL, Freyssinet JM: The significance of shed membrane particles during programmed cell death in vitro, and in vivo, in HIV-1 infection. J Clin Invest. 1997, 99: 1546-1554. 10.1172/JCI119317
Zhang J, Reedy MC, Hannun YA, Obeid LM: Inhibition of caspases inhibits the release of apoptotic bodies: Bcl-2 inhibits the initiation of formation of apoptotic bodies in chemotherapeutic agent-induced apoptosis. J Cell Biol. 1999, 145: 99-108. 10.1083/jcb.145.1.99
Tabas I, Williams KJ, Boren J: Subendothelial lipoprotein retention as the initiating process in atherosclerosis: update and therapeutic implications. Circulation. 2007, 116: 1832-1844. 10.1161/CIRCULATIONAHA.106.676890
Tabas I: Apoptosis and plaque destabilization in atherosclerosis: the role of macrophage apoptosis induced by cholesterol. Cell Death Differ. 2004, 11 (Suppl 1): S12-S16.
Salvayre R, Auge N, Benoist H, Negre-Salvayre A: Oxidized low-density lipoprotein-induced apoptosis. Biochim Biophys Acta. 2002, 1585: 213-221. 10.1016/S1388-1981(02)00343-8
Distler JH, Huber LC, Hueber AJ, Reich CF, Gay S, Distler O, Pisetsky DS: The release of microparticles by apoptotic cells and their effects on macrophages. Apoptosis. 2005, 10: 731-741. 10.1007/s10495-005-2941-5
Rhode S, Grurl R, Brameshuber M, Hermetter A, Schutz GJ: Plasma membrane fluidity affects transient immobilization of oxidized phospholipids in endocytotic sites for subsequent uptake. J Biol Chem. 2009, 284: 2258-2265.
Esterbauer H, Schaur RJ, Zollner H: Chemistry and biochemistry of 4- hydroxynonenal, malonaldehyde and related aldehydes. Free Rad Biol Med. 1991, 11: 81-128. 10.1016/0891-5849(91)90192-6
Ullery JC, Marnett LJ: Protein modification by oxidized phospholipids and hydrolytically released lipid electrophiles: Investigating cellular responses. Biochim Biophys Acta. 2012, 1818: 2424-35. 10.1016/j.bbamem.2012.04.014
Negre-Salvayre A, Auge N, Ayala V, Basaga H, Boada J, Brenke R, Chapple S, Cohen G, Feher J, Grune T, Lengyel G, Mann GE, Pamplona R, Poli G, Portero-Otin M, Riahi Y, Salvayre R, Sasson S, Serrano J, Shamni O, Siems W, Siow RC, Wiswedel I, Zarkovic K, Zarkovic N: Pathological aspects of lipid peroxidation. Free Radic Res. 2010, 44: 1125-71. 10.3109/10715762.2010.498478
Zarkovic N: 4-hydroxynonenal as a bioactive marker of pathophysiological processes. Mol Aspects Med. 2003, 24: 281-91. 10.1016/S0098-2997(03)00023-2
Heery JM, Kozak M, Stafforini DM, Jones DA, Zimmerman GA, McIntyre TM, Prescott SM: Oxidatively modified LDL contains phospholipids with platelet-activating factor-like activity and stimulates the growth of smooth muscle cells. J Clin Invest. 1995, 96: 2322-2330. 10.1172/JCI118288
Marathe GK, Harrison KA, Murphy RC, Prescott SM, Zimmerman GA, McIntyre TM: Bioactive phospholipid oxidation products. Free Radic Biol Med. 2000, 28: 1762-1770. 10.1016/S0891-5849(00)00234-3
Tokumura A, Toujima M, Yoshioka Y, Fukuzawa K: Lipid peroxidation in low density lipoproteins from human plasma and egg yolk promotes accumulation of 1-acyl analogues of platelet-activating factor-like lipids. Lipids. 1996, 31: 1251-1258. 10.1007/BF02587909
Sommer A, Paltauf F, Hermetter A: Dipolar solvent relaxation on a nanosecond time scale in ether phospholipid membranes as determined by multifrequency phase and modulation fluorometry. Biochemistry. 1990, 29: 11134-11140. 10.1021/bi00502a017
Smaby JM, Hermetter A, Schmid PC, Paltauf F, Brockman HL: Packing of Ether and Ester Phospholipids in Monolayers - Evidence for Hydrogen-Bonded Water at the Sn-1 Acyl Group of Phosphatidylcholines. Biochemistry. 1983, 22: 5808-5813. 10.1021/bi00294a019.
Huber LC, Jungel A, Distler JH, Moritz F, Gay RE, Michel BA, Pisetsky DS, Gay S, Distler O: The role of membrane lipids in the induction of macrophage apoptosis by microparticles. Apoptosis. 2007, 12: 363-374. 10.1007/s10495-006-0622-7
Shih PT, Elices MJ, Fang ZT, Ugarova TP, Strahl D, Territo MC, Frank JS, Kovach NL, Cabanas C, Berliner JA, Vora DK: Minimally modified low-density lipoprotein induces monocyte adhesion to endothelial connecting segment-1 by activating beta1 integrin. J Clin Invest. 1999, 103: 613-625. 10.1172/JCI5710
Yang L, Latchoumycandane C, McMullen MR, Pratt BT, Zhang R, Papouchado BG, Nagy LE, Feldstein AE, McIntyre TM: Chronic alcohol exposure increases circulating bioactive oxidized phospholipids. J Biol Chem. 2010, 285: 22211-22220. 10.1074/jbc.M110.119982
Holopainen JM, Lehtonen JY, Kinnunen PK: Lipid microdomains in dimyristoylphosphatidylcholine-ceramide liposomes. Chem Phys Lipids. 1997, 88: 1-13. 10.1016/S0009-3084(97)00040-6
Acknowledgements
This work was financially supported by the Austrian Science Fund FWF (project F30-B05 - special research program SFB Lipotox), ESF EuroMEMBRANE CRP OXPL (project I308-B12) and COST CM0603 (ChemBioradical).
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authorsā contributions
US was involved in study design, manuscript preparation and performed FACS analysis of cell death. ZAD performed viability and cell death measurements. DK measured enzyme activities. EZ synthesized phospholipids. H-P D synthesized enzyme inhibitors. EA and DK contributed cell biology. AH did the conceptual work and participated in study design and manuscript preparation. All authors read and approved the final manuscript.
Authorsā original submitted files for images
Below are the links to the authorsā original submitted files for images.
Rights and permissions
Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Stemmer, U., Dunai, Z.A., Koller, D. et al. Toxicity of oxidized phospholipids in cultured macrophages. Lipids Health Dis 11, 110 (2012). https://doi.org/10.1186/1476-511X-11-110
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/1476-511X-11-110