 |
||||
| 2007 JASN IMPACT FACTOR 7.111 | HOME AUTHOR INFO EDITORIAL BOARD SUBSCRIBE FEEDBACK ALERTS HELP | |||
| CURRENT ISSUE | ARCHIVES | JASN Express | ONLINE SUBMISSION | |
|
||||
| 2007 JASN IMPACT FACTOR 7.111 | HOME AUTHOR INFO EDITORIAL BOARD SUBSCRIBE FEEDBACK ALERTS HELP | |||
| CURRENT ISSUE | ARCHIVES | JASN Express | ONLINE SUBMISSION | |
*Steno Diabetes Center, Gentofte, Denmark and Faculty of Health Science, University of Aarhus, Denmark.
Correspondence to Dr. Peter Jacobsen, Steno Diabetes Center, Niels Steensens Vej 2, 2820 Gentofte, Denmark. Phone: 45-44-43-90-97; Fax: 45-44-43-81-60;
 |
Abstract |
|---|
 Top Abstract IntroductionMaterials and MethodsResultsDiscussionReferences |
|---|
|
Introduction |
|---|
|
TopAbstractIntroductionMaterials and MethodsResultsDiscussionReferences |
|---|
A superior effect on BP and a tendency toward a more pronounced drop in urinary albumin excretion of dual blockade of the RAS compared with single blockade has been reported in type II patients with microalbuminuria (5). We have recently shown additional drop in albuminuria and diastolic BP when adding an angiotensin receptor blocker (ARB) to angiotensin-converting enzyme inhibitor (ACE-I) treatment in type l patients with albuminuria >1 g/24 h and BP >135/85 mmHg, despite conventional antihypertensive therapy including three different agents (6). However, this subgroup is highly selected; therefore, it may differ from the patients in general with DN, especially with regard to RAS activity and sensitivity to blockade of the RAS system. Furthermore, our earlier design as well as others in DN did not include a placebo period; as a consequence, we could not directly compare the effect of dual blockade of the RAS with effectiveness of both monotherapies, which could help elucidate the underlying mechanisms of progression of DN in addition to future treatment strategy.
Therefore, in a placebo-controlled, double-blind, randomized, crossover trial, we tested if dual blockade of the RAS with both an ACE-I and an ARB is superior to either drug alone in a representative group of type I diabetic patients with DN.
|
Materials and Methods |
|---|
|
TopAbstractIntroductionMaterials and MethodsResultsDiscussionReferences |
|---|
Exclusion criteria at start of the study were: plasma potassium > 4.8 mmol/L, pregnancy, no use of contraceptives, age < 18 yr, alcohol or medicine abuse, inability to understand the patient information, contraindication to treatment with ACE-I or ARBs systolic BP < 100 mmHg, GFR < 30 ml/min, heart failure, myocardial infarction, or coronary bypass within the last 6 mo. On the basis of medical records, we invited all (n = 60) potential candidates to participate in the study; 22 accepted and were invited to a screening visit. Twenty fulfilled all inclusion criteria and were included; of these, 18 completed the study (see below).
Design
We performed a randomized, double-blind, placebo-controlled crossover trial. The study consisted of an initial 4-wk single-blind placebo period (run-in) followed by four treatment periods, each lasting 8 wk. Each patient received treatment with placebo, 20 mg of benazepril once daily, 80 mg of valsartan once daily, and the combination of 20 mg of benazepril and 80 mg of valsartan once daily in random order. The computerized randomization was done by the manufacturing company (Novartis Healthcare A/S, Basel, Switzerland). The code was kept in a concealed envelope and not broken until all data were entered in a database after the last patient visit. Patients attended the clinic nine times: one screening visit and subsequently 2 and 8 wk after start of each treatment period. At the screening visit, information on inclusion and exclusion criteria in addition to informed consent were obtained. Then all antihypertensive medication was withdrawn, except for loop diuretics, which were continued unchanged throughout the study to prevent edema. Patients received placebo medication for both benazepril and valsartan during the run-in period. Throughout the whole study, BP was monitored at home by the patients to ensure that the BP did not exceed the safety limits (>160/105 mmHg).
BP, plasma potassium, and plasma creatinine were measured 2 wk after the beginning of each treatment period for safety reasons. At the end of each treatment period, we assessed clinical end points, including the primary end point (albuminuria) and the secondary end points (24-h arterial BP and GFR).
Drug compliance was assessed by tablet counts. The study protocol was in accordance with the Declaration of Helsinki and was approved by the local ethical committee.
Methods
Albuminuria was determined by three consecutive 24-h urine collections, completed immediately before each visit at the end of each treatment period (Turbidimetry, Cobas Mira Plus; Roche, Montclair, NJ). To correct the reduction in 24-h albuminuria for changes in GFR and plasma albumin, we constructed the following "fractional clearance" index: [24-h albuminuria]/([plasma albumin concentration] x [GFR]). In addition, sodium, urea, creatinine, and carbamide excretion in the urine were determined (Cobas Mira Plus).
Arterial BP after each treatment period was assessed by 24-h ambulatory BP measurements with the Takeda TM2420 device; model 6 and 7 (A&D, Medical Inc., Tokyo, Japan). A measurement of the BP was performed every 15 min during daytime (from 7:00 a.m. to 11:00 p.m.) and every 30 min during nighttime (from 11:00 p.m. to 7:00 a.m.) Values were averaged for each hour before calculating the mean 24-h, day and night arterial BP. GFR was measured after a single intravenous injection of 3.7 MBq 51Cr-EDTA at 8:30 a.m. by following the plasma clearance of the tracer for 4 h (9,10 ). Extra renal loss was corrected for by subtracting 3.7 ml/min (11). The small underestimation (10%) of 51Cr-EDTA renal clearance versus renal clearance of inulin was corrected for by multiplying the EDTA clearance by 1.10 (11). The results were standardized for 1.73 m2 body surface area. The mean day-to-day coefficient of variation in GFR is 4% in our laboratory.
From venous samples, hemoglobin, plasma potassium, sodium, creatinine, and fasting cholesterol concentrations were determined. Plasma potassium was measured by an indirect ion-selective method (normal range, 3.2 to 4.7 mmol/L) (BM/HITACHI system; Boehringer Mannheim GmbH, Roche Lab Systems, Mannheim, Germany). Our hemoglobin method has a normal range of 7 to 10 mmol/L in female patients and 8 to 11 mmol/L in male patients (Sysmex SF 3000; Sysmex Corp. Kobe, Japan). Hemoglobin A1c was measured by HPLC (normal range, 4.1 to 6.1%) (Variant; Bio-Rad Laboratories, Hercules, CA). Blood samples for angiotensin II (AngII) levels were drawn in prechilled tubes after 30 min of supine rest and immediately centrifuged at 4°C. Plasma concentrations were measured radioimmunologically (12). Blood samples for renin concentration were taken after 30 min supine rest and measured directly by an improved immunoradiometric assay (13)
Statistical Analyses
Before carrying out the study, we calculated the SD (log scale: 0.1771) of the mean difference in urinary albumin excretion rate in three consecutive 24-h urine samples collected twice within 3 mo in 36 type I patients with DN. On the basis of these data, a sample-size calculation revealed a necessary minimum of 16 patients to detect a 25% difference in change in urinary albumin excretion rate (
= 0.05; 
= 0.80).
Normally distributed variables are expressed as mean (SEM). Values for albuminuria, AngII, and renin were logarithmically transformed and expressed as geometric mean (95% CI) because of their positively skewed distribution. Changes in these variables between different treatments are expressed in percent.
Data were analyzed using linear mixed models (14). The software used was R (http://www.r-project.org) and SPSS 10.0 (SPSS Inc., Chicago, IL). The adapted model was one with fixed effects of treatments, visit and treatment sequence, and a random effect of person included to account for the person-dependencies in data. For the simplest models, the P value and effects correspond to results obtained from paired t test and two-way ANOVA, but these models allows for more elaborate exploration of the material. Tests for presence of effects were performed as likelihood ratio tests, and final estimates were reported as REML estimates (14). We were not able to include type of previous treatment period in the statistical model due to lack of power; we therefore performed additional test for time and carryover effects as described by Altman (15) and compared treatment response in patients starting with placebo with patients treated with active compounds in the first period. Linear regression analyses were made between the changes in arterial BP and the changes in albuminuria: ln [albuminuria during dual blockade/albuminuria during placebo or monotherapy]. P < 0.05 was considered significant (two-tailed).
|
Results |
|---|
|
TopAbstractIntroductionMaterials and MethodsResultsDiscussionReferences |
|---|
Patient characteristics at baseline are shown in Table 1. Two patients had the dose of furosemide doubled during the study, one due to fluid retention during the placebo period (furosemide from 80 mg to 160 mg) and one due to increasing plasma potassium during dual blockade (furosemide from 20 mg to 40 mg).
|
Albuminuria and 24-h BP were significantly reduced by all three types of interruption of the RAS compared with placebo (Table 2). Benazepril and valsartan were equally effective.
|
|
|
|
Linear regression analysis showed a correlation between the change in mean arterial BP and the change in albuminuria when comparing dual blockade with placebo (R = 0.51; P = 0.03) and valsartan treatment (R = 0.65; P < 0.01), but not dual blockade versus benazepril treatment (R = 0.11, P = 0.66).
GFR was reversibly lowered on dual blockade of the RAS compared with both placebo (Table 2) and monotherapies. Treatment with both benazepril and valsartan resulted in a reversible reduction in GFR of 7 (3 to 11) ml/min per 1.73 m2 compared with benazepril (P < 0.01) and 6 (2 to 11) ml/min per 1.73 m2 compared with valsartan (P < 0.01). There was a nonsignificant drop in GFR of 3 (-1 to 7) and 4 (-1 to 8) ml/min per 1.73 m2 on benazepril (P = 0.18) and valsartan (P = 0.10), respectively.
Dual blockade of the RAS induced a significant decline in plasma cholesterol and plasma LDL cholesterol compared with placebo and benazepril (Table 3). No changes were seen in plasma HDL cholesterol and triglyceride.
|
|
|
Discussion |
|---|
|
TopAbstractIntroductionMaterials and MethodsResultsDiscussionReferences |
|---|
The clinical significant decrease in GFR observed in the present study was reversible, because the mean GFR of all the patients in each treatment period was unchanged and an equal number of patients received dual blockade throughout the study (no time/order effect). The finding is in accordance with previous results (16) and is likely to be caused by the changes in systemic BP.
The rationale for dual blockade of the RAS system is based on the different mechanisms of action of the two drug classes. In addition to decreased AngII formation ACE-I decrease the degradation of bradykinin, a powerful vasodilator (17). However, an insufficient response to ACE-I might be explained by incomplete blockade of the ACE enzyme or by the generation of AngII by ACE-independent pathways such as Chymase (18). The incomplete blockade possibly explains the observation that plasma AngII levels return to normal after chronic ACE-I treatment, a phenomenon called ACE-escape (19). Treatment with AngII receptor blockers may result in more complete blockade of the unfavorable actions of AngII mediated through the AngII type 1 receptor. However, new data from animal studies indicate that some of the deleterious effects of AngII on glomerular cell migration, tubular cell proliferation, and development of urinary protein excretion may be mediated through the AngII type 2 receptor (20–22 ). Therefore, treatment with both ACE-I and ARB may offer synergistic blockade of the RAS, not obtainable with either drug alone. The effects of ACE-I and ARB on main end points were almost identical; our study indicates the beneficial effect of interrupting the RAS is mediated solely through blocking the action of AngII and not through the bradykinin or chymase pathways. Instead, our study supports the concept that dual blockade offers more complete blockade of the intrarenal and systemic AngII formation than monotherapy. In accordance, Komine et al. (23) demonstrated in an animal model that dual RAS blockade with captopril (1.7 mg/d) + losartan (0.7 mg/d) treatment further reduces renal tissue AngII level compared with treatment with captopril (2.4 mg/d) or losartan (1.7 mg/d) alone. Furthermore, tripling the dose of captopril (7.5 mg/d) or losartan (6.0 mg/d) did not reduce the intrarenal AngII to the level observed with low-dose dual blockade therapy (23). The lower renal tissue AngII during ARB treatment may be caused by decreased binding to the receptor and internalization of AngII in the presence of ARB and/or increased degradation of AngII. On the other hand, conflicting results from studies of dual blockade of the RAS on BP and urinary protein excretion in subtotally nephrectomized rats have been reported (24,25 ).
The CALM-study of type II diabetic patients with microalbuminuria and hypertension found an enhanced reduction in BP by dual blockade (16 mg candesartan cilexetil and 20 mg lisinopril) compared with therapy with either agent alone (5). The additional effect of combination therapy was a reduction in systolic BP of 10 mmHg and a tendency toward a more pronounced drop in urinary albumin excretion. Once DN has developed, we have recently demonstrated a beneficial short-term effect of dual blockade of the RAS in the subset of type I and type II diabetic patients with diabetic nephropathy responding insufficiently to recommended antihypertensive therapy (6,26 ). As described earlier, these studies were carried out in a different patient category using a different design. In addition, the present study demonstrated an additive effect on albuminuria and BP of combining ACE-I with ARB irrespective of which monotherapy is the initial treatment.
In nondiabetic renal disease, a superior effect of dual blockade compared with single blockade were reported in several short-term open-label studies (27–30 ). The COOPERATE trial (31) is the first long-term trial addressing the effect of dual blockade on primary renal end points. This double-blind randomized study of 263 patients with nondiabetic renal disease demonstrated that 11% of patients on 100 mg of losartan + 3 mg of trandolapril developed doubling of s-creatinine or reached end-stage renal disease during a median of 3 yr of follow-up, whereas 23% reached the primary end points during treatment with either monotherapy (P = 0.02) (31).
The additive effect of benazepril and valsartan on albuminuria, BP, and plasma renin concentration indicate incomplete blockade of the RAS on 20 mg of benazepril or 80 mg of valsartan alone. Therefore, the potential role of dual blockade depends on whether the observed effects in our study could be obtained by increasing the dose of monotherapy. Unfortunately, there are no dose-escalation studies of the antiproteinuric and antihypertensive effect of >100 mg of captopril daily or >20 mg of enalapril/lisinopril/benazepril daily in humans with DN. Patients in the present study received 80 mg of valsartan. No further reduction of urinary albumin excretion rate and BP have been reported when comparing 80 and 160 mg in a 1-yr study of 62 type II patients with microalbuminuria (32). From studies in patients with moderate-to-severe essential hypertension, no evidence of an additional antihypertensive effect of doses of captopril up to 600 mg or enalapril/benazepril up to 80 mg (33–36 ) exists. Increasing the dose of valsartan from 80 to 160 mg resulted in an additional drop in systolic and diastolic BP of < 1 mmHg in mild-to-moderate hypertension (37). Consequently, our findings of an additive effect on albuminuria and BP suggest a more complete blockade of the RAS when using both ACE-I and ARB. Agarwal (38) reported that adding 50 mg of losartan daily to 40 mg of lisinopril daily had no effect on BP and proteinuria in a small heterogeneous group of predominantly severely obese, hypertensive, proteinuric diabetic African Americans with advanced renal failure. Surprisingly this study showed a lowered plasma renin activity and enhanced GFR during losartan on top of ACE-I treatment. Limitations of this study include underdosing with losartan, because 100 mg is more effective than 50 mg on both albuminuria and BP in patients with DN (39). Furthermore, the findings of Agarwal cannot be extrapolated to other ethnic groups due to differences in RAS activity and response to RAS blockade (40,41 ). Therefore, more studies of dual blockade of the RAS including patients treated with maximal recommended doses of ACE-I are needed.
The design of the present study does not allow us to distinguish between a specific antiproteinuric effect of dual blockade of the RAS and the effect of lowering BP per se. To do so, a head-to-head comparison between dual blockade and mono blockade of the RAS in combination with other antihypertensive drugs aiming at identical BP levels is needed. However, the observed relation between changes in BP and changes in albuminuria suggests an important hemodynamic component. This fact does not diminish the importance of our observations, because both reduction in BP and albuminuria is essential treatment goals in diabetic patients with kidney disease. On the other hand, a reduction in albuminuria independent of BP reduction when starting losartan treatment has been suggested in 62 patients with diabetic and nondiabetic renal disease (42).
The lengths of our treatment periods were 8 wk. We cannot be sure if full treatment effects have developed; however, studies in diabetic (43,44 ) and nondiabetic kidney disease (45) have suggested a maximal antiproteinuric and antihypertensive effect of ARB is present after less than 1 mo of treatment.
Crossover trials are vulnerable to time and carryover effects. We found no evidence of any time, carryover, or treatment sequence effect. This is in accordance with our previous study applying identical types and length of treatment periods (although different populations and design) when evaluating the effect of dual blockade therapy (6,26 ).
Our study suggested a beneficial effect dual blockade of the RAS on plasma cholesterol and plasma LDL-cholesterol levels. Studies have found a cholesterol-lowering effect of treatment with ACE-I or ARB in type I diabetic patients with DN (46,47 ). The reduction in albuminuria is probably the main reason underlying our findings, as documented for patients obtaining reversal of nephrotic syndrome (48). If confirmed, a beneficial impact of dual blockade on lipid profile may further contribute to long-term renal and cardiovascular protection.
In conclusion, our short-term study suggests that treatment with both ACE-I and ARB in recommended doses offer additive renal and cardiovascular protection in type I patients with DN.
|
Acknowledgments |
|---|
The authors wish to express appreciation to Tina R. Juhl, Birgitte V. Hansen, Ulla M. Smidt, and Inge-Lise Rossing for technical assistance.
|
References |
|---|
|
TopAbstractIntroductionMaterials and MethodsResultsDiscussionReferences |
|---|
This article has been cited by other articles:
 |
|
 |
|
  S. Basi, P. Fesler, A. Mimran, and J. B. Lewis Microalbuminuria in Type 2 Diabetes and Hypertension: A marker, treatment target, or innocent bystander? Diabetes Care, February 1, 2008; 31(Supplement_2): S194 - S201. [Full Text] [PDF]
|
|
|
|
 |
|
 R. Kunz, C. Friedrich, M. Wolbers, and J. F.E. Mann Meta-analysis: Effect of Monotherapy and Combination Therapy with Inhibitors of the Renin-Angiotensin System on Proteinuria in Renal Disease Ann Intern Med, January 1, 2008; 148(1): 30 - 48. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. L. Linas Are Two Better Than One? Angiotensin-Converting Enzyme Inhibitors Plus Angiotensin Receptor Blockers for Reducing Blood Pressure and Proteinuria in Kidney Disease Clin. J. Am. Soc. Nephrol., January 1, 2008; 3(Supplement_1): S17 - S23. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 F. F. Hou, D. Xie, X. Zhang, P. Y. Chen, W. R. Zhang, M. Liang, Z. J. Guo, and J. P. Jiang Renoprotection of Optimal Antiproteinuric Doses (ROAD) Study: A Randomized Controlled Study of Benazepril and Losartan in Chronic Renal Insufficiency J. Am. Soc. Nephrol., June 1, 2007; 18(6): 1889 - 1898. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
W. B.A. Eijkelkamp, Z. Zhang, G. Remuzzi, H.-H. Parving, M. E. Cooper, W. F. Keane, S. Shahinfar, G. W. Gleim, M. R. Weir, B. M. Brenner, et al. Albuminuria Is a Target for Renoprotective Therapy Independent from Blood Pressure in Patients with Type 2 Diabetic Nephropathy: Post Hoc Analysis from the Reduction of Endpoints in NIDDM with the Angiotensin II Antagonist Losartan (RENAAL) Trial J. Am. Soc. Nephrol., May 1, 2007; 18(5): 1540 - 1546. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
G. Fernandez-Juarez, V. Barrio, S. G. de Vinuesa, M. Goicoechea, M. Praga, and J. Luno Dual Blockade of the Renin-Angiotensin System in the Progression of Renal Disease: The Need for More Clinical Trials J. Am. Soc. Nephrol., December 1, 2006; 17(12_suppl_3): S250 - S254. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. A. Griffin and A. K. Bidani Progression of Renal Disease: Renoprotective Specificity of Renin-Angiotensin System Blockade Clin. J. Am. Soc. Nephrol., September 1, 2006; 1(5): 1054 - 1065. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 T. Kobayashi, Y. Hayashi, K. Taguchi, T. Matsumoto, and K. Kamata ANG II enhances contractile responses via PI3-kinase p110{delta} pathway in aortas from diabetic rats with systemic hyperinsulinemia Am J Physiol Heart Circ Physiol, August 1, 2006; 291(2): H846 - H853. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 P. K. Jacobsen, P. Rossing, and H.-H. Parving Impact of renin angiotensin system blockade on night to day blood pressure ratio in diabetic nephropathy Nephrol. Dial. Transplant., July 1, 2006; 21(7): 2030 - 2031. [Full Text] [PDF]
|
|
|
|
 |
|
 S. G. Tsouli, E. N. Liberopoulos, D. N. Kiortsis, D. P. Mikhailidis, and M. S. Elisaf Combined Treatment With Angiotensin-Converting Enzyme Inhibitors and Angiotensin II Receptor Blockers: A Review of the Current Evidence Journal of Cardiovascular Pharmacology and Therapeutics, March 1, 2006; 11(1): 1 - 15. [Abstract] [PDF]
|
|
|
|
|
|
J. H. Song, S. H. Cha, H. J. Lee, S. W. Lee, G. H. Park, S. W. Lee, and M.-J. Kim Effect of low-dose dual blockade of renin-angiotensin system on urinary TGF-{beta} in type 2 diabetic patients with advanced kidney disease Nephrol. Dial. Transplant., March 1, 2006; 21(3): 683 - 689. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 L. J. Coppey, E. P. Davidson, T. W. Rinehart, J. S. Gellett, C. L. Oltman, D. D. Lund, and M. A. Yorek ACE Inhibitor or Angiotensin II Receptor Antagonist Attenuates Diabetic Neuropathy in Streptozotocin-Induced Diabetic Rats Diabetes, February 1, 2006; 55(2): 341 - 348. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 P. De, G. Das, K. Harley, and H. Nair Review: Dual blockade of renin-angiotensin system in diabetic nephropathy: review of literature and local experience The British Journal of Diabetes & Vascular Disease, January 1, 2006; 6(1): 23 - 28. [Abstract] [PDF]
|
|
|
|
 |
|
 T. W.R. Doulton, F. J. He, and G. A. MacGregor Systematic Review of Combined Angiotensin-Converting Enzyme Inhibition and Angiotensin Receptor Blockade in Hypertension Hypertension, May 1, 2005; 45(5): 880 - 886. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
N. H. Andersen, Per. L Poulsen, S. T. Knudsen, S. H. Poulsen, H. Eiskjaer, K. W. Hansen, K. Helleberg, and C. E. Mogensen Long-Term Dual Blockade With Candesartan and Lisinopril in Hypertensive Patients With Diabetes: The CALM II study Diabetes Care, February 1, 2005; 28(2): 273 - 277. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S M Marshall Recent advances in diabetic nephropathy Postgrad. Med. J., November 1, 2004; 80(949): 624 - 633. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. D Coyle, S. F Gardner, and C M. White The Renal Protective Effects of Angiotensin II Receptor Blockers in Type 2 Diabetes Mellitus Ann. Pharmacother., October 1, 2004; 38(10): 1731 - 1738. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. Erman, S. Veksler, U. Gafter, G. Boner, C. Wittenberg, and D. J. van Dijk Renin-angiotensin system blockade prevents the increase in plasma transforming growth factor {beta}1, and reduces proteinuria and kidney hypertrophy in the streptozotocin-diabetic rat Journal of Renin-Angiotensin-Aldosterone System, September 1, 2004; 5(3): 146 - 151. [Abstract] [PDF]
|
|
|
|
|
|
V. L Wade and B. L Gleason Dual Blockade of the Renin-Angiotensin System in Diabetic Nephropathy Ann. Pharmacother., July 1, 2004; 38(7): 1278 - 1282. [Abstract] [Full Text] [PDF]
|
|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
