Volume 2013, Issue 1 232170
Research Article
Open Access

Proximal Point Algorithms for Finding a Zero of a Finite Sum of Monotone Mappings in Banach Spaces

H. Zegeye

H. Zegeye

Departement of Mathematics, University of Botswana, Private Bag 00704, Gaborone, Botswana ub.bw

Search for more papers by this author
N. Shahzad

Corresponding Author

N. Shahzad

Department of Mathematics, King Abdulaziz University, P.O. Box 80203, Jeddah 21589, Saudi Arabia kau.edu.sa

Search for more papers by this author
First published: 16 May 2013
Academic Editor: Yisheng Song

Abstract

We introduce an iterative process which converges strongly to a zero of a finite sum of monotone mappings under certain conditions. Applications to a convex minimization problem are included. Our theorems improve and unify most of the results that have been proved in this direction for this important class of nonlinear mappings.

1. Introduction

Let C be a nonempty subset of a real Banach space E with dual E*. A mapping A : CE* is said to be monotone if for each x, yC, the following inequality holds:
()
A monotone mapping AE × E* is said to be maximal monotone if its graph is not properly contained in the graph of any other monotone mapping. We know that if A is maximal monotone mapping, then A−1(0) is closed and convex (see [1] for more details).
Monotone mappings were introduced by Zarantonello [2], Minty [3], and Kačurovskiĭ [4]. The notion of monotone in the context of variational methods for nonlinear operator equations was also used by Vaĭnberg and Kačurovskiĭ [5]. The central problem is to iteratively find a zero of a finite sum of monotone mappings A1, A2, …, AN in a Banach space E, namely, a solution to the inclusion problem
()
It is known that many physically significant problems can be formulated as problems of the type (2). For instance, a stationary solution to the initial value problem of the evolution equation
()
can be formulated as (2) when the governing maximal monotone F is of the form F : = A1 + A2 + ⋯+AN (see, e.g., [6]). In addition, optimization problems often need [7] to solve a minimization problem of the form
()
where fi, i = 1,2, …, N are proper lower semicontinuous convex functions from E to the extended real line . If in (2), we assume that Ai : = fi, for i = 1,2, …, N, where fi is the subdifferential operator of fi in the sense of convex analysis, then (4) is equivalent to (2). Consequently, considerable research efforts have been devoted to methods of finding approximate solutions (when they exist) of equations of the form (2) for a sum of a finite number of monotone mappings (see, e.g., [6, 812]).
A well-known method for solving the equation 0 ∈ Ax in a Hilbert space H is the proximal point algorithm: x1 = xH and
()
where rn ⊂ (0, ) and Jr = (I + rA) −1 for all r > 0. This algorithm was first introduced by Martinet [10]. In 1976, Rockafellar [11] proved that if liminf nrn > 0 and A−1(0) ≠ , then the sequence {xn} defined by (5) converges weakly to an element of A−1(0). Later, many researchers have studied the convergence of the sequence defined by (5) in Hilbert spaces; see, for instance, [8, 1218] and the references therein.
In 2000, Kamimura and Takahashi [9] proved that for a maximal monotone mapping A in a Hilbert spaces H and Jr = (I + rA) −1 for all r > 0, the sequence {xn} defined by
()
where {αn}⊂[0,1] and {rn}⊂(0, ) satisfy certain conditions, called Halpern type, converges strongly to a point in A−1(0).
In a reflexive Banach space E and for a maximal monotone mapping , Reich and Sabach [19] proved that the sequence {xn} defined by
()
where λn > 0 and is the Bergman projection of E on to a closed and convex subset CE induced by a well-chosen convex function f, converges strongly to a point in A−1(0).

Furthermore, many authors (see, e.g., [12, 2025]) have studied strong convergence of an iterative process of Halpern type or proximal type to a common zero of a finite family of maximal monotone mappings in Hilbert spaces (or in Banach spaces).

Regarding iterative solution of a zero of sum of two maximal monotone mappings, Lions and Mercier [6] introduced the nonlinear Douglas-Rachford splitting iterative algorithm which generates a sequence {vn} by the recursion
()
where denotes the resolvent of a monotone mapping T; that is, . They proved that the nonlinear Douglas-Rachford algorithm (8) converges weakly to a point v, a solution of the inclusion,
()
for A + B maximal monotone mappings in Hilbert spaces.

A natural question arises whether we can obtain an iterative scheme which converges strongly to a zero of sum of a finite number of monotone mappings in Banach spaces or not?

Motivated and inspired by the work mentioned above, it is our purpose in this paper to introduce an iterative scheme (see (21)) which converges strongly to a zero of a finite sum of monotone mappings under certain conditions. Applications to a convex minimization problem are included. Our theorems improve the results of Lions and Mercier [6] and most of the results that have been proved in this direction.

2. Preliminaries

Let E be a Banach space and let S(E) = {xE : ∥x∥ = 1}. Then, a Banach space E is said to be smooth provided that the limit
()
exists for each x, yS(E). The norm of E is said to be uniformly smooth if the limit (10) is attained uniformly for (x, y) in S(E) × S(E) (see [1]).
The modulus of convexity of E is the function δE : (0,2]→[0,1] defined by
()
E is called uniformly convex if and only if δE(ϵ) > 0, for every ϵ ∈ (0,2] (see [26]).

Lemma 1 (see [27].)Let E be a smooth, strictly convex, and reflexive Banach space. Let C be a nonempty closed convex subset of E, and let A : CEE* be a monotone mapping. Then, A is maximal if and only if R(J + rA) = E*, for all r > 0, where J is the normalized duality mapping from E into defined, for each xE, by

()
where 〈·, ·〉 denotes the generalized duality pairing between members of E and E*. We recall that E is smooth if and only if J is single valued (see [1]). If E = H, a Hilbert space, then the duality mapping becomes the identity map on H.

Lemma 2 (see [27].)Let E be a reflexive with E* as its dual. Let A : D(A)⊆EE*, and let B : D(B)⊆EE* be maximal monotone mappings. Suppose that D(A)∩int D(B) ≠ . Then, A + B is a maximal monotone mapping.

Lemma 3 (see [28].)Let E be a reflexive with E* as its dual. Let A : D(A)⊆EE* be maximal monotone mapping, and let B : D(B)⊆EE* be monotone mappings such that D(B) = E, B is hemicontinuous (i.e., continuous from the segments in E to the weak star topology in E*) and carries bounded sets into bounded sets. Then, A + B is maximal monotone mapping.

Let E be a smooth Banach space with dual E*. Let the Lyapunov function ϕ : E × E, introduced by Alber [29], be defined by
()
where J is the normalized duality mapping from E into . If E = H, a Hilbert space, then (13) reduces to ϕ(x, y) = ∥xy2, for x, yH.
Let E be a reflexive, strictly convex, and smooth Banach space, and let C be a nonempty closed and convex subset of E. The generalized projection mapping, introduced by Alber [29], is a mapping ΠC : EC that assigns an arbitrary point xE to the minimizer, , of ϕ(·, x) over C; that is, , where is the solution to the minimization problem
()
We know the following lemmas.

Lemma 4 (see [23].)Let E be a real smooth and uniformly convex Banach space, and let {xn} and {yn} be two sequences of E. If either {xn} or {yn} is bounded and ϕ(xn, yn) → 0, as n, then xnyn → 0, as n.

Lemma 5 (see [29].)Let C be a convex subset of a real smooth Banach space E, and let xE. Then x0 = ΠCx if and only if

()

We make use of the function V : E × E* defined by
()
studied by Alber [29]. That is, V(x, y) = ϕ(x, J−1x*), for all xE and x*E*.

In the sequel, we will make use of the following lemmas.

Lemma 6 (see [29].)Let E be a reflexive strictly convex and smooth Banach space with E* as its dual. Then,

()
for all xE and x*, y*E*.

Lemma 7 (see [30].)Let E be a smooth and strictly convex Banach space, C be a nonempty closed convex subset of E, and AE × E* be a maximal monotone mapping. Let Qr be the resolvent of A defined by Qr = (J + rA) −1J, for r > 0 and {rn} a sequence of (0, ) such that limnrn = . If {xn} is a bounded sequence of C such that , then zA−1(0).

Lemma 8 (see [31].)Let E be a smooth and strictly convex Banach space, C be a nonempty closed convex subset of E, and AE × E* be a maximal monotone mapping, and A−1(0) is nonempty. Let Qr be the resolvent of A defined by Qr = (J + rA) −1J, for r > 0. Then, for each r > 0

()
for all pA−1(0) and xC.

Lemma 9 (see [32].)Let {an} be a sequence of nonnegative real numbers satisfying the following relation:

()
where {αn}⊂(0,1) and {δn} ⊂ R satisfying the following conditions: lim nαn = 0, , and limsup nδn ≤ 0. Then, lim nan = 0.

Lemma 10 (see [33].)Let {an} be the sequences of real numbers such that there exists a subsequence {ni} of {n} such that , for all iN. Then, there exists a nondecreasing sequence {mk} ⊂ N such that mk, and the following properties are satisfied by all (sufficiently large) numbers kN:

()
In fact, mk = max {jk : aj < aj+1}.

3. Main Result

Theorem 11. Let C and D be nonempty, closed and convex subsets of a smooth and uniformly convex real Banach space E with E* as its dual. Assume that C∩int (D) ≠ . Let A1 : CE* and A2, A3, …, AN : DE* be maximal monotone mappings. Assume that F : = (A1 + A2 + ⋯+AN) −1(0) is nonempty. Let {xn} be a sequence generated by

()
where A = A1 + A2 + ⋯+AN, αn ∈ (0,1) and {rn} a sequence of (0, ) satisfying: lim nαn = 0, , and lim nrn = . Then, {xn} converges strongly to p = ΠF(w).

Proof. Observe that by Lemma 2, we have that A2 + A3 + ⋯+AN is maximal monotone. In addition, since C∩int (D) ≠ , the same lemma implies that A = A1 + A2 + ⋯+AN is maximal monotone. Now, let p = ΠF(w), and let . Then, we have that xn+1 = J−1(αnJw + (1 − αn)Jwn), and since pA−1(0), from Lemma 8, we get that

()
Now from (21), property of ϕ, and (22) we get that
()
Thus, by induction,
()
which implies that {xn} is bounded. In addition, using Lemma 6 and property of ϕ, we obtain that
()
Furthermore, using property of ϕ and the fact that αn → 0, as n, imply that
()
which implies from Lemma 4 that
()
Now, following the method of proof of Lemma 3.2 of Maing’e [33], we consider two cases.

Case 1. Suppose that there exists n0 such that {ϕ(p, xn)} is nonincreasing for all nn0. In this situation, {ϕ(p, xn)} is convergent. Since {xn+1} is bounded and E is reflexive, we choose a subsequence of {xn+1} such that and . Then, from (27), we get that

()
Thus, by Lemma 7, we get that zA−1(0), and hence zF = (A1 + A2 + ⋯+AN) −1(0). Therefore, by Lemma 5, we immediately obtain that . It follows from Lemma 9 and (25) that ϕ(p, xn) → 0, as n. Consequently, xnp.

Case 2. Suppose that there exists a subsequence {ni} of {n} such that

()
for all i. Then, by Lemma 10, there exist a nondecreasing sequence {mk} ⊂ such that mk, satisfying
()
Thus, following the method of proof of Case 1, we obtain that
()
Then, from (25), we have that
()

Now, inequalities (30) and (32) imply that

()
In particular, since , we get
()
Then, from (31), we obtain , as k. This together with (32) gives , as k. But , for all kN; thus, we obtain that xkp. Therefore, from the above two cases, we can conclude that {xn} converges strongly to p, and the proof is complete.

Theorem 12. Let C be a nonempty, closed, and convex subset of a smooth and uniformly convex real Banach space E with E* as its dual. Let A1 : CE* be maximal monotone mapping, and let A2, A3, …, AN : EE* be bounded and hemicontinuous monotone mappings. Assume that F : = (A1 + A2 + ⋯+AN) −1(0) is nonempty. Let {xn} be a sequence generated by

()
where A = A1 + A2 + ⋯+AN, αn ∈ (0,1) and {rn} is a sequence of (0, ) satisfying: lim nαn = 0, , and lim nrn = . Then, {xn} converges strongly to p = ΠF(w).

Proof. By Lemma 3, we have that A = A1 + A2 + ⋯+AN is maximal monotone, and hence following the method of proof of Theorem 11, we obtain the required assertion.

If in Theorem 12, we assume that Ai, for i = 2, …, N, are continuous monotone mappings, then are hemicontinuous, and hence we get the following corollary.

Corollary 13. Let C be a nonempty, closed, and convex subset of a smooth and uniformly convex real Banach space E with E* as its dual. Let A1 : CE* be a maximal monotone mapping, and let A2, A3, …, AN : EE* be bounded and continuous monotone mappings. Assume that F : = (A1 + A2 + ⋯+AN) −1(0) is nonempty. Let {xn} be a sequence generated by

()
where A = A1 + A2 + ⋯+AN, αn ∈ (0,1) and {rn} a sequence of (0, ) satisfying: lim nαn = 0, , and lim nrn = . Then, {xn} converges strongly to p = ΠF(w).

If in Theorem 12, we assume that Ai, for i = 2, …, N, are uniformly continuous monotone mapping, then are bounded and hemicontinuous, and hence we get the following corollary.

Corollary 14. Let C be a nonempty, closed, and convex subset of a smooth and uniformly convex real Banach space E with E* as its dual. Let A1 : CE* be a maximal monotone mapping, and let A2, A3, …, AN : EE* be monotone uniformly continuous mappings. Assume that F : = (A1 + A2 + ⋯+AN) −1(0) is nonempty. Let {xn} be a sequence generated by

()
where A = A1 + A2 + ⋯+AN, αn ∈ (0,1) and {rn} a sequence of (0, ) satisfying: lim nαn = 0, , and lim nrn = . Then, {xn} converges strongly to p = ΠF(w).

If in Theorem 12 we assume that Ai ≡ 0, for i = 2, …, N, then we get the following corollary.

Corollary 15. Let C be a nonempty, closed, and convex subset of a smooth and uniformly convex real Banach space E. Let A : CE* be a maximal monotone mapping. Assume that F : = A−1(0) is nonempty. Let {xn} be a sequence generated by

()
where αn ∈ (0,1) and {rn} a sequence of (0, ) satisfying: lim nαn = 0, , and lim nrn = . Then, {xn} converges strongly to p = ΠF(w).

If E = H, a real Hilbert space, then E is smooth and uniformly convex real Banach space. In this case, J = I, identity map on H and ΠC = PC, projection mapping from H onto C. Thus, the following corollaries follow from Theorems 11 and 12.

Corollary 16. Let C and D be nonempty, closed, and convex subsets of a real Hilbert space H. Assume that C∩int (D) ≠ . Let A1 : CH, and let A2, A3, …, AN : DH be maximal monotone mappings. Assume that F : = (A1 + A2 + ⋯+AN) −1(0) is nonempty. Let {xn} be a sequence generated by

()
where A = A1 + A2 + ⋯+AN, αn ∈ (0,1) and {rn} a sequence of (0, ) satisfying: lim nαn = 0, , and lim nrn = . Then, {xn} converges strongly to p = PF(w).

Corollary 17. Let C be a nonempty, closed, and convex subset of a real Hilbert space H. Let A1 : CH be a maximal monotone mapping, and let A2, A3, …, AN : HH be bounded, hemicontinuous, and monotone mappings. Assume that F : = (A1 + A2 + ⋯+AN) −1(0) is nonempty. Let {xn} be a sequence generated by

()
where A = A1 + A2 + ⋯+AN, αn ∈ (0,1) and {rn} a sequence of (0, ) satisfying: lim nαn = 0, , and lim nrn = . Then, {xn} converges strongly to p = PF(w).

Corollary 18. Let C be a nonempty, closed, and convex subset of a real Hilbert space H. Let A1 : CH be a maximal monotone mapping, and let A2, A3, …, AN : HH be uniformly continuous monotone mappings. Assume that F : = (A1 + A2 + ⋯+AN) −1(0) is nonempty. Let {xn} be a sequence generated by

()
where A = A1 + A2 + ⋯+AN, αn ∈ (0,1) and {rn} a sequence of (0, ) satisfying: lim nαn = 0, , and lim nrn = . Then, {xn} converges strongly to p = PF(w).

4. Application

In this section, we study the problem of finding a minimizer of a continuously Fréchet differentiable convex functional in Banach spaces. The followings are deduced from Theorems 11 and 12.

Theorem 19. Let C and D be a nonempty, closed, and convex subsets of a smooth and uniformly convex real Banach space E. Let C∩int (D) ≠ . Let f be a continuously Fréchet differentiable convex functional, and let ∇f be maximal monotone on C. Let g be a continuously Fréchet differentiable convex functional, and let ∇g be maximal monotone on D. Assume that F : = (∇f + ∇g) −1(0) = {zE : f(z) + g(z) = inf yE{f(y) + g(y)}} ≠ . Let {xn} be a sequence generated by

()
where αn ∈ (0,1) and {rn} a sequence of (0, ) satisfying: lim nαn = 0, , and lim nrn = . Then, {xn} converges strongly to an element of F.

Theorem 20. Let C be a nonempty, closed, and convex subset of a smooth and uniformly convex real Banach space. Let f be a continuously Fréchet differentiable convex functional, and let ∇f be maximal monotone on C. Let g be a continuously Fréchet differentiable convex functional, and let ∇g be bounded, hemicontinuous, and monotone on E with F : = (∇f + ∇g) −1(0) = {zE : f(z) + g(z) = inf yE{f(y) + g(y)}} ≠ . Let {xn} be a sequence generated by

()
where αn ∈ (0,1) and {rn} a sequence of (0, ) satisfying: lim nαn = 0, , and lim nrn = . Then, {xn} converges strongly to an element of F.

Remark 21. Our results provide strong convergence theorems for finding a zero of a finite sum of monotone mappings in Banach spaces and hence extend the results of Rockafellar [11], Kamimura and Takahashi [9], and Lions and Mercier [6].

Acknowledgments

The authors thank the referee for his comments that considerably improved the paper. The research of N. Shahzad was partially supported by Deanship of Scientific Research (DSR), King Abdulaziz University, Jeddah, Saudi Arabia.

      The full text of this article hosted at iucr.org is unavailable due to technical difficulties.