Volume 2012, Issue 1 207323
Research Article
Open Access

A Perturbed Projection Algorithm with Inertial Technique for Split Feasibility Problem

Yazheng Dang

Corresponding Author

Yazheng Dang

School of Management, University of Shanghai for Science and Technology, 516 Jungong Road, Shanghai 200093, China

Department of Mathematics and Information Science, Henan Polytechnic University, Henan 454001, China

Search for more papers by this author
Yan Gao

Yan Gao

School of Management, University of Shanghai for Science and Technology, 516 Jungong Road, Shanghai 200093, China

Search for more papers by this author
Yanli Han

Yanli Han

School of Management, University of Shanghai for Science and Technology, 516 Jungong Road, Shanghai 200093, China

Department of Mathematics and Information Science, Henan Polytechnic University, Henan 454001, China

Search for more papers by this author
First published: 29 May 2012
Citations: 3
Academic Editor: Giuseppe Marino

Abstract

This paper deals with the split feasibility problem that requires to find a point closest to a closed convex set in one space such that its image under a linear transformation will be closest to another closed convex set in the image space. By combining perturbed strategy with inertial technique, we construct an inertial perturbed projection algorithm for solving the split feasibility problem. Under some suitable conditions, we show the asymptotic convergence. The results improve and extend the algorithms presented in Byrne (2002) and in Zhao and Yang (2005) and the related convergence theorem.

1. Introduction

Let CRn and QRm be nonempty closed convex sets, and let A be an m × n real matrix. The split feasibility problem (SFP) is to find a point
()
This problem was first presented and analyzed by Censor and Elfving [1] and appeared in signal processing, image reconstruction [2], and so on. Many well-known iterative algorithms for solving (1.1) were established, see the papers [35]. Denoted by PS, the orthogonal projection operator onto convex set S, that is
()
where ∥·∥ indicates the 2-norm. The CQ algorithm proposed by Byrne in [6] has the following iterative process:
()
where γ ∈ (0,2/L), L denotes the largest eigenvalue of the matrix ATA, and I is the identity operator.
In some cases, it is difficult or even impossible to compute orthogonal projection; to avoid computing projection, Zhao and Yang in [7] proposed the perturbed projections algorithm for the SFP. This development was based on results of Santos and Scheimberg [8] who suggested replacing each nonempty closed convex set of the convex feasibility problem by a convergent sequence of supersets. If such supersets can be constructed with reasonable efforts and projecting onto them is simpler than projecting onto the original convex sets, then a perturbed algorithm is favorable. The concrete iterative process of perturbed CQ algorithm [7] is as follows:
()
where αk ∈ [0,1], γ ∈ (0,2/L), L, I defined as in algorithm (1.3), and and (see the definitions in the Section 2), while the perturbed projections algorithm sometime converges slowly by reason of using only the current point to get the next iterative point.

Many papers have studied the inertial-type extrapolation recently, see [912], which uses the term θk and the two previous iterative points xk−1, xk to get the next iterative point xk+1. As an acceleration process, it can considerably improve the speed of convergence for the following causes: one is that the vector xkxk−1 acts as an impulsion term, the other is that the parameter θk acts as a speed regulator.

To the best of our knowledge, no publications deal with perturbed projection algorithm and inertial process simultaneously. In this paper, we apply the inertial technique to the perturbed projection algorithm to get a perturbed inertial projection algorithm for the split feasibility problem. The results improve and extend the algorithms presented in [6] and in [7] and the related convergence theorem.

The paper is organized as follows. In Section 2, some preliminaries are given. The inertial perturbed algorithm and the corresponding convergence theorem for the split feasibility problem are presented in Section 3.

2. Preliminaries

Throughout the rest of the paper, I denotes the identity operator, Fix (T) denotes the fixed points of an operator T, that is, Fix (T)∶ = {xx = T(x)}.

An operator T is said to be nonexpansive (ne) if
()
It is well known that the projection operator is nonexpansive.

Recall the following notions of the convergence and ρ-distance.

Definition 2.1. Let N be an operator on a Hilbert space H; let Nk, k = 0,1, 2, … be a family of operators on a Hilbert space. {Nk} is said to be convergent to N if ∥Nk(x) − N(x)∥ → 0 as k → + for all xH.

Definition 2.2. The ρ-distance (ρ ≥ 0) for operators N1 and N2 on H is given by

()

Now we introduce the Mosco-convergence for sequences of sets in a reflexive Banach space.

Definition 2.3 (see [13].)Let X be a reflexive Banach space and C and {Ck} kN (N is a set of natural numbers) a sequence of subsets of X. The sequence {Ck} kN is Mosco-convergent to C, denoted by , if

()
where Xs and Xw denote the strong and weak topologies, respectively. In particular, if {Ck} and C are in Rn, then is equivalent to
()

Using the notation NCCS(Rn) for the family of nonempty closed convex subsets of Rn, let C and Ck be sets in NCCS(Rn), for k = 0,1, …. It is easy to verify that if the sequence {Ck} converges to C in the Mosco sense, then the operator sequence converges to PC.

Definition 2.4. Let C1 and C2 be elements in NCCS(Rn). The ρ-distance is defined by

()

Let C and Ck be sets in NCCS(Rn), then if and only if dρ(Ck, C) → 0 for all ρ ≥ 0.

The following lemmas will be used in convergence analysis later on.

Lemma 2.5 (see [14].)Let {δk} and {γk} be nonnegative sequences satisfying ∑kδk < + and γk+1γk + δk, k = 0,1, …. Then, {γk} is a convergent sequence.

Lemma 2.6 (see [10].)Let ϕk ∈ [0, ), k = 1,2, …, and δk ∈ [0, ), k = 1,2, … satisfying

  • (1) ϕk+1ϕkθk(ϕkϕk−1) + δk,

  • (2) ∑kδk < ,

  • (3) θk ∈ [0, θ], k = 1,2, …, where θ ∈ [0,1).

Then, {ϕk} is a converging sequence and , where (t) +∶ = max  {t, 0} for any tR.

Lemma 2.7 (Opial [15]). Let H be a Hilbert space, and let {xk} be a sequence in H such that there exists a nonempty set SH satisfying:

  • (1) for every x*S,   lim k ∥xkx*∥ exists,

  • (2) any weak cluster point of {xk} belongs to S.

Then, there exists such that {xk} weakly converges to .

Lemma 2.8 (see [15].)Let H be a Hilbert space, T : HH a nonexpansive operator, and y a weak cluster point of a sequence {xk}, and let ∥T(xk) − xk∥ → 0. Then y ∈ Fix (T).

3. The Inertial Perturbed Algorithm and the Asymptotic Convergence for the SPF

Let C and Ck be sets in NCCS(Rn), and let Q and Qk be sets in NCCS(Rm), for k = 0,1, …, with and . Then dρ(Ck, C) → 0 and dρ(Qk, Q) → 0 for all ρ > 0. We denote
()
From Lemma  3.1 in [5], we know that x* solves the SFP (1.1) if and only if x* ∈ Fix (N).

It is well known that the operator AT(IPQ)A is λ-Lipschitz continuous with λ = ρ(ATA). The same is true for the operators for k = 0,1, …; it is easy to obtain the following conclusion.

Lemma 3.1 (see [7].)Let C and Ck be sets in NCCS(Rn), and let Q and Qk be sets in NCCS(Rm), for k = 0,1, …, with and . Then, the operators N and Nk defined in (3.1) are nonexpansive operators for γ ∈ (0, 2/λ). Moreover, the operator sequence {Nk} converges to N.

Now we give the perturbed inertial KM-type algorithm for SFP.

Algorithm 3.2. Given arbitrary elements in Rn for k = 0,1, …, let

()
where , αk ∈ (0,1), for any k and γ ∈ (0, 2/λ) with λ = ρ(ATA), {θk}⊂[0, θ], θ ∈ [0.1).

The following theorem is necessary for the convergence analysis of Algorithm 3.2.

Theorem 3.3. Let N and Nk for k = 0,1, 2, … be nonexpansive (ne) operators in finite-dimensional Hilbert space, with NkN, and let {αk} be a sequence in (0,1) satisfying

()
()
for all ρ > 0. Then, the sequence {xk} defined by the iterative step
()
()
converges to a fixed point of N provided that we choose parameter θk satisfying
()
whenever such fixed points exist.

Proof. We first prove that the sequence {xk} is bounded and {∥xkz∥} is convergent for all z ∈ Fix (N), where Fix (N) denotes the set of the fixed points of the operator N, that is, N(z) = z. Since N and Nk are ne operators, we have

()
where . From the selection of parameter θk, we have
()
It is easy to get
()
By (3.4), (3.8)-(3.10), we obtain from Lemma 2.5 that the sequence {∥xkz∥} is convergent and hence the sequence {xk} is bounded.

We next prove that lim  inf k ∥ykN(yk)∥ = 0. Let ek = Nk(yk) − N(yk) and notice the fact that

()
Then, we have
()
From (3.6), we obtain
()
By (3.12) and observing that (since θk ∈ [0,1]), we have
()
Combining 〈a, b〉 = −(1/2)∥ab2 + (1/2)∥a2 + (1/2)∥b2 with (3.14), we get
()
We have known that the sequence {xk} is bounded and {∥xkz∥} is convergent; hence, there exist and G > 0 such that ∥xk∥ ≤ ρ and ∥xkz∥ ≤ G for all k.

Thus

()
Moreover, one has that
()
Denoting
()
we get
()
Similarly, from the selection of parameter θk, we have
()
It is easy to get
()
Both (3.10) and (3.21) manifest
()
Then, from (3.4), (3.21), and (3.22), we get
()
According to Lemma 2.6, we obtain .

From (3.17), it follows that

()
Because of (3.3) , we conclude that lim  inf k ∥ykN(yk)∥ = 0.

Finally, we prove that {xk} converges to a fixed point of N. From the above computation, we know that the sequence {yk} is also bounded; hence there exist x* and a subsequence of {yk} (denoted ) such that

()
From Lemmas 2.7 and 2.8, we have x* ∈ Fix (N). It is easy to obtain that , because ∥ykxk∥ = θkxkxk−1∥ → 0 by (3.10). Since {∥xkx*∥} is convergent, it follows that . The proof is completed.

Remark 1. Since the current value of ∥xkxk−1∥ is known when choosing the parameter θk, then θk is well defined in Theorem 3.3. In fact, from the process of proof for the Theorem 3.3, we can get the following assert: the convergence result of Theorem 3.3 always holds provided that we select θk ∈ [0, θ], θ ∈ [0,1), for  all  k ≥ 0 with

()

Now let us return to the convergence analysis of Algorithm 3.2.

Theorem 3.4. Let the hypotheses in Lemma 3.1 be satisfied. Then the sequence {xk} generated by (3.2) converges to a fixed point of N if

()
where parameter θk is satisfying (3.10) and (3.21).

Proof. For any yRn, ∥y∥ ≤ ρ, by reason of the nonexpansive properties of projection, we have

()
Obviously,
()
where .

Since for any given , the result of this theorem can be obtained using Theorem 3.3.

Acknowledgments

This paper is supported by National Science Foundation of China (under Grant no. 11171221), Shanghai Municipal Committee of Science and Technology (under Grant no. 10550500800), Shanghai Municipal Government (under Grant no. S30501), Basic and Frontier Research Program of Science and Technology Department of Henan Province (under Grant nos. 112300410277, 082300440150), and China Coal Industry Association Scientific and Technical Guidance to Project (under Grant no. MTKJ-2011-403).

      The full text of this article hosted at iucr.org is unavailable due to technical difficulties.