A Projection-Type Method for Multivalued Variational Inequality
Abstract
We propose a projection-type method for multivalued variational inequality. The iteration sequence generated by the algorithm is proven to be globally convergent to a solution, provided that the multivalued mapping is continuous with nonempty compact convex values. Moreover, we present a necessary and sufficient condition on the nonemptiness of the solution set. Preliminary computational experience is also reported.
1. Introduction
Projection-type algorithms have been extensively studied in the literature; see [1–8] and the references therein. Reference [2] proposes a subgradient extragradient algorithm for solving single-valued variational inequality in which the next iterate is a projection onto a halfspace whose bounding hyperplane supports the feasible set K at a certain point. Reference [6] proposes a projection method for variational inequality problems in which the hyperplane strictly separates the current iterate from the solution set of (1). Theory and algorithm of multivalued variational inequality have been much studied in the literature [1, 9–18]. Various algorithms for computing the solution of (1) are proposed. The well-known proximal point algorithm [19] requires the multivalued mapping T to be monotone. Relaxing the monotonicity assumption, [12] proposed the double projection algorithm for solving (1); also see [5]. Assume that T is pseudomonotone; [20] described a combined relaxation method for solving (1); see also [21]. Recently, [22] proposed an extragradient method for generalized variational inequality. In [22], the next iterate is the projection of the current iterate onto the feasible set K; also see [23].
In this paper, we introduce a projection-type method for multivalued variational inequality in which the next iterate is a projection of the initial iterate onto intersection of two halfspaces containing the solution set. We obtain a global convergence theorem, assuming that T is pseudomonotone on K with respect to the solution set; see (3) in the following. Moreover, we show that the iterative sequence diverges if and only if the solution set is empty. We also present numerical results of the proposed method. Now let us compare our algorithm with algorithms in [5, 12, 22, 23]. First, the next iterate in our method relates to the initial point. In [5, 12], the next iterate is the projection of the current iterate onto the intersection of the hyperplane and the feasible set K. Secondly, the next iterate in our method is a projection of the initial point onto the intersection of the two hyperplanes and the feasible set K. In addition, our Armijo-type linesearch procedure is also different from those in [12, 22, 23].
The organization of this paper is as follows. In the next section, we present the algorithm details and some lemmas. We prove several preliminary results for convergence analysis in Section 3. Numerical results are reported in the last section.
2. Algorithms
Let us recall the definition of continuous multivalued mapping. T is said to be upper semicontinuous at x ∈ K if, for every open set V containing T(x), there is an open set U containing x such that T(y) ⊂ V for all y ∈ K∩U. T is said to be lower semicontinuous at x ∈ K if, given any sequence {xk} converging to x and any y ∈ T(x), there exists a sequence yk ∈ T(xk) that converges to y. T is said to be continuous at x ∈ T if, it is both upper semicontinuous and lower semicontinuous at x. If T is single valued, then both upper semicontinuity and lower semicontinuity reduce to the continuity of T.
Let ΠK denote the projector onto K, and let μ > 0 be a parameter.
Proposition 1. x ∈ K and ξ ∈ T(x) solves the problem (1) if and only if
Algorithm 2. Choose x0 ∈ K and three parameters σ > 0, μ ∈ (0,1/σ), and γ ∈ (0,1). Set i = 0.
Step 1. If rμ(xi, w) = 0 for some w ∈ T(xi), stop; else take arbitrarily wi ∈ T(xi).
Step 2. For every positive integer k, let .
Step 3. Let ki be the smallest nonnegative integer k satisfying
Remark 3. Let us compare the previous algorithm with Algorithm 3.1 in [11]. First, the parameter σ > 0 is required to be strictly less than 1, and μ is assumed to be equal to 1 in their Algorithm 3.1. In our Algorithm 2, the parameter σ can take any positive scalar and μ ∈ (0,1/σ). Secondly, since T has compact convex values, T has closed convex values. Therefore, yk in Step 2 of our algorithm is uniquely determined by k. Hence, it is easy to compute the value of yk satisfying (5). In Step 1 of their Algorithm 3.1, since F is a multivalued mapping, it is very difficult in practice to compute the value of ζk satisfying ζk ∈ F(xk − γmr(xk, ξk)) and at the same time. In addition, we report numerical results concerning our algorithm, while [11] does not present numerical experiments for the proposed algorithm. Finally, we compare the performance of our algorithm and Algorithm 3.1 in [11] (see Table 4).
Lemma 4. The sequence {yk} generated in Step 2 has the following properties:
Proof. See Lemma 2.1 in [5].
Lemma 5. For every x ∈ K and w ∈ T(x),
Proof. See Lemma 2.3 in [5].
We show that Algorithm 2 is well defined and implementable.
Lemma 6. If rμ(xi, wi) ≠ 0, there exists k satisfying (5).
Proof. In view of Lemma 4, we have lim k→∞yk = wi. Therefore,
Lemma 7. Let K be a closed convex subset of ℝn. For any x, y ∈ ℝn and z ∈ K, the following statements hold:
- (i)
〈ΠK(x) − x, z − ΠK(x)〉≥0,
- (ii)
∥ ΠK(x) − ΠK(y)∥2 ≤ ∥ x − y∥2 − ∥ ΠK(x) − x + y − ΠK(y)∥2.
Proof. See [25].
Lemma 8. Let x* ∈ S and . If rμ(xi, wi) ≠ 0, then the hyperplane
Proof. Since zi = xi − ηirμ(xi, wi),
Lemma 9. If S ≠ ∅, then .
Proof. It follows from Lemma 8 that . Next, it is sufficient to prove that for all i ≥ 0. The proof will be given by induction.
Obviously, . Suppose that
Let x* ∈ S. Since
Lemma 10. Let K ⊂ ℝn be a nonempty bounded closed convex set, and let the mapping be lower semicontinuous with nonempty closed convex values; then, the solution set S of GVI(T, K) is nonempty.
Proof. See Lemma 2.9 in [22].
The following lemma says that if the solution set S is empty, then is a nonempty set, which implies the feasibility of Algorithm 2.
Lemma 11. Let be continuous with nonempty compact convex values on K, and suppose that S = ∅; then, for all i.
Proof. On the contrary, suppose that there exists i0 ≥ 0 such that . Then, there exists a positive number M such that
- (i)
the set has at least i0 + 1 elements;
- (ii)
for 0 ≤ i ≤ i0;
- (iii)
is not a solution of GVI(T, C).
Items (i) and (iii) are obvious. Next we prove the item (ii). It is sufficient to prove that
Since
Since S1 ≠ ∅, it follows from Lemma 9 that . Therefore, for 0 ≤ i ≤ i0, which contradicts the supposition that .
3. Main Results
Theorem 12. Let be continuous with nonempty compact convex values on K satisfying condition (3). Suppose that Algorithm 2 generates an infinite sequence {xi}. If the solution set S of GVI(T, K) is nonempty, then {xi} globally converges to a solution x* of GVI(T, K) satisfying x* = ΠS(x0).
Proof. Since , by Lemma 9 and the definition of projection, it follows that
Since , . Since
If is a solution of the problem (1), we show next that the whole sequence {xi} converges to . Let x* = ΠS(x0). Since x* ∈ S, by Lemma 9,
Suppose now that is not a solution of the problem (1). We show first that ki in Algorithm 2 cannot tend to ∞. Since T is continuous with compact values, Proposition 3.11 in [26] implies that {T(xi) : i ∈ N} is a bounded set, and so the sequence {wi} is bounded. Therefore, there exists a subsequence converging to . Since T is upper semicontinuous with compact values, Proposition 3.7 in [26] implies that T is closed, and so . By the definition of ki, we have
By (31) and the boundedness of {ηi}, we obtain that lim i→∞∥rμ(xi, wi)∥ = 0. Since rμ(·, ·) is continuous and the sequences {xi} and {wi} are bounded, there exists an accumulation point of {(xi, wi)} such that . This implies that solves the variational inequality (1). Similar to the preceding proof, we obtain that {xi} globally converges to .
Remark 13. In [11], the mapping F is required to be pseudomonotone. Since the pseudomonotonicity implies condition (3), our assumptions of the mapping T are more general.
Theorem 14. Let be continuous with nonempty compact convex values on K satisfying condition (3). Suppose that Algorithm 2 generates an infinite sequence {xi}. Then the solution set S of GVI(T, K) is empty if and only if the sequence generated by Algorithm 2 diverges.
Proof. In view of Theorem 12, it is sufficient to prove that if the solution set is empty, then the sequence generated by Algorithm 2 diverges. Since inequality (26) also holds in this case, the sequence {∥xi − x0∥} is still nondecreasing. We claim that
4. Numerical Experiments
In this section, we present some numerical experiments for the proposed algorithm. The MATLAB codes are run on a PC (with CPU Intel P-T2390) under MATLAB Version 7.0.1.24704(R14) Service Pack 1. We compare the performance of our Algorithm 2 and the algorithms in [5, 11, 12, 22]. In Tables 1, 2, 3, and 4, “It.” denotes number of iteration, and “CPU" denotes the CPU time in seconds. The tolerance ε means that when ∥rμ(x, w)∥ ≤ ε, the procedure stops.
Example 15. Let n = 3,
Acknowledgments
This work is partially supported by Natural Science Foundation Project of CQ CSTC (no. 2010BB9401), Science and Technology Project of Chongqing Municipal Education Committee of China (no. KJ110509), and Foundation of Chongqing University of Posts and Telecommunications for the Scholars with Doctorate (no. A2012-04).