Jacobian Consistency of a Smoothing Function for the Weighted Second-Order Cone Complementarity Problem
Abstract
In this paper, a weighted second-order cone (SOC) complementarity function and its smoothing function are presented. Then, we derive the computable formula for the Jacobian of the smoothing function and show its Jacobian consistency. Also, we estimate the distance between the subgradient of the weighted SOC complementarity function and the gradient of its smoothing function. These results will be critical to achieve the rapid convergence of smoothing methods for weighted SOC complementarity problems.
1. Introduction
Obviously, if w = 0, WSOCCP (1) reduces to second-order cone complementarity problem (SOCCP). In this article, we may assume that r = 1 and in the following analysis, since it can easily be extended to the general case.
In order to reformulate several equilibrium problems in economics and study highly efficient algorithms to solve these problems, Potra [1] introduced the notion of a weighted complementarity problem (WCP). He showed that the Fisher market equilibrium problem can be modeled as a monotone linear WCP. Moreover, the linear programming and weighted centering (LPWC) problem, which was introduced by Anstreicher [2], can also be formulated as a monotone linear WCP. And Potra [1] analyzed two interior-point methods for solving the monotone linear WCP over the nonnegative orthant. Since then, many scholars are dedicated to investigating the theories and solution methods of WCP. Tang [3] gave a new nonmonotone smoothing-type algorithm to solve the linear WCP. Chi et al. [4] studied the existence and uniqueness of the solution for a class of WCPs.
As is well known, smoothing methods have superior theoretical and numerical performances. For solving the SOCCP by smoothing methods, we usually reformulate the SOCCP as a system of equations based on parametric smoothing functions of SOC complementarity functions [5, 6]. The smoothing parameter involved in smoothing functions may be treated as a variable [7] or a parameter with an appropriate parameter control [8]. In the latter case, the Jacobian consistency is important to achieve a rapid convergence of Newton methods or Newton-like methods. Hayashi et al. [8] proposed a combined smoothing and regularized method for monotone SOCCP, and based on the Jacobian consistency of the smoothing natural residual function, they proved that the method has global and quadratic convergence. Krejić and Rapajić [9] gave a nonmonotone Jacobian smoothing inexact Newton method for nonlinear complementarity problem and proved the global and local superlinear convergence of the method. Chen et al. [10] presented a modified Jacobian smoothing method for the nonsmooth complementarity problem and established the global and fast local convergence for the method.
The main contribution of this paper is to show the Jacobian consistency of the smoothing function (7) and estimate the distance between the subgradient of the weighted SOC complementarity function (5) and the gradient of its smoothing function (7). These properties will be critical to solve weighted SOC complementarity problems by smoothing methods.
The paper is organized as follows. In Section 2, we review some concepts and properties. In Section 3, we derive the computable formula for the Jacobian of the smoothing function in WSOCCP. In Section 4, we show the Jacobian consistency of the smoothing function and estimate the distance between the gradient of smoothing function and the subgradient of the weighted SOC complementarity function. Some conclusions are reported in Section 5.
Throughout this paper, ℝ+ denotes the set of nonnegative numbers. ℝn and ℝm×n denote the space of n-dimensional real column vectors and the space of matrices, respectively. We use ‖⋅‖ to denote the Euclidean norm and define for a vector x or the corresponding induced matrix norm. For simplicity, we often use x = (x0; x1) instead of the column vector . and mean the topological interior and the boundary of the SOC , respectively. For a given set S ⊂ ℝm×n, convS denotes the convex hull of S in ℝm×n, and for any matrix X ∈ ℝm×n, dist(X, S) denotes inf{‖X − Y‖ : Y ∈ S}.
2. Preliminaries
In this section, we briefly recall some definitions and results about the Euclidean Jordan algebra [11] associated with the SOC and subdifferentials [12].
For any x = (x0; x1) ∈ ℝ × ℝn−1, let x′ = (x0; −x1)[13]. Then, x″ = x, (x + s)′ = x′ + s′, and (cx)′ = cx′ for any c ∈ ℝ. Moreover, if .
Definition 1 (see [12].)Let G : ℝm⟶ℝn be a locally Lipschitzian function and Gμ : ℝm⟶ℝn be a continuously differentiable function for any μ > 0, and for any z ∈ ℝm, we have limμ⟶0Gμ(z) = G(z). Then, Gμ satisfies the Jacobian consistency property if for any z ∈ ℝm, .
3. Smoothing Function
In this section, we study the properties of the smoothing function (7).
Definition 2 (see [8].)For a nondifferentiable function f : ℝm⟶ℝn, we consider a function fμ : ℝm⟶ℝn with a parameter μ > 0 that has the following properties:
- (i)
fμ is differentiable for any μ > 0
- (ii)
limμ⟶0fμ(x) = f(x) for any x ∈ ℝm
Such a function fμ is called a smoothing function of f.
Lemma 1. For any and μ ∈ ℝ, one has
Proof. We first suppose that . Then,
That is, φμ(x, s, w) = 0.
Conversely, suppose that φμ(x, s, w) = 0; then, it follows from (7) that
Upon squaring both sides of it, we obtain
Let
Therefore,
Further, it follows from Proposition 3.4 [15] that
Lemma 2. For any given and any (μ, x, s) ∈ ℝ × ℝn × ℝn, let φ and φμ be defined as (5) and (7), respectively. Then, we have
- (i)
The function φμ is continuously differentiable everywhere with any μ > 0, and its Jacobian is given by
(34) -
Here if υ1 = 0; otherwise,
(35) -
with
(36)(37) -
where
(38) - (ii)
For any (x, s) ∈ ℝn × ℝn, we have limμ⟶0φμ(x, s, w) = φ(x, s, w). Thus, φμ is a smoothing function of φ.
- (iii)
For any μ, ν ∈ ℝ+,
(39)
Proof.
- (i)
For any (x, s) ∈ ℝn × ℝn and any μ > 0, according to Corollary 5.4 [15] and (28), formula (34) holds. By Proposition 5.2 and its proof [15], we get formula (35).
- (ii)
Given any x = (x0; x1), s = (s0; s1) ∈ ℝ × ℝn−1. For any μ > 0, we obtain from the spectral factorization of υμ and υ that
(40) -
where
(41) -
and λi(υμ) and ui(υ) are, respectively, given by (25) and (26) for i = 1,2. It is obvious that
(42) -
for i = 1,2. Then,
(43) -
and limμ⟶0φμ(x, s, w) = φ(x, s, w). Thus, by (i) and Definition 2, φμ is a smoothing function of φ.
- (iii)
By following the proof of Proposition 5.1 [15], we obtain the desired result.
Next, we study some properties of φ, which will be used in the subsequent analysis.
Lemma 3. For any , let . Then, we have
Lemma 4. For any x = (x0; x1), s = (s0; s1) ∈ ℝ × ℝn−1, let . Then, one has
Proof. Since
It follows from these equalities that the results in (45)–(47) hold. Since , we have λ1(υ) = 0, i.e.,
By the last relation and (45)–(47), we obtain that (49) holds. To prove (48), we only need to verify x0υ1 = υ0x1 and by the symmetry of x and s in υ. From (45)–(47) and (49),
From (51), the equivalence is also true.
4. Jacobian Consistency
Since the function Φ(z) is typically nonsmooth, Newton’s method cannot be applied to the system Φ(z) = 0 directly. Thus, we can approximately solve the smooth system Φμ(z) = 0 at each iteration and make ‖Φμ(z)‖ decrease gradually by reducing μ to zero. First, we show that the function Φμ(z) satisfies the Jacobian consistency.
Lemma 5. For any arbitrary but fixed vector , we have for any (μ, x, s) ∈ ℝ × ℝn × ℝn,
Proof. By (34) and the symmetry of x and s, it suffices to prove
Case 2. If (x, s) ∈ ℬ, it is easy to prove (51), and
Thus, we obtain the following from (25):
For any μ ≠ 0, we may get from (35) that L−1(ωμ) = L1(υμ) + L2(υμ). We first prove for any μ ≠ 0,
Let
Based on (36), (48), and (64), we have
Next, we prove limμ⟶0L2(υμ) = J. From (37), (64), and (65), we have
Combining (68) and (69) yields
Case 3. If , it follows from Lemma 4 that (x, s, w) = (0,0,0) and
Lemma 6. For any arbitrary but fixed vector , we have for any (x, s) ∈ ℝn × ℝn,
Proof. By Proposition 5.2 [15] and the chain rule for differentiation, the complementarity function φ is continuously differentiable at any (x, s) ∈ ℐ with
Thus, it suffices to consider the two cases: (x, s) ∈ ℬ and .
For any (x, s) ∈ ℬ or , let with sufficiently small μ ≠ 0, and define
Then, we have
Obviously, when μ⟶0, we have for i = 1,2. Then by (7), it suffices to show
Case 4. If (x, s) ∈ ℬ, we obtain , and from (45), (46), and (48),
The last relation together with υ0 > 0 implies that for sufficiently small μ, we have
For sufficiently small μ ≠ 0, we obtain from (77) and (80),
It follows from (81) and (82) that , and hence φ is differentiable at .
Now we will prove
By (45), (46), (48), and (84), we have
It follows from (73)–(84) that as μ⟶0,
Then, by following the proof of Case 5 in Lemma 5, we have
Therefore, we obtain from (86) and (88) that
Next we will prove
By (45), (46), (48), (81), and (84), we have
Therefore, we obtain from (88) and (92) that
Case 5. If , it follows from Lemma 4 that (x, s, w) = (0,0,0). Thus, , , and
Now we show the Jacobian consistency of the function Φμ (56) and then estimate an upper bound of the parameter μ > 0 for the predicted accuracy of the distance between the gradient of Φμ (56) and the subgradient of Φ (55).
Theorem 1. The following results hold. (i) The function Φμ defined by (56) with μ > 0 satisfies the Jacobian consistency. (ii) For given τ > 0 and any point z≔(x, s, y) ∈ ℝ2n+m, let ρ(x, s) be any function such that
Then, for any μ ∈ ℝ such that , we have
Proof. By (56), it suffices to show the Jacobian consistency of φμ with μ > 0. Define
It follows from Lemma 5 and Lemma 6 that
Thus, we obtain from (34) and (100) that
Then, similar to the proof of Proposition 4.1 [13], we have
Hence, by following the proof of Theorem 4.1 [13], the result holds.
5. Conclusions
In this paper, we show the Jacobian consistency of the smoothing function φμ for WSOCCP, which will play a key role in analyzing the rapid convergence of smoothing methods. Moreover, in order to adjust a parameter appropriately in smoothing methods, we estimate the distance between the gradient of the smoothing function φμ and the subgradient of the weighted SOC complementarity function φ.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
Acknowledgments
This research was supported by the National Natural Science Foundation of China (no. 11861026), Guangxi Key Laboratory of Cryptography and Information Security (no. GCIS201819), and Guangxi Key Laboratory of Automatic Detecting Technology and Instruments, China (no. YQ18112).
Open Research
Data Availability
The data used to support the findings of this study are available from the corresponding author upon request.