Exact Asymptotic Stability Analysis and Region-of-Attraction Estimation for Nonlinear Systems
Abstract
We address the problem of asymptotic stability and region-of-attraction analysis of nonlinear dynamical systems. A hybrid symbolic-numeric method is presented to compute exact Lyapunov functions and exact estimates of regions of attraction of nonlinear systems efficiently. A numerical Lyapunov function and an estimate of region of attraction can be obtained by solving an (bilinear) SOS programming via BMI solver, then the modified Newton refinement and rational vector recovery techniques are applied to obtain exact Lyapunov functions and verified estimates of regions of attraction with rational coefficients. Experiments on some benchmarks are given to illustrate the efficiency of our algorithm.
1. Introduction
Lyapunov′s stability theory, which concern is with the behavior of trajectories of differential systems, plays an important role in analysis and synthesis of nonlinear continuous systems. Lyapunov functions can be used to verify the asymptotic stability, including locally asymptotic stability and globally asymptotic stability. In the literature, there has been lots of work on constructing Lyapunov functions [1–12]. For example, [4, 5] used the linear matrix inequality (LMI) method to compute quadratic Lyapunov functions. In [8, 13], based on sum of squares (SOS) decomposition, a method is proposed to construct high-degree numerical polynomial Lyapunov functions. Reference [9] proposed a new method for computing polynomials Lyapunov functions by solving semialgebraic constraints via the tool DISCOVERER [14]. Reference [15] constructed Lyapunov functions beyond polynomials by using radial basis functions. In [11], the Gröbner based method is used to choose the parameters in Lyapunov functions in an optimal way.
Since the analysis of asymptotic stability is not sufficient for safety critical systems, the analysis of the region of attraction (ROA) of an asymptotically stable equilibrium point is a topic of significant importance. The ROA is the set of initial states from which the system converges to the equilibrium point. Computing exact regions of attraction (ROAs) for nonlinear dynamical systems is very hard if not impossible; therefore, researchers have focused on finding estimates of the actual ROAs. There are many well-established techniques for computation of ROAs [5, 16–22]. Among all methods, those based on Lyapunov functions are dominant in the literature. These methods compute both a Lyapunov function as a stability certificate and the sublevel sets of this Lyapunov function, which give rise to estimates of the ROA. In [17], the authors computed quadratic Lyapunov functions to optimize the volume of an ellipsoid contained in ROA by using nonlinear programming. Reference [5] employed LMI based method to compute the optimal quadratic Lyapunov function for maximizing the volume of an ellipsoid contained in the ROA of odd polynomial systems. In [22], based on SOS decomposition, a method is presented to search for polynomial Lyapunov functions that enlarge a provable ROA of nonlinear polynomial system. Reference [18] used discretization (in time) to flow invariant sets backwards along the flow of the vector field, obtaining larger and larger estimates for the ROA. Reference [21] employed quantifier elimination (QE) method via QEPCAD to find Lyapunov functions for estimating the ROA.
Taking advantage of the efficiency of numerical computation and the error-free property of symbolic computation, in this paper, we present a hybrid symbolic-numeric algorithm to compute exact Lyapunov functions for asymptotic stability and verified estimates of the ROAs of continuous systems. The algorithm is based on SOS relaxation [23] of a parametric polynomial optimization problem with LMI or bilinear matrix inequality (BMI) constraints, which can be solved directly using LMI or BMI solver in MATLAB, such as SOSTOOLS [24], YALMIP [25], SeDuMi [26], PENBMI [27], and exact SOS representation recovery techniques presented in [28, 29]. Unlike the numerical approaches, our method can yield exact Lyapunov functions and verified estimates of ROAs, which can overcome the unsoundness in analysis of nonlinear systems caused by numerical errors [30]. In comparison with some symbolic approaches based on qualifier elimination technique, our approach is more efficient and practical, because parametric polynomial optimization problem based on SOS relaxation with fixed size can be solved in polynomial time theoretically.
The rest of the paper is organized as follows. In Section 2, we introduce some definitions and notions about Lyapunov stability and ROA. Section 3 is devoted to transform the problem of computing Lyapunov functions and estimates of ROAs into a parametric program with LMI or BMI constraints. In Section 4, a symbolic-numeric approach via SOS relaxation and exact rational vector recovery is proposed to compute Lyapunov functions and estimates of ROAs, and an algorithm is described. In Section 5, experiments on some benchmarks are shown to illustrate our algorithm on asymptotic stability and ROA analysis. At last, we conclude our results in Section 6.
2. Lyapunov Stability and Region of Attraction
In this section, we will present the notion of Lyapunov stability and regions of attraction (ROAs) of dynamical systems.
A vector x ∈ ℝn is an equilibrium point of the system (1) if f(x) = 0. Since any equilibrium point can be shifted to the origin 0 via a change of variables, without loss of generality, we may always assume that the equilibrium point of interest occurs at the origin.
Lyapunov theory is concerned with the behavior of the solution ϕ(t; x0) where the initial state x0 is not at the equilibrium 0 but is “close” to it.
Definition 1 (Lyapunov stability). The equilibrium point 0 of (1) is
- (i)
stable, if for any ϵ > 0, there exists δ = δ(ϵ) such that
()here ∥·∥ denotes any norm defined on ℝn; - (ii)
unstable, if it is not stable,
- (iii)
asymptotically stable, if it is stable, and δ can be chosen such that
() - (iv)
globally asymptotically stable if it is stable, and for all x0 ∈ ℝn,
()
Intuitively, the equilibrium point 0 is stable if all solutions starting near the origin (meaning that the initial conditions are in a neighborhood of the origin) remain near the origin for all time. The equilibrium point 0 is asymptotically stable if all solutions starting at nearby points not only stay nearby but also converge to the equilibrium point as time approaches infinity. And the equilibrium point 0 is globally asymptotically stable if it is asymptotically stable for all initial conditions x0 ∈ ℝn. The stability is an important property in practice, because it means arbitrarily small perturbations of the initial state about the equilibrium point 0 result in arbitrarily small perturbations in the corresponding solution trajectories of (1).
A sufficient condition for stability of the zero equilibrium is the existence of a Lyapunov function, as shown in the following theorem.
Theorem 2 ([31, Theorem 4.1]). Let D ⊂ ℝn be a domain containing the equilibrium point 0 of (1). If there exists a continuously differentiable function V : D → ℝ such that
A function V(x) satisfying the conditions (5) and (6) in Theorem 2 is commonly known as a Lyapunov function. And we can verify globally asymptotic stability of system (1) by using Lyapunov functions stated as follows.
Theorem 3 ([31, Theorem 4.2]). Let the origin be an equilibrium point for (1). If there exists a continuously differentiable function V : ℝn → ℝ such that
Remark that a function satisfying condition (9) is said to be radially unbounded.
It is known that globally asymptotic stability is very desirable, but in many applications it is difficult to achieve. When the equilibrium point is asymptotically stable, we are interested in determining how far from the origin the trajectory can be and still converge to the origin as t approaches ∞. This gives rise to the following definition.
Definition 4 (region of attraction). The region of attraction (ROA) Ω of the equilibrium point 0 is defined as Ω = {x ∈ ℝn∣lim t→∞ϕ(t; x) = 0}.
The ROA of the equilibrium point 0 is a collection of all points x such that any trajectory starting at initial state x at time 0 will be attracted to the equilibrium point. In the literature, the terms “domain of attraction” and “attraction basin” are also used instead of “region of attraction”.
Definition 5 (positively invariant set). A set M ⊂ ℝn is called a positively invariant set of the system (1), if x0 ∈ M implies ϕ(t; x0) ∈ M for all t ≥ 0. Namely, if a solution belongs to a positively invariant set M at some time instant, then it belongs to M for all future time.
In general, finding the exact ROA analytically might be difficult or even impossible. Usually, Lyapunov functions are used to find underestimates of the ROA, that is, sets contained in the region of attraction, as stated in the following theorem.
Theorem 6 ([20, Theorem 10]). Let D ⊂ ℝn be a domain containing the equilibrium point 0 of (1). If there exists a continuously differentiable function V : D → ℝ satisfying (5) and (7), then any region Ωc = {x ∈ ℝn∣V(x) ≤ c} with c ≥ 0 such that Ωc⊆D is a positively invariant set contained in the ROA of the equilibrium 0.
Theorem 6 describes an approach to compute estimates of the ROA through Lyapunov functions. More specifically, in the case of asymptotic stability, if Ωc = {x ∈ ℝn∣V(x) ≤ c} is bounded and contained in D, then every trajectory starting in Ωc remains in Ωc and approaches the origin as t → ∞. Thus, Ωc is an estimate of the ROA. Remark that when the origin is globally asymptotically stable, the region of attraction is the whole space ℝn.
3. Problem Reformulation
In this section, we will transform the problem of the asymptotic stability and ROA analysis of system (1) to a parametric program with LMI or BMI constraints. In the sequel, we suppose that system (1) is a polynomial dynamical system with fi(x) ∈ ℝ[x] for 1 ≤ i ≤ n, where ℝ[x] denotes the ring of real polynomials in the variables x.
3.1. Asymptotic Stability
3.2. Region of Attraction
Suppose that the equilibrium point 0 is asymptotically stable. In this section, we will consider how to find a large enough underestimate of the ROA. In the case where the equilibrium point 0 is globally asymptotically stable, the ROA becomes the whole space ℝn.
4. Exact Certificate of Sum of Squares Decomposition
According to Theorems 2, 3, and 6, the key of asymptotic stability analysis and ROA estimation lies in finding a real function V(x) and a constant β satisfying the desired conditions. We will present a symbolic-numeric hybrid method, based on SOS relaxation and rational vector recovery, to compute the exact polynomial V(x) and constant β.
4.1. Approximate Solution from LMI or BMI Solver
In this section, we will discuss how to handle the SOS programmings (16), (18), and (22) directly using the LMI and BMI solver or iterative method.
Many Matlab packages of SDP solvers, such as SOSTOOLS [24], YALMIP [25], and SeDuMi [26], are available to solve the problem (24) and (25) efficiently.
Now, let us consider the problem (22). The following example shows how to transform nonlinear parametric polynomial constraints into a BMI problem.
Example 7. To find a polynomial φ(x) satisfying φ(x) ≥ 0∧−x2 + 1 ≥ 0⊨2x(dφ/dx) ≥ 0, it suffices to find φ(x) such that
Alternatively, observing (30), ℬ(u, v) involves no crossing products like uiuj and vivj. Taking this special form into account, an iterative method can be applied by fixing u and v alternatively, which leads to a sequential convex LMI problem [20]. Remark that although the convergence of the iterative method cannot be guaranteed, this method is easier to implement than PENBMI solver and can yield a feasible solution efficiently in practice.
4.2. Exact SOS Recovery
Since the SDP (LMI) or BMI solvers in Matlab are running in fixed precision, applying the techniques in Section 4.1 only yields numerical solutions of (16), (18), and (22). In the sequel, we will propose an improved algorithm based on a modified Newton refinement and rational vector recovery technique, to compute exact solutions of polynomial optimization problems with LMI or BMI constraints.
Example 8. Consider the following nonlinear system:
In our former papers [36, 37], we applied Gauss-Newton iteration and rational vector recovery to obtain exact solutions that satisfy the constraints in (34), exactly. However, these techniques may fail in some cases, as shown in [38, Example 2]. The reason may lie in that we recover the vector c and the associated positive semidefinite matrices separately. Here, we will compute exact solutions of (34) by using a modified Newton refinement and rational vector recovery technique [38], which applies on the vector c and the associated positive semidefinite matrices simultaneously. The main ideal is as follows.
We first convert W[3] to a nearby rational positive semidefinite matrix by nonnegative truncated PLDLTPT-decomposition. In practice, W[3] is numerical diagonal matrix; in other words, the off-diagonal entries are very tiny and the diagonal entries are nonnegative. Therefore, by setting the small entries of W[3] to zeros, we easily get the nearby rational positive semidefinite matrix . We then apply Gauss-Newton iteration to refine c, W[1], and W[2] simultaneously with respect to a given tolerance τ.
4.3. Algorithm
The results in Sections 4.1 and 4.2 yield an algorithm to find exact solutions to the problem (34).
Algorithm 9. Verified Parametric Optimization Solver.
Input
- (i)
A polynomial optimization problem of the form (34).
- (ii)
D ∈ ℤ>0: the bound of the common denominator.
- (iii)
e ∈ ℤ≥0: the degree bound 2e of the SOSes used to construct the SOS programming.
- (iv)
τ ∈ ℝ>0: the given tolerance.
Output
- (i)
The verified solution of (34) with the positive semidefinite.
- (1)
(Compute the numerical solutions) Apply LMI or BMI solver to compute numerical solutions of the associated polynomial optimization problem (34). If this problem has no feasible solutions, return “we can′t find solutions of (34) with the given degree bound 2e.” Otherwise, obtain c and W[i]⪸0,1 ≤ i ≤ 3.
- (2)
(Compute the verified solution )
- (2.1)
Convert W[3] to a nearby rational positive semidefinite matrix by non-negative truncated PLDLTPT-decomposition.
- (2.2)
For the tolerance τ, apply the modified Newton iteration to refine c and W[1], W[2].
- (2.3)
Determine the singularity of W[1] and W[2] with respect to τ. Then, for a given common denominator, the rational vector , and rational matrices , can be obtained by orthogonal projection if W[1], W[2] are of full rank, or by rational vector recovery method otherwise.
- (2.4)
Check whether the matrices , are positive semidefinite. If so, return , and , 1 ≤ i ≤ 3. Otherwise, return “we can′t find the solutions of (34) with the given degree bound”.
- (2.1)
- (1)
5. Experiments
Let us present some examples of asymptotic stability and ROAs analysis of nonlinear systems.
Example 10 ([8, Example 1]). Consider a nonlinear continuous system
Furthermore, we will consider the globally asymptotic stability. It suffices to find a Lyapunov function V(x) with rational coefficients, which satisfies all the conditions in Theorem 3. By solving the associated SOS programming (18), we obtain
Table 1 shows the performance of Algorithm 9 on another six examples, for globally asymptotic stability analysis of dynamical systems in the literature. All the computations have been performed on an Intel Core 2 Duo 2.0 GHz processor with 2 GB of memory. In Table 1 Examples 1–3 correspond to [9, Examples 2, 3, 9] and Examples 4–6 correspond to [39, Example 7], [6, Example 22], and [40, page 1341]. For all these examples, let the degree bound of the SOSes be 4, and set τ = 10−2, D = 100. Here n and Num denote the number of system variables and the number of decision variables in the LMI problem, respectively; denotes the degree of obtained from Algorithm 9; Time is that for the entire computation run Algorithm 9 in seconds.
Example | n | Num | deg | Time (s) |
---|---|---|---|---|
1 | 2 | 11 | 2 | 1.391 |
2 | 2 | 11 | 2 | 1.418 |
3 | 3 | 18 | 2 | 1.674 |
4 | 4 | 81 | 4 | 2.951 |
5 | 2 | 24 | 4 | 1.832 |
6 | 2 | 24 | 4 | 1.830 |
Example 11 ([41, Example A]). Consider a nonlinear continuous system
We now construct Lyapunov functions to find certified estimates of the ROA. In the associated SOS programming (22) with BMI constraints, we suppose . When d = 2, we obtain
Table 2 shows the performance of Algorithm 9 on another three examples, for computing verified estimates of ROAs of dynamical systems with the same fixed positive definite polynomial p(x) given in the literature. All the computations have been performed on an Intel Core 2 Duo 2.0 GHz processor with 2 GB of memory. In Table 2, Examples 1–3 correspond to [22, Examples 1, 2] and [20, page 75]. For all these examples, let the degree bound of the SOSes be 4, τ = 10−4 and D = 10000. Here n and Num denote the number of system variables and the number of decision variables in the BMI problem, respectively; and denote, respectively, the degree of and value of β obtained from Algorithm 9, whereas β is reported in the literature; time is that for the entire computation run Algorithm 9 in seconds.
Example | n | Num | deg | β | Time (s) | |
---|---|---|---|---|---|---|
1 | 2 | 28 | 2 | 5415/9277 | 0.593 | 19.417 |
2 | 3 | 46 | 2 | 2650/9902 | 2.76 | 26.635 |
3 | 2 | 28 | 2 | 99/41 | 2.05 | 9.915 |
6. Conclusion
In this paper, we present a symbolic-numeric method on asymptotic stability and ROA analysis of nonlinear dynamical systems. A numerical Lyapunov function and an estimate of ROA can be obtained by solving an (bilinear) SOS programming via BMI solver. Then a method based on modified Newton iteration and rational vector recovery techniques is deployed to obtain exact polynomial Lyapunov functions and verified estimates of ROAs with rational coefficients. Some experimental results are given to show the efficiency of our algorithm. For future work, we will consider the problem of stability region analysis of nonpolynomial systems by applying a rigorous polynomial approximate technique to compute an uncertain polynomial system, whose set of trajectories contains that of the given nonpolynomial system.
Acknowledgments
This material is supported in part by the National Natural Science Foundation of China under Grants 91118007 and 61021004 (Wu Yang), the Fundamental Research Funds for the Central Universities under Grant 78210043 (Wu Yang), and the Education Department of Zhejiang Province Project under Grant Y201120383 (Lin).