A nonlinear dynamical system, in which the feed rates of glycerol and alkali are taken as the control functions, is first proposed to formulate the fed-batch culture of 1,3-propanediol (1,3-PD) production. To maximize the 1,3-PD concentration at the terminal time, a constrained optimal control model is then presented. A solution approach is developed to seek the optimal feed rates based on control vector parametrization method and improved differential evolution algorithm. The proposed methodology yielded an increase by 32.17% of 1,3-PD concentration at the terminal time.
1. Introduction
1,3-propanediol (1,3-PD) possesses potential applications on a large commercial scale, especially as a monomer of polyesters or polyurethanes, its microbial production is recently paid attention to for its low cost, high production, and no pollution, and so forth. It is considered to be one of the bulk chemicals, which is likely to be produced by bioprocesses on large scales [1]. During the bioconversion of glycerol to 1,3-PD, the most efficient cultivation method appears to be a fed-batch culture which corrects pH by alkali addition for glycerol supply [2]. In the fed-batch cultivation process of glycerol bioconversion 1,3-PD, several factors influence the process state and govern the process behavior [3]. Along with the concentration of substrate, the process is influenced by the products of metabolism that accumulate in cultivation broth and cause an inhibition of cells’ growth. To maintain a suitable environment for cells’ growth, alkali is also intermittently added to the fermentor. Consequently, two control actions should be considered for modelling and optimal control the fed-batch cultivation process: the feeding with glycerol and the adding with alkali.
Optimal control of fed-batch culture by feed rates has received extensive attention [4–17]. Initially, the batch model is extrapolated to fed-batch cultivation by incorporating the dilution factors. Unstructured and nonsegregational models with specific rates of cell growth rate, metabolite production rate, and substrate consumption rate have been used to model fed-batch fermentation. The models have been used for optimal control studies by a number of researchers [7, 9–11]. Recently, assuming the feed of substrate only occurs at the impulsive instants, nonlinear impulsive systems [4] have been extensively investigated to formulate the fermentation process. Subsequently, the properties [5], parameter identification problem [12], and optimal control problem [4, 13] have been investigated. Nonetheless, since the feed rate of substrate is finite, it is not reasonable to describe the actual fed-batch fermentation process by the impulsive system. In contrast, taking the feed rate of substrate as a time-continuous process, a nonlinear multistage was proposed in [8]. The parameter identification problem [6] and optimal control problem [8] for the system are investigated. Moreover, regarding the fed-batch fermentation as switching between the batch process and the feed process, the switched systems and their optimal control are discussed in [14–17]. Although the achieved results are interesting, the control action in the above nonlinear dynamical systems and optimal control problems only include the feed rate of the substrate.
Typically, a fed-batch process could have more than one control variable that need to be optimized. This leads to a fairly complex optimization problem when the controlled nonlinear system involving more than one control variables and physical constraints on state variables. In this paper, we propose a nonlinear dynamical system, in which the feed rates of glycerol and alkali are taken as the control functions, to describe 1,3-PD production in fed-batch cultivation process. To maximize the 1,3-PD concentration at the terminal time, a constrained optimal control problem is then presented. Incidently, there exist many methods to solve the feed rates optimization problem involving more than one feed rates, such as maximum principle of Pontryagin [18], Luus-Jaakola search method [19], and genetic algorithm [10]. However, these methods are all applied to the fed-batch process in which the substrates are fed to the fermentor continuously. In the actual fermentation, glycerol and alkali are intermittently fed into fermentor. As a result, the computation is more complex and it is necessary to develop a fast and robust algorithm to solve the complex-constrained optimal control problem. A solution approach is developed to seek the optimal feed rates of glycerol and alkali based on the control vector parametrization method and an improved differential evolution algorithm. Numerical results show that the concentration of 1,3-PD at the terminal time can be increased considerably compared with previous results.
The rest of the paper is organized as follows. The nonlinear dynamical system and constrained optimal control model in fed-batch fermentation process are formulated in Section 2. Section 3 develops a computational approach to solve the constrained optimal control model, while Section 4 illustrates the numerical results. Finally, conclusions are provided in Section 5.
2. Problem Formulation
Based on the nonlinear dynamical system [6] and taking the feed rates of glycerol and alkali as the control functions, mass balances of biomass, substrate, and products in fed-batch culture can be formulated as
()
where , is the state vector whose components represent the extracellular concentrations of biomass, glycerol, 1,3-PD, acetic acid, and ethanol at time t in the fermentor, respectively. T is the terminal time of the fermentation, and x0 is a given initial state. u(t): = (u1(t), u2(t)) T ∈ R2 is the control function whose components denote the feed rates of glycerol and alkali, respectively. ti, i ∈ Λ : = {1,2, …, 2N + 1} is the switching instant such that 0 = t0, ti−1 < ti, i ∈ Λandt2N+1 = T. In particular, t2j+1 is the moment of adding glycerol, at which the fermentation process switches to continuous culture from batch culture, and t2j+2 denotes the moment of ending the flow of glycerol, at which the fermentation process jumps into batch culture from continuous culture, . Furthermore, for ,
()
for ,
()
In (2.3), cs0 denotes the initial concentration of glycerol in feed. D(t) is the dilution rate at time t defined by
()
()
In (2.5), V0 is the initial volume of solution in the fermentor. On the basis of the previous work [20], the specific growth rate of cells μ is expressed by
()
where Δ1 is the maximum specific growth rate; k1 is the Monod saturation constant; are the maximal residual substrate and products concentrations; and nℓ are the exponents for the substrate and products. The specific consumption rate of substrate q2 is
()
In (2.7), m2 is the maintenance term of substrate consumption under substrate-limited conditions. Y2 is the maximum growth yield. Δ2 is the maximum increment of substrate consumption rate under substrate-sufficient conditions. k2 is the saturation constant for substrate. The specific formation rates qℓ, ℓ = 3,4, of 1,3-PD and acetic acid are defined as
()
where mℓ are the maintenance terms of product formations under substrate-limited conditions; Yℓ are the maximum product yields; Δℓ are the maximum increments of product formation rates under substrate-sufficient conditions; kℓ are saturation constants for products. Moreover, the specific formation rate q5 of ethanol can be described by
()
in which c1, c2, c3, and c4 are parameters for determination of yield of ethanol on glycerol.
Under anaerobic conditions at 37°C and pH 7.0, the critical concentrations for cells growth and the parameters in (2.6)–(2.9) are listed in Table 1.
Table 1.
The parameters and the values of critical concentrations in the controlled nonlinear system (2.1).
ℓ
mℓ
Yℓ
Δℓ
kℓ
nℓ
cℓ
x*ℓ
1
—
—
0.67
0.28
—
0.025
0.01
6
2
2.20
0.0088
28.58
11.43
1
0.06
15
2039
3
−2.69
67.69
26.59
15.50
3
5.18
0
1036
4
−0.97
33.07
5.74
85.71
3
50.45
0
1026
5
—
—
—
—
3
—
0
60.9
Define
()
where a1,2j+1, a2,2j+1, b1,2j+1 and , are identically equal to zero. a1,2j+2, a2,2j+2, b1,2j+2, and are positive constants which denote the minimal and maximal rates of adding glycerol and alkali, respectively. Let 𝒰 be the class of all the measurable functions u from [0, T] into R2 with u(t) ∈ U.
There exist critical concentrations, outside which cells cease to growth, of biomass, glycerol, 1,3-PD, acetic acid, and ethanol. Hence, it is biologically meaningful to restrict the concentrations of biomass, glycerol, products, and the volume of culture fluid in a set W defined as
()
For the system (2.1), we confirm that the system has a unique continuous solution on [0, T], denoted by x(·; u), for each u ∈ 𝒰. Moreover, the solution x(·; u) is continuous in u and is uniformly bounded on [0, T] [21].
In fed-batch fermentation of glycerol bioconversion to 1,3-PD, controlling the feed rates of glycerol and alkali is to maximize the final 1,3-PD productivity. Therefore, the 1,3-PD concentration at the terminal time is taken as the cost functional, that is,
()
where x3(·; u) is the third component of the solution to the system (2.1). Furthermore, the control constraint (2.10) and the state constraint (2.11) should be satisfied.
Thus, a constrained optimal control model in the fed-batch fermentation can be formulated as follows.
()
3. Computational Methods
In solving the optimal control problem, a particularly attractive technique variously proposed [22, 23] is the parametrization of the control vector u into a number of intervals so as to result in an expression as
()
that is, let the time subinterval [ti−1, ti] be partitioned into ni subintervals with ni + 1 partition points denoted by
()
In the above equation, ϕij(t) are known trial functions that need to be chosen. is the value of the kth control variable in ith interval and is the coefficient that need to be determined from optimization. A number of trial functions based on the use of different basis functions have been used in various work. However, the choice of trial functions ϕij(t) affects the evaluation of the exact optimization and needs to be carefully chosen. In this paper, we assume that each control variable in the control vector u(t) is approximated by a piecewise constant value in a particular interval i, namely,
()
Let x(·; σp) be the solution of the system (2.1) replacing the control function u with up. Furthermore, denote the set of the admissible parameterized controls σp by Ξp, namely, Ξp = {σp∣up ∈ 𝒰}. Now, (COCP) can be approximated by the following parameter optimization problem
()
To solve (COCP) by the control vector parametrization method, we need to solve a sequence of problems . However, it is difficult to cope with the state constraints. To surmount these difficulties, let
()
Then, the condition (2.11) is equivalently transcribed into
()
where . However, G(σp) is nonsmooth in σp. Consequently, standard optimization routines would have difficulties in dealing with this type of equality constraints. The following smoothing technique is to replace max {0, gl(t; σp)} with , where
()
In (3.7), ϵ > 0 is an adjustable parameter controlling the accuracy of the approximation. Note that
()
is a smooth function in θ. The equality constraint (3.3) now can be approximated by
()
As a result, (COCP(p)) can be approximated by the following approximation problem as follows.
()
Then, the gradient of the constraint can be computed by the following theorem.
Theorem 3.1. For the constraint given in (3.9), it holds that its gradient with respect to parameterized control σp is
()
where
()
is the solution of the costate system
()
with the boundary conditions
()
Proof. The proof can be completed using the method of Chapter 3 in [24].
On this basis, (COCP) can be solved by a sequence of approximation problems {(COCPϵ(p))}. Each of these {(COCPϵ(p))} is viewed as a smooth nonlinear mathematical programming problem solved by various optimization methods such as gradient-based techniques [23]. However, all those techniques are only designed to find local optimal solutions. Furthermore, in solving these {(COCPϵ(p))}, the evaluation of candidate feed rates is a computationally expensive operation because of solving the controlled nonlinear system (2.1). Consequently, finding the global optimum or a good suboptimal solution with traditional algorithms based on gradient method or nontraditional search and optimization techniques based on natural phenomenon such as genetic algorithm [25], evolution strategies [26], and simulation annealing [27] is too consuming, or even impossible within the time available.
Differential evolution (DE), a recent optimization technique, is an exceptionally simple and easy to use evolution strategy, which is significantly faster and robust at numerical optimization and is more likely to find a function’s true global optimum [28]. Differential evolution algorithm has been used in the recent past to solve many engineering optimization problem, see, for example, [29, 30]. When using any population-based search algorithm in general and DE in particular to optimize a function, an acceptable trade-off between convergence rate (with reference to locating optimum) and robustness (with reference to not missing the global optima) must generally be determined. To increase the convergence speed of DE without compromising with the robustness, a modified differential evolution (MDE) is developed to solve nonlinear unconstrained optimization problems encountered in chemical engineering [31]. Nevertheless, the (COCPϵ(p))is a nonlinear optimization problem with constraints in state and control parameters, which MDE can not be applied directly to solving it. Hence, the following strategies are added to the MDE [31].
(i)
(Handling the control constraint). If there is bound violation for a parameter in the ιth individual at the κth step, then that parameter is generated randomly between given lower and upper bound using the following equation:
()
where is D is the number of parameters.
(ii)
(Dealing with the continuous state constraint). For the parameter of the ιth individual at the κth step, test the value of . If , then the parameter is feasible. Otherwise, that is, , move the parameter towards the feasible region in the direction of with Armijo line search.
(iii)
(Stopping criteria). The algorithm stops when any of the following conditions holds:
(a)
the maximal iteration M is reached;
(b)
the maximal deviation between the group’s best fitness values in the last M1 iterations is less than ε, where ε is a predefined constant.
Now, we can obtain an approximately optimal control for (COCP) as shown in the following algorithm.
Algorithm 1.
Step 1. Choose initial value of ϵ.
Step 2. Solve approximate problem (COCPϵ(σp)) using the improved MDE algorithm to give .
Step 3. Set ϵ = αϵ. If , where is a prespecified positive constant, go to Step 2. Otherwise go to Step 4.
Step 4. If , where P is a predefined positive constant, go to Step 5. Otherwise, go to Step 1 with increased to for each i.
The piecewise constant control up,* obtained is an approximately optimal solution of (COCP).
4. Numerical Results
The initial state, the initial volume of fermentor, the initial concentration of glycerol in feed, and the fermentation time are x0 = (0.1115 gL−1, 495 mmolL−1,0,0, 0) T, V0 = 5 L, cs0 = 10762 mmolL−1, and T = 24.16 h, respectively. Fed-batch process begins at t1 = 5.33 h. The feeding moment t2j+1 and the feeding stopping moment t2j+2, are determined by the experiment.
In order to save computational time, the fermentation process is partitioned into the first batch phase (Bat.Ph.) and phases I-IX (Phs.I-IX) according to the actual fermentation process. In each of Phs.I-IX, the same feeding strategy is adopted. Moreover, the durations of the feeding processes in Phs. I-IX are 5, 7, 8, 7, 6, 4, 3, 2, 1 seconds in each 100 seconds, leaving 95, 93, 92, 93, 96, 97, 98, and 99 seconds for batch cultures, respectively. It should be mentioned that this approach had been adopted to obtain the experimental data [12]. In addition, the bounds of feed rates of glycerol and alkali in Phs.I-IX are listed in Table 2.
Table 2.
The bounds of feed rates in Phs.I-IX.
Phases
Upper (u1)
Lower (u1)
Upper (u2)
Lower (u2)
Phs.I-II
0.2524
0.1682
0.1905
0.12615
Ph.III
0.2390
0.1594
0.17925
0.11955
Phs.IV-V
0.2524
0.1682
0.1905
0.12615
Ph.VI
0.2657
0.1771
0.199275
0.132825
Ph.VII
0.2924
0.1949
0.2193
0.146175
Phs.VIII-IX
0.3058
0.2038
0.22935
0.15285
In the improved MDE algorithm, the number of populations Np, the maximal iteration M, and the parameters F, CR, M1, ε, ϵ, are, respectively, 86, 300, 0.5, 0.9, 10, 10−3, 0.1, and 1.0 × 10−8. The specified constant P in Algorithm 1 is 1. These parameters are derived empirically after numerous experiments.
Applying Algorithm 1 to the optimal control model, we obtain the optimal feed strategies of glycerol and alkali. Here, the computational process is coded using Microsoft Visual C++ on PC with Intel Core 2 Duo CPU, 2.93 GHz RAM. Especially, the ODEs are numerically calculated by the improved Euler method with the relative error tolerance 10−4. The optimal feed rates of glycerol and alkali are plotted using MATLAB R2010a in Figure 1. To show the feed rates of glycerol and alkali in the feeding processes for Ph. I to Ph. IX better, 9 small subfigures are also incorporated in Figure 1, respectively. Under the obtained optimal feed rates, the computational concentration of 1,3-PD at the terminal time is 1053.67 mmolL−1 which is increased by 32.17% in comparison with experimental result 797.23 mmolL−1. In particular, the concentration change of 1,3-PD with respect to fermentation time under the optimal feed rates of glycerol and alkali is shown in Figure 2. From these curves in Figure 2, we conclude that 1,3-PD concentration at the terminal time in this paper is actually higher than the one previously reported.
The concentration changes of 1,3-PD with respect to fermentation time.
5. Conclusions
Taking the feed rates of glycerol and alkali as the control functions, a nonlinear dynamical system was proposed to describe a fed-batch fermentation. A constrained optimal control model involving the nonlinear dynamical system was then presented to maximize the concentration of 1,3-PD at the terminal time. Based on the control vector parametrization method and the improved MDE algorithm, a computational method was developed to seek the optimal solution of the optimal control model. Numerical results verified the validity of the mathematical model and the effectiveness of the computational method.
Acknowledgments
This paper is supported by the Shandong Province Natural Science Foundation of China (Grant no. ZR2010AQ016 and Grant no. ZR2011AL003), the Natural Science Foundation for the Youth of China (Grant no. 11001153), and the TianYuan Special Funds of the National Natural Science Foundation of China (Grant no. 11126077).
1Menzel K.,
Zeng A. P., and
Deckwer W. D., High concentration and productivity of 1,3-propanediol from continuous fermentation of glycerol by Klebsiella pneumoniae, Enzyme and Microbial Technology. (1997) 20, no. 2, 82–86, 2-s2.0-0031081403, https://doi.org/10.1016/S0141%2D0229(96)00087%2D7.
2Zeng A. P. and
Biebl H., Bulk chemicals from biotechnology: the case of 1,3-propanediol production and the new trends, Advances in Biochemical Engineering/Biotechnology. (2002) 74, 239–259, 2-s2.0-0036360494.
3Zeng A. P.,
Ross A.,
Biebl H.,
Tag C.,
Gunzel B., and
Deckwer W. D., Multiple product inhibition and growth modeling of Clostridium butyricum and Klebsiella pneumoniae in glycerol fermentation, Biotechnology and Bioengineering. (1994) 44, no. 8, 902–911, https://doi.org/10.1002/bit.260440806.
4Gao C.,
Feng E.,
Wang Z., and
Xiu Z., Nonlinear dynamical systems of bio-dissimilation of glycerol to 1,3-propanediol and their optimal controls, Journal of Industrial and Management Optimization. (2005) 1, no. 3, 377–388, 2153074, https://doi.org/10.3934/jimo.2005.1.377, ZBL1076.92023.
5Gao C.-X.,
Li K.-Z.,
Feng E.-M., and
Xiu Z.-L., Nonlinear impulsive system of fed- batch culture in fermentative production and its properties, Chaos Solitons Fractals. (2006) 28, 271–277.
6Gong Z., A multistage system of microbial fed-batch fermentation and its parameter identification, Mathematics and Computers in Simulation. (2010) 80, no. 9, 1903–1910, 2658522, https://doi.org/10.1016/j.matcom.2009.12.011, ZBL1194.37174.
7Lim H.-C. and
Lee K.-S., K. Schugerl, Control of bioreactor systems, Biotechnology, 1991, 4, VCH, Weinhelm, Germany, 506–560, Measuring, Modelling and Control.
9Oberle H. J. and
Sothmann B., Numerical computation of optimal feed rates for a fed-batch fermentation model, Journal of Optimization Theory and Applications. (1999) 100, no. 1, 1–13.
10Sarkar D. and
Modak J. M., Optimization of fed-batch bioreactors using genetic algorithm: multiple control variables, Computers and Chemical Engineering. (2004) 28, no. 5, 789–798, 2-s2.0-1842840111, https://doi.org/10.1016/j.compchemeng.2004.02.018.
11Shin H. S. and
Lim H. C., Maximization of metabolite in fed-batch cultures. Sufficient conditions for singular arc and optimal feed rate profiles, Biochemical Engineering Journal. (2007) 37, no. 1, 62–74, 2-s2.0-35148852774, https://doi.org/10.1016/j.bej.2007.03.015.
12Wang G.,
Feng E., and
Xiu Z., Modeling and parameter identification of microbial bioconversion in fed-batch cultures, Journal of Process Control. (2008) 18, no. 5, 458–464, 2-s2.0-42949159158, https://doi.org/10.1016/j.jprocont.2007.08.005.
13Wang H.,
Feng E., and
Xiu Z., Optimality condition of the nonlinear impulsive system in fed-batch fermentation, Nonlinear Analysis: Theory, Methods & Applications. (2008) 68, no. 1, 12–23, 2-s2.0-34848859588, https://doi.org/10.1016/j.na.2006.10.027.
14Liu C.,
Gong Z., and
Feng E., Modeling and optimal control of a nonlinear dynamical system in microbial fed-batch fermentation, Mathematical and Computer Modelling. (2011) 53, no. 1-2, 168–178, 2739254, https://doi.org/10.1016/j.mcm.2010.08.001, ZBL1211.93012.
15Liu C. and
Feng E., Optimal control of switched autonomous systems in microbial fed-batch cultures, International Journal of Computer Mathematics. (2011) 88, no. 2, 396–407, https://doi.org/10.1080/00207160.2011.553674, 2754702, ZBL1213.82114.
16Ye J.,
Feng E.,
Yin H., and
Xiu Z., Modelling and well-posedness of a nonlinear hybrid system in fed-batch production of 1,3-propanediol with open loop glycerol input and pH logic control, Nonlinear Analysis: Real World Applications. (2011) 12, no. 1, 364–376, https://doi.org/10.1016/j.nonrwa.2010.06.022, 2728688, ZBL1201.92032.
17Gong Z.,
Liu C.,
Feng E.,
Wang L., and
Yu Y., Modelling and optimization for a switched system in microbial fed-batch culture, Applied Mathematical Modelling. (2011) 35, no. 7, 3276–3284, https://doi.org/10.1016/j.apm.2011.01.023, 2785278, ZBL1221.34033.
18Levišauskas D.,
Galvanauskas V.,
Simutis R.,
Žilinskas A., and
Žilinskas J., Optimization of biomass production in fed-batch culture by feed and dilution control actions, Information Technology and Control. (2006) 35, no. 4, 383–388.
19Luus R. and [email protected], Hennessy D., Optimization of fed-batch reactors by the Luus-Jaakola optimization procedure, Industrial and Engineering Chemistry Research. (1999) 38, no. 5, 1948–1955.
20Xiu Z.-L.,
Zeng A.-P., and
An L.-J., Mathematical modelling of kinetics and research on multiplicity of glyceroll bioconversion to 1,3-propanediol, Journal of Dalian University of Technology. (2000) 4, 428–433.
27Kirkpatrick S.,
Gelatt,C. D.Jr., and Vecchi M. P., Optimization by simulated annealing, American Association for the Advancement of Science. Science. (1983) 220, no. 4598, 671–680, 702485, ZBL1225.90162.
28Price K. and
Storn R., Differential Evolution—a simple evolution strategy for fast optimization, Dr Dobb′s Journal. (1997) 22, 18–24 , 2-s2.0-0142000477.
29Chiou J. P. and
Wang F. S., Hybrid method of evolutionary algorithms for static and dynamic optimization problems with application to a fed-batch fermentation process, Computers and Chemical Engineering. (1999) 23, no. 9, 1277–1291, 2-s2.0-0033544450, https://doi.org/10.1016/S0098%2D1354(99)00290%2D2.
30Wang F. S. and
Shyu C. H., Optimal feed policy for fed-batch fermentation of ethanol production by Zymomous mobilis, Bioprocess Engineering. (1997) 17, no. 2, 63–68, 2-s2.0-0030876130, https://doi.org/10.1007/s004490050354.
31Babu B. V. and
Angira R., Modified differential evolution (MDE) for optimization of non-linear chemical processes, Computers and Chemical Engineering. (2006) 30, no. 6-7, 989–1002, 2-s2.0-33747878550, https://doi.org/10.1016/j.compchemeng.2005.12.020.
Please check your email for instructions on resetting your password.
If you do not receive an email within 10 minutes, your email address may not be registered,
and you may need to create a new Wiley Online Library account.
Request Username
Can't sign in? Forgot your username?
Enter your email address below and we will send you your username
If the address matches an existing account you will receive an email with instructions to retrieve your username
The full text of this article hosted at iucr.org is unavailable due to technical difficulties.