Abstract
Aggregate thermostatically controlled loads (ATCLs) are a suitable candidate for power imbalance on demand side to smooth the power fluctuation of renewable energy. A new control scheme based on an improved bilinear aggregate model of ATCLs is investigated to suppress power imbalance. Firstly, the original bilinear aggregate model of ATCLs is extended by the second-order equivalent thermal parameter model to optimize accumulative error over a long time scale. Then, to ensure the control performance of tracking error, an improved model predictive control algorithm is proposed by integrating the Lyapunov function with the error transformation, and theoretical stability of the proposed control algorithm is proven. Finally, the simulation results demonstrate that the accuracy of the improved bilinear aggregate model is enhanced; the proposed control algorithm has faster convergence speed and better tracking accuracy in contrast with the Lyapunov function-based model predictive control without the prescribed performance.
THE bulk of intermittent renewable energy integrated with the power grid triggers the power imbalance between the supply side and demand side [
One of the key issues in the challenge is to establish an accurate model to describe the dynamic evolutionary behavior of aggregate thermostatically controlled loads (ATCLs) over a time scale as long as possible. The modeling of ATCLs currently includes four methods: state-space equation [
Another further problem is to study the control algorithm based on the aggregate model of ATCLs. Through changing the set-point temperature of ATCLs in [
In this paper, for the first issue of aggregate modeling, the bilinear aggregate model (BAM) of ATCLs is firstly extended in terms of the second-order ETP model with average load transfer rates. But the extended model called SBAM fits only a small change of set-point temperature. To further enhance the accuracy of modeling over a longer time scale, an improved SBAM (ISBAM) is built taking into account the real indoor mass temperature and set-point temperature. For another issue of the control approach, an improved Lyapunov function-based MPC (ILMPC) algorithm with prescribed performance is proposed. The simulation results show that the ISBAM is more accurate than the ordinary aggregate model. The proposed ILMPC algorithm reduces the computation time and confines tracking performance within a prescribed boundary as compared with traditional MPC.
The contributions of this paper are manifested as follows: ① by considering the indoor mass temperature, the original BAM of ATCLs is improved to build a more accurate ISBAM; ② a Lyapunov function-based MPC algorithm with prescribed performance is presented for ATCLs to less execution time while ensuring control performance both in steady state and transient state.
The remainder of this paper is organized as follows. Section II derives the ISBAM for ATCLs. The ILMPC approach is developed in Section III. The simulation is conducted in Section IV to verify the precision of the improved model and the effectiveness of the proposed control approach. Section V draws out some conclusions.
The disregarding of the coupling effect between indoor mass temperature and indoor air temperature in the first-order ETP model results in the fact that it cannot accurately describe the real dynamic thermal behavior of TCL in transient response such as the change of set-point temperature. A second-order ETP model [
(1) |
where is the indoor air temperature; is the indoor mass temperature; is the outdoor ambient temperature; P is the operating power of an individual TCL; Tmax and Tmin are the upper and lower limits of temperature, respectively; Tset is the set-point temperature; is the temperature deadband; Ca is the heat capacity of indoor air; Ra is the indoor air thermal resistance; Cm is the heat capacity of the indoor mass; Rm is the indoor mass thermal resistance; t is the time; is the switching variable; and is the time step.
The corresponding dynamic thermal equivalent circuit of the two-mass model is shown in

Fig. 1 Thermal equivalent circuit of second-order ETP model for individual TCL.
The aggregate power Pr based on the second-order ETP model is:
(2) |
where is the efficiency of the
Both the continuous temperature variable and “ON/OFF” discrete variable included in the second-order ETP model of TCL make it complex to use for control design, even though the model can precisely represent its power consumption. If each TCL is expressed as an independent ETP model, the aggregate model describing a huge number of TCLs will inevitably confront the disaster of dimensionality.
Control-oriented original BAM of ATCLs constructed through the first-order ETP model in [
(3) |
where is an state variable matrix representing the number of TCLs in each temperature interval after the finite difference discretization, L is the number of temperature intervals; is the control input; is the total consuming power of ATCLs; is an output matrix; is an matrix; and B is also an matrix with the same structure as matrix A. Please see matrix A in Appendix A for details, where and in matrix A are the load transfer rates of TCL over the ON and OFF states, respectively, which can be calculated by (4). and in matrix A are set to be -1 to obtain matrix B, i.e., .
(4) |
To reduce the amount of computation, the load transfer rates in each temperature interval are approximated in the average transfer rates under the expected set-point temperature and the initial indoor mass temperature Tm0. Then, A becomes a constant matrix , and (4) could be simplified and written as:
(5) |
The SBAM only suits for a relatively small variation of the set-point temperature Tset. When Tset deviates greatly from its expected value , if the average transfer rates are still used to express the real transfer rates , the SBAM will be inaccurate over a long time scale and the comparative results will be demonstrated in Section IV.
Hence, the real mass temperature and real set-point temperature are used to express the transfer rates . A new group of transfer rates can be written as:
(6) |
Thus, the ISBAM based on can be derived as:
(7) |
where and reflect the real-time and cumulative effects with the change of set-point temperature on the evolutionary process of ATCLs, respectively; and indicates the influence of the two-mass model. The matrices A and B remain unchanged and are still constant matrices., , and . As the indoor mass temperature is not easy to obtain, its estimation is used instead, given by:
(8) |
(9) |
where .
The dynamic process of TCLs after finite-difference discretization is shown in

Fig. 2 Dynamic process of TCLs after finite-difference discretization.
The control goal is to devise an ILMPC algorithm with prescribed performance for the ISBAM to track a given reference trajectory. The major difference between the modified MPC and traditional MPC is that the optimal control law in the modified MPC is directly determined through a constructed Lyapunov function, which guarantees the stability and reduces the computational burden. Hence, minimizing the cost function to obtain the control signal in traditional MPC is avoided. Moreover, in combination with the prescribed performance function (PPF), the tracking error can be assumed to converge to a predefined arbitrarily small residual set both in steady state and transient state [

Fig. 3 Control flow chart of ILMPC.
Lemma 1: considering a dynamic system , for a given bounded initial conditions, if there exists a continuous and positive Lyapunov function satisfying , where and are positive constants, then the solution of the system is semi-global uniformly ultimate bounded.
Proof: please refer to [
In terms of the elaborately designed PPF [
(10) |
where and are the positive design parameters; and , where ; is a bounded, smooth, strictly positive, and decreasing function used to specify the error boundary range called performance function, and it can be designed as:
(11) |
where , and is selected such that ; represents the maximum allowable boundary of in the steady state that can be set as an arbitrarily small value to ensure the practical convergence of to be zero. Moreover, the rate of convergence for is related to the constant r.
In contrast with the other conventional prescribed performance functions like preset time performance function given in (12),
(12) |

Fig. 4 Simulation results for exponential PPF and preset time PPF.
where is the preset convergence time; and h is a positive constant larger than 2.
To achieve the control performance depicted in (10) more conveniently, an equivalent unconstraint condition is built as:
(13) |
where s is known as the transformation error; and is the smooth and strictly increasing function satisfying (14):
(14) |
According to (13), the transformation error s could be represented as:
(15) |
Its first derivative is:
(16) |
where ; and .
Lemma 2: for the tracking error signal and corresponding transformation error defined by (13) and satisfying (14), if is bounded, will satisfy (10) for all .
Proof: we assume that there exist two unknown constants s1 and s2 such that:
(17) |
By using the inverse transformation for all , (13) could be written as:
(18) |
Finally, in terms of (14), we can obtain:
(19) |
Hence, Lemma 2 holds.
Lemma 3: for any and arbitrary constant , the following inequality (20) holds.
(20) |
Proof: please refer to [
This section is to design the ILMPC algorithm.
Step 1: (7) is chosen as the prediction model and rewritten as:
(21) |
Step 2: the transformation error is rewritten in accordance with (16) and (21) and shown as:
(22) |
The Lyapunov function of the system is defined as . Then, we can obtain:
(23) |
According to the Lyapunov stability theory and prescribed performance control, the optimal control law is designed as:
(24) |
where .
In terms of Lemma 3, the expression of could be written as:
(25) |
where .
Substituting (25) into (23), we can obtain:
(26) |
It follows from (26) that:
(27) |
By Lemma 1, is bounded and exponentially convergent in (27), which shows that s is bounded. By Lemma 2 and the appropriate choices of the performance function and the constants and , the tracking error could remain within the prescribed performance boundary when .
Theorem 1: Considering the system (21) and the controller (24), the closed-loop system is stable and the tracking error converges to a neighborhood of the origin within the prescribed performance boundary for all .
For evaluating the accuracy of ISBAM, 1000 TCLs are chosen to analyze the performance of the first-order ETP model, second-order ETP model, SBAM, and ISBAM through the Monte Carlo simulation method. In order to make the selected parameters of TCLs closer to the actual situation and ensure the parameters of TCLs to be non-uniform, the parameters of TCLs are taken as a series of log-normally distributed functions with the expected values of the distributed functions as shown in

Fig. 5 Comparative results of first-order ETP model with second-order ETP model.

Fig. 6 Comparative results among second-order ETP model, SBAM, and ISBAM.
In
To illustrate the validity of the presented ILMPC with prescribed performance, a three-layer control architecture is presented in

Fig. 7 Schematic diagram of example system.
About the selection of parameters, it is known that and are usually taken as 1; r, , and can be selected according to the initial state of the controlled system and the desired preset performance. Generally, we use to determine ; r is larger than zero, and is a positive number close to zero. For practical application scenarios, the optimal control parameters can be identified based on the trial-and-error method and previous experience.
To verify the control performance better, the comparative analysis with the Lyapunov function-based MPC (LMPC) algorithm without prescribed performance is investigated and three cases are conducted.
The objective is to regulate ATCLs to provide 40 MW power in 30 minutes. Six initial conditions of ey0 are 0.0175, 0.0451, 0.0947, -0.0239, -0.0515 and -0.0929, respectively. The design parameters of the controller and PPF are chosen as , , , , and . The simulation results are given in Figs.

Fig. 8 Comparison of power tracking error with different control approaches. (a) Proposed ILMPC. (b) LMPC without prescribed performance.

Fig. 9 Change in number of TCLs in each temperature interval.

Fig. 10 Power errors ey with different r.
Moreover,
For the initial state and the reference power MW, with the aid of the proposed control algorithm, we observe the change in the number of TCLs. The result is shown in
We will further validate the improved performance of the proposed PPF-based ILMPC control scheme. In this case, a more realistic reference power MW is used in the first group simulation. The initial tracking error and the design parameters of the controller and PPF are chosen as , , , , and . The simulation results are shown in

Fig. 11 Comparisons of power tracking error with different control approaches under more realistic reference power. (a) Proposed ILMPC in the first group simulation. (b) LMPC in the first group simulation. (c) Proposed ILMPC in the second group simulation. (d) LMPC in the second group simulation.
For practical applications, TCL parameters on the load side may be different, and there will also be uncertainties on the generation side. The control effect of ATCLs may be affected by the change of TCL parameters. The controller must be robust enough to make sure that the reference signal can be accurately tracked under external disturbances. In order to further verify the robustness of the proposed control algorithm, when the TCL parameters change in the range of -40%-40%, the tracking effect of the proposed algorithm and LMPC algorithm is compared and simulated, and the results are shown in

Fig. 12 Robustness analysis with uncertainties in the model parameters. (a) Proposed ILMPC. (b) LMPC without prescribed performance.
The consuming power of ATCLs is used to smooth the power fluctuation of renewable energy. The desired trajectory Pref of ATCLs is delivered by the dispatch center. The generation power data and load power data of the system within two hours are shown in

Fig. 13 Power generation and consumption of system.
Due to the suddenness and randomness of renewable power output, it is difficult to meet the load demand by only adjusting the conventional generators, which is restricted by climbing rates and the minimum technical outputs. By regulating ATCLs to consume the surplus power of renewable energy, the power imbalance will be effectively alleviated and the curtailment of WP or PV power will also be prevented.
To track the given reference trajectory Pref, the largest value among the initial conditions is that satisfies the inequality . The design parameters of the controller and PPF are chosen as , , , , and . The simulation results are shown in

Fig. 14 Power tracking error curve with different control approaches.
By introducing indoor mass temperature, the original bilinear aggregate model of TCLs is enhanced by the second-order equivalent thermal parameter model. An LMPC algorithm with prescribed performance is proposed for ATCLs to maintain the power balance between the supply side and demand side. The conclusions are given as follows.
1) The improved bilinear aggregate model optimizes the cumulative error of the innovative model over a long time scale and the dynamic thermal process of ATCLs is described more precisely.
2) The proposed control approach designed in a priori manner improves the control performance both in steady state and transient state, and has a faster convergence speed compared with the algorithm without prescribed performance function.
3) ATCLs can be effectively dispatched by the proposed control method to smooth the power fluctuation of renewable energy without increasing dispatch burden on supply side, and the operating efficiency of the entire system is improved.
Appendix
References
S. R. Sinsel, R. L. Riemke, and V. H. Hoffmann, “Challenges and solution technologies for the integration of variable renewable energy sources–a review,” Renewable Energy, vol. 145, pp. 2271-2285, Jan. 2020. [Baidu Scholar]
A. Basit, A. D. Hansen, M. Altin et al., “Compensating active power imbalances in power system with large-scale wind power penetration,” Journal of Modern Power Systems and Clean Energy, vol. 4, no. 2, pp. 229-237, Jul. 2015. [Baidu Scholar]
J. Wang, Z. Zhou, J. Zhao et al., “Optimizing for clean-heating improvements in a district energy system with high penetration of wind power,” Energy, vol. 175, pp. 1085-1099, May 2019. [Baidu Scholar]
J. A. Pinzon, P. P. Vergara, L. Silva et al., “Optimal management of energy consumption and comfort for smart buildings operating in a microgrid,” IEEE Transactions on Smart Grid, vol. 10, no. 3, pp. 3236-3247, Apr. 2018. [Baidu Scholar]
B. Biegel, P. Andersen, J. Stoustrup et al., “Sustainable reserve power from demand response and fluctuating production–two Danish demonstrations,” Proceedings of the IEEE, vol. 104, no. 4, pp. 780-788, Apr. 2016. [Baidu Scholar]
J. Hu, J. Cao, M. Chen et al., “Load following of multiple heterogeneous TCL aggregators by centralized control,” IEEE Transactions on Power Systems, vol. 32, no. 4, pp. 3157-3167, Jul. 2017. [Baidu Scholar]
J. L. Mathieu, S. Koch, and D. S. Callaway, “State estimation and control of electric loads to manage real-time energy imbalance,” IEEE Transactions on Power Systems, vol. 28, no. 1, pp. 430-440, Feb. 2013. [Baidu Scholar]
N. Lu and D. P. Chassin, “A state-queueing model of thermostatically controlled appliances,” IEEE Transactions on Power Systems, vol. 19, no. 3, pp. 1666-1673, Aug. 2004. [Baidu Scholar]
R. Malhame and C. Y. Chong, “Electric load model synthesis by diffusion approximation of a high-order hybrid-state stochastic system,” IEEE Transactions on Automatic Control, vol. 30, no. 9, pp. 854-860, Sep. 1985. [Baidu Scholar]
S. Bashash and H. K. Fathy, “Modeling and control of aggregate air conditioning loads for robust renewable power management,” IEEE Transactions on Control Systems Technology, vol. 21, no. 4, pp. 1318-1327, Jul. 2013. [Baidu Scholar]
X. Chen, J. Wang, J. Xie et al., “Demand response potential evaluation for residential air conditioning loads,” IET Generation, Transmission & Distribution, vol. 12, no. 19, pp. 4260-4268, Sept. 2018. [Baidu Scholar]
L. M. Cheng and Y. Q. Bao, “A day-ahead scheduling of large-scale thermostatically controlled loads model considering second-order equivalent thermal parameters model,” IEEE Access, vol. 8, pp. 102321-102334, Jun. 2020. [Baidu Scholar]
X. Wu, J. He, Y. Xu et al., “Hierarchical control of residential HVAC units for primary frequency regulation,” IEEE Transactions on Smart Grid, vol. 9, no. 4, pp. 3844-3856, Jul. 2018. [Baidu Scholar]
P. Bajaria and N. M. Singh, “Dynamic dispatch of thermostatically controlled loads using phase oscillator model,” Sustainable Energy Grids & Networks, vol. 18, pp. 1-9, Jun. 2019. [Baidu Scholar]
W. Zhang, J. Lian, C. Y. Chang et al., “Aggregated modeling and control of air conditioning loads for demand response,” IEEE Transactions on Power Systems, vol. 28, no. 4, pp. 4655-4664, Nov. 2013. [Baidu Scholar]
J. Yang, T. Liu, H. Wang et al., “Optimizing the regulation of aggregated thermostatically controlled loads by jointly considering consumer comfort and tracking error,” Energies, vol. 12, no. 9, pp. 1-17, May. 2019. [Baidu Scholar]
H. Zhao, Q. Wu, S. Hang et al., “Hierarchical control of thermostatically controlled loads for primary frequency support,” IEEE Transactions on Smart Grid, vol. 9, no. 4, pp. 2986-2998, Jul. 2018. [Baidu Scholar]
S. Lin, D. Liu, F. Hu et al., “Grouping control strategy for aggregated thermostatically controlled loads,” Electric Power Systems Research, vol. 171, pp. 97-104, Jun. 2019. [Baidu Scholar]
N. Mahdavi, J. H. Braslavsky, M. M. Seron et al., “Model predictive control of distributed air-conditioning loads to compensate fluctuations in solar power,” IEEE Transactions on Smart Grid, vol. 8, no. 6, pp. 3055-3065, Nov. 2017. [Baidu Scholar]
C. Lv, H. Yu, P. Li et al., “Model predictive control based robust scheduling of community integrated energy system with operational flexibility,” Applied Energy, vol. 243, pp. 250-265, Jun. 2019. [Baidu Scholar]
S. Fan and C. Tong, “Model predictive current control method for PMSM drives based on an improved prediction model,” Journal of Power Electronics, vol. 20, no. 8, pp. 1456-1466, Aug. 2020. [Baidu Scholar]
L. Zhang, S. Xu, X. Ju et al., “Flexible satellite control via fixed-time prescribed performance control and fully adaptive component synthesis vibration suppression,” Nonlinear Dynamics, vol. 100, no. 4, pp. 3413-3432, May 2020. [Baidu Scholar]
H. Wu, S. Liu, C. Cheng et al., “Observer based adaptive double-layer fuzzy control for nonlinear systems with prescribed performance and unknown control direction,” Fuzzy Sets and Systems, vol. 392, pp. 93-114, Aug. 2020. [Baidu Scholar]
B. Zhang, L. Jiang, and J. Bai, “Velocity-free prescribed performance control for spacecraft hovering over an asteroid with input saturation,” Journal of the Franklin Institute, vol 357, no. 11, pp. 6471-6497, Jul. 2020. [Baidu Scholar]
J. Zhang, S. Wang, P. Zhou et al., “Novel prescribed performance-tangent barrier Lyapunov function for neural adaptive control of the chaotic PMSM system by backstepping,” International Journal of Electrical Power & Energy Systems, vol. 121, pp. 1-12, Oct. 2020. [Baidu Scholar]
Y. Huang, J. Na, X. Wu et al., “Adaptive control of nonlinear uncertain active suspension systems with prescribed performance,” ISA Transactions, vol. 54, pp. 145-155, Jan. 2015. [Baidu Scholar]
S. Iacovella, F. Ruelens, P. Vingerhoets et al., “Cluster control of heterogeneous thermostatically controlled loads using tracer devices,” IEEE Transactions on Smart Grid, vol. 8, no. 2, pp. 528-536, Mar. 2017. [Baidu Scholar]
S. Bashash and H. K. Fathy, “Modeling and control of aggregate air conditioning loads for robust renewable power management,” IEEE Transactions on Control Systems Technology, vol. 21, no. 4, pp. 1318-1327, Jul. 2013. [Baidu Scholar]
M. P. Akter, S. Mekhilef, N. L. Tan et al., “Modified model predictive control of a bidirectional AC-DC converter based on lyapunov function for energy storage systems,” IEEE Transactions on Industrial Electronics, vol. 63, no. 2, pp. 704-715, Feb. 2016. [Baidu Scholar]
S. Golzari, F. Rashidi, and H. F. Farahani, “A Lyapunov function based model predictive control for three phase grid connected photovoltaic converters,” Solar Energy, vol. 181, pp. 222-233, Mar. 2019. [Baidu Scholar]
Y. Zhang, C. Hua, and K. Li, “Disturbance observer-based fixed-time prescribed performance tracking control for robotic manipulator,” International Journal of Systems Science, vol. 50, no. 13, pp. 1-12, Sept. 2019. [Baidu Scholar]
X. Wang, X. Yin, Q. Wu et al., “Disturbance observer based adaptive neural control of uncertain MIMO nonlinear systems with unmodeled dynamics,” Neurocomputing, vol. 313, pp. 247-258, Nov. 2018. [Baidu Scholar]
Y. Li, S. Tong, L. Liu et al., “Adaptive output-feedback control design with prescribed performance for switched nonlinear systems,” Automatica, vol. 80, pp. 225-231, Jun. 2017. [Baidu Scholar]
C. Wang and Z. Zuo, “Adaptive trajectory tracking control of output constrained multi-rotors systems,” IET Control Theory & Applications, vol. 8, no. 13, pp. 1163-1174, Sept. 2014. [Baidu Scholar]