Abstract
An analytic method is proposed to compute the price-reserve offer curve at the consumer level in hierarchical direct load control. The convexification of the consumer reserve provision is examined, and the analytic expression of the optimal solution within each critical region is derived. Then, based on multi-parametric programming, a combinatorial enumeration method in conjunction with efficient reduction and pruning strategy is proposed to compute the optimal response of consumers in the whole price space. Numerical tests along with an application example in the bi-level aggregator pricing problem demonstrate the merit of this method.
WITH the integration of an increasing amount of renewable sources, power systems need more reserve capacity to keep power balance. As demand response has been recognized as an effective and convenient way for energy management [
To tackle these issues, an efficient method is proposed to obtain the optimal price-reserve offer curve [

Fig. 1 Comparison of three methods to characterize consumers’ response in DLC. (a) mpEC. (b) PM. (c) Proposed analytic method.
To achieve this, multi-parametric programming is employed [
The merits of this short letter are summarized as follows.
1) Most existing literature adopts stepwise constant price-reserve offer curves, which may be convenient but not optimal. An MPEP is proposed, for the first time, to accurately describe the optimal reserve provision.
2) Calculating the optimal reserve with a specific price signal has been well studied by the existing works. However, the difficulty is how to obtain the optimal reserve in the whole price space where numerous cases of price signals should be considered. To this end, a reduction and pruning method is proposed to explore all CRs efficiently.
3) A bi-level aggregator pricing (AP) problem is listed as an example to demonstrate the application of the proposed method. Numerical results show that even in this simple case, the economic improvement due to more accurate price-reserve offer curves is still substantial.
With a certain pt = (pt,up, pt,down
(1) |
s.t.
(2) |
(3) |
(4) |
(5) |
(6) |
(7) |
(8) |
(9) |
where , , are the current, maximum, and minimum power consumptions of the consumer at time t, respectively; denotes the approximated load shifting, load shedding, and load increasing components of the reserve capacity at time t, respectively; , , are the corresponding costs, respectively; and , , are the cost coefficients.
The model can be described as follows. The objective in (1) is the total profit maximization of CRP. Constraints (2) and (3) bound up- and down-reserve by load consumption, respectively. Constraints (4)-(6) factorize the reserve into shifting, shedding, and increasing components, while constraints (7)-(9) represent the corresponding costs.
Note that and . To avoid non-differential representation of (4)-(6), CRP can be rewritten equivalently as in the following form [
(10) |
s.t.
(11) |
(12) |
(13) |
(14) |
(15) |
(16) |
where is the multipliers of the corresponding constraints under the KKT conditions. Bilinear constraint (16) makes this model strongly nonconvex and hard to solve.
can be written as two convex problems (CRP1 and CRP2) by nulling and , respectively, which provides two solutions of reserve provision. The final decision made by the consumer will be the solution that brings more profits. However, this procedure will involve solving two problems. To further speed up the solution, the condition where constraint (16) can be relaxed is discussed, and the analytic price-reserve offer curve among the whole investigated price space can be obtained via solving one convex problem instead of two. rCRP is denoted as the convex relaxed version of CRP by removing (16).
Proposition 1: the optimal solution of rCRP is denoted as . Then relaxing (16) is exact under the following sufficient conditions with regard to the marginal costs, where is the first-order derivative of the cost function .
1) Condition 1: .
2) Condition 2: .
Before proving Proposition 1, a lemma is stated as follows.
Lemma 1: if there exists and in the optimal solution of rCRP, then under condition 1.
Proof of Lemma 1: assume . With a small enough positive , is set, and it follows that is also a feasible solution of rCRP. The difference of corresponding objectives between solutions and is , which is positive under condition 1, and is an infinitesimal of higher order than . This contradicts with the optimality of solution .
Proof of Proposition 1: assume there exists and in the optimal solution of rCRP, then we have under condition 1 according to Lemma 1. Then , . Let L denote the Lagrangian of rCRP. Using KKT conditions, we can obtain and .
Combining these with the fact that yields under condition 2, which violates KKT conditions. Hence, and cannot appear simultaneously in the optimal solution of rCRP. Therefore, the relaxation is exact under sufficient conditions 1 and 2.
Remark: the aim of condition 1 is to avoid zero load shifting at the optimal point. In fact, compared with the load shedding, the cost of load shifting is relatively lower, and is usually prioritized. Conditions 1 and 2 can also be replaced by a stricter condition, which can be checked beforehand.
(17) |
Although condition (17) may not hold all the time, CRP1, CRP2, and rCRP are all convex quadratic programming problems, where the following MPEP is applicable to obtain the price-reserve offer curve from these problems. The set of binding constraints is denoted as the active set . Without the loss of generality, CRP1, CRP2, and rCRP can be compacted as CPR-A in the following form:
(18) |
s.t.
(19) |
(20) |
where B is a constant coefficient matrix determined by constraints; and d is a corresponding right-hand side vector; a matrix or vector with a subscript denotes the sub-matrix or vector associated with active or inactive constraints; ; ; and E is a constant matrix [1, 1; 1, 0; 0, 1]. With a price signal , the optimal response, i.e., reserve provision, from a consumer can be derived in an analytic form:
(21) |
which holds for any pt in the following CR:
(22) |
where , , and , which are all constant matrices.
To enumerate all active sets A, a combinatorial tree listing all possibilities for A is established as shown in

Fig. 2 Combinatorial tree listing all possibilities for MPEP.
To sum up,

Fig. 3 Whole flowchart to obtain price-reserve offer curve using proposed MPEP method.
The parameter setting remains the same as type III consumer in [
In

Fig. 4 Comparison of average errors over 10201 samples in evolution of t.

Fig. 5 Price-reserve offer curve (t = 17 hour) divided by 5 CRs using proposed MPEP method.
To further demonstrate how the proposed method can be applied to help the upper-level aggregator for decision making, the following problem of bi-level AP [
(23) |
s.t.
(24) |
(25) |
(26) |
where is the clearing prices for up- and down-reserve capacities determined through the electricity market clearing by system operator (SO) at time t; are the lower- and upper- bounds of up- and down-reserve capacities required by SO, respectively; is the price signal from the aggregator to consumer i for up- and down-reserve capacities at time t, which should lie in a price interval specified by (25); is the optimal response, which depends on , from consumer i determined by the lower-level problem, i.e., (26) and (11)-(15). After receiving required by SO, the goal of AP problem is to optimally decide its price signal , so that its profit in (23) is maximized, while the total up- and down-reserve capacities gathered from consumers through the incentive meet the requirement of SO in (24).
For comparison, three methods are implemented to solve the AP problem using mpEC, PM and the proposed method, respectively. Note that when using the proposed method, the lower-level problem can be replaced by the piece-wise affine offer curve in (21) and (22). Finally, the bi-level problem is transformed equivalently into a mixed-integer quadratic program (MIQP), which can be solved efficiently by the existing commercial solvers such as Gurobi. The reserve requirement is set to be and . For simplicity, is considered in the simulation. is simplified as a constant vector arbitrarily, setting to be when , and .
Simulation results are compared in
If using PM(20), the aggregator will misprice the down-reserve due to the error of the estimated offer curve, which unnecessarily costs itself 31.97% of the profit even in the simple case. As shown in
Based on the proposed MPEP, an efficient analytic method is presented to compute the price-reserve offer curve at the consumer level. An example of its application in the bi-level AP problem is also discussed. Numerical results show that the proposed method is both efficient and accurate compared with the existing methods, while the privacy of consumers is well preserved. Even in the simple illustrating example, the proposed method brings significant economic improvement due to the accuracy of the calculated offer curve compared with the existing methods that use stepwise constant offer curves. The improvement is due to a more accurate description of the optimal reserve using the proposed analytic method.
Temporal constraints can be readily considered if the variables are extended to incorporate all time slots in the problem of CRP-A. Also, the proposed MPEP does not rely on the specific formulation of CRP model. If other problems can be written in the form of CRP-A, which is a quadratic programming problem, MPEP is still applicable.
However, this research work is preliminary. Large-scale demand-side flexibility aggregation is left open, where efficient decomposition, e.g., based on the alternating direction method of multipliers, is worthy of further study. In the future, we will also investigate a more detailed load model of consumers [
References
W. Zheng, W. Wu, B. Zhang et al., “Distributed optimal residential demand response considering operational constraints of unbalanced distribution networks,” IET Generation, Transmission, and Distribution, vol. 12, no. 9, pp. 1970-1979, May 2018. [Baidu Scholar]
D. S. Callaway and I. A. Hiskens, “Achieving controllability of electric loads,” Proceedings of the IEEE, vol. 99, no. 1, pp. 184-199, Jan. 2011. [Baidu Scholar]
W. Zheng and D. J. Hill, “Incentive-based coordination mechanism for distributed operation of integrated electricity and heat systems,” Applied Energy, vol. 285, p. 116373, Jan. 2021. [Baidu Scholar]
S. M. Amin, “Smart grid security, privacy, and resilient architectures: opportunities and challenges,” in Proceedings of 2012 IEEE PES General Meeting, San Diego, USA, Jul. 2012, p. 2 [Baidu Scholar]
T. W. Haring, J. L. Mathieu, and G. Andersson, “Comparing centralized and decentralized contract design enabling direct load control for reserves,” IEEE Transactions on Power Systems, vol. 31, no. 3, pp. 2044-2054, May 2016. [Baidu Scholar]
M. Bozorg, A. Ahmadi-Khatir, and R. Cherkaoui, “Developing offer curves for an electric railway company in reserve markets based on robust energy and reserve scheduling,” IEEE Transactions on Power Systems, vol. 31, no. 4, pp. 2609-2620, Jul. 2016. [Baidu Scholar]
W. Zheng, Y. Hou, and Z. Li, “A dynamic equivalent model for district heating networks: formulation, existence and application in distributed electricity-heat operation,” IEEE Transactions on Smart Grid, doi: 10.1109/TSG.2020.3048957 [Baidu Scholar]
W. Zheng, W. Wu, Z. Li et al., “A non-iterative decoupled solution for robust integrated electricity-heat scheduling based on network reduction,” IEEE Transactions on Sustainable Energy, doi: 10.1109/TSTE.2021.3052235 [Baidu Scholar]
T. Gal, Postoptimal Analyses, Parametric Programming, and Related Topics. Prinston: De Gruyter, 2010. [Baidu Scholar]
Y. Guo, L. Tong, W. Wu et al., “Coordinated multi-area economic dispatch via critical region projection,” IEEE Transactions on Power Systems, vol. 32, no. 5, pp. 3736-3746, Sept. 2017. [Baidu Scholar]
A. Gupta, S. Bhartiya, and P. S. V. Nataraj, “A novel approach to multiparametric quadratic programming,” Automatica, vol. 47, no. 9, pp. 2112-2117, Nov. 2011. [Baidu Scholar]
Z. Xu, T. Deng, Z. Hu et al., “Data-driven pricing strategy for demand-side resource aggregators,” IEEE Transactions on Smart Grid, vol. 9, no. 1, pp. 57-66, Jan. 2018. [Baidu Scholar]
X. Zhang, C. Lu, Y. Wang et al., “Identifiability analysis of load model by estimating parameters’ confidential intervals,” CSEE Journal of Power and Energy Systems, doi: 10.17775/CSEEJPES.2020.02780 [Baidu Scholar]
Y. Ju, J. Wang, Z. Zhang et al., “A calculation method for three-phase power flow in micro-grid based on smooth function,” IEEE Transactions on Power Systems, vol. 35, no. 6, pp. 4896-4903, Nov. 2020. [Baidu Scholar]
W. Zheng, W. Huang, D. J. Hill et al., “An adaptive distributionally robust model for three-phase distribution network reconfiguration,” IEEE Transactions on Smart Grid, doi: 10.1109/TSG.2020.3030299 [Baidu Scholar]