1 Introduction

1.1 Transmission expansion planning

Transmission expansion planning (TEP) refers to comprehensive studies on determining the time, location, and type of adding new power transmission lines as well as the associated electrical components, in order to ensure the economic, secure, and reliable operations of a power system [1]. There are a variety of factors contributing to the necessity of TEP, including load growth, components’ entry or decommissioning, technological improvement, policy incentive, etc. [2]

Following the advent of electricity markets in many countries, power industry has been transformed from a vertically integrated and regulated utility to an unbundled and liberalized structure. This deregulation and restructuring has resulted in fundamental changes to the power system TEP practices [3, 4]. For instance, the emergence of various self-interested market participants such as brokers and independent power producers has made planning difficult due to conflicting objectives and uncertainties in a market environment [5, 6].

Moreover, the power sector is one of the biggest emission sources and should take a key responsibility in promoting the coordinated development among economy, energy and environment by mitigating carbon emission [7, 8]. This concern on carbon emission mitigation is driving the need to explore power system planning practices under the mode of low-carbon economy, e.g. network planning to facilitate the integration of renewable energy and/or to encourage clean power outputs. Therefore, power system planning becomes more complicated under the impacts of different emission reduction policies.

1.2 Carbon pricing policies

Some key carbon pricing policies in the world are summarized as follows. In 2003 in the U.S., carbon emission allowances could be traded among American corporations under a voluntary scheme on Chicago Climate Exchange. In October 2003, the EU parliament approved a new emission trading scheme in order to meet its commitment made in the Kyoto Protocol. Following this, an EU emission trading scheme (ETS), which was the largest multinational, greenhouse gas emission trading scheme in the world, was enforced in February 2005. Under the EU ETS, a specific allowance for emission was allocated to each EU member and any excessive allowance could be sold to whom was in need of allowances. Some allowances were permitted to be transferred between countries through joint implementation (JI) or clean development mechanisms (CDM), but these transfers should be validated by the United Nations Framework Convention on Climate Change (UNFCCC). This type of EU ETS is also called cap-and-trade. In April 2007, an emission price of $15 NZ per carbon equivalent was implemented. In September 2008, the New Zealand ETS was legislated, and it adopted all free allocation without caps. In July 2010, India introduced a nationwide carbon tax of about $1.07 US on coal, as coal was a major fuel resource for power generation in India. In November 2011, China had a pilot test of carbon trading in seven provinces and a national trading is expected to start in 2016. In July 2012, the Australian government introduced a carbon price of $23 AU per ton of emitted carbon equivalent, but this carbon price has been phased out.

1.3 Review of TEP

Conventional TEP models are formulated as minimizing investment costs of adding new lines. The widely used deterministic and static TEP model in a regulated power utility is defined as [6, 9, 10]:

Minimize

$$ \sum\limits_{i,j \in N} {C_{ij} \eta_{ij} + \lambda \sum\limits_{i \in N} {r_{i} } } $$
(1)

subject to

$$ \varvec{S}^{\text{T}} \varvec{F} + \varvec{g} + \varvec{r} = \varvec{L} $$
(2)
$$ F_{ij} - B_{ij} \left( {\eta_{ij}^{0} + \eta_{ij} } \right)\left( {\theta_{i} - \theta_{j} } \right) = 0 $$
(3)
$$ \left| {F_{ij} } \right| \le \left( {\eta_{ij}^{0} + \eta_{ij} } \right)\overline{F}_{ij} $$
(4)
$$ 0 \le \varvec{g} \le \overline{\varvec{g}} $$
(5)
$$ 0 \le \varvec{r} \le \varvec{L} $$
(6)
$$ 0 \le \eta_{ij} \le \overline{\eta }_{ij} $$
(7)
$$ \eta_{ij} \;{\text{is}}\;{\text{integer,}}\;{\text{and}}\;i,j \in N $$
(8)

where C ij is the investment cost of a line added to corridor \( i {-} j \); η 0 ij and η ij are the initial number of lines between \( i {-} j \) and the number of new added lines; r i is load curtailment at bus i due to insufficient transmission capacity, associated with a penalty factor λ; S is the branch incidence matrix; vectors \( \varvec{F},\,\varvec{g},\,\varvec{r},\,\varvec{L} \) denote active power flow, active power output of generators, load curtailment and predicted load, with elements of F ij g i r i L i respectively; B ij denotes the susceptance of a line between \( i{ - }j \); θ i is the phase angle at bus i; \( \overline{\left( \bullet \right)} \) denotes the upper bounds; N is the total bus number.

To obtain the value of r i , usually an optimal power flow (OPF) model is employed to reschedule power generations and alleviate violations of network constraints. The objective of this OPF model is to minimize the total load curtailment [11]. Note this penalty factor for r i helps the optimization process in (1) to find an economical planning solution without a loss of load.

However, the above model is more suitable for a vertically regulated power system, as they do not take into account the market interactions among various stakeholders, e.g. congestion costs caused by different marginal generation costs [12]. By contrast, the main objective of TEP in a new deregulated environment is to provide all stakeholders with nondiscriminatory access to cheap, secure and clean energy resources, subject to reliability and other criteria [13].

1.4 Contributions of this paper

The key contributions of the paper are:

  1. 1)

    A chanced constrained load curtailment index is proposed;

  2. 2)

    A risk based probabilistic TEP model is proposed with the consideration of planning uncertainties;

  3. 3)

    A novel hybrid solution algorithm in an iterative process is proposed to solve the formulated multistage programming problem.

2 Formulated probabilistic model

2.1 Define probabilistic load curtailment

In order to consider uncertainties in TEP, we propose a probabilistic formulation to reflect the level of load curtailment bounded by a threshold, r max. This load curtailment threshold is common in industrial practice. For instance, in Australia, expected energy not supplied (EENS) should be less than 0.002% of total energy consumption, which is also the network planning criterion used by the Australian Energy Market Operator (AEMO) [14]. In our probabilistic approach, the loss of load item in (1) is replaced by a percentage of having load curtailment over the threshold, as given in (9) and (10).

Note the meaning of λ R is different from λ. In (1), λ is the cost of each unit of load loss, whereas λ R is just a penalty factor and without special meaning, whose unit could be set as $. With this penalty factor, any TEP schemes with or without excessive load curtailment can be included in the optimization process, helping search a bigger solution region and avoiding premature convergence to a local optima.

$$ \sum\limits_{i,j \in N} {C_{ij} \eta_{ij} + \lambda_{R} R} $$
(9)
$$ R = \left\{ \begin{array}{ll} 0&\displaystyle\sum\limits_{{i \in N_{L} }} {r_{i} } \le r_{\hbox{max} } \hfill \\ \frac{{\displaystyle\sum\limits_{{i \in N_{L} }} {r_{i} - r_{\hbox{max} } } }}{{r_{\hbox{max} } }}& \displaystyle\sum\limits_{{i \in N_{L} }} {r_{i} > r_{\hbox{max} } } \hfill \\ \end{array} \right. $$
(10)

When TEP takes into account a variety of uncertainties such as load and wind power output, a commonly used approach is using Monte Carlo (MC) simulations to sample uncertainty scenarios. After simulation stops, EENS is obtained as the average or mean of unsupplied power in the simulation after solving the optimal power flow problems. Planning schemes selected by this method are optimal in the statistical sense, leading to low-probability scenarios being discounted [6]. Moreover, in practice, TEP investment costs may be very high to guarantee that there is no excessive load curtailment at all times.

Alternatively, in this paper, we propose to find a planning scheme which can attain an acceptable probability of non-excessive load curtailment within system operational constraints. The second term in (9) is transferred into a probability version and this probability is required to be higher than a specified criterion α, as shown in (11). This probabilistic approach is rational particularly when network planners are subject to financial constraints or have different risk aversion levels. After that, a chanced constrained index ɛ is defined as shown in (12). This index becomes a new objective that should be included into the optimization process.

$$ \Pr \left\{ {\sum\limits_{{i \in N_{L} }} {r_{i} } \le r_{\hbox{max} } \;} \right\} \ge \alpha $$
(11)
$$ \varepsilon = \left\{ \begin{aligned}& 0\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\Pr \left\{ {\sum\limits_{{i \in N_{L} }} {r_{i} } \le r_{\hbox{max} } \;} \right\} \ge \alpha \;\;\;\;\;\; \\& \alpha - \Pr \left\{ {\sum\limits_{{i \in N_{L} }} {r_{i} } \le r_{\hbox{max} } } \right\}\;\;\;\;\;\;\Pr \left\{ {\sum\limits_{{i \in N_{L} }} {r_{i} } \le r_{\hbox{max} } \;} \right\} < \alpha \\ \end{aligned} \right. $$
(12)

2.2 Carbon emission modelling

As summarized in Section 1.2, in general there are two types of carbon pricing policies: mode 1 is carbon tax; mode 2 is carbon trading [15], [16, 17]. In mode 1, only when the annual carbon emission exceeds free emission allowances, power generators will incur a cost for the excessive emission based on the carbon price. In mode 2, power generators can either sell their emission allowance surpluses or by the shortage in allowance from the emission trading market. Therefore, there will be some operating benefits for clean power generators that emit less than their emission allowance. On the other hand, power generators whose annual emission is greater than allowance will incur higher operating costs from buying extra emission allowance. Detailed mathematical formulations of the two emission pricing modes are given in (13) and (14). Note that in (14) Φ i,t can be either positive or negative value, representing cost or benefit from emission trading.

$$ \varPhi_{i,t} = \left\{ \begin{array}{ll} 0& \displaystyle\sum\limits_{k = 1}^{{N_{D} }} {\delta_{i} } D_{k,t} g_{i,k,t} \le A_{i,t} \hfill \\ \displaystyle\sum\limits_{k = 1}^{{N_{D} }} {\delta_{i} } D_{k,t} g_{i,k,t} - A_{i,t} & \displaystyle\sum\limits_{k = 1}^{{N_{D} }} {\delta_{i} } D_{k,t} g_{i,k,t} > A_{i,t} \hfill \\ \end{array} \right. $$
(13)
$$ \varPhi_{i,t} = \sum\limits_{k - 1}^{{N_{D} }} {\delta_{i} } D_{k,t} g_{i,k,t} - A_{i,t} $$
(14)

where Φ i,t and A i,t are the net annual emission and the annual free allowance for generator i in year t; δ i is the emission coefficient of the generators; g i,k,t is the power output of generator i at load block k in year t; D k,t is the duration of load block k in year t; N D is the total number of load blocks.

2.3 Uncertainties modelling

In this paper, uncertainties taken into account are wind power outputs, component working state of the power system, load growth and carbon price. Four types of probability density functions (PDFs) are used to model those uncertainties. Parameters of these PDFs can be obtained based on historical data. MC simulations are deployed to randomly generated scenarios composed by values from the four PDFs.

Wind speed V is generally modeled by a Weibull distribution [18, 19]. Wind power outputs can be derived by wind speed and a power curve of wind power generators. A piecewise function as given in (15) is widely used to model a power curve [20].

$$ P_{W} = \left\{ \begin{gathered} 0\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;0 \le V < V_{In} \hfill \\ P_{W}^{rate} \frac{{V - V_{In} }}{{V_{rate} - V_{In} }}\;\;\;\;\;\;\;\;\;\;\;\;\;V_{In} \le V < V_{rate} \hfill \\ P_{W}^{rate} \;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;V_{rate} \le V \le V_{Out} \hfill \\ 0\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;\;V_{Out} < V \hfill \\ \end{gathered} \right. $$
(15)

where P W is the power output of wind power generators, whose rated power output is P rate W ; V In V rate V Out are cut-in, rated and cut-out wind speeds, respectively.

The PDF of wind power output i.e. P pdf is given in (16). Pr zero W , Pr rate W denote probabilities of zero and rated wind power output. δ(•) is the Dirac delta function used to represent the discrete wind output PDF. y(•) can be expressed by either a fitted polynomial function or discrete samples [9].

$$ P_{{\rm{pdf}}} \left( {P_{W} } \right) = \left\{ {\begin{array}{ll} {\Pr _{W}^{{zero}} \delta \left( {P_{W} } \right)} & {P_{W} = 0} \\\\ {y\left( {P_{W} } \right)} & {0 < P_{W} < P_{W}^{{rate}} } \\\\ {\Pr _{W}^{{rate}} \delta \left( {P_{W} - P_{W}^{{rate}} } \right)} & {P_{W} = P_{W}^{{rate}} } \\\\ 0 & {\rm{otherwise}} \\ \end{array} } \right. $$
(16)

The availability of power system components is modelled by a Binomial PDF [21]. The probability Prstate of a availability state is given in (17) and (18). Ω state down Ω state up denote sets of components in unavailable and available states. r FOR is the forced outage rate of components.

$$ \Pr{^{state}} = \prod\limits_{{i \in \varOmega_{down}^{state} }} {\left( {1 - \Pr{_{{i}}} } \right)} \prod\limits_{{j \in \varOmega_{up}^{state} }} {\left( {\Pr{_{j}} } \right)} $$
(17)
$$ \Pr{_{j}} = 1 - r_{FOR} $$
(18)

Uncertainties of load L are modelled by a Normal PDF with mean μ and standard deviation σ, as given in (19) [18].

$$ P_{{\text{pdf}}} \left( {l;\mu ,\sigma } \right) = \frac{1}{{\sqrt {2\uppi\sigma^{2} } }}\exp \left[ { - \frac{{\left( {L - \mu } \right)^{2} }}{{2\sigma^{2} }}} \right] $$
(19)

Uncertainties of carbon price ϕ are modelled by a Weibull PDF with scale parameter τ and shape parameter ρ, as given in (20) [15].

$$ P_{{\text{pdf}}} \left( {\varphi ;\tau ,\rho } \right) = \frac{\rho }{\tau }\left( {\frac{\varphi }{\tau }} \right)^{\rho - 1} \exp \left[ { - \left( {\frac{\varphi }{\tau }} \right)^{\rho } } \right] $$
(20)

2.4 Proposed probabilistic model

A multi-stage probabilistic TEP model is formulated as minimizing the total cost with the chance constrained index ɛ t proposed in Section 2.1, as follows.

Minimize

$$ \begin{gathered} \sum\limits_{t = 1}^{T} {\sum\limits_{i,j \in N} {\frac{{C_{ij} \left( {\eta_{ij,t} - \eta_{ij,t - 1} } \right)}}{{\left( {1 + \gamma } \right)^{t - 1} }}} } + \sum\limits_{t = 1}^{T} {\frac{{\lambda_{\varepsilon } \varepsilon_{t} }}{{\left( {1 + \gamma } \right)^{t - 1} }}} \hfill \\ + \sum\limits_{t = 1}^{T} {\sum\limits_{k = 1}^{{N_{D} }} {\sum\limits_{i = 1}^{{N_{G} }} {\frac{{D_{k,t} C_{Oi} g_{i,k,t} }}{{\left( {1 + \gamma } \right)^{t - 1} }}} } } + \sum\limits_{t = 1}^{T} {\sum\limits_{i = 1}^{{N_{G} }} {\frac{{\varphi \varPhi_{i,t} }}{{\left( {1 + \gamma } \right)^{t - 1} }}} } \hfill \\ \end{gathered} $$
(21)

subject to

$$ \sum\limits_{i,j \in N} {F_{ij,k,t} + \sum\limits_{{i \in N_{G} }} {g_{i,k,t} + \sum\limits_{{i \in N_{L} }} {r_{i,k,t} - } } } \sum\limits_{{i \in N_{L} }} {L_{i,k,t} = 0} $$
(22)
$$ F_{ij,k,t} - B_{ij} \left( {\eta_{ij,t}^{0} + \eta_{ij,t} } \right)\left( {\theta_{i,k,t} - \theta_{j,k,t} } \right) = 0 $$
(23)
$$ \left| {F_{ij,k,t} } \right| \le \left( {\eta_{ij,t - 1}^{{}} + \eta_{ij,t} } \right)\overline{F}_{ij,k,t} $$
(24)
$$ 0 \le g_{i,k,t} \le \overline{g}_{i} $$
(25)
$$ 0 \le r_{i,k,t} \le L_{i,k,t} $$
(26)
$$ 0 \le \eta_{ij,t} \le \overline{\eta }_{ij} $$
(27)
$$ \eta_{ij,t} \;\text{is}\;\text{integer,}\;\text{and}\;i,j \in N $$
(28)

Equation (21) is a model represented by net present value (NPV) with a discount rate γ. T is the total planning horizon. ij are superscripts for buses. kt are superscripts for load block and planning year respectively. The first term is the investment cost, and the second term is the chance constrained index at year t scaled by a penalty factor λ ɛ . The third term is the operating cost of power generators, whose incremental cost of output is denoted by C Oi . The total number of generators in the system is N G . The fourth term is the cost of carbon emission, derived from carbon price and the net annual emission of power generators.

For completeness, we use a piecewise function to derive the quadratic losses in the DC power model, as given in (29)-(37). Note losses are not incorporated into the objective function. Instead, they are considered as the additional active power in (22) required from power generation, in order to satisfy the nodal balance due to the presence of losses.

The detailed linearization process is given as follow.

$$ P_{ij,k,t}^{loss} \approx 2G_{{\text{cond}}ij} \left( {1 - \cos \theta_{i - j,k,t} } \right) \approx G_{{\text{cond}}ij} \theta_{i - j,k,t}^{2} $$
(29)
$$ \theta_{i - j,k,t}^{2} \approx \sum\limits_{h = 1}^{H} {\varpi \left( h \right)\Delta \theta_{i - j,k,t} \left( h \right)} $$
(30)
$$ \varpi \left( h \right) = \left( {2h - 1} \right)\frac{{\theta_{i - j,t}^{\hbox{max} } }}{H} $$
(31)
$$ \theta_{i - j,k,t}^{{}} = \theta_{i - j,k,t}^{ + } - \theta_{i - j,k,t}^{ - } $$
(32)
$$ \left| {\theta_{i - j,k,t}^{{}} } \right| = \sum\limits_{h = 1}^{H} {\Delta \theta_{i - j,k,t}^{{}} \left( h \right)} = \theta_{i - j,k,t}^{ + } + \theta_{i - j,k,t}^{ - } $$
(33)
$$ 0 \le \theta_{i - j,k,t}^{ + } \le \chi \theta_{i - j,t}^{\hbox{max} } $$
(34)
$$ 0 \le \theta_{i - j,k,t}^{ - } \le \left( {1 - \chi } \right)\theta_{i - j,t}^{\hbox{max} } $$
(35)
$$ 0 \le\Delta \theta_{i - j,k,t}^{{}} \left( h \right) \le \frac{{\theta_{i - j,t}^{\hbox{max} } }}{H} $$
(36)
$$ 0 \le\Delta \theta_{i - j,k,t}^{{}} \left( h \right) \le\Delta \theta_{i - j,k,t}^{{}} \left( {h - 1} \right) $$
(37)

Where P loss ij,k,t , θ ij,k,t are the active power losses and phase angle difference between \( i{ - }j \) at load block k in year t, repectively; \( G_{{\text{cond}}{ij}} \) is the line conductance; the quadratic term θ 2 i-j,k,t is linearized by a piecewise function, as shown in Fig. 1; H is the total number of intersection, with a h-th intersection of Δθ ij,k,t (h), and the slope is ϖ(h); two nonnegative slack variables θ + ij,k,t θ ij,k,t are introduced to replace θ ij,k,t , and they are also bounded by a binary variable χ to make this replacement effective, as shown in (32)-(35). Equations (36)-(37) can ensure the linear intersection on the left side is always filled up first.

Fig. 1
figure 1

Piecewise linear approximation of phase angle difference between \( i {-} j \)

3 Solution algorithms

Solution algorithms for TEP problems mainly fall into either mathematical programming classes or heuristic search classes. Mathematical programming methods have strict requirements on the model itself (e.g. the problem or the continuous relaxation of the problem should be convex) and can provide more clues on the quality of the final solution [22]. However, mathematical programming methods tend to be trapped by local optima in some cases. On the contrary, heuristic methods are suitable for stochastic global search, free from problem formulation difficulties and can escape from premature local optimal. The drawbacks of heuristic methods are: the quality of the solution cannot be guaranteed; and prohibitive computation efforts are required [22, 23, 24].

In this paper, the proposed TEP model is a dynamic optimization problem with a chance constrained reliability evaluation. To enhance the solution performance of the proposed model, a hybrid method based on decomposition is proposed as follows.

The overall stochastic programming problem can be divided into two subproblems: 1) the investment subproblem in the first and second terms of the defined objective; 2) the operating subproblem in the third and fourth terms of the defined objective. Note that the investment subproblem is targeted at a specific planning year, whereas the operating decisions are subject to the decisions from the investment subproblem and should be evaluated over multiple years thereafter [25].

Firstly, an evolutionary algorithm is deployed to help the optimization process in subproblem 1 to find a bigger set of expansion candidates. In this paper, differential evolution (DE) is used, as it is shown faster, simpler and more robust [6]. Secondly, the subproblem 2 can be soundly solved by a state-of-the-art nonlinear programming technique, such as the interior point (IP) method. IP is widely used in solving power system operation and dispatch problems, because the optimality of the solution found by IP is guaranteed [26]. Moreover, IP has higher efficiency in searching local optima [26], which means that IP can quickly locate local optima for the subproblem 2, adding them to new generation in the evolution process. As shown in Fig. 2, the two subproblems are solved in an iterative way to progressively converge to the final solution. The termination criterion can be defined by two ways: the maximum iteration number is reached; or the objective value does not improve for a few successive generations.

Fig. 2
figure 2

An iterative solution algorithm for the decomposed two subproblems

The main procedure of the proposed hybrid method is given as follows:

  1. 1)

    Determine the PDFs of wind speed, carbon price, load, and FOR based on historical data. Note that the PDF of wind power outputs is translated from the wind power curve in (15).

  2. 2)

    MC simulations are deployed to generate values of wind power outputs, load, component availability, and carbon price from the PDFs in step 1).

  3. 3)

    Initialize the population of the EA corresponding to the number of new added lines. Note that the quality of initial population has great impacts on the final solution. Therefore, in this process, uncertain features are neglected and some deterministic values are assigned. To be specific, carbon price is set to its mean value, wind power output is set to the installed capacity scaled by its capacity factor, all components are set as available, and load is set as (μ + 3σ).

  4. 4)

    Using the initial values generated by step 3), denoted by \( \varvec{\eta}^{G} = \left\{ {\eta_{ij,0} ,\forall i,\,j \in N} \right\} \), apply the IP to generate local optima, i.e. subproblem 2 is solved with this generation. In this process, IP can solve the DC optimal power flow (OPF) for each individual in the population. Note if network violations are identified, a linear programming is required to minimize the total load curtailment, i.e. re-dispatching of generation is not based on bids or marginal costs. Then calculate the operating and carbon emission costs and add the two local optima to \( \varvec{\eta}^{G + 1} \). Also, based on identify network violations, find the probability of \( \Pr \left\{ {\sum\limits_{{i \in N_{L} }} {r_{i} } \le r_{\hbox{max} } \;} \right\} \), and calculate the probabilistic index of reliability.

  5. 5)

    Start mutation and recombination process. Integers representing adding or reducing lines will be generated and recombined.

  6. 6)

    For each TEP scheme, the objective function in (21) is assigned as the fitness value. A newly generated child individual is compared with the parent, and replaces it if the fitness value of the child is smaller.

  7. 7)

    Terminate the algorithm if the stopping criterion is satisfied, otherwise go back to step 2).

4 Case studies

In this section, a series of numerical experiments are undertaken to demonstrate the performance of the proposed model on the modified IEEE 14-bus system. The 14-bus system initially has five power generators, and 20 transmission corridors.

In our paper, the five power generators in the base case are assumed to be fossil-fuel-fired, and the carbon emission coefficients for them are set as 1.2, 1, 0.8, 0.8 and 0.6 tCO2/MWh respectively. Other power generation types such as hydro power or nuclear power could be included as future works. Moreover, for simplicity, power generators are assumed to receive 80% of their emission allowances for free based on their emissions in the base year, and free allowances will decrease linearly each year to 30% in the last planning horizon. Note that allocating emission allowances is a complex issue involving political motivation. The assumption made in this paper regarding emission allocation is in accordance with the EU ETS practice, which can be found in [27].

The total generation capacity of the base system is 720 MW, while the total load is 440 MW. Durations for load blocks are 20%, 50%, 29% and 1%. As illustrated in Fig. 3, two wind farms with capacities of 50 MW are assumed to be installed at buses 9 and 11. The two wind farms are assumed to be totally independent, and therefore the wind speeds for modelling their outputs are randomly generated from two different Weibull distribution functions. Parameters for modelling the wind power curve are V In  = 4, V rate  = 10, V Out  = 22m/s. To model the possibility of N-1 contingencies, transmission lines outages are modelled by a r FOR of 1%. The mean value of carbon prices is set as E[φ] = $23/tCO2. The planning horizon is set as five years, and the annual load growth rate is 5%, with uncertainties of \( {\raise0.7ex\hbox{$\sigma $} \!\mathord{\left/ {\vphantom {\sigma \mu }}\right.\kern-0pt} \!\lower0.7ex\hbox{$\mu $}} = 2\% \), i.e. μ = 0.05, σ = 0.001.

Fig. 3
figure 3

Modified IEEE 14-bus system with two wind power generators

The capacity of each candidate line is 100 MW, and up to four lines are allowed for each corridor. The investment cost is assumed to be 50 M$/100 km. We set the upper bound of load curtailment threshold as a percentage of the total annual energy demand, i.e. r max = 0.1%. To make ɛ t have a significant effect in the objective function, the penalty factor λ ɛ is set big enough to ensure that planning schemes with considerable load curtailments will be eliminated in the optimization process during the heuristic search. The settings of α and λ ɛ are 95% and $1 × 109.

In order to make a comparison and demonstrate the performance of the proposed probabilistic approach, three deterministic TEP studies with different carbon pricing policies are undertaken, i.e. deterministic TEP with no emission price, deterministic TEP in carbon mode 1 and mode 2 respectively with a carbon price of $23/tCO2. As illustrated in Table 1, investment costs for three deterministic models are all 378.25 M$, whereas the investment cost for Case 4 is the highest due to the volatility of emission market. For operating cost, Case 1 is the lowest as a result of no carbon pricing policies. Moreover, compared to Case 2, the operating cost in Case 3 is lower. This is because some power generators can earn benefits in the emission trading market if they have lower emission coefficient. Although the carbon price uncertainty increases the investment cost in Case 4, the total cost in Case 4 is lower compared to that in Case 2 (1,107.77 vs 1,119.22 M$), reflecting the operating benefits of carbon mode 2. It should be noted that, if stochastic features are removed, i.e. without uncertainties of wind power, load and carbon price, for zero load curtailment and selected line outages, the results of the probabilistic and deterministic TEP are identical, which validates the applicability of our approach. Furthermore, comparisons in Table 1 reveal that the planning schemes identified by deterministic TEP are greatly affected by carbon price uncertainties, leading to a high probability of load curtailment. This may imply that the deterministic TEP is insufficient, particularly when exposed to higher risks of uncertainties.

Table 1 Comparisons of deterministic and probabilistic TEP with different carbon pricing policies

As mentioned in Section 2.1, the probability α is defined as the lower bound for each planning scheme the possibility of having load curtailment below the required threshold, and α ∊ [0, 1]. This probability can be interpreted as a risk measure, which can be chosen by network planners. The higher value of α, the more important to choose a plan without excessive load curtailment, leading to a higher investment cost (more conservative). We set α as three different levels to run simulations of Case 4. The probabilities of load curtailment are given in Fig. 4. As seen, a plan chosen by a higher α is said to be risk averse, whereas a plan chosen by lower α is said to be risk preferring. Note a higher α also increases the probability of no load curtailment (see the intersections on the Y-axis in Fig. 4). In this way, our probabilistic approach can provide comprehensive information for network planners regarding the balance between minimizing investment costs and minimizing the risk of load curtailment in the face of uncertainties.

Fig. 4
figure 4

Probability of load curtailment with different α values

The detailed result of our probabilistic TEP in carbon mode 2 is given in left column in Table 2. As given in the right two columns in Table 2, carbon price uncertainties (i.e. high standard deviation) make a planning scheme expose to higher risk, requiring higher investment cost for meeting the α criterion (the initial α is set as 95%). As seen, if the standard deviation of carbon prices is set above $3/tCO2, investment costs have to be increased as α becomes lower than 95%. Also, the same situation will happen when the mean of carbon prices are raised from $23/tCO2 to $35/tCO2, which implies that more use of intermittent renewable energy (e.g. wind power), will increase TEP uncertainties, thus requiring higher investment costs. These findings are also supported by simulation results in Fig. 5. According to Fig. 5, the total costs without carbon price or with fixed carbon price are always lower than total costs with carbon price uncertainties in both modes 1 and 2, regardless of the value of α.

Table 2 Final result against different carbon price characteristics
Fig. 5
figure 5

Total cost against different values of α with different carbon uncertainties

To examine the effects of different upper bounds of the maximum load curtailment parameter r max, we run simulations to obtain the total cost with different values of α. As shown in Fig. 6, the higher r max, the lower total cost. This is more obvious with a conservative planning scheme, i.e. with a higher α. In addition, results of the total cost against total installed wind power capacity with different α values are given in Fig. 7. As seen, for a specific α, it is possible to obtain the optimal wind power capacity, i.e. the lowest total cost when integrating different wind power capacities into the system. For instance, when α is chosen as 95%, in order to obtain the lowest total cost, the optimal wind power capacity to be integrated into the power system should be about 60 MW. This finding is of significance for renewable energy integration analysis, as the rapid growth of wind power will have significant impact on power system operations and planning [28]. Moreover, our approach can reveal the relationship between the overall system cost and the risk of load curtailment with the presence of wind power uncertainties. Therefore, our probabilistic TEP model serves a good indicative role in achieving low carbon economy, in terms of identifying a robust and cost-effective planning scheme.

Fig. 6
figure 6

Total cost against different values of α with different total load curtailment thresholds

Fig. 7
figure 7

Total cost against different total installed wind power capacity with different values of α

5 Conclusion

This paper has proposed a probabilistic TEP model with a chance constrained load curtailment index. Planning uncertainties such as wind power output, component availability, load, and carbon price are incorporated by a Monte Carlo simulation based approach. Our multi-stage planning objective is formulated as minimizing the total cost, including investment cost, operating cost, emission cost and a risk factor of load curtailment. For completeness, a piecewise approximation function is used to linearize the quadratic power losses. Meanwhile, a novel iterative solution algorithm combing heuristic search and mathematical programming is proposed to solve the formulated a dynamic optimization problem. The performance of the proposed approach is demonstrated by a modified IEEE 14-bus system. Simulation results have proved that our approach can give network planners an opportunity to trade-off between the overall cost and the probability of load curtailment in the presence of uncertainties. Our approach can also provide network planners with comprehensive information regarding effects of uncertainties on TEP schemes, allowing them to adjust planning strategies based on their risk aversion levels or financial constraints. Moreover, our approach can be used for renewable energy integration analysis in terms of long-term network planning. Therefore, our novel TEP approach is a risk-based, flexible decision tool, which is important for achieving low carbon economy through planning practices.