Journal of Modern Power Systems and Clean Energy

ISSN 2196-5625 CN 32-1884/TK

A Q-learning Algorithm for Optimizing On-load Tap Changer Operation and Voltage Control in Distribution Networks with High Integration of Renewable Energy Sources
CSTR:
Author:
Affiliation:

1.Department of Electrical, Computer and Biomedical Engineering, University of Pavia, 27100 Pavia, Italy;2.Research Center, Ricerca sul Sistema Energetico (RSE S.p.A.), 20134 Milano, Italy;3.Energy Department, Politecnico di Milano, 20156 Milano, Italy;4.Edison S.p.A., 20121 Milano, Italy;5.Unareti S.p.A., 20128 Milano, Italy

Clc Number:

Fund Project:

This work was supported by the Research Fund for the Italian Electrical System under the Three-Year Research Plan 2022-2024 (DM MITE No. 337, 15.09.2022), in compliance with the Decree of April 16, 2018.

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    Distribution networks have been experiencing significant changes under the pressure of the energy transition. The high integration of renewable energy sources combined with the electrification process introduces new challenges in managing distribution networks. Innovative solutions aimed at optimizing the control of complex problems, starting from historical data instead of a detailed system model, have been growing due to rapid development in artificial intelligence and machine learning. This paper proposes a Q-learning algorithm to control the tap setting of the on-load tap changer installed in primary substation transformers. The ultimate goal is to maintain voltage magnitudes at all busses of the medium-voltage distribution network within a safe range, simultaneously optimizing on-load tap changer operations. As a case study, the effectiveness of the proposed algorithm is assessed using a real medium-voltage distribution network with high penetration of renewable energy sources that supplies more than 2500 users/prosumers. The ability of the proposed algorithm to control bus voltages is tested in several scenarios characterized by significant variability and uncertainty. Outcomes show that the proposed algorithm is suitable for optimizing voltage control in distribution networks using a data-driven approach.

    Reference
    Related
    Cited by
Get Citation
Related Videos

Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:May 21,2024
  • Revised:November 26,2024
  • Adopted:
  • Online: December 01,2025
  • Published:
Article QR Code