DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Reactive Power Control of a Converter in a Hardware-Based Environment Using Deep Reinforcement Learning

Bokker, Ode and Schlachter, Henning and Beutel, Vanessa and Geißendörfer, Stefan and von Maydell, Karsten (2022) Reactive Power Control of a Converter in a Hardware-Based Environment Using Deep Reinforcement Learning. Energies. Multidisciplinary Digital Publishing Institute (MDPI). doi: 10.3390/en16010078. ISSN 1996-1073.

[img] PDF - Published version


Due to the increasing penetration of the power grid with renewable, distributed energy re-sources, new strategies for voltage stabilization in low voltage distribution grids must be devel-oped. One approach to autonomous voltage control is to apply reinforcement learning (RL) for reactive power injection by converters. In this work, to implement a secure test environment in-cluding real hardware influences for such intelligent algorithms, a power hardware-in-the-loop (PHIL) approach is used to combine a virtually simulated grid with real hardware devices to em-ulate as realistic grid states as possible. The PHIL environment is validated through the identifica-tion of system limits and analysis of deviations to a software model of the test grid. Finally, an adaptive volt–var control algorithm using RL is implemented to control reactive power injection of a real converter within the test environment. Despite facing more difficult conditions in the hardware than in the software environment, the algorithm is successfully integrated to control the voltage at a grid connection point in a low voltage grid. Thus, the proposed study underlines the potential to use RL in the voltage stabilization of future power grids.

Item URL in elib:https://elib.dlr.de/192833/
Document Type:Article
Title:Reactive Power Control of a Converter in a Hardware-Based Environment Using Deep Reinforcement Learning
AuthorsInstitution or Email of AuthorsAuthor's ORCID iDORCID Put Code
Bokker, OdeUNSPECIFIEDhttps://orcid.org/0000-0003-3252-2770UNSPECIFIED
Schlachter, HenningUNSPECIFIEDhttps://orcid.org/0000-0002-6356-9128UNSPECIFIED
Geißendörfer, StefanUNSPECIFIEDhttps://orcid.org/0000-0002-7496-8191UNSPECIFIED
von Maydell, KarstenUNSPECIFIEDhttps://orcid.org/0000-0003-0966-5810UNSPECIFIED
Date:22 December 2022
Journal or Publication Title:Energies
Refereed publication:Yes
Open Access:Yes
Gold Open Access:Yes
In ISI Web of Science:Yes
Publisher:Multidisciplinary Digital Publishing Institute (MDPI)
Keywords:power grid; reactive power; voltage control; power hardware-in-the-loop
HGF - Research field:Energy
HGF - Program:Energy System Design
HGF - Program Themes:Digitalization and System Technology
DLR - Research area:Energy
DLR - Program:E SY - Energy System Technology and Analysis
DLR - Research theme (Project):E - Energy System Technology
Location: Oldenburg
Institutes and Institutions:Institute of Networked Energy Systems > Energy System Technology
Deposited By: Bokker, Ode
Deposited On:04 Jan 2023 11:17
Last Modified:19 Oct 2023 14:56

Repository Staff Only: item control page

Help & Contact
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.