发电技术

• •    下一篇

基于改进近端策略优化算法的双馈风电场站无功裕度优化研究

余达1,武志韬2,陈子文3,林旭1,王巍桦1,刘崇茹2*   

  1. 1.广东电网有限责任公司电力调度控制中心,广东省 广州市 510030;
    2.新能源电力系统全国重点实验室(华北电力大学),北京市 昌平区 102206;
    3.中国长江三峡集团有限公司,湖北省 武汉市 430010
  • 基金资助:
    国家自然科学基金项目(U23B6008);南方电网公司科技项目(GDKJXM20220335)。

Research on Reactive Power Margin Optimization of Doubly-Fed Induction Generator Wind Farm Based on Improved Proximal Policy Optimization Algorithm

YU Da1, WU Zhitao2, CHEN Ziwen3, LIN Xu1, WANG Weihua1, LIU Chongru2*   

  1. 1. Electric Power Dispatching and Control Center of Guangdong Power Grid Co., Ltd., Guangzhou 510030, Guangdong Province, China;
    2. State Key Laboratory of Alternate Electrical Power System with Renewable Energy Sources(North China Electric Power University), Changping District 102206, Beijing, China;
    3. China Three Gorges Corporation, Wuhan 430010, Hubei Province, China
  • Supported by:
    Project Supported by National Natural Science Foundation of China (U23B6008); China Southern Power Grid Corporation Science and Technology Project (GDKJXM20220335).

摘要: 【目的】为了在平抑双馈风场并网点电压波动的同时兼顾提高其无功裕度,进而增强其暂态电压支撑能力,提出了一种基于改进近端策略优化算法的双馈风电场站无功裕度优化方法。【方法】以双馈风电机组以及静止无功发生器为主要无功调节设备,建立了双馈风电场站无功裕度优化数学模型,并将其转化为了马尔可夫决策过程模型;针对原始的近端策略优化算法中不当的裁剪系数设置可能导致的智能体难以平衡探索和利用的问题,提出了一种基于变裁剪系数的近端策略优化算法。【结果】基于改进的IEEE39节点系统验证所提算法的正确性和有效性,仿真结果表明所提算法可以提高智能体的收敛速度,且在决策速度和无功裕度优化效果上优于传统的近端策略优化算法和启发式算法。【结论】该算法有效提升了双馈风电场站的无功裕度,增强了其在暂态下的电压支撑能力,对更好地解决考虑源荷不确定性的电力系统无功优化问题具有重要意义。

关键词: 双馈风电场站, 无功裕度优化, 深度强化学习, 近端策略优化, 裁剪系数

Abstract: [Objectives] To simultaneously suppress voltage fluctuations at the point of common coupling of doubly-fed induction generator wind farms and enhance their reactive power margin, thereby strengthening their transient voltage support capability, a reactive power margin optimization method for doubly-fed induction generator wind farms based on an improved proximal policy optimization algorithm is proposed. [Methods] A mathematical model for optimizing the reactive power margin of a doubly-fed induction generator wind farm was established, with doubly-fed induction generator wind turbines and static reactive power generators as the main reactive power regulation equipment, and transformed into a Markov decision process model; A proximal policy optimization algorithm based on variable clipping coefficients is proposed to address the problem of difficulty for agents to balance exploration and exploitation caused by improper clipping coefficient settings in the original proximal policy optimization algorithm. [Results] Based on the improved IEEE 39 node system, the correctness and effectiveness of the proposed algorithm were verified. Simulation results showed that the proposed algorithm can improve the convergence speed of the agent, and is superior to traditional proximal policy optimization algorithms and heuristic algorithms in decision speed and reactive power margin optimization. [Conclusions] This algorithm effectively improves the reactive power margin of doubly-fed induction generator wind farms, enhances their voltage support capability under transient conditions, and is significant for better solving reactive power optimization problems in power systems with uncertain sources and loads.

Key words: double-fed induction generator wind farm, reactive power margin optimization, deep reinforcement learning, proximal policy optimization, clipping coefficient