刘国静;韩学山;王尚;杨明;王明强;

• 1:电网智能化调度与控制教育部重点实验室(山东大学)
• 2:天津城东供电分公司

摘要(Abstract)：

在风储配置给定前提下,研究风电与储能系统如何有机合作的问题。核心在于风电与储能组成混合系统参与电力交易,通过合作提升其市场竞争的能力。针对现有研究的不足,在具有过程化样本的前提下,引入强化学习算法。所建立的控制器具备在线学习能力,在学习过程中不断以混合系统收益为反馈信息逐步具备对储能系统充/放电功率、购买备用容量的决策能力。伴随学习时间的累积,将渐进趋于最佳策略,减轻电网调控负担的同时,提高风储合作效率。

关键词(KeyWords)： 风电;储能系统;强化学习理论;Q学习算法

Abstract:

Keywords:

基金项目(Foundation): 国家自然科学基金项目(51477091,51177091);; 国家重点基础研究发展计划项目(973计划)(2013CB228205)~~

作者(Author): 刘国静;韩学山;王尚;杨明;王明强;

Email:

DOI: 10.13335/j.1000-3673.pst.2016.09.021

参考文献(References)：

• [1]李海波,鲁宗相,乔颖,等.大规模风电并网的电力系统运行灵活性评估[J].电网技术,2015,39(6):1672-1678.Li Haibo,Lu Zongxiang,Qiao Ying,et al.Assessment on operational flexibility of power grid with grid-connected large-scale wind farms[J].Power System Technology,2015,39(6):1672-1678(in Chinese).
• [2]刘斌,刘锋,王程,等.考虑风电场灵活性及出力不确定性的机组组合[J].电网技术,2015,39(3):730-736.Liu Bin,Liu Feng,Wang Cheng,et al.Unit commitment considering flexibility and uncertainty of wind power generation[J].Power System Technology,2015,39(3):730-736(in Chinese).
• [3]宋艺航,谭忠富,李欢欢,等.促进风电消纳的发电侧,储能及求侧联合优化模型[J].电网技术,2014,38(3):610-615.Song Yihang,Tan Zhongfu,Li Huanhuan,et al.An optimization model combining generation side and energy storage system with demand side to promote accommodation of wind power[J].Power System Technology,2014,38(3):610-615(in Chinese).
• [4]孙宏斌,张伯明,吴文传,等.自律协同的智能电网能量管理系统家族:概念、体系架构和示例[J].电力系统自动化,2014,38(9):1-5.Sun Hongbin,Zhang Boming,Wu Wenchuan,et al.Autonomoussynergetic energy management system family for smart grids:concept,architecture and cases[J].Automation of Electric Power Systems,2014,38(9):1-5(in Chinese).
• [5]吴雄,王秀丽,李骏,等.风电储能混合系统的联合调度模型及求解[J].中国电机工程学报,2013,33(13):10-17.Wu Xiong,Wang Xiuli,Li Jun,et al.A joint operation model and solution for hybrid wind energy storage system[J].Proceeding of the CSEE,2013,33(13):10-17(in Chinese).
• [6]胡泽春,丁华杰,孔涛.风电?抽水蓄能联合日运行优化调度模型[J].电力系统自动化,2012,36(2):36-41.Hu Zechun,Ding Huajie,Kong Tao.A joint daily operation optimization model for wind power and pumped-storage plant[J].Automation of Electric Power Systems,2012,36(2):36-41(in Chinese).
• [7]熊猛,高峰,张海峰,等.基于混合储能系统的风电场调度策略[J].电网技术,2014,38(5):1242-1249.Xiong Meng,Gao Feng,Zhang Haifeng,et al.Risk-constrained coordinative dispatching for large-scale wind-storage system[J].Power System Technology,2014,38(5):1242-1249(in Chinese).
• [8]Garcia-Gonzalez J,De l M R M R,Santos L M,et al.Stochastic joint optimization of wind generation and pumped-storage units in an electricity market[J].IEEE Transactions on Power Systems,2008,23(2):460-468.
• [9]Dicorato M,Forte G,Pisani M,et al.Planning and operating combined wind-storage system in electricity market[J].IEEE Transactions on Sustainable Energy,2012,3(2):209-217.
• [10]Dukpa A,Duggal I,Venkatesh B,et al.Optimal participation and risk mitigation of wind generators in an electricity market[J].IET Renewable Power Generation,2010,4(2):165-175.
• [11]Barto A G.Reinforcement learning:An introduction[M].MIT press,1998:87-160.
• [12]张汝波.强化学习理论及应用[M].哈尔滨工程大学出版社,2001:126-155.
• [13]余涛,周斌,甄卫国.强化学习理论在电力系统中的应用及展望[J].电力系统保护与控制,2009,37(14):122-128.Yu Tao,Zhou Bin,Zhen Weiguo.Application and development of reinforcement learning theory in power systems[J].Power System Protection and Control,2009,37(14):122-128(in Chinese).
• [14]余涛,王宇名,刘前进.互联电网CPS调节指令动态最优分配Q-学习算法[J].中国电机工程学报,2010,20(7):62-69.Yu Tao,Wang Yuming,Liu Qianjin.Q-learning-based dynamic optimal allocation algorithm for CPS order of interconnected power grids[J].Proceeding of the CSEE,2010,20(7):62-69(in Chinese).
• [15]邹斌,李庆华,言茂松.电力拍卖市场的智能代理仿真模型[J].中国电机工程学报,2005,25(15):7-11.Zou Bin,Li Qinghua,Yan Maosong.An agent-based simulation model on pool-based electricity market using locational marginal price[J].Proceeding of the CSEE,2005,25(15):7-11(in Chinese).
• [16]郭红霞,吴捷,刘永强,等.基于强化学习算法的静止同步补偿电压控制器[J].电网技术,2004,28(19):9-13.Guo Hongxia,Wu Jie,Liu Yongqiang,et al.Application of reinforcement learning to STATCOM controller[J].Power System Technology,2004,28(19):9-13(in Chinese).
• [17]张昭遂,孙元章,李国杰,等.计及风电功率不确定性的经济调度问题求解方法[J].电力系统自动化,2011,35(22):125-130.Zhang Zhaosui,Sun Yuanzhang,Li Guojie,et al.A solution of economic dispatch problem considering wind power uncertainty[J].Automation of Electric Power Systems,2011,35(22):125-130(in Chinese).