冯小峰;谢添阔;高赐威;林国营;陈亮;卢世祥;

• 1:广东电网有限责任公司计量中心
• 2:华北电力大学电力工程系
• 3:东南大学电气工程学院

摘要(Abstract)：

在电力现货市场下,为实现售电商长期收益最大化,提出采用强化学习的需求响应动态优化方案。首先建立售电商和用户的需求响应模型,通过建立用户舒适成本函数的前后联系,构建出售电商动态优化收益函数;利用用户的需求响应收益函数确定其响应负荷,并将售电商当前需求响应的收益函数转化为立即奖励函数;然后采用BP神经网络构建强化学习的Q函数,采用迭代方法训练BP神经网络直到Q函数收敛。最后,通过1个售电商和5个工业用户的仿真算例结果表明所提方法的有效性。

关键词(KeyWords)： 电力现货;长期收益;需求响应;强化学习

Abstract:

Keywords:

基金项目(Foundation): 中国南方电网有限责任公司科技项目(GDKJXM20161607)~~

作者(Author): 冯小峰;谢添阔;高赐威;林国营;陈亮;卢世祥;

Email:

DOI: 10.13335/j.1000-3673.pst.2019.0651

参考文献(References)：

• [1]杨旭英,周明,李庚银.智能电网下需求响应机理分析与建模综述[J].电网技术,2016,40(1):220-226.Yang Xuying,Zhou Ming,Li Gengyin.Survey on demand response mechanism and modeling in smart grid[J].Power System Technology,2016,40(1):220-226(in Chinese).
• [2]田世明,王蓓蓓,张晶.智能电网条件下的需求响应关键技术[J].中国电机工程学报,2014,34(22):3576-3589.Tian Shiming,Wang Beibei,Zhang Jing.Key technologies for demand response in smart grid[J].Proceedings of the CSEE,2014,34(22):3576-3589(in Chinese).
• [3]沈运帷,李扬,高赐威,等.需求响应在电力辅助服务市场中的应用[J].电力系统自动化,2017,41(22):157-167.Shen Yunwei,Li Yang,Gao Ciwei,et al.Application of demand response in ancillary service market[J].Automation of Electric Power Systems,2017,41(22):157-167(in Chinese).
• [4]徐筝,孙宏斌,郭庆来.综合需求响应研究综述及展望[J].中国电机工程学报,2018,38(24):84-95+336.Xu Zheng,Sun Hongbin,Guo Qinglai.Review and prospect of integrated demand response[J].Proceedings of the CSEE,2018,38(24):84-95+336(in Chinese).
• [5]王剑晓,钟海旺,夏清,等.基于成本-效益分析的温控负荷需求响应模型与方法[J].电力系统自动化,2016,40(5):45-53.Wang Jianxiao,Zhong Haiwang,Xia Qing,et al.Model and method of demand response for thermostatically-controlled loads based on cost-benefit analysis[J].Automation of Electric Power Systems,2016,40(5):45-53(in Chinese).
• [6]卫文婷,王丹,贾宏杰,等.一种基于模型预测的城市园区分层分布式温控负荷需求响应控制策略[J].中国电机工程学报,2016,36(8):2049-2056.Wei Wenting,Wang Dan,Jia Hongjie,et al.A hierarchical and distributed control strategy of thermostatically controlled appliances for city park based on load model prediction[J].Proceedings of the CSEE,2016,36(8):2049-2056(in Chinese).
• [7]陈雨果,张轩,罗钢,等.用户报量不报价模式下电力现货市场需求响应机制与方法[J].电力系统自动化,2019,43(9):179-186.Chen Yuguo,Zhang Xuan,Luo Gang,et al.Demand response mechanism and approach of electricity spot market in bidding mode without price on the user side[J].Automation of Electric Power Systems,2019,43(9):179-186(in Chinese).
• [8]艾欣,赵阅群,周树鹏.适应清洁能源消纳的配电网直接负荷控制模型与仿真[J].中国电机工程学报,2014,34(25):4234-4243.Ai Xin,Zhao Yuequn,Zhou Shupeng.Direct load control model and simulation for clean energy accommodation in distribution network[J].Proceedings of the CSEE,2014,34(25):4234-4243(in Chinese).
• [9]Kai Ma,Ting Yao,Jie Yang,et al.Residential power scheduling for demand response in smart grid[J].International Journal of Electrical Power&Energy Systems,2016,78:320-325.
• [10]罗琴,宋依群.售电市场环境下计及可中断负荷的营销策略[J].电力系统自动化,2015,39(17):134-139.Luo Qin,Song Yiqun,Marketing strategy in competitive retail market considering interruptible load[J].Automation of Electric Power Systems,2015,39(17):134-139(in Chinese).
• [11]周保荣,黄廷城,张勇军.计及激励型需求响应的微电网可靠性分析[J].电力系统自动化,2017,41(13):70-78.Zhou Baorong,Huang Tingcheng,Zhang Yongjun.Reliability analysis on microgrid considering incentive demand response[J].Automation of Electric Power Systems,2017,41(13):70-78(in Chinese).
• [12]曹佳,马洪艳,刘扬,等.基于节点电价的需求响应策略研究[J].电网技术,2016,40(5):1536-1542.Cao Jia,Ma Hongyan,Liu Yang,et al.Research on demand response strategy based on nodal price[J].Power System Technology,2016,40(5):1536-1542(in Chinese).
• [13]Maharjan S,Zhu Q,Zhang Y,et al.Demand response management in the smart grid in a large population regime[J].IEEE Transactions on Smart Grid,2016,7(1):189-199.
• [14]Liu Z,Wierman A,Chen Y,et al.Data center demand response:Avoiding the coincident peak via workload shifting and local generation[J].Performance Evaluation,2013,70(10):770-791.
• [15]徐业琰,廖清芬,刘涤尘,等.基于综合需求响应和博弈的区域综合能源系统多主体日内联合优化调度[J].电网技术.http://doi.org/10.13335/j.1000-3673.pst.2018.2421.Xu Yeyan,Liao Qingfen,Liu Dichen,et al.Multi-player intraday optimal dispatch of integrated energy system based on integrated demand response and games[J].Power System Technology.http://doi.org/10.13335/j.1000-3673.pst.2018.2421(in Chinese).
• [16]Chai B,Chen J,Yang Z,et al.Demand response management with multiple utility companies:a two-level game approach[J].IEEETransactions on Smart Grid,2014,5(2):722-731.
• [17]Qian L P,Zhang Y J,Huang J,et al.Demand response management via real-time electricity price control in smart grids[J].IEEE Journal on Selected Areas in Communications,2013,31(7):1268-1280.
• [18]孙宇军,王岩,王蓓蓓,等.考虑需求响应不确定性的多时间尺度源荷互动决策方法[J].电力系统自动化,2018,42(2):106-113.Sun Yujun,Wang Yan,Wang Beibei,et al.Multi-time scale decision method for source-load interaction considering demand response uncertainty[J].Automation of Electric Power Systems,2018,42(2):106-113(in Chinese).
• [19]张禹森,孔祥玉,孙博伟,等.基于电力需求响应的多时间尺度家庭能量管理优化策略[J].电网技术,2018,42(6):1811-1819.Zhang Yusen,Kong Xiangyu,Sun Bowei,et al.Multi-time scale home energy management strategy based on electricity demand response[J].Power System Technology,2018,42(6):1811-1819(in Chinese).
• [20]张忠会,刘故帅,谢义苗.基于博弈论的电力系统供给侧多方交易决策[J].电网技术,2017,41(6):1779-1785.Zhang Zhonghui,Liu Gushuai,Xie Yimiao.A game theory approach to analyzing multi-party electricity trading on supply side[J].Power System Technology,2017,41(6):1779-1785(in Chinese).
• [21]刘一欣,郭力,王成山.多微电网参与下的配电侧电力市场竞价博弈方法[J].电网技术,2017,41(8):2469-2476.Liu Yixin,Guo Li,Wang Chengshan.Optimal bidding strategy for microgrids in electricity distribution market[J].Power System Technology,2017,41(8):2469-2476(in Chinese).
• [22]尹龙,刘继春,高红均,等.考虑多种用户价格机制下的综合型能源售电公司购电竞价策略[J].电网技术,2018,42(1):88-97.Yin Long,Liu Jichun,Gao Hongjun,et al.Study on bidding strategy of comprehensive power retailer under multiple user-price mechanisms[J].Power System Technology,2018,42(1):88-97(in Chinese).
• [23]Fahrioglu M,Alvarado F L.Using utility information to calibrate customer demand management behavior models[J].IEEETransactions On Power Systems,2001,16(2):317-322.
• [24]朱兆霞,邹斌.PJM日前市场电价的统计分析[J].电力系统自动化,2006,30(23):53-57.Zhu Zhaoxia,Zou Bin.Statistical analysis of day-ahead prices in PJMmarket[J].Automation of Electric Power Systems,2006,30(23):53-57(in Chinese).