Volume 12, Issue 1 (March 2016)                   IJEEE 2016, 12(1): 42-51 | Back to browse issues page


XML Print


Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:

Bakhshandeh H, Akbari Foroud A. Development of Reinforcement Learning Algorithm to Study the Capacity Withholding in Electricity Energy Markets. IJEEE 2016; 12 (1) :42-51
URL: http://ijeee.iust.ac.ir/article-1-810-en.html
Abstract:   (5591 Views)

This paper addresses the possibility of capacity withholding by energy producers, who seek to increase the market price and their own profits. The energy market is simulated as an iterative game, where each state game corresponds to an hourly energy auction with uniform pricing mechanism. The producers are modeled as agents that interact with their environment through reinforcement learning (RL) algorithm. Each producer submits step-wise offer curves, which include the quantity-price pairs, to independent system operator (ISO) under incomplete information. An experimental change is employed in the producer's profit maximization model that causes the iterative algorithm converge to a withholding bidding value. The producer can withhold the energy of his own generating unit in a continuous range of its available capacity. The RL relation is developed to prevent from becoming invalid in certain situations. The results on a small test system demonstrate the emergence of the capacity withholding by the producers and its effect on the market price.

Full-Text [PDF 399 kb]   (2354 Downloads)    
Type of Study: Research Paper | Subject: Market Deregulation
Received: 2015/07/02 | Revised: 2017/08/23 | Accepted: 2016/03/09

Rights and permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Creative Commons License
© 2022 by the authors. Licensee IUST, Tehran, Iran. This is an open access journal distributed under the terms and conditions of the Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0) license.