Decentralised demand response market model based on reinforcement learning

• Type: Article in International Scientific Journal
• Date: 2020

Authors

Shafie Khah, M (Author) Other; Talari, S (Author) Other; Wang, F (Author) Other; Catalao, JPS (Author) FEUP

Journal

Title: IET Smart Grid

Vol. 3

Pages: 713-721

Publisher: Wiley-Blackwell

Indexing

ISI Web of Knowledge - 2 Citations

Scopus - 3 Citations

Other information

Authenticus ID: P-00T-0NB

DOI: 10.1049/iet-stg.2019.0129

Abstract (EN): A new decentralised demand response (DR) model relying on bi-directional communications is developed in this study. In this model, each user is considered as an agent that submits its bids according to the consumption urgency and a set of parameters defined by a reinforcement learning algorithm called Q-learning. The bids are sent to a local DR market, which is responsible for communicating all bids to the wholesale market and the system operator (SO), reporting to the customers after determining the local DR market clearing price. From local markets' viewpoint, the goal is to maximise social welfare. Four DR levels are considered to evaluate the effect of different DR portions in the cost of the electricity purchase. The outcomes are compared with the ones achieved from a centralised approach (aggregation-based model) as well as an uncontrolled method. Numerical studies prove that the proposed decentralised model remarkably drops the electricity cost compare to the uncontrolled method, being nearly as optimal as a centralised approach.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 9