Dynamic appliance scheduling and energy management in smart homes using adaptive reinforcement learning techniques Scientific Reports

energy demand management

In the exploitation stage, the PO https://www.mlb4s.com/top-12-most-commonly-used-iot-protocols-and-standards.html?noamp=mobile algorithm uses two operators to enhance solutions based on pumas’ hunting behaviours. Good-quality solutions undergo a few changes to avoid local optimality traps while ensuring the new production Pumas is better than the existing ones35. As the parameter increases, solutions with higher cost values change to explore worse solutions. Using pumas’ behavior in finding food, new solutions are generated. The function relates to exploitation or exploration stages based on the iteration number.

  • The following is a discussion of the principles, techniques, issues, optimization techniques, and future developments used in literature.
  • The search agents are sorted by cost, with high-quality solutions prioritized initially.
  • DR denotes the strategy with a set of technologies and programs intended to manage consumer demand for electricity.
  • Data sharing is not applicable to this articles as no datasets were generated or analysed during the current study.
  • Forms EIA uses to collect energy data including descriptions, links to survey instructions, and additional information.

User dissatisfaction arises from the fact that appliance operations fail to comply with user preferences, as observed in Eq. The total energy used by all of the rigid appliances is provided by Eq. The system will have a comprehensive and effective strategy for managing household energy consumption in a very dynamic and efficient way. The system incorporates feedback loops for continuous refinement and responds to changes in energy costs and user preferences, ensuring robust performance and user-centricity. It examines user preferences and employs adaptive learning to enhance scheduling effectiveness.

energy demand management

The power system’s functioning will become more difficult if corrective control is used. A thorough evaluation of the technical, economic, and environmental performance of current and upcoming DSM systems is required. In addition to this, the agencies, shareholders, and policymakers need to step up and enact new rules and policies to increase the trust of the public. The majority of the review focused on thermal comfort and appliance waiting time to address customer satisfaction. The peak load was reduced with the IPSO by about 30.26% while it was reduced with the GA by 25.78% (Yang et al. 2015).

Environment

The third function in the selection mechanism highlights diversity and gives a chance for unselected phases to be chosen. Costs are related to the best solutions before and after improvements in selections. The second function emphasizes resonance and performance, aiding the exploitation phase. Costs depict the best solution before and after improvements in the current choice.

energy demand management

Conventional energy sources including diesel, gas, microturbines, and combustion turbines still make up the bulk of the energy market despite their limited availability. With the increasing integration of DER into the grid, a variety of benefits and opportunities, including affordability, reliability, efficiency, power quality, and energy independence for the power system and its stakeholders emerge. Critical peak pricing (CPP) is a price control signal that uses higher power charges to restrict energy usage at a peak time. Price-based DR is used to persuade energy users to participate in different electricity pricing signals with the aim of lowering energy usage. Large energy users, such as industrial and commercial customers, favored this strategy because it gave them a way to bargain for the cost of energy for the load they would be prepared to reduce during a system outage. Customers’ energy expenses are reduced through demand response, an optional alteration to the load pattern in response to a change in the electricity tariff (Aghaei and Alizadeh 2013).

energy demand management

Cooperative stochastic energy management of multi smart home microgrids joint with modern distribution network

  • The first function emphasizes the escalation component, prioritizing exploration or exploitation phases.
  • This limitation guarantees each appliance’s operational cycle gets adequate energy for its functioning
  • It is also important to note that as the problem constraint shrinks, the likelihood of discovering global solutions increases, as well as the assurance of the quality of the optimal solutions attained.
  • Various RL agents are qualified with different algorithms to reduce electricity costs and increase self-consumption in a residential system with a PV battery.
  • 6, Demand Side Management (DSM) techniques for load shaping include peak clipping, valley filling, load shifting, strategy conservation, strategic load growth, and variable load shape (Macedo et al. 2015).

The exploration phase is more emphasized in the first function, calculated using Eq. The first function emphasizes the escalation component, prioritizing exploration or exploitation phases. Each step independently finds solutions after 3 iterations, exceeding the total population. They assess solution performance during exploration and exploitation, deciding whether to focus on exploration or shift to exploitation based on past and current outcomes.

Explore content categories

In Küçüker et al. (2017), a hybrid energy management strategy is proposed by using a hierarchical genetic algorithm (HGA) to alter the fuzzy inference system’s rule base. The hybrid approaches have been used in numerous engineering applications to get beyond the drawbacks of each optimization strategy and enhance their efficacy and accuracy to give a greater performance of the system (Tsipianitis & Tsompanakis). Reinforcement learning (RL) is the task of determining how agents should perform actions in a given environment to maximize cumulative rewards.

  • In response to the electricity challenges, Eskom Distribution has launched the Distribution Demand Management Programme (DDMP) to assist in the reduction of load shedding.
  • The approach includes user preferences, adapts dynamically to real-time energy consumption and cost, learns by experience, aims at big appliances, and tracks performance indicators.
  • With an explosion of smart appliances, devices, and renewable resources, intelligent systems that can manage energy usage dynamically while reducing expenditure and preserving comfort are in higher demand.
  • Due to consumers’ unexpected, impulsive, non-linear, and complex energy usage behaviors, the MINLP was unable to regulate some appliances.
  • The Bellman equation, which is used to train the target value for every state-action combination in Q learning, serves as the loss function of DNNs and is expressed as an Eq.

The recommended algorithms provide the appliances in a home with the best schedule possible, Cost savings, reduced PAR, and user comfort are all obtained when appliances are designed. Reinforcement learning (RL) has become a potential answer to these challenges because it can learn by interaction, accommodate user preferences, and manage the variability of dynamic and uncertain environments. Data sharing is not applicable to this articles as no datasets were generated or analysed during the current study. To get the best results, the HGWD reduced user comfort by 40%, PAR by 17%, and electricity costs by 30% (Javaid et al. 2017b). O’Neill et al. consider pre-specified disutility functions for customers’ dissatisfaction with job scheduling (O’Neill et al. 2010), but Wen et al. address this limitation (Wen et al. 2015). Q-learning is commonly used at the HEMS level to optimize appliance scheduling by using cost and user comfort as reward functions (O’Neill et al. 2010; Wen et al. 2015).

The PAR and the electric cost were reduced by 25.12% and 24.88% respectively by the HGPSO http://mycosesstudygroup.org/educatio/EventDetails.pl?slno=390 (Ahmad et al. 2017). A hybrid power system for residential structures was the subject of an energy management strategy developed by Zenned et al. (2017). In a similar line, the study (Pascual et al. 2015) proposes the conventional fuzzy-genetic algorithm approach.

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top