Conference Paper

Evaluating the effectiveness of smart home energy management systems in the real-world


Smart home energy management systems (SHEMS) digitally monitor, control and coordinate functions in a home for space heating, cooling, lighting, appliances, security, and renewable technologies. Although experimental trials and simulated studies on SHEMS are available, limited attention has been paid to the actual performance of SHEMS in the real-world. This paper identifies qualitative and quantitative criteria that have been used for evaluation of SHEMS in empirical studies globally from a technical and non-technical perspective. Using 14 criteria identified in the literature and grouped by the extent and type of interactions between technology and users, a new flexible and customisable evaluation framework has been developed. The framework will help to evaluate the real-world effectiveness of SHEMS in a smart and flexible energy system. It is useful for policymakers, academics, and industry to determine the success of SHEMS in delivering expected outcomes for the energy system and users.

Attached files


Gupta, Rajat
Gregg, Matt
Antony, Anu

Oxford Brookes departments

School of Architecture


Year of publication: 2023
Date of RADAR deposit: 2023-03-24

Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License

Related resources

This RADAR resource is the Accepted Manuscript of Evaluating the effectiveness of smart home energy management systems


  • Owner: Joseph Ripp
  • Collection: Outputs
  • Version: 1 (show all)
  • Status: Live
  • Views (since Sept 2022): 424