Journal Home > Volume 8 , Issue 2

Improving energy efficiency management has become an important task for current electricity market participating entities, and monitoring consumption of pivotal appliances plays an important role in many applications. This paper focuses on detecting whether a residence possesses a certain type of appliance based on their electricity consumption and the problem of class imbalance within deep learning model training for large power appliances with the state 'ON’. We propose a data-driven deep learning approach with attention mechanism to detect residential appliances from low-resolution aggregate energy consumption data. Firstly, the historical consumption profile of each user is divided into a specific length and labeled with the status of an appliance to generate training and test samples. Then, a deep convolutional neural network model with attention mechanism is trained, and the trained model is utilized to classify the test samples. Meanwhile, we obtain appliance status in a residence based on classification of multiple samples. Finally, we propose a novel approach of data generation for class imbalance of appliance detection using generative adversarial networks. In order to guarantee the quality, we devise a mechanism of self-validation to ensure generated data approximating real distribution of minor class samples. Experiments are conducted on a low-frequency smart meter data set sampled once every 30 minutes, and the results show that the proposed model performs better than hidden Markov model based algorithms and has good application prospects.


menu
Abstract
Full text
Outline
About this article

Residential Appliance Detection Using Attention- based Deep Convolutional Neural Network

Show Author's information Chunyu Deng( )Kehe WuBinbin Wang
China Electric Power Research Institute, Beijing 100192, China
State Key Laboratory of Alternate Electrical Power System with Renewable Energy Sources, North China Electric Power University, Beijing 102206, China
Software College, Northeastern University, Shenyang 110169, China

Abstract

Improving energy efficiency management has become an important task for current electricity market participating entities, and monitoring consumption of pivotal appliances plays an important role in many applications. This paper focuses on detecting whether a residence possesses a certain type of appliance based on their electricity consumption and the problem of class imbalance within deep learning model training for large power appliances with the state 'ON’. We propose a data-driven deep learning approach with attention mechanism to detect residential appliances from low-resolution aggregate energy consumption data. Firstly, the historical consumption profile of each user is divided into a specific length and labeled with the status of an appliance to generate training and test samples. Then, a deep convolutional neural network model with attention mechanism is trained, and the trained model is utilized to classify the test samples. Meanwhile, we obtain appliance status in a residence based on classification of multiple samples. Finally, we propose a novel approach of data generation for class imbalance of appliance detection using generative adversarial networks. In order to guarantee the quality, we devise a mechanism of self-validation to ensure generated data approximating real distribution of minor class samples. Experiments are conducted on a low-frequency smart meter data set sampled once every 30 minutes, and the results show that the proposed model performs better than hidden Markov model based algorithms and has good application prospects.

Keywords: attention, deep learning, convolutional neural network, Appliance detection, class imbalance

References(34)

[1]
P. A. Østergaard, N. Duic, Y. Noorollahi, H. Mikulcic, and S. Kalogirou, “Sustainable development using renewable energy technology,” 2020.10.1016/j.scs.2020.102391
DOI
[2]
Haidar A. M., Fakhar A. , and Helwig A. , “Sustainable energy planning for cost minimization of autonomous hybrid microgrid using combined multi-objective optimization algorithm,” Sustainable Cities and Society, vol. 62, p. 102391, 2020.10.1109/TSG.2016.2626389
[3]
Faustine A. , Mvungi N. H., Kaijage S. , and Michael K. , “A survey on non-intrusive load monitoring methodies and techniques for energy disaggregation problem,” arXiv preprint arXiv:1703.00785, 2017.10.1109/TSG.2016.2626389
[4]
Kong W. , Dong Z. Y., Hill D. J., Ma J. , Zhao J. , and Luo F. , “A hierarchical hidden markov model framework for home appliance modeling,” IEEE Transactions on Smart Grid, vol. 9, no. 4, pp. 30793090, 2016.10.1109/5.192069
[5]
Hart G. W., “Nonintrusive appliance load monitoring,” Proceedings of the IEEE, vol. 80, no. 12, pp. 18701891, 1992.10.1016/j.enbuild.2018.10.030
[6]
Miyasawa A. , Fujimoto Y. , and Hayashi Y. , “Energy disaggregation based on smart metering data via semi-binary nonnegative matrix factorization,” Energy and Buildings, vol. 183, pp. 547558, 2019.10.1109/ACCESS.2020.3002155
[7]
Afzalan M.  and Jazizadeh F. , “A machine learning framework to infer time-of-use of flexible loads: Resident behavior learning for demand response,” IEEE Access, vol. 8, pp. 111 718111 730, 2020.10.1109/TPWRS.2013.2266122
[8]
Batra N. , Singh A. , and Whitehouse K. , “Creating a detailed energy breakdown from just the monthly electricity bill,” in Proceedings of the 3rd International NILM Workshop, San Francisco, CA, USA, 2016, pp. 1415.10.1109/TPWRS.2013.2266122
[9]
Albert A.  and Rajagopal R. , “Smart meter driven segmentation: What your consumption says about you,” IEEE Transactions on Power Systems, vol. 28, no. 4, pp. 40194030, 2013.10.1109/TII.2019.2925323
[10]
Zeinal-Kheiri S. , Shotorbani A. M., and Mohammadi-Ivatloo B. , “Residential load disaggregation considering state transitions,” IEEE Transactions on Industrial Informatics, 2019.10.1016/j.ins.2018.08.017
[11]
Lai C. S., Tao Y. , Xu F. , Ng W. W., Jia Y. , Yuan H. , Huang C. , Lai L. L., Xu Z. , and Locatelli G. , “A robust correlation analysis framework for imbalanced and dichotomous data with uncertainty,” Information Sciences, vol. 470, pp. 5877, 2019.10.1109/ACCESS.2019.2926137
[12]
Deng Z. , Wang B. , Xu Y. , Xu T. , Liu C. , and Zhu Z. , “Multi-scale convolutional neural network with time-cognition for multi-step short-term load forecasting,” IEEE Access, vol. 7, pp. 88 05888 071, 2019.10.1155/2020/9147545
[13]
Deng Z. , Wang B. , Guo H. , Chai C. , Wang Y. , and Zhu Z. , “Unified quantile regression deep neural network with time-cognition for probabilistic residential load forecasting,” Complexity, vol. 2020, 2020.10.1109/TNNLS.2019.2921952
[14]
Khodayar M. , Wang J. , and Wang Z. , “Energy disaggregation via deep temporal dictionary learning,” IEEE Transactions on Neural Networks and Learning Systems, 2019.10.1109/ACCESS.2019.2923742
[15]
Kaselimi M. , Protopapadakis E. , Voulodimos A. , Doulamis N. , and Doulamis A. , “Multi-channel recurrent convolutional neural networks for energy disaggregation,” IEEE Access, vol. 7, pp. 81 04781 056, 2019.10.1007/s00521-019-04414-3
[16]
Xia M. , Xu Y. , Wang K. , Zhang X.  et al., “Dilated residual attention network for load disaggregation,” Neural Computing and Applications, vol. 31, no. 12, pp. 89318953, 2019.10.1109/TSG.2018.2815763
[17]
Singhal V. , Maggu J. , and Majumdar A. , “Simultaneous detection of multiple appliances from smart-meter measurements via multi-label consistent deep dictionary learning and deep transform learning,” IEEE Transactions on Smart Grid, vol. 10, no. 3, pp. 29692978, 2018.10.1109/TII.2019.2916213
[18]
Zhang J. , Chen X. , Ng W. W., Lai C. S., and Lai L. L., “New appliance detection for nonintrusive load monitoring,” IEEE Transactions on Industrial Informatics, vol. 15, no. 8, pp. 48194829, 2019.10.1109/TPWRS.2014.2327041
[19]
Guo Z. , Wang Z. J., and Kashani A. , “Home appliance load modeling from aggregated smart meter data,” IEEE Transactions on power systems, vol. 30, no. 1, pp. 254262, 2014.10.1109/TAAI.2012.54
[20]
Chen Y.-C., Ko Y.-L., and Peng W.-C., “An intelligent system for mining usage patterns from appliance data in smart home environment,” in 2012 Conference on Technologies and Applications of Artificial IntelligenceIEEE, 2012, pp. 319322.10.1007/978-3-642-37453-1_9
[21]
Chen Y.-C., Ko Y.-L., Peng W.-C., and Lee W.-C., “Mining appliance usage patterns in smart home environment,” in Pacific-Asia Conference on Knowledge Discovery and Data MiningSpringer, 2013, pp. 99110.10.1007/978-3-319-06605-9_19
[22]
Chen Y.-C., Chen C.-C., Peng W.-C., and Lee W.-C., “Mining correlation patterns among appliances in smart home environment,” in Pacific-Asia Conference on Knowledge Discovery and Data MiningSpringer, 2014, pp. 222233.10.1109/IWCMC.2013.6583632
[23]
Chen S.-Y., Lai C.-F., Huang Y.-M., and Jeng Y.-L., “Intelligent home-appliance recognition over iot cloud network,” in 2013 9th International Wireless Communications and Mobile Computing Conference (IWCMC)IEEE, 2013, pp. 639643.10.1109/UIC-ATC.2017.8397559
[24]
Ito M. , Uda R. , Ichimura S. , Tago K. , Hoshi T. , and Matsushita Y. , “A method of appliance detection based on features of power waveform,” in 2004 International Symposium on Applications and the Internet. Proceedings. IEEE, 2004, pp. 291294.10.1109/UIC-ATC.2017.8397559
[25]
Gao Y. , Schay A. , and Hou D. , “Home appliance detection from aggregated energy consumption data on a single circuit,” in 2017 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computed, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI)IEEE, 2017, pp. 18.10.1109/TII.2017.2696534
[26]
Zhu L. , Lu C. , Dong Z. Y., and Hong C. , “Imbalance learning machine-based power system short-term voltage stability assessment,” IEEE Transactions on Industrial Informatics, vol. 13, no. 5, pp. 25332543, 2017.10.1109/TII.2018.2850930
[27]
Ng W. W., Zhang J. , Lai C. S., Pedrycz W. , Lai L. L., and Wang X. , “Cost-sensitive weighting and imbalance-reversed bagging for streaming imbalanced and concept drifting in electricity pricing classification,” IEEE Transactions on Industrial Informatics, vol. 15, no. 3, pp. 15881597, 2018.10.1109/TCYB.2014.2372060
[28]
Ng W. W., Hu J. , Yeung D. S., Yin S. , and Roli F. , “Diversified sensitivity-based undersampling for imbalance classification problems,” IEEE transactions on cybernetics, vol. 45, no. 11, pp. 24022412, 2014.10.1109/TCYB.2016.2606104
[29]
Kang Q. , Chen X. , Li S. , and Zhou M. , “A noise-filtered under-sampling scheme for imbalanced classification,” IEEE Transactions on Cybernetics, vol. 47, no. 12, pp. 42634274, 2016.10.1613/jair.953
[30]
Chawla N. V., Bowyer K. W., Hall L. O., and Kegelmeyer W. P., “Smote: synthetic minority over-sampling technique,” Journal of artificial intelligence research, vol. 16, pp. 321357, 2002.10.1016/j.neucom.2018.04.088
[31]
de Morais R. F. and Vasconcelos G. C., “Boosting the performance of over-sampling algorithms through under-sampling the minority class,” Neurocomputing, vol. 343, pp. 318, 2019.10.1145/3427771.3427859
[32]
Faustine A. , Pereira L. , Bousbiat H. , and Kulkarni S. , “Unet-nilm: A deep neural network for multi-tasks appliances state detection and power estimation in nilm,” in Proceedings of the 5th International Workshop on Non-Intrusive Load Monitoring, 2020, pp. 8488.10.1109/CVPR.2017.113
[33]
Lea C. , Flynn M. D., Vidal R. , Reiter A. , and Hager G. D., “Temporal convolutional networks for action segmentation and detection,” in proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 156165.
[34]
Irish-Social-Science-Data-Archive, “Commission for energy regulation (cer) smart metering project,” [EB/OL], http://www.ucd.ie/issda/data/commissionforenergyregulationcer/ Accessed February 1, 2020.
Publication history
Copyright
Acknowledgements
Rights and permissions

Publication history

Received: 20 July 2020
Revised: 09 October 2020
Accepted: 09 November 2020
Published: 20 December 2020
Issue date: March 2022

Copyright

© 2020 CSEE

Acknowledgements

Acknowledgements

This project is supported by "the Fundamental Research Funds for the Central Universities" N2017001.

Rights and permissions

Return