Abstract
This paper presents the evaluation results of an improved version of an interactive tool for energy demand and supply forecasting, based on the combination of explainable machine learning with visual analytics. The prototype applies a kNN algorithm to forecast energy demand and supply from historical data (consumption, production, weather) and presents the results in an interactive visual dashboard. The dashboard allows the user to understand how the forecast relates to the input parameters and to analyse different forecast alternatives. It provides small utilities not familiar with AI with an easily understandable, while sufficiently accurate tool for energy forecasting in prosumer scenarios. The evaluation of the forecast accuracy has shown our method to be only 0.26%–1.73% less accurate than more sophisticated, but less explainable machine learning methods. Moreover, the achieved accuracy (MAPE 5.06%) is sufficient for practical needs of the application scenario. The evaluation with potential end-users also provided positive results regarding the usability, understandability and usefulness for the intended application context.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Paulescu, M., Brabec, M., Remus, B., Viorel, B.: Structured, physically inspired (gray box) models versus black box modeling for forecasting the output power of photovoltaic plants. Energy 121, 792–802 (2017)
Ahmad, T., Huanxin, C.: Nonlinear autoregressive and random forest approach to forecasting electricity load for utility energy management systems. Sustain. Urban Areas 45, 460–473 (2019)
Linardatos, P., Vasilis, P., Sotiris, K.: Explainable AI: review of machine learning interpretability methods. Entropy 23, 2021 (2021)
Shin, D.: The effects of explainability and causability on perception, trust, and acceptance: Implications for explainable AI. Int. J. Hum. Comput. Stud. 146, 1–10 (2021)
Revina, A., Buza, K., Meister, V.: IT ticket classification: the simpler, the better. IEEE Access 8, 193380–193395 (2020)
Filz, M., Gellrich, S., Herrmann, C., Thiede, S.: Data-driven analysis of product state propagation in manufacturing systems using visual analytics and machine learning. In: 53rd CIRP Conference on Manufacturing Systems (2020)
Hock, K.P., McGuiness, D.: Future state visualization in power grid. In: 2018 IEEE International Conference on Environment and Electrical Engineering and 2018 IEEE Industrial and Commercial Power Systems Europe (2018)
Miller, C., Nagy, Z., Schlueter, A.: A review of unsupervised statistical learning and visual analytics techniques applied to performance analysis of non-residential buildings. Renew. Sustain. Energy Rev. 81, 1365–1377 (2018)
Grimaldo, A.I., Novak, J.: Combining machine learning with visual analytics for explainable forecasting of energy demand in prosumer scenarios. Proc. Comput. Sci. 175, 525–532 (2020)
Kandakatla, A., Chandan, V., Kundu, S., Chakraborty, I., Cook, K., Dasgupta, A.: Towards trust-augmented visual analytics for data-driven energy modeling. In: 2020 IEEE Workshop on TRust and EXpertise in Visual Analytics (TREX), pp. 16–21 (2020)
Markus, A.F., Kors, J.A., Rijnbeek, P.R.: The role of explainability in creating trustworthy artificial intelligence health care: a comprehensive survey of the terminology, design and evaluation strategies. J. Biomed. Inform. 113, 1–11 (2021)
Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., Pedreschi, D.: A survey of methods for explaining black box models. ACM Comput. Surv. 5, 1–42 (2018)
Dam, H.K., Tran, T., Ghose, A.: Explainable software analytics. In: ICSE 2018 NIER, Gothenburg, Sweden (2018)
Anwar, T., Sharma, B., Chakraborty, K., Sirohia, H.: Introduction to load forecasting. Int. J. Pure Appl. Math. 119, 1527–1538 (2018)
Dong, Y., Ma, X., Fu, T.: Electrical load forecasting: a deep learning approach based on k-nearest neighbours. Appl. Soft Comput. J. 99(1–15), 106900 (2021)
Grimaldo, A.I., Novak, J.: User-centered visual analytics approach for interactive and explainable energy demand analysis in prosumer scenarios. In: Tzovaras, D., Giakoumis, D., Vincze, M., Argyros, A. (eds.) ICVS 2019. LNCS, vol. 11754, pp. 700–710. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-34995-0_64
Davis, F.D.: Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q. 13, 319–340 (1989)
Ghalehkhondabi, I., Ardjmand, E., Weckman, G.R., Young, W.A.: An overview of energy demand forecasting methods published in 2005–2015. Energy Syst. 8(2), 411–447 (2016). https://doi.org/10.1007/s12667-016-0203-y
Acknowledgements
The SIT4Energy project has received funding from the German Federal Ministry of Education and Research (BMBF) and the Greek General Secretariat for Research and Technology (GSRT) in the context of the Greek-German Call for Proposals on Bilateral Research and Innovation Cooperation. We thank Stadtwerk Haßfurt for their cooperation and support of this work with input from their practice and experiences as small but innovative utility and to all participants of the workshop.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 IFIP International Federation for Information Processing
About this paper
Cite this paper
Grimaldo, A., Novak, J. (2021). Explainable Needn’t Be (Much) Less Accurate: Evaluating an Explainable AI Dashboard for Energy Forecasting. In: Maglogiannis, I., Macintyre, J., Iliadis, L. (eds) Artificial Intelligence Applications and Innovations. AIAI 2021 IFIP WG 12.5 International Workshops. AIAI 2021. IFIP Advances in Information and Communication Technology, vol 628. Springer, Cham. https://doi.org/10.1007/978-3-030-79157-5_28
Download citation
DOI: https://doi.org/10.1007/978-3-030-79157-5_28
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-79156-8
Online ISBN: 978-3-030-79157-5
eBook Packages: Computer ScienceComputer Science (R0)
