Abstract
Today software is core part of modern automobiles. The amount, complexity and importance of software components within Electrical/Electronics (E/E) systems of modern cars is only increasing with time. Several automotive functions carrying software provide or interact with safety critical systems such as systems steering and braking and thus assuring functional safety for such systems is of high importance. Requirements for the safety assurance are specified partially by such functional safety standards as ISO 26262. The standard provides the framework and guidelines for the development of hardware and software for components deemed to be safety critical. In this chapter we argue that traditional approaches for safety assurance such as fault injection and mutation testing can be adapted and applied to functional models to enable early verification and validation according to the requirements of ISO 26262. We show how to use fault injection in combination with mutation based testing to identify defects early in the development process - both theoretically and on a case of self-driving miniature vehicles. The argument is grounded upon the current best practices within the industry, a study of ISO 26262 standard, and academic and industrial case studies using fault injection and mutation based testing applied to the functional model level. In this paper we also provide the initial validation of this approach using software of a self-driving miniature vehicle.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Broy, M.: Challenges in automotive software engineering. In: Proceedings of the 28th International Conference on Software Engineering, pp. 33–42 (2006)
Charette, R.N.: This car runs on code. IEEE Spectr. 46(3), 3 (2009)
Fennel, H., Bunzel, S., Heinecke, H., Bielefeld, J., Fürst, S., Schnelle, K.P., Grote, W., Maldener, N., Weber, T., Wohlgemuth, F., et al.: Achievements and exploitation of the autosar development partnership. In: Convergence 2006, October 2006
Boehm, B., Basili, V.: Defect reduction top 10 list. Computer 34, 135–137 (2001)
ISO, C.: 26262, road vehicles-functional safety (2011)
Mellegård, N., Staron, M., Törner, F.: A light-weight defect classification scheme for embedded automotive software and its initial evaluation. In: 2012 IEEE 23rd International Symposium on Software Reliability Engineering (ISSRE), pp. 261–270. IEEE (2012)
Hillenbrand, M., Heinz, M., Adler, N., Müller-Glaser, K.D., Matheis, J., Reichmann, C.: ISO/DIS 26262 in the context of electric and electronic architecture modeling. In: Giese, H. (ed.) ISARCS 2010. LNCS, vol. 6150, pp. 179–192. Springer, Heidelberg (2010)
Schätz, B.: Certification of embedded software – impact of ISO DIS 26262 in the automotive domain. In: Margaria, T., Steffen, B. (eds.) ISoLA 2010, Part I. LNCS, vol. 6415, p. 3. Springer, Heidelberg (2010)
Hsueh, M., Tsai, T., Iyer, R.: Fault injection techniques and tools. Computer 30(4), 75–82 (1997)
Rana, R., Staron, M., Berger, C., Hansson, J., Nilsson, M., Törner, F.: Increasing efficiency of iso 26262 verification and validation by combining fault injection and mutation testing with model based development. In: 8th International Joint Conference on Software Technologies-ICSOFT-EA, Reykjavík, Iceland, July 2013
Jones, E.L.: Integrating testing into the curriculumarsenic in small doses. In: ACM SIGCSE Bulletin, vol. 33, pp. 337–341
Megen, R., Meyerhoff, D.: Costs and benefits of early defect detection: experiences from developing client server and host applications. Software Qual. J. 4(4), 247–256 (1995)
Svenningsson, R., Vinter, J., Eriksson, H., Törngren, M.: MODIFI: a MODel-implemented fault injection tool. In: Schoitsch, E. (ed.) SAFECOMP 2010. LNCS, vol. 6351, pp. 210–222. Springer, Heidelberg (2010)
Ziade, H., Ayoubi, R., Velazco, R., et al.: A survey on fault injection techniques. Int. Arab J. Inf. Technol. 1(2), 171–186 (2004)
Jia, Y., Harman, M.: An analysis and survey of the development of mutation testing. IEEE Trans. Softw. Eng. 37(5), 649–678 (2011)
Andrews, J., Briand, L., Labiche, Y.: Is mutation an appropriate tool for testing experiments? [software testing]. In: Proceedings of the 27th International Conference on Software Engineering, ICSE 2005, pp. 402–411 (2005)
DeMillo, R., Lipton, R., Sayward, F.: Hints on test data selection: help for the practicing programmer. Computer 11(4), 34–41 (1978)
Offutt, A.: Investigations of the software testing coupling effect. ACM Trans. Softw. Eng. Methodol. (TOSEM) 1(1), 5–20 (1992)
ESAC: Enhanced safety assessment for complex systems. FP5-GROWTH contract no. G4RDCT-2000-00361
ISAAC: Improvement of safety activities on aeronautical complex systems. FP6-AEROSPACE project reference 501848 (2007)
Vinter, J., Bromander, L., Raistrick, P., Edler, H.: Fiscade - a fault injection tool for scade models. In: 2007 3rd Institution of Engineering and Technology Conference on Automotive Electronics, pp. 1–9 (2007)
Plummer, A.: Model-in-the-loop testing. Proc. Inst. Mech. Eng. Part I: J. Syst. Control Eng. 220(3), 183–199 (2006)
Brillout, A., He, N., Mazzucchi, M., Kroening, D., Purandare, M., Rümmer, P., Weissenbacher, G.: Mutation-based test case generation for simulink models. In: de Boer, F.S., Bonsangue, M.M., Hallerstede, S., Leuschel, M. (eds.) FMCO 2009. LNCS, vol. 6286, pp. 208–227. Springer, Heidelberg (2010)
Berger, C., Chaudron, M., Heldal, R., Landsiedel, O., Schiller, E.M.: Model-based, composable simulation for the development of autonomous miniature vehicles. In: Mod4Sim’13: 3rd International Workshop on Model-driven Approaches for Simulation Engineering at SCS/IEEE Symposium on Theory of Modeling and Simulation in Conjunction with SpringSim 2013 (2013)
Berger, C., Hansson, J., et al.: Cots-architecture with a real-time os for a self-driving miniature vehicle. In: Proceedings of Workshop ASCoMS (Architecting Safety in Collaborative Mobile Systems) of the 32nd International Conference on Computer Safety, Reliability and Security (2013)
Acknowledgements
The work has been funded by Vinnova and Volvo Cars jointly under the FFI programme (VISEE, Project No: DIARIENR: 2011-04438).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Rana, R., Staron, M., Berger, C., Hansson, J., Nilsson, M., Törner, F. (2014). Early Verification and Validation According to ISO 26262 by Combining Fault Injection and Mutation Testing. In: Cordeiro, J., van Sinderen, M. (eds) Software Technologies. ICSOFT 2013. Communications in Computer and Information Science, vol 457. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-44920-2_11
Download citation
DOI: https://doi.org/10.1007/978-3-662-44920-2_11
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-44919-6
Online ISBN: 978-3-662-44920-2
eBook Packages: Computer ScienceComputer Science (R0)