[Back]

W. Hummer, F. Rosenberg, F. Oliveira, T. Eilam:
"Testing Idempotence for Infrastructure as Code (Best Student Paper Award)";
Talk: ACM/IFIP/USENIX 14th International Middleware Conference, Middleware 2013, Beijing, China; 12-09-2013 - 12-13-2013; in: "Middleware 2013, ACM/IFIP/USENIX 14th International Middleware Conference, Proceedings", D. Eyers, K. Schwan (ed.); Springer Berlin Heidelberg, LNCS 8275 (2013), ISBN: 978-3-642-45064-8; 368 - 388.

Due to the competitiveness of the computing industry, software
developers are pressured to quickly deliver new code releases. At the
same time, operators are expected to update and keep production systems stable at all times. To overcome the development-operations barrier, organizations have started to adopt Infrastructure as Code (IaC) tools to efficiently deploy middleware and applications using automation scripts. These automations comprise a series of steps that should be idempotent to guarantee repeatability and convergence. Rigorous testing is required to ensure that the system idempotently converges to a desired state, starting from arbitrary states. We propose and evaluate a model-based testing framework for IaC. An abstracted system model is utilized to derive state transition graphs, based on which we systematically generate test cases for the automation. The test cases are executed in light-weight virtual machine environments. Our prototype targets one popular IaC tool (Chef), but the approach is general. We apply our framework to a large base of public IaC scripts written by operators, showing that it correctly detects non-idempotent automations.

Middleware Deployment, Software Automation, Idempotence, Convergence, Infrastructure as Code, Software Testing.

http://dx.doi.org/10.1007/978-3-642-45065-5_19