Introduction To Software Testing

This page intentionally left blank

Introduction to Software Testing
Extensively class tested, this text takes an innovative approach to software testing: it defines testing as the process of applying a few welldefined, general-purpose test criteria to a structure or model of the software. The structure of the text directly reflects the pedagogical approach and incorporates the latestinnovations in testing, including modern types of software such as OO, Web applications, and embedded software. The book contains numerous examples throughout. An instructor’s solution manual, PowerPoint slides, sample syllabi, additional examples and updates, testing tools for students, and example software programs in Java are available on an extensive Web site at www.introsoftwaretesting.com. PaulAmmann, PhD, is an Associate Professor of software engineering at George Mason University. He received an outstanding teaching award in 2007 from the Volgenau School of Information Technology and Engineering. Dr. Ammann earned an AB degree in computer science from Dartmouth College and MS and PhD degrees in computer science from the University of Virginia. Jeff Offutt, PhD, is a Professor of softwareengineering at George Mason University. He is editor-in-chief of the Journal of Software Testing, Verification and Reliability; chair of the steering committee for the IEEE International Conference on Software Testing, Verification, and Validation; and on the editorial boards for several journals. He recived the outstanding teacher award from the Volgenau School of Information Technology andEngineering in 2003. Dr. Offutt earned a BS degree in mathematics and data processing from Morehead State University and MS and PhD degrees in computer science from the Georgia Institute of Technology.

INTRODUCTION TO SOFTWARE TESTING

Paul Ammann
George Mason University

Jeff Offutt
George Mason University

CAMBRIDGE UNIVERSITY PRESS

Cambridge, New York, Melbourne, Madrid, Cape Town,Singapore, São Paulo Cambridge University Press The Edinburgh Building, Cambridge CB2 8RU, UK Published in the United States of America by Cambridge University Press, New York www.cambridge.org Information on this title: www.cambridge.org/9780521880381 © Paul Ammann and Jeff Offutt 2008 This publication is in copyright. Subject to statutory exception and to the provision of relevant collectivelicensing agreements, no reproduction of any part may take place without the written permission of Cambridge University Press. First published in print format 2008

ISBN-13 978-0-511-39330-3 ISBN-13 978-0-521-88038-1

eBook (EBL) hardback

Cambridge University Press has no responsibility for the persistence or accuracy of urls for external or third-party internet websites referred to in thispublication, and does not guarantee that any content on such websites is, or will remain, accurate or appropriate.

Contents

List of Figures List of Tables Preface

page ix xiii xv

Part 1 1

Overview

1 3 4 5 8 10 11 16 20 20 21 22 25 27 27 32 33 44 50 52
v

Introduction 1.1 Activities of a Test Engineer 1.1.1 Testing Levels Based on Software Activity 1.1.2 Beizer’s Testing LevelsBased on Test Process Maturity 1.1.3 Automation of Test Activities 1.2 Software Testing Limitations and Terminology 1.3 Coverage Criteria for Testing 1.3.1 Infeasibility and Subsumption 1.3.2 Characteristics of a Good Coverage Criterion 1.4 Older Software Testing Terminology 1.5 Bibliographic Notes

Part 2 Coverage Criteria 2 Graph Coverage 2.1 Overview 2.2 Graph Coverage Criteria 2.2.1 StructuralCoverage Criteria 2.2.2 Data Flow Criteria 2.2.3 Subsumption Relationships among Graph Coverage Criteria 2.3 Graph Coverage for Source Code

vi

Contents

2.4

2.5

2.6 2.7

2.8

2.3.1 Structural Graph Coverage for Source Code 2.3.2 Data Flow Graph Coverage for Source Code Graph Coverage for Design Elements 2.4.1 Structural Graph Coverage for Design Elements 2.4.2 Data Flow Graph...