Testing Complex and Embedded Systems  book cover
1st Edition

Testing Complex and Embedded Systems

ISBN 9781439821404
Published December 8, 2010 by CRC Press
320 Pages 100 B/W Illustrations

FREE Standard Shipping
USD $125.00

Prices & shipping based on shipping country


Book Description

Many enterprises regard system-level testing as the final piece of the development effort, rather than as a tool that should be integrated throughout the development process. As a consequence, test teams often execute critical test plans just before product launch, resulting in much of the corrective work being performed in a rush and at the last minute.

Presenting combinatorial approaches for improving test coverage, Testing Complex and Embedded Systems details techniques to help you streamline testing and identify problems before they occur—including turbocharged testing using Six Sigma and exploratory testing methods. Rather than present the continuum of testing for particular products or design attributes, the text focuses on boundary conditions. Examining systems and software testing, it explains how to use simulation and emulation to complement testing.

  • Details how to manage multiple test hardware and software deliveries
  • Examines the contradictory perspectives of testing—including ordered/ random, structured /unstructured, bench/field, and repeatable/non repeatable
  • Covers essential planning activities prior to testing, how to scope the work, and how to reach a successful conclusion
  • Explains how to determine when testing is complete

Where you find organizations that are successful at product development, you are likely to find groups that practice disciplined, strategic, and thorough testing. Tapping into the authors’ decades of experience managing test groups in the automotive industry, this book provides the understanding to help ensure your organization joins the likes of these groups.

Table of Contents

Does Your Testing Look Like This?
Last-Minute Flailing
Fiascos Uncovered Weeks before Launch
Huge Warranty Problems
Customer Dissatisfaction

Benefits of Improved Testing
Product Problems Revealed Early
Improved Reliability = Lower Cost
Happy Customers
Confidence in a Fine Product
Cost-Effective Testing Solutions Not Waiting Until
the Last Minute
Goals of Testing
Types of Testing
Levels of Testing

Basic Principles
Looking at the Evidence

The Question
Not Phrases

Contradictory Perspectives of Testing
Single Environment/Multiple Environments
Inside System/Outside System
"Good"/"Bad" Testing

The Use of Noise
Can Use Taguchi Approach
Sometimes Difficult to Simulate
Where to Apply Noise?
Exogenous Shocks
Self-Generated Noise

How to Perform "Bad’’ Tests
Do Not
Documenting the Testing
Components of a Test Plan
Components of a Test Report
The DVP&R Format

Test Administration
Test Management
Test Scheduling
Test Human Resources
Test Device Resources
Test Quality
Test Costing
Test Risk
Calibration Issues

Advanced Concepts
Test Impacts
Construct Validity
Types of Bias
Reliability and Confidence
Life Testing
Testing Team Early Involvement

Software Test Documentation
Defect Life Cycle

Configuration Management
Configuration Management Areas
Elements of Configuration Management
Importance of Configuration Management
Links to Testing

Software Testing
Software Testing—The Problem
Test Metrics
Software Boundary Testing
Static Code Analysis
Dynamic Code Analysis

Systems Testing
End-to-End Testing
Big-Bang Testing
Top-Down Testing
Bottom-Up Testing
Managing Multiple Test Hardware
and Software Deliveries
Test Configuration Management
System Variations and Test Demands
Functional Testing
System Response to Multiple System Failures
Ranges of System Performance

Simulation and Emulation
Simulation Levels
Simulation Activities
Objectives of Simulation
Simulation as Verification
Simulation as Test Preparation
Conflict between Simulation and Test Results

Span of Tests
Unit Test
Component Test
Subsystem-Level Integration Testing
Production Test
Static Analysis
Structural Analysis
Prototyping and Simulation
Reliability and Confidence
Limitations of Reliability and Confidence
Concept of "Life" and the Product
Establishing Product Life Exposure

Exit Criteria
When Is Enough, Enough?
Compared to Plan?
Testing Ethics
Final Words


View More



Kim H. Pries has a B.A. in history from the University of Texas at El Paso (UTEP), a B.S. in metallurgical engineering from UTEP, an M.S. in metallurgical engineering from UTEP, and an M.S. in metallurgical engineering and materials science from Carnegie Mellon University. In addition he has the following certifications:

– Certified Production and Inventory Manager (CPIM)
_ American Society for Quality (ASQ)
– Certified Reliability Engineer (CRE)
– Certified Quality Engineer (CQE)
– Certified Software Quality Engineer (CSQE)
– Certified Six Sigma Black Belt (CSSBB)
– Certified Manager of Quality/Operational Excellence (CMQ/OE)
– Certified Quality Auditor (CQA)

Pries worked as a computer systems manager ("IT"), a software engineer for an electrical utility, a scientific programmer on defense contracts; and for Stoneridge, Incorporated (SRI), he has worked for 15 years as:
_ Software manager
_ Engineering services manager
_ Reliability section manager
_ Product integrity and reliability director

In addition to his other responsibilities, Pries provides Six Sigma training for both UTEP and SRI and cost reduction initatives for SRI. Additionally, in concert with Quigley, Pries is the co-founder and principal with Value Transformation, LLC, a training, testing, and product development consultancy. He is also a lay monk in the Soto tradition of Zen Buddhism and functions as an Ino for the Zen Center of Las Cruces while studying for the Soto Zen priesthood.

Pries’ first book was Six Sigma for the Next Millennium: A CSSBB Guidebook, revised as Six Sigma for the New Millennium: A CSSBB Guidebook, second edition, from ASQ’s Quality Press. For Taylor&Francis, Pries has worked with Jon Quigley to write Project Management of Complex and Embedded Systems, Scrum Project Management, as well as this book. With Quigley, he has written well over 30 magazine articles. He has also presented for the Society of Automotive Engineers, the Automotive Industry Action Group, MarcusEvans, and the Software Test and Performance Convention.

Additionally, Pries is a principal of Value Transformation, a product development training and cost improvement organization. He is also a founding faculty member of Practical Project Management.

Jon M. Quigley has a B.S. in electronic engineering technology from the University of North Carolina at Charlotte and a master’s of business administration and an M.S. in project management from City University of Seattle. In addition to these degrees, he holds the following certifications:
_ Project Management Institute:
– Project Management Professional (PMP)
_ International Software Testing Qualifications Board (ISTQB):
– Certified Tester Foundation Level (CTFL)

Quigley has secured six U.S. patents over the years, with another two in various stages at the U.S. Patent Office, one of which is in the pre-grant stage. These patents range from human–machine interfaces to telemetry systems and drivers’ aids:
_ U.S. Patent Award 6,253,131, Steering wheel electronic interface
_ U.S. Patent Award 6,130,487, Electronic interface and method for connecting the electrical systems of truck and trailer
_ U.S. Patent Award 6,828,924, Integrated vehicle communications display (also a European patent)
_ U.S. Patent Award 6,718,906, Dual scale vehicle gauge
_ U.S. Patent Award 7,512,477 Systems and methods for guiding operators to optimized engine operation
_ U.S. Patent Award 7,629,878, Measuring instrument having location controlled display

Quigley won the Volvo-3P Technical Award in 2005, going on to win the Volvo Technology Award in 2006. Quigley has more than 20 years of product development experience, ranging from embedded hardware and software design through verification, project management, and line management.

_ Software engineer
_ Embedded engineer (hardware)
_ Test engineer
_ Project manager
_ Electrical and electronic systems manager
_ Verification and test manager

Quigley is a principal of Value Transformation, a product development training and cost improvement organization. He is also a founding faculty member of Practical Project Management. He is the co-author of the books Project Management of Complex and Embedded Systems and Scrum Project Management. Also with Kim H. Pries, he has written more than 30 magazine articles and presented at numerous product development conferences about various aspects of product development and project management. Quigley lives in Lexington, North Carolina. For additional information , visit www.valuetransform.com.