“When will the tests be green?” Have you heard that question? I submit that, until we fix all the bugs, they never will be! Project leaders look to the test results to know if we can release. They want to see “Green” on the status board. Green means all tests are passing. Will they ever? Experience tells us very few releases are delivered completely bug free. When designing metrics we need to take care that we do not encourage bad behavior. Pushing for “Green” test results can result in bad behavior: The removal of failing tests or (worse yet) the modification of tests to PASS with known defects in the software, all in an effort to report “Green”. This presentation suggests a new way to manage results, and expectations, so that your tests are true to the quality of the product.
Outcomes:
