Running a suite of acceptance tests should be the second gate of a deployment pipeline. The acceptance tests also serve as a regression test suite to verify that new features have not been introduced into the system. During this stage, any test failures that occur in the acceptance test suite need to be evaluated on a case-by-case basis. The failure may be due to intentional behavior changes in the system, and so the acceptance test suite needs to be updated or the failure may represent a regression that needs to be addressed. Either way, the acceptance test suite must be fixed as soon as possible. The acceptance tests act as another gate in order for the deployment pipeline to progress down the line.
Acceptance tests build stage
Get Hands-On Continuous Integration and Delivery now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
