Testing Practitioner Handbook

Testing Practitioner Handbook

by Renu Rajani
Released March 2017
Publisher(s): Packt Publishing
ISBN: 9781788299541

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

Gain insights into the latest technology and business trends within testing domains

About This Book

  • This book covers the latest trends that every Testing and QA professional should keep up-to-date with given the advancements in digital technologies.
  • Master cutting-edge testing techniques for emerging areas such as IOT, Machine Learning, Cognitive.
  • Best practices for Testing and Quality Assurance within several industry domains.

Who This Book Is For

This book is targeted at those working in the QA and Testing areas. The book does not cover testing basics, which QA professional are already familiar with - for example, writing a test plan or test case, and so on.

What You Will Learn

  • Understand the TCOE model, managed services, the structure of testing in Agile/DevOps engagements, factory models, and crowdsourcing
  • Implement testing processes, practices, and automation tools in the Agile/DevOps life cycle
  • Adapt to current technologies in social media, mobile, analytics and the Cloud
  • Leverage cognitive intelligence/machine-learning, robotics, and the Internet of Things in testing
  • How key industries/domains (consumer products and retail, energy and utilities, healthcare, telecom, and automotive) adapt to digital transformation
  • Future directions for the QA industry, consulting careers, testing profession, and professionals

In Detail

The book is based on the author`s experience in leading and transforming large test engagements and architecting solutions for customer testing requirements/bids/problem areas. It targets the testing practitioner population and provides them with a single go-to place to find perspectives, practices, trends, tools, and solutions to test applications as they face the evolving digital world.

This book is divided into five parts where each part explores different aspects of testing in the real world. The first module explains the various testing engagement models. You will then learn how to efficiently test code in different life cycles. The book discusses the different aspects of Quality Analysis consideration while testing social media, mobile, analytics, and the Cloud. In the last module, you will learn about futuristic technologies to test software.

By the end of the book, you will understand the latest business and IT trends in digital transformation and learn the best practices to adopt for business assurance.

Style and approach

This book is a compilation of the latest business and IT trends in digital transformation & Tools and Best Practices that QA professionals need to adopt for business assurance.

Table of contents

  1. Testing Practitioner Handbook
    1. Table of Contents
    2. Testing Practitioner Handbook
    3. Credits
    4. About the Author
    5. Acknowledgement
    6. About the Reviewer
    7. www.PacktPub.com
      1. eBooks, discount offers, and more
        1. Why subscribe?
    8. Customer Feedback
    9. Preface
      1. What this book covers
      2. What you need for this book
      3. Who this book is for
      4. Conventions
      5. Reader feedback
      6. Customer support
        1. Errata
        2. Piracy
        3. Questions
    10. 1. State of Digital Transformation – What Has Changed in the Last Four Years (2013-16)?
      1. Renewed focus on efficiency and effectiveness
      2. QA and testing transformation focus
      3. QA and testing transformation drivers
      4. State of digital maturity
      5. Spends for digital QA
      6. Predictions on the level of cloud-based applications
      7. Increased challenges in mobile and IoT multichannel testing
      8. Reduction in customer experience testing challenges
      9. Conclusion
    11. 2. Future of Testing Engagement Models – Are Predictions of Increased QA Spends Justified?
      1. How is QA effort spread
        1. Split of QA effort between development and production support
        2. Increased QA efforts for new development – point of view
        3. Increase of QA effort in the design phase
        4. Increased QA effort in the design phase – point of view
      2. QA organizations would follow hybrid QA teams (centralized and decentralized)
        1. Trend towards Hybrid QA teams – point of view
      3. What will be the future of testing engagement models?
        1. Future of testing engagement models – point of view
      4. Conclusion
      5. References
    12. 3. The Benefits of Replacing Testing Subcontractors with Managed Testing Services
      1. Findings from the World Quality Report 2016 on industrialization and testing centers of excellence
      2. Use of direct subcontractors remains prevalent
      3. Key challenges associated while working with subcontractors
      4. How replacing testing subcontractors with managed testing services helps
        1. Knowledge retention
        2. Handover
        3. Cost of resourcing
        4. Economies of scale
        5. Illustration of benefits
        6. A saving calculator
      5. Conclusion
    13. 4. Digital Quality Assurance in a Factory Model
      1. Services factories
      2. A digital factory model for industrializing digital QA delivery
      3. Key Elements for Onboarding in DQAF
        1. DQAF enablement functions
        2. DQAF service delivery functions
      4. Benefits delivered through DQAF model
      5. Conclusion
    14. 5. Crowdsourcing – Enabling Flexible, On-Demand Testing COEs
      1. Trends - crowdsourced testing
      2. What is crowdtesting and how does it work?
      3. Crowdtesting operating models
      4. Crowdtesting as part of Testing Center of Excellence (TCOE)
        1. Key challenges of adopting crowdtesting
      5. The benefits of crowdtesting
      6. Conclusion
      7. References
    15. 6. Testing Goes an Extra Mile over Weekends
      1. Weekend testing – modus operandi
      2. Advantages
      3. Disadvantages
      4. Trends in the use of crowdsourced testing
      5. How can large IT organizations ride the weekend testing bandwagon?
      6. Conclusion
      7. References
    16. 7. Testing in Agile Development and the State of Agile Adoption
      1. What do agile projects promise compared to traditional waterfall?
      2. Flavors of agile
        1. Scrum
        2. Kanban
      3. How is testing done in agile sprints?
      4. Agile in distributed environments
      5. State of agile adoption – findings from the World Quality Report 2016-2017
        1. Challenges in applying agile methodology
        2. Approaches to testing in agile development environments
        3. Skills needed from QA and testing professions for agile
      6. Conclusion
    17. 8. Agile and DevOps Adoption are Gaining Momentum
      1. Increased use of agile/DevOps principles
      2. Increased complexity of testing in the agile landscape
      3. Challenges cited in setting up agile test COEs
      4. How is QA transforming to meet the demands of agile/DevOps life cycles
      5. What is the difference between testing in DevOps and traditional life cycle?
      6. Conclusion
    18. 9. Does the Rise of DevOps Undermine Agile?
      1. Agile is about speed
      2. DevOps removes the boundaries between dev, QA, and operations
      3. Agile versus DevOps
      4. Conclusion
    19. 10. Role of Automation in DevOps Life Cycle
      1. The importance of automation in DevOps
      2. Early integration automation
      3. Automation – the default practice
      4. Deployment automation
      5. Automation – metrics and measurements
        1. Automation coverage
        2. Automation index
        3. Framework and scripts reusability
        4. Automation scripting and execution productivity
        5. Automation ROI
        6. Automation progress tracking
      6. Best practices to adopt early and continuously automate
        1. Treating automation as any other development work
        2. Quality engineering
        3. Coupling of development, automation, and test teams
        4. Selecting the right solution
      7. Conclusion
    20. 11. Assessing the State of Your DevOps Adoption with DevOps Benchmarking Approach
      1. Why DevOps – the drivers
      2. Challenges organizations face in implementing DevOps
      3. DevOps QA benchmarking — why and what?
      4. DevOps QA benchmarking assessment areas
        1. Outcome of DevOps QA benchmarking assessment
      5. Conclusion
    21. 12. Accelerating DevOps – ChatOps is the New Cool
      1. DevOps trends from World Quality Report
      2. ChatOps – How does it work?
      3. Application of ChatOps as a collaboration platform
      4. Benefits of ChatOps
      5. Conclusion
    22. 13. Behavior-Driven Development (BDD) Using Gherkin in Agile/DevOps Environment
      1. Background – Behavior-Driven Development (BDD)
      2. Gherkin – basic syntax and illustration
      3. Roles of members involved
      4. Benefits of using Gherkin
      5. Conclusion
    23. 14. Automating Configuration Management for DevOps Test Environments
      1. Background
      2. Types of test environments
        1. Configuration and environment management services on cloud and related challenges
      3. Potential solutions for automated configuration management
      4. The benefits of automating configuration management
      5. Conclusion
    24. 15. Automated Test Data Management in the DevOps Environment
      1. Background
      2. TDM in DevOps environment – key challenges
      3. Automated TDM solution for DevOps environment
      4. Typical TDM services and TDM architecture
      5. Benefits of automated TDM
      6. Best practices in TDM
      7. Conclusion
    25. 16. Testing in DevOps Life Cycle Using Microservices Architecture
      1. What is microservices architecture?
      2. Testing in agile/DevOps life cycle using Microservices Architecture
      3. Performance testing of Microservices
      4. Monitoring Microservices
      5. Conclusion
    26. 17. Automated Test Environments for DevOps
      1. Test Environment Management – key challenges
      2. Test environment automation approach for DevOps
      3. Benefits of test environment automation
      4. Test environment metrics to consider in release management
      5. Test environment automation tools
      6. Conclusion
    27. 18. Service Virtualization as an Enabler of DevOps
      1. Service virtualization and DevOps
      2. Role of service virtualization in DevOps
      3. Service virtualization – research input
      4. Service virtualization automation tools used in DevOps
      5. Conclusion
    28. 19. Best Practices in Identifying Regression Test Cases
      1. Background – software regression testing
      2. Software regression process
      3. How should one choose test cases for regression?
      4. Conclusion
    29. 20. Accessibility Test Automation in DevOps Environment
      1. Background – Accessibility (AX)
      2. AX and DevOps
      3. AX test automation in DevOps
      4. Standard AX tools
      5. Conclusion
    30. 21. Performance Tuning of Java Applications
      1. Performance bottlenecks – key challenges and solutions
        1. Reusing objects
        2. Managing pool of objects
        3. Canonicalizing objects
        4. Enumerating constants
        5. Comparison versus identity
        6. Avoiding excess garbage collection
        7. Delayed initialization
      2. Java performance tuning tools
        1. NetBean profiler for analyzing Java applications
          1. Thread state
          2. CPU Performance
          3. Memory Usage
      3. Conclusion
    31. 22. Testing Mobile Applications – Key Challenges and Considerations
      1. User expectations
      2. Key challenges encountered in testing mobile applications
        1. User experience
        2. Contextual appropriateness
        3. Varied mobile user interfaces
        4. Device diversity and availability
        5. Device based testing approach
        6. Automated testing of layouts
        7. Test automation challenges with non-standardized tools
        8. Reduced time to market
      3. Recommendations to enhance mobile applications usability
      4. Conclusion
    32. 23. Testing Analytics Applications – What Has Changed in SMAC World
      1. Understanding your customers, gathering data and analyzing it
      2. Testing the data
      3. Testing the BI/BA applications
      4. How is testing done differently for big data/Hadoop applications?
      5. Conclusion
    33. 24. Migrating Applications to Cloud Environments – Key Testing Considerations
      1. Need for validating applications for cloud migration
      2. Key testing focus areas in cloud migration of applications
      3. Key challenges in validation during cloud migration of applications
      4. Application migration validation – a holistic approach
      5. Conclusion
    34. 25. How Should a Tester Adapt to Cloud – Call for Change of Mindset among Testers
      1. What must testers prepare for when testing applications on cloud
        1. Testing the invisible
        2. Understanding the distance
        3. Breaking the communication barriers
        4. Securing the application
        5. Replicating the platform
        6. Using the right tools
      2. Conclusion
    35. 26. On-Demand Performance Testing on Self-Service Environments
      1. On-demand performance testing environments — key challenges and solutions
      2. Need for a cloud platform to build end-to-end performance testing
      3. On-demand self-service environments for carrying out performance testing
      4. Key scenarios for on-demand performance testing – proposed architecture
        1. Scenario-1 — Architecture and how performance testing is carried out
        2. Scenario-2 — Architecture and how performance testing is carried out
      5. Conclusion
    36. 27. Quality Assurance for Digital Marketing Initiatives
      1. Evolution of digital marketing
      2. Challenges of implementing digital marketing
      3. Need for quality focus in digital marketing initiatives
      4. QA of digital marketing applications – key validations
      5. Conclusion
    37. 28. Security Dashboard for the Board
      1. Why security threats need to be monitored and reported?
      2. What should be monitored and reported?
        1. Application security/vulnerability management
      3. Specific metrics to be reported in dashboard
      4. Consequences of security lapses
      5. Key challenges in implementing a dashboard
      6. Conclusion
    38. 29. Applying Robotic Automation to Mobile Applications Testing
      1. Software robot and their applicability
      2. The benefits of Robotic Process Automation (RPA)
      3. Implementing RPA for mobile testing
      4. Conclusion
      5. References
    39. 30. Key Considerations in Testing Internet of Things (IoT) Applications
      1. Need for a robust IoT test strategy
      2. IoT Revolution – key findings from the World Quality Report 2016
      3. IoT Testing Considerations
      4. IoT testing types
      5. Conclusion
      6. References
    40. 31. Algorithmic Business – In Need of Model-Based Testing
      1. Introduction and journey of analytics
      2. Algorithmic business – an illustration
      3. Implications of testing – the need for model-based testing
      4. Conclusion
    41. 32. Making Testing Adaptive, Interactive, Iterative, and Contextual with Cognitive Intelligence
      1. Background – cognitive intelligence
      2. What is cognitive testing all about?
      3. Evolution of cognitive technology and available platforms
      4. Methodologies involved in cognitive testing
      5. Advantages of cognitive testing compared to the current methods
      6. Sector specific use cases
      7. Technologies supported
      8. Costs involved
      9. Challenges associated in implementing cognitive technologies
      10. Conclusion
    42. 33. FinTech – A New Disruptor in Industry and Implications for Testing and QA
      1. FinTech ecosystem
      2. FinTech services and their impact on various sectors
      3. Testing for FinTech applications or solutions
      4. Conclusion
    43. 34. Blockchain Technology – Assuring Secure Business
      1. Introduction to blockchain
      2. The blockchain process
      3. Popular blockchains
      4. Implication for testing
      5. Conclusion
    44. 35. Technologies for Digital Supply Chains and QA Considerations
      1. Understanding the customer buying process
      2. Industry trends in supply chain management
      3. New technologies in supply chain management
      4. An illustration – new technologies in retail
      5. Focus of QA in supply chain
      6. Conclusion
    45. 36. Potential Innovations in eHealth-Care – Implications for Testing and QA
      1. Digital transformation trends in the healthcare sector
      2. Applications of digital eHealth-Care care
      3. Digital eHealth-Care care ecosystem
      4. Typical challenges in digital eHealth-Care care
      5. Need for robust digital QA
      6. An illustrative customer journey validation of patient using wearables
      7. Conclusion
    46. 37. Trends in the Global Automotive Sector – Implications for Testing and QA
      1. Business drivers for global automotive evolution
      2. Key highlights from the growing Chinese automotive market
      3. Influence of global automotive trends on the Chinese market
      4. How are trends in automotive segments shaping software testing?
      5. Conclusion
    47. 38. Digital Transformation in Consumer Products and Retail Sector – QA Considerations
      1. Current challenges in the consumer products and retail sector
      2. Physical versus online stores – key trends
        1. Brick-and-mortar – physical stores
        2. Online stores
      3. Digital transformation in CPR industry
      4. Customer journey of a digital shopper in an omni-channel environment – an illustration
      5. Being digital – what value levers can it offer to CPR industry
      6. Factors considered by digital shoppers
      7. Multi/omni-channel CPR – quality considerations
        1. Inventory visibility
        2. Web-ready products
        3. Predictive customer analysis
        4. Fulfillment strategy
      8. Digital transformation in CPR - tests required
      9. Conclusion
    48. 39. Digital Transformation Trends in Energy and Utilities – QA Considerations
      1. Technology trends in utilities industry
      2. Key technology blocks of digital transformation in the EUC sector
      3. Challenge of multichannel and the need for a unified customer journey
      4. Testing considerations in an EUC customer journey – an illustration
      5. Testing considerations in smart metering infrastructure – an illustration
      6. Digital transformation QA trends in EUC
      7. Conclusion
      8. References
    49. 40. Smart Energy and Smart Grids – in Need of Effective Testing
      1. Background
      2. Trends in Energy and Utilities (E&U)
        1. E&U Trends – References from WQR 2016
      3. Typical challenges in the E&U segment
      4. Smart Meters and Smart Grids
      5. Testing process for Smart Metering Infrastructure (SMI)
      6. Conclusion
    50. 41. Testing Airline Digital Applications – Case for Responsive Design
      1. Background – the state of the airline business
      2. Role of digitization
      3. QA and testing in the airline industry
        1. Testing business rules implementation
        2. Systems integration testing
        3. Non-functional testing
      4. Testing responsive web designs
      5. Conclusion
    51. 42. Orthogonal Array Testing (OAT) – an Application in Healthcare Industry
      1. Background
      2. Challenges in H&LS applications testing
      3. How can Orthogonal Array Testing Strategy (OATS) help?
      4. Conclusion
    52. 43. Future of Consulting in the Era of Digital Disruption
      1. Digital driving a shift in the way consulting worked
      2. The digital age consultant
      3. Future of consulting
      4. What would I do differently as a consultant now?
        1. Engage with my clients more through the life cycle
        2. Don't drop a bomb of travel costs
        3. Solving the consultant utilization problem with Crowd-Source
        4. Flexible operating model of consulting firms
      5. Conclusion
    53. 44. Future of Testing in the Digital World
      1. Key technology trends that would shape the future of Information Technology
        1. Pervasive technologies and predictive analytics for customer experience
        2. Cognitive Intelligence in Connected Autonomous Vehicle (CAV)
        3. Multi-channel customer connect – wearable technology
        4. Disintermediation – business platform to connect new partners
        5. Changing workplaces of future – Robotic Process Automation (RPA)
      2. Testing considerations for new technologies
        1. Pervasive technologies and predictive analytics
        2. Cognitive intelligence – Connected Autonomous Vehicle (CAV)
        3. Multi-channel customer connect – wearable technology
        4. Disintermediation – business platform
        5. Changing workplaces of the future – robotic process automation
      3. Conclusion
    54. 45. Future of Testing – Career Opportunities
      1. Career options in testing services
      2. Typical roles in testing services
      3. The importance of industry and domain, technology and tools, and process skills in testing careers
      4. Required skills for agile and DevOps testing
      5. New breed of testers in DevOps
      6. Conclusion
    55. 46. Robotics and Machine Learning Combined with Internet of Things – What Could This Mean for Indian Services Industries
      1. Understanding the context – robotics, machine learning, and IoT
      2. What does advancement of technology mean for the Indian economy?
        1. Learning from the global oil price crash
        2. Learning from the economic slowdown of China–what caused the slowdown in China?
      3. Outlook for the the services sector in India – a point of view
      4. Conclusion
    56. A. References
      1. Across Chapters – World Quality Report 2016 (Capgemini, Sogeti, HPE):
      2. Chapter 2 – Future of Testing Engagement Models – Are Predictions of increased QA Spends Justified?
      3. Chapter 3 – The Benefits of Replacing Testing Subcontractors with Managed Testing Services
      4. Chapter 18 – Service Virtualization as an Enabler of DevOps
      5. Chapter 30 – Key Considerations in Testing Internet of Things (IOT) Applications
      6. Chapter 31 – Algorithmic Business – In Need of Model-Based Testing
      7. Chapter 46 – Robotics and Machine Learning Combined with Internet of Things – What could this mean for Indian Services Industries
    57. Index

Product information

  • Title: Testing Practitioner Handbook
  • Author(s): Renu Rajani
  • Release date: March 2017
  • Publisher(s): Packt Publishing
  • ISBN: 9781788299541