Skip to content

Commit 2776e1a

Browse files
authored
Merge pull request #305 from ashiskumarnaik/automation-testing
merging the section "Why does this matter" in the opening section on the importance of testing
2 parents 79555f1 + 64a703f commit 2776e1a

File tree

1 file changed

+38
-39
lines changed

1 file changed

+38
-39
lines changed

COBOL Programming Course #4 - Testing/COBOL Programming Course #4 - Testing.md

Lines changed: 38 additions & 39 deletions
Original file line numberDiff line numberDiff line change
@@ -38,6 +38,16 @@ We will look at some of the background to software testing and the different typ
3838

3939
- **The role of exploratory testing**
4040

41+
- **Why does automated testing matter?**
42+
43+
- **Value of automated testing in continuous delivery**
44+
45+
- **Dangers of not automating testing**
46+
47+
- **Risks of not adopting continuous delivery**
48+
49+
- **Use of automated testing for system reliability**
50+
4151
- **Basics of continuous integration, continuous delivery**
4252

4353
- **Introduction to DevOps and CI/CD pipelines**
@@ -54,16 +64,6 @@ We will look at some of the background to software testing and the different typ
5464

5565
- **Challenges for test automation on z/OS**
5666

57-
- **Why does this matter?**
58-
59-
- **Value of automated testing in continuous delivery**
60-
61-
- **Dangers of not automating testing**
62-
63-
- **Risks of not adopting continuous delivery**
64-
65-
- **Use of automated testing for system reliability**
66-
6767
- **How can test automation be achieved on z/OS?**
6868

6969

@@ -160,6 +160,34 @@ Exploratory testing is often referred to as being a 'thinking' activity. It is
160160

161161
This type of testing makes the best use of the skills of the tester, but clearly by its very nature does not lend itself to automation. The value of automation of testing lies in freeing the tester from the need to manually carry out repetitive and un-thinking testing.
162162

163+
164+
## Why does automated testing matter?
165+
166+
Organizations that use z/OS for their mission-critical systems have enjoyed growth and success for many years. So, does it matter if most of the testing is done manually? In today's world, it is important to be able to respond very rapidly to new market opportunities and threats, and to have confidence in the quality and robustness of the services that you provide.
167+
168+
169+
### Value of automated testing in continuous delivery
170+
171+
As we have seen, if testing cannot be automated, then it is difficult if not impossible to gain the benefits of continuous delivery, reducing the agility of an organization and its ability to react and innovate quickly. Even responding to a new competitive threat or compliance regulation might not be possible without a CI/CD pipeline and automated testing.
172+
173+
174+
### Dangers of not automating testing
175+
176+
If an organization continues to test manually, then they run the risk that the test cycle will be too long to enable the required agility and speed to market, or the amount of testing will have to be reduced, leading to uncertainty over the quality of the software being delivered, or perhaps both.
177+
178+
179+
### Risks of not adopting continuous delivery
180+
181+
If an organization does not adopt a continuous delivery approach, in which small changes can be constantly delivered and tested, then there is a tendency to save up all the changes until enough have been made to justify the large effort involved in testing a software release. Not only does this mean that users endure a long wait for new function to become available, but if problems occur then it is harder to identify the cause and to isolate the failing component.
182+
183+
184+
Even more damaging could be the impact of being unable to deliver function rapidly into the marketplace, and missing opportunities as a result.
185+
186+
187+
### Use of automated testing for system reliability
188+
189+
With automated testing in place, it is easy to run the checks which ensure the software is working as expected. So, whenever a change is introduced into the system, such as applying maintenance, a hardware upgrade, or updates to another component, there is automation available to verify that all is as it should be. This also means that such changes can be made more easily and with more confidence.
190+
163191

164192
## Basics of continuous integration, continuous delivery
165193

@@ -298,36 +326,7 @@ Why is test automation such a challenge on z/OS? Some of the reasons are:
298326

299327
The difficulty in achieving this has resulted in falling back to manual processes and checks, and as a result continuing to use waterfall processes. To quote Sandeep Johri again, "If you move to Agile development but your testing cycle is still 6 to 12 weeks due to manual testing, you’ll fall right back into a Waterfall mode” ([https://devops.com/devops-chat-continuous-testing-w-sandeep-johri-ceo-tricentis/](https://devops.com/devops-chat-continuous-testing-w-sandeep-johri-ceo-tricentis/)). If the testing cycle takes a long time, then developers will be tempted to group together lots of changes to get them tested all together, which is entirely counter to the idea of continuous integration.
300328

301-
302-
303-
## Why does this matter?
304-
305-
Organizations that use z/OS for their mission-critical systems have enjoyed growth and success for many years. So, does it matter if most of the testing is done manually? In today's world, it is important to be able to respond very rapidly to new market opportunities and threats, and to have confidence in the quality and robustness of the services that you provide.
306-
307-
308-
### Value of automated testing in continuous delivery
309-
310-
As we have seen, if testing cannot be automated, then it is difficult if not impossible to gain the benefits of continuous delivery, reducing the agility of an organization and its ability to react and innovate quickly. Even responding to a new competitive threat or compliance regulation might not be possible without a CI/CD pipeline and automated testing.
311329

312-
313-
### Dangers of not automating testing
314-
315-
If an organization continues to test manually, then they run the risk that the test cycle will be too long to enable the required agility and speed to market, or the amount of testing will have to be reduced, leading to uncertainty over the quality of the software being delivered, or perhaps both.
316-
317-
318-
### Risks of not adopting continuous delivery
319-
320-
If an organization does not adopt a continuous delivery approach, in which small changes can be constantly delivered and tested, then there is a tendency to save up all the changes until enough have been made to justify the large effort involved in testing a software release. Not only does this mean that users endure a long wait for new function to become available, but if problems occur then it is harder to identify the cause and to isolate the failing component.
321-
322-
323-
Even more damaging could be the impact of being unable to deliver function rapidly into the marketplace, and missing opportunities as a result.
324-
325-
326-
### Use of automated testing for system reliability
327-
328-
With automated testing in place, it is easy to run the checks which ensure the software is working as expected. So, whenever a change is introduced into the system, such as applying maintenance, a hardware upgrade, or updates to another component, there is automation available to verify that all is as it should be. This also means that such changes can be made more easily and with more confidence.
329-
330-
331330
## How can test automation be achieved on z/OS?
332331

333332
Many organizations have built, or are now building, CI/CD pipelines for their z/OS applications, with considerable success. These teams are looking to test automation to help them achieve an efficient pipeline. This chapter described an approach to test automation on z/OS, by using a framework for automating tests which offers deep integration with z/OS capabilities.

0 commit comments

Comments
 (0)