At JANOG41, with the title of Network device testing automation by BDD + Python, we announced our verification test automation efforts.
Since tests other than physical operations are almost automated,
we decided to leave the operation to each project.
After checking the situation about a year later, the automation application rate was The initial 67% has decreased to 29%, and we decided to carry out improvement activities in a hurry.
As a result, the test automation rate of the latest project reached 83%.
Compared to manual testing, the cost was reduced by 29%.
In this presentation, we will explain the factors that required improvement
activities and how to deal with them. Also, we would like to share the points
and issues that We had difficulty in continuing to automate as a project.
