ABoT : Test Orchestration Solution

Application and service complexity demands intricate setup, configuration, and test scripts. For successful and faster roll-outs of network services like Mobility and IoT on different platforms, it is necessary to define call flows and execute them on multiple setups in a CI/CD environment.

The ABot Test Orchestration Solution uses the concept of BDD to define and execute test scenarios enabling collaboration amongst multiple stakeholders. The test cases are written in a user-friendly Domain Specific Language (DSL) for Product Managers, Dev/QA engineers, Solution Architects as well as Field personnel to define and reuse the test cases. ABot can be seamlessly invoked from different CI engines like Jenkins for scheduling the test execution. The framework integrates with orchestrators like Juju and Cloudify for Continuous Deployment (CD) and lifecycle management on NFV platforms. ABot can incorporate plugins to emulate components of complex systems like Mobility and IoT for comprehensive functional and performance testing.

ABot comes integrated with an intuitive web-based UI that provides a graphical summary,  detailed review of the test results and test analytics. The test results are viewable through the ABot UI as well as through the Jenkins dashboard; thereby enabling easy certification of the System under Test (SUT).

The ABot solution includes a Test Orchestration framework that enables Service Providers and OEMs to define reusable tests based on a user-friendly Domain Specific Language (DSL) and schedule their execution through any CI engine like Jenkins.

ABot uses the concept of BDD (Behaviour driven development) to define service-level test scenarios in a high-level language using spec-driven acceptance criteria thereby enabling collaboration with multiple stakeholders. Since test cases are written in English like language (no programming syntax), even a field engineer can easily add a field level test case thereby enhancing the test repository. These feature files are mapped to relevant specifications, call flows and procedures, hence they can be provided as a part of RFP response for easy customer verification.

ABot provides a repository for user-defined test cases as well as the testbed configuration in the form of templates. These test cases are in the form of feature files and can be executed either individually or in groups through CI systems like Jenkins. The test results are viewable either through the built-in ABot UI or any integrated CI dashboard; thereby enabling easy analysis of the SUT.

ABot is integrated with an intuitive web-based UI that provides a graphical summary of the test results; primarily focusing on the aggregate/holistic view. One can then drill down to detailed results indicating the status of each step in a test case along with relevant artifacts such as log files and PCAP captures.

Managing complex mobility services like IoT, M2M & AI requires seamless interoperability between different network functions. Executing reusable DSL-based feature files across multiple environments helps uncover specific problems as well as performance constraints on different physical and virtual platforms. The ABot supported plugins can change parameters for different call flows with ease and yet support complex use cases under demanding load conditions as emulated by advanced traffic generators like Ixia and dsTest.

ABot as a test harness can emulate complex telecom network systems like the vEPCvIMS as well as vIoT under a single umbrella offering. If the need of the user is to simulate different network components like that of a vEPC system, namely – eNodeB, MME and SPGW, ABot provides the ability to do so. The idea is to emulate important features of the system and provide the capability of performing functional and load testing on all of its features. ABot comprises of easily modifiable NFV templates for feature-level call flows. Vendors can send these templates with the RFP specifications for visibility and validation. The customers can not only execute the DSL based test cases but also modify values to test the threshold.

ABot helps test granular pieces of the system in pre-deployment and lab environments. The ABot supported plugins test protocol stacks like S1APGTPv2CGTPv1UDiameterRadiusSIP, and RTP. ABot has the ability to support different releases of specification standards such as 3GPP. New feature call flows can be implemented in minimal time using the existing template files. ABot can answer questions such as does my implementation of S1 Handoff supports the information elements of 3GPP Release 14? While aiming to support a wide spectrum of protocol stacks in the mobility domain, ABot also supports wireless stacks built for the short-range IoT world, such as WifiBluetoothBluetooth Mesh and ZigBee.

ABot targets the need for emulation while testing. Apart from its low footprint and lab-oriented approach to traffic generation; ABot also supports plugins for industry standard traffic generators like Ixia and dsTest used in large environments with production-grade requirements. ABot provides the necessary plugins like CI enginesprotocol stack emulators, orchestrator and 3rd party tools to meet troubleshooting needs for the lab and production environment. Tailor-made plugins can also be integrated with the ABot framework.

As cloud computing and NFV becomes a reality, VNF deployment verification poses a major challenge. There has been a fair amount of focus on VNF on-boarding but the industry is yet to find an automated validation mechanism for virtualized network services deployed at multiple locations. Operators need automated deployment of test harnesses on NFV-compliant infrastructure with scripted execution of well-defined test on the target VNFs and the ability to troubleshoot issues using easily understood results.

ABot is easily deployed on any virtualized platform to run functional and performance validation on the target VNFs. It has plugins to integrate with test bench components (such as 3rd party traffic generators and metrics collectors) and can run repeated test scenarios. Abot has the capability toperform system tests on multi-vendor VNFs for service-level validationlike VoLTE. It can also perform VNF lifecycle management verification as well as validation of self-healing and auto-scaling policies of the deployed VNFs. ABot can certify VNFs deployed as virtual machines on cloud platforms such as OpenStack and VNFs deployed as containers and managed by Kubernetes.

The ABot solution can be deployed along with selected NFV orchestrator on any target cloud platform. It can trigger VNF deployment using the NFVO/VNFM and subsequently invoke functional and load tests for VNF certification and deployment validation. ABot supports multiple NFVO/VNFM combinations such as CloudifyJuju and OpenBaton.

ABot uses the plugins for emulation capabilities to execute functional and performance tests on the deployed VNFs using templates. These templates enable easy verification against different KPIs for the test scenarios. Various reports can be generated for the presentation of all statistical values.

ABoT Application Scenario

Emulation

Mobility Analytics

Diameter Traffic

Rebaca-Ixia Joint Solution

Solution Brief

Download the Whitepaper to understand how Rebaca can solve your VoLTE network validation challenges.



Press Release

Ixia and Rebaca Collaborate to Bring New Test Methodologies to Network Operators

Rebaca joins Ixia’s Xceed™ Technology Partner Program to Simplify Evolved Packet Core (EPC) Deployment Testing …

Features and Specification

Supports testing of virtual, hybrid and proprietary hardware based wireless network

on multiple cloud platforms using different NFV orchestrators

Read More

Performance and Load Testing

Read More

EPC, IMS, VoLTE

Conformance and Technical Specifications

Read More

Easily extensible protocol adapters SDK

for supporting multiple Network Function

Read More

Advanced Reporting

based on Predictive Test analytics for feature testing, regression testing, integration testing, performance testing etc.

Read More

Available in Canonical Juju charm store

for deployment in multiple cloud platforms including Openstack

Read More