iLink's QA Centre of Excellence (CoE) has built a Test Automation Framework that helps manage the complete Automation Testing Life Cycle. The Test Automation Framework (TAF) is a set of assumptions, concepts and practices that guide automated Software testing.
TAF focuses on a comprehensive architecture to drive the complete test automation to help achieve:
- Increased Maintainability
- Increased Reusability
- Minimized Redundancy
- Extensibility Coverage
Automation Process Overview - Automation Life Cycle
Following are the key tenets of TAF:
Test input and output values are typically read from data files (ODBC sources, Text files, Excel files, DAO objects, ADO objects and such) and are loaded into variables that are coded in scripts. The Test scripts work for different sets of data without any changes to the test script code.Data Driven testing is implemented for applications whose behavior is data dependent - Test Scenarios are to be run with one or more set of data values that vary for each execution cycle.
Creation of small, independent scripts that represent modules / sections / functions of the application to be tested. These modules are then used in a hierarchical or logical fashion to construct larger tests realizing test case(s). Modularity is achieved by nesting the test scripts and using library files to implement reusable components.
Keyword Driven Form Execution
In a keyword-driven test, functionality of the application being tested (includes individual forms, fields and actions), is documented in a table like structure e.g. Excel Sheet. Data tables and keywords (that represent form fields and actions), are created independent of the test automation tool to be used for execution. The driver code "drives" the application to be tested using keywords and data. The driver would utilize the form controller to control the execution flow based on Use-cases.
Tools that have been used by iLink to implement TAF:
- QTP – Automating Healthcare, Telecom applications.
- Telerik Test studio– Automating Healthcare application(s) developed in cutting edge technologies and Environmental Management System (EMS).
- Ranorex – Automating Retail Applications.
- LoadRunner – Fine tuning Telecom applications.
- MS Ultimate TFS (Load test) – Fine tuning Digital Media applications.
- Selenium – Automating various applications.
Return On Investment
TAF measures Return On Investment (ROI) through Key Process Areas (KPAs) such as Revenue (Increase), Business Coverage (Expansion), User Coverage (Increase in Adoption by Business Users etc.) and Costs (Reduction). These are quantified by granular Key Process Indicators (KPIs) such as:
- Increased Automation test coverage and reduced Manual testing
- Increased Eye balls
- Increased Build Stability and Turn-around time for Production
- Reduced QA Costs (Reduction in Personnel for Manual Testing, Data Entry Effort, Processing Effort, Verification Effort and Execution Effort)
- Increased Productivity