AdventNet Inc - Excellence Matters
Enterprise
Management
Enterprise
Security
Software
Testing
CRM &
Collaboration
QEngine | Issue Management Software  
    Search For
Printer Friendly Contact Us | Tell Us | Free Products 
Home > Products > QEngine 6 > Web Services Testing Buy Now Buy Now

Web Services Testing

 
Performance TestingPerformance Testing   Test Manager Test Manager

Live Demo of QEngine Test Automation Software
Download QEngine, Test Automation Software Download QEngine Free Edition Download QEngine Professional Edition

AdventNet QEngine Web Services Test Tool is a flexible, easy-to-use and affordable way to test the functionality and performance of your web services that are bound with the SOAP/HTTP binding. This includes:

Web Services Functional Testing

AdventNet QEngine Web Services Functional Test Tool - To automate the functional testing of your web services for valid, invalid and inopportune inputs. It automatically generates scripts from a WSDL document and validates XML responses to web service requests.

AdventNet QEngine Web Service Performance Test Tool - To automate the performance testing of web services from local or remote machines. It realistically simulates load to identify the performance bottlenecks and failures within your web services. You can automatically generate the load test scripts from a WSDL document and configure the load test data through the web-based interface. Load tests can be run simulating a single virtual user or a large number of simultaneous virtual users.

Web Services Performance Testing


Click here to view the comparison document which compares QEngine Web Services Test Tool with other Web Services Test Tools.

Web Services Test Tool Features

Automatic Script Generation
 
Automatic Script Generator
  • QEngine automatically generates test scripts to provide an easier and more effective way to test all the published web services in a WSDL with a click of the mouse. This eliminates the need for in-depth knowledge of a proprietary scripting language.
  • You can also replay the generated test scripts to ensure that the server delivers appropriate responses for the given requests.
  • Support for MIME attachment.
  • Ability to set various properties to call before invoking a particular web service.
Standard Scripting Language

 

  • Web service scripts are generated as Jython scripts which provides the fastest and easiest way to create, read, and manipulate test scripts, with no programming. Jython scripts provide more control over testing and have the ability to invoke regular Java classes. It also provides support for looping constructs and conditional statements such as, For, if…else, etc.
Data-driven Testing
 

Data Configuration

 

Data-driven test scripts enables you to test the web service application in different scenarios by just changing the test data in an external data source. Thus, enabling you to extensively test all the aspects of the web service application in terms of test data.

  • You can create data-driven test scripts to send data source values as part of a request to a server. A single test script can be created to test with multiple sets of data where the values are substituted at runtime from an external database or CSV file. This facilitates maximum script re-usability and eliminates the need to re-generate test scripts for each set of data.
Dynamic Data Replacement
 
  • The web-based Parameterization UI provides a drilled down view of the input parameters passed to each WSDL method.
  • Supports a broad array of data types and allows you to parameterize all operation parameters including complex data types and arrays. This ensures the validity of a WSDL method to replay the script without any errors.
  • Parameterization for web service performance testing allows you to simulate a realistic load with different virtual users using different data.

Dynamic Data Replacement

 

Verification Functions
 
Function Generator

 

  • Easy-to-use Function Generator tool provides a non-erroneous way to insert specific functions from a rich library of verification functions. This will help you to extend the web functionality testing and analyze the test results.
  • Verification functions can be added for performance testing to get response code, status, check if there is a fault, verify XML contents, verify database values, add common string functions, add custom reporting functions, etc. To learn more, please refer to Web Service Insert Built-in Function.
Reusability of Test Scripts
 
  • Test scripts generated for web service functional testing can be re-used for performance testing without any modification in web services. This eliminates re-generation of scripts and allows you to share scripts using the standard Jython language for both functional and performance testing.
Test Asynchronous Capability
 
  • This feature supports the testing of asynchronous messages, including notification and alert messages in addition to synchronous RPC capabilities.
Flexible User Scenarios
 
  • Intuitive and easy-to-use Load Test Configurator UI allows you to create scenario-based test cases that contain one or more web service operations with appropriate work load to emulate the real-user activities. For example, you have the flexibility to split the number of users accessing different parts of the web service application performing different operations, such as, 60% of users trying to get employee details, 20% of users trying to update employee details, and the other 20% of users trying to update employee phone details.
  • Provides extensive configuration options to repeat delay (user iterations), percentage of load for each user, the speed with which the recorded business cases will be replayed (normal with think time or fast mode), etc.
  • Quickly change the server host (or test server) and the server port in the user profile configuration to run the same user scenario (recorded URLs) against different test servers and port numbers without re-recording the test scripts.
User Scenario Configuration
Real-world Load Simulation
 

Workload Configuration

  • Accurately simulate a large number of virtual users performing a defined set of operations (or business cases) in your web service application.
  • Group the individual user scenarios as user profiles and associate each user profile with different load levels (normal, ramp-up, or burn-in) as load test cases to capture real-life user testing.
  • Configure various workload types to test your web service application under different load and stress conditions. This includes:
    • Load Test (Normal Workload) - This test measures the capability of your web service application under anticipated production workload. It runs the load test for a constant number of virtual users (steady-state workload) until the given test duration time has passed.
    • Peak Tests (Ramp-up Workload) - Ramp-up test determines the peak load at which your web service application fails to respond. It simulates heavy load by gradually increasing the number of users at defined periods until the count reaches the maximum number of users.
    • Burn-In Tests (Burn-in Workload) - This test helps you to identify issues with web services when a heavy load is hit for an extended period of time. You can exit the test only based on the specified exit criteria.
Runtime Settings
 

Provides considerable flexibility, enabling testers to configure a wide range of options using the Settings tab that affect the playback of functional and performance test scripts. All these configurations are optional.

  • Option to run the recorded functional test scripts against any server or port. This will allow you to test and compare the same web service application hosted in different servers and ports.
  • Option to change the order of script execution using the automatic or manual sequencing mode.
  • Option to e-mail test case failures to team members and other related stat ff.
  • Option to send out summary reports to configured e-mail IDs.
  • Option to integrate third party bug tracking software.
  • Users accessing a web page will not wait too long for a page to download. The delay may due to an error in socket connection or the server not able to process the request due to some errors. To shorten this delay, you can configure the socket timeout value and enable/disable the option Enable Session Maintenance.
  • Proxy settings option to send requests through a proxy.
  • Option to save the web page obtained in the response for all the pages. Enabling this option consumes a lot of disk space.
  • Option to save the logs obtained during load test execution for each user.
Server and Database Monitors
 
  • When users accessing your web service application report a problem, you need to identify the source of the problem which could be in the network, or it could lie with a database or the web server. To monitor all the key elements that drive your entire web service application infrastructure, you need to have specific monitors to collect data from your web servers or databases. QEngine monitors critical web server parameters and database parameters for MySQL and Oracle databases. This provides better insights into the performance of your web servers and databases that form the core components of your web service application.

    • Configure server monitors to monitor the resource utilization such as CPU and memory usage of your web servers.
    • Define monitors in Windows or Linux machines to collect data from web servers or databases running in local or remote machines. QEngine uses WMI to monitor server resources running in remote Windows machines and Telnet/CLI to monitor server resources in Linux machines.
    • Configure MySQL or Oracle monitors to collect the database parameters specific to a database. Parameters collected for MySQL include:
      • Thread Details - Threads connected, created, running, cached, etc.
      • Connection Details - Max_used_connections, Aborted clients, Aborted connections, etc.
      • Temporary Table Details - Created_tmp_disk_tables and Created_tmp_tables.
      • Throughput Details - Bytes_received and Bytes_sent.
      • Query Details - Total Number of reads, Total Number of writes, Slow_queries, etc,
      • Table Related Statistics - Table_locks_waited, Open_tables etc.
Load Test Server Monitoring
Load Test Database Monitoring
QEngine Issue Tracking Software
 
  • In addition to test automation of your web applications and web services, QEngine provides built-in issue tracking software that helps you to track product defects and manage product enhancement requests. It enables users to log in defects / requests from any geographic location and allows all the team members to access the tracking system from anywhere, anytime. Click here, to learn more.
Interoperability with Issue Tracking Software
 
  • QEngine allows you to integrate any third-party Bug Tracking Systems to help you track bugs the way you are used to. Click here, to know the customization details.
Clear and Descriptive Reports and Graphs
 

Web Service Functional Test Reports

Web Service Functional testing provides HTML-based reports to indicate the status of the test execution. Hyperlinks allow for easy navigation through the report. Summary reports are also generated for test scripts and test cases which link to the passed and failed test cases. This helps to effectively review failures.

Script Report
Script Report

Script Report displays the details of the scripts executed, such as, script name, status, debug info, number of failures and links to the request, response and attachments (if any) in the WSDL.

 
Test Case Report
Test Case Report

Test Case Report displays the details of the test cases executed, such as severity, number of cases passed, number of cases failed, status, debug info, etc.

Web Service Performance Test Reports

Web Service Performance Testing provides a clear and comprehensive range of reports and graphs to quickly and easily identify the potential bottlenecks in your web services. It displays both summarized and detailed reports and graphs that are categorized as Response Validation Report, Graphs for User Status, Time vs Hits/sec, Response Status Distribution, Performance Status, Saved Responses, Server Monitoring Graphs and Database Monitoring Graphs.

Summary Report
Script Report

Web service performance summary report displays the test case details such as test case name, test start time, test end time, elapsed time, server response time in milliseconds and total hits.

 
Graphs
Performance Test Graph

Web service response status distribution graph shows the percentage of response status for each operation in the WSDL. Displays the operations in the horizontal axis and percentage of response status in the vertical axis.

Performance TestingPerformance Testing   Test Manager Test Manager
Discussions New Post Policy Discussions - RSS
Start Discussion Start Discussion Search Topics Search Topics
More MoreMore

 Quick Links
QEngine Home QEngine Home
What's New What's New
Online Demo Online Demo | Request Demo
Buy Now Buy Now
User Forums User Forums | Blogs

 Product Download
QEngine 6 Download Download : Free Edition | 15 Day Trial
QEngine 6 Service Pack Download Download : Service Pack

 Product Documents
Key Features Key Features
Product Documentation Product Documentation
Support Support
FAQ FAQ
Customers Customers

 Features
 Bullet Functional Testing
 Bullet Performance Testing
 Bullet Web Services Testing
 Bullet Test Manager
 Bullet Issue Manager

Datasheets
QEngine Datasheet QEngine
Functional Testing Datasheet Functional Testing
Performance Testing Datasheet Performance Testing
Web Services Testing Datasheet Web Services Testing

© 1996-2006, AdventNet, Inc. All rights reserved. Trademarks | Privacy Policy | Site Map | Contact Us | Tell Us