QuickTest User Guide

Login or Register

• • If you’ve already registered simply login at https://www.app.quicktest.ai.

• • If you haven’t registered go to https://www.app.quicktest.ai and click signup.

• • After signing up you’ll be redirected to select your membership which will be either free or paid.

Note: For the paid membership you will need to provide debit or credit card details.

Introducing Service, Script, and Test Method

In order to start with any type of test we need to understand the following three topics.

1. Service
2. Script
3. Test Method

• • Service: Is the destination, where you want to target the test. A phone number for IVR, WhatsApp or SMS; for chat you will need a chat API URL, similarly for email you will need Email ID.
  • Script: Is where you define what the IVR or chat are going to send to QuickTest and what QuickTest is going to respond with.

  • Test Method: Here is where you select the type of testing you’d prefer, such as automated testing, scheduled testing or load testing. When you have set-up a test, it is called a Sprint.

The Home Page – Dashboard

Dashboard: The Dashboard provides an overview of the tests performed along with performance graphs.

• • Data can be shown for today, this week or this month by clicking the relevant button at the top.

• • For the period chosen, a count of total tests run, successful tests and failed tests is shown.
    
    • • Clicking any of these boxes will drill down into the Sprint Details report for the relevant period and result.

• • Service Monitoring Overview shows all the test cases run as Scheduled Tests, Automated tests and Folder tests.
    
    • • ‘Last Completed Run’  indicates when the test was last active
    • • A green dot indicates a successful test, red is failed 
    • • Hover over any dot to see the date and time of the test
    • • Click on any dot to see drill down to the details of that test.
      • Check the ‘Frequency visibility’ to view the frequency of each test sprint  

Performance Graph – graphically shows test results for the given selected period.

Channel Wise Graph – graphically shows channel test results for the given selected period.

Service Monitoring

• • Located on the top right-hand side of the dashboard, ‘Service Monitoring’ provides you with a visualization of the health of your channels by conducting tests with pre-defined parameters.  

• • To perform ‘Service Monitoring’, click on ‘Test Method’, select ‘Schedule Testing’ and then click on ‘Folders’. To learn more about creating test folders click here.  

• • Hover over the ‘Folder’ to perform ‘Service Monitoring’ on, under the ‘Actions Column’ click on the ‘Edit Folder’ icon. Select the ‘Use Service Monitoring’ and your test sprints will be calculated accordingly.   

• • On the dashboard, click on ‘Service Monitoring’ and it will display all the test folders you have created. The data is currently available for NLU, Voice inbound and Web Chat.  

• • Select the required test folder to view the quality of your channels customer interaction. The service monitoring data is based on four parameters: ‘Correct Prompt’, ‘Answering’, ‘Welcome Prompt’ and ‘Responsiveness’.  

• • For each run the result is represented by a colored dot: 

Green dot: Signifies a successful test that has met the defined parameters.  

Red dot: Signifies a failed test that has not met the defined parameters. 

Yellow dot: Signifies a test that has satisfied the defined parameters.  

Hovering over each dot will indicate the date & time the test was run at. 

• • For the test runs an ‘Audio Quality’ graph will also be generated. Each individual run will be depicted on the graph, hovering over the dots will display the date & time the sprint was tested at. Note: The audio quality data is only available 60 minutes after the test execution.  

• • To define custom parameters that are listed above for your tests, click on profile located on the right-hand corner and select ‘Service Monitoring’. Click on ‘Service Monitoring Data’.  

• • Enter ‘Name’ and select the ‘Channel Name’ from the dropdown options. Select the ‘Service Monitoring Parameters’ from the dropdown menu:   

• • Answering – Enter the ‘min’ and ‘max’ range of seconds the prompt should respond within for the parameter to be determined as successful, satisfactory and failed.  

• • Correct Prompts: Enter the ‘min’ and ‘max’ range of percentage the prompt should be correct within for the parameter to be determined as successful, satisfactory and failed. 

• • Welcome Prompt: Enter the ‘min’ and ‘max’ range of percentage the welcome prompt should be correct within for the parameter to be determined as successful, satisfactory and failed. 

• • Responsiveness: Enter the ‘min’ and ‘max’ range of percentage the prompts responsiveness should be within for the parameter to be determined as successful, satisfactory and failed. 

The Home Page – Custom Dashboard

The Custom Dashboard feature allows you to create personalized dashboards by adding and configuring widgets such as “Service Monitoring Overview,” “Performance Information,” “Channel Information,” and “Sub-organization Information” (admin-only). 

How to create Custom Dashboard?

• In the left menu, go to Dashboard and select Custom Dashboard.
• Click + Create Dashboard.
• Name your dashboard and select widgets like Service Monitoring Overview, Performance Information, Channel Information, and Sub-organization Information (admin-only) by clicking Add.
• To set this dashboard as your default view upon logging in, check the Default Dashboard box. This selection will make your custom dashboard the primary dashboard displayed on the main page of QuickTest, allowing quick access to key information for streamlined decision-making.
• For each added widget, you can further customize the displayed data by selecting the relevant checkboxes. To remove any widget, click the trash bin icon at the top-right corner of the widget box.
• Once you’ve configured the dashboard, click Save.

You can create multiple custom dashboards by repeating the + Create Dashboard process.

To view or switch between your custom dashboards, navigate to the Dashboard page and select your desired dashboard from the Select Dashboard dropdown menu.

Creating a Service

• • Service: The destination where you want to target the test. Example: if you want to test the IVR, WhatsApp or SMS, you will need a phone number. For chat you will need a chat API URL, similarly for email you will need email ID.

• • To create a Service:
    
    • • Click on Service section on the left-hand side
    • • Select Create Service
    • • Give the service a meaningful name and click Next.
      • Select from the ‘Service Folder’ if you wish to add the service in a folder 
    • • Select the channel as you require and click Next. The below table shows the channels and sub-channels that are currently available in QuickTest
    • • Enter the Phone Number destination of the where the test needs to go and click Save (Note: you will need to include the country Dialling code e.g. +44 for UK, +1 for USA).

CHANNEL	SUB-CHANNEL
API	API
Chat	Genesys Chat Genesys Cloud Chat  Five9 Chat Genesys Cloud Web Messaging  Amazon Connect Chat  Elastic CCaas Chat
ChatBot	Google Dialogue  Genesys Cloud Chatbot Google Dialogue ES Amazon Lex
Email	Email Genesys Cloud Email Five9 Email Nice Email ElasticCX CCaaS Email
Email Outbound	Genesys Email Outbound  ElasticCX CCaaS Email Outbound
Facebook	Facebook
NLU Bot	NLU Bot
SMS	SMS Genesys Cloud SMS ElasticCX CCaaS SMS Intbound
SMS Outbound	Genesys SMS Outbound  ElasticCX CCaaS SMS Outbound
Voice Inbound	Genesys Cloud Voice  Five9 Voice Inbound  Amazon Connect  Nice Voice Inbound  ElasticCX CCaaS Voice Inbound
Voice Outbound	Five9 Voice Outbound  Genesys Voice Outbound  Amazon Connect Voice Outbound  Nice Voice Outbound  ElasticCX CCaaS Voice Outbound

NLU, DTMF & STEP : 

• • NLU Support: If you select NLU support, QuickTest will respond to the IVR with speech.  

• • DTMF Support: If you select DTMF, QuickTest will respond to the IVR by sending DTMF tones based on your script. 

• • You must select either NLU support or DTMF or you may select both if your IVR has a combination of the two.  

• • Use Step: The message played by IVR is based on the steps which we have defined earlier. Using Step allows the users to test the flow exactly as they have been defined in the script. For example, if we expect the first message from the IVR as ‘Welcome to QuickTest! How can we help you?’ but we receive a different message while testing, the test will be marked as failed. This is due to the fact that the step did not exactly match. If we don’t use the step approach, all the messages in the entire script get checked. This means when the message received matches any of the messages in the script, the test will be considered a success, irrespective of the order.   

Note: To change language, click on ‘Settings’ on top right of the page, go to Account Management from dropdown option and click on ‘My Profile’-> Language and select your language and that sets as default.  

Creating a script template for Service

• • Click on Settings located on top right side, go to Configuration from dropdown option and click on ‘Script Template’.  

• • Click on ‘Add Script Template’.  

• • Enter Script Name. 

• • Select the channels you wish to choose (This will be based on your membership).  

• • For non-voice channels: 

• • Click on ‘NLU Support’ and click ‘Update’.  

• • For voice channels: 

• • Choose from NLU Support, DTMF Support and Use Step and click ‘Update’.   

• •  To delete or edit the script template 

• • Click on ‘Script Template’ from settings  

• • Under the ‘Action’ column: 

• • To edit the services, click on the ‘Edit’ icon. 

• • To delete the script, click on the ‘Delete’ icon. 

Creating a script using a template

• • To create script by using one of the existing templates, click on ‘Create Script by Template’ option on top right.  

• • Enter the Script Name. 

• • Select from the templates that you have already created and click on ‘Next’.  

• • The channel you selected when you created this template would be selected by default here. Click on ‘Next.  

• • Enter details required for ‘Add Messages’ (Refer to “How to create Script” for details)  

• • Click on ‘Save’ once details have been populated.  

Uploading data driven files

• • To change the ‘Expected Response’ of a script, you can make changes in a CSV format as well where the key is the ‘Expected Message’ while the value is the ‘Expected Response’.  

• • To do this you will have to upload a data driven file, click on Settings located on top right side, go to Configuration from dropdown option and click on ‘Upload Data Driven File’. Click on ‘Upload File’.  

• • The file should be based on a key-value system where the key is the ‘Expected Message’ and value is the ‘Expected Message’. Once the file is uploaded click on ‘Upload’.  

• • Next, select ‘Script’ and click on ‘+create script’.  

• • Enter the ‘Script Name’, select the ‘Channel’ and select ‘NLU & DTMF’ if required. In ‘Add Messages’ for ‘Expected Response’ it is important to enter ‘${“sheet name”.”key”}’. For example, ‘${sheet1.hello}’ where ‘sheet1’ is the sheet name and ‘hello’ is the key for which you want the value to be represented. Note: All values of ‘Key’ must be formatted to Text in the CSV for QuickTest to be able to read it.  

• • To ensure that the CSV file created is referred to the correct script, it is required to be mapped to a sprint. From ‘Test Methods’ select ‘Automated Testing’ or ‘Schedule Testing’.  

• • Fill out the sprint details as required, in ‘Channel’ select ‘Data driven file’ and from the dropdown options select the created data driven file.  

• • Click on ‘Next’ and your script will be updated as changes are made in the CSV file.  

How to Export or Import a Script

• • Click on ‘Script’ on the top left column.  

• • Create a new script or edit an existing one. 

• • Go to ‘Add Messages’ section, click on bottom left ‘…’ and click on ‘Export’ option to select Import Script or Export Script. This will download your data in Excel format.  

Note: We support both Excel and .csv format.  

Creating folder and sub-folder for Service

• • Click on ‘Create Folder’ option on top right.  

• • Enter ‘Folder Name’ and “Select Channel’ from the drop-down menu. 

• • Click on the heading ‘Folders’, click on the ‘Edit Folder’ icon to run and execute multiple tests at once.   

• • To create a sub-folder, click on the ‘Add sub-folder’ icon. Enter your sub-folder name and select channel from the dropdown menu.  

• • The default testing of the sprint is done in the browser time zone. In case you require testing at a user-defined time zone, you can select from the ‘Select Timezone’ dropdown options. Note: To enable user-defined time zone, all scheduled tests previously entered must be in the same defined time zone or have to be deleted if in a different time zone.   

• • Select Date and time: 

• • To run a single folder test, select the ‘Start Date’ and ‘Time’. 

• • To run a folder testing with scheduled repetition, click on ‘Repeat’ and choose the frequency of the tests from the drop-down menu. Select the ‘Start Date’, ‘End Date’ and ‘Time’. Once selected click on ‘Add Schedule’.  

• • To customize the frequency of running the folder of tests, select ‘Custom’ from ‘Select Repetition’. Select the ‘Start Date’ and ‘End Date’, select the days you would like the test from ‘Week(s)’, select ‘Hour’ and ‘Minute. You can even choose multiple ‘Weeks’, ‘Hours’, and ‘Minute’. To select a range of weeks, hours and/ or minutes, click on ‘Select Range’ and then click the desired start and end weeks, hours and/ or minutes. 

• • Click on ‘Add Schedule’ and all scheduled tests will be displayed on the right side.  

• • To delete any scheduled test, click on ‘x’ located beside the specified ‘Date’.  

• • To edit any scheduled test, click on the edit icon and define the new changes. Click on ‘Edit Schedule’ and that schedule will be updated.  

• • Click on ‘Import Script’ to select the desired script you want to test from the script folder.  

• • From ‘Select Sprint’ dropdown menu, choose script as per requirement. 

• • To receive an emailed report of the script folder testing, enter your ‘Email ID’ and select ‘Send Email’. 

• • To receive alerts on the failure or success of the tests: 

• • To receive an emailed alert if the tests have failed, enter required email in ‘Email’. From ‘Send Email On’ dropdown menu select ‘FAILURE’.  

• • To receive an emailed alert if the tests have been successful and/or failed, enter required email in ‘Email’. From ‘Send Email On’ dropdown menu select ‘BOTH’.  

• • To receive an alert on SMS or Whatsapp if the tests have failed or have been successful and/or failed, select ‘Send SMS’ and/or ‘Send WhatsApp notification’ and enter phone number. 

• • To receive an alert on your desired system, select ‘Send Webhook URL’ and enter Webhook URL in the text box.  

• • To identify your test easily or make notes for your script, you can add comments in the ‘Add Update Comments’ text box.  

• • Once these details have been entered, click on ‘Run Now’ to generate results.  

• • Click on ‘Save’.  

• • If certain tests within a folder have failed before, you can choose the tests you want to re-run by selecting them and then clicking ‘Run Now.’ Simply mark the checkbox next to the desired test and initiate the test by clicking ‘Run Now.’ 

How to Pause/ Resume Script Folder Testing

• • 
    
    • • Click on ‘Script’ on the top left column and click on the heading ‘Folders’ 
    • • To halt the testing of any future tests in the script folder  
    • • In the ‘Actions’ column, click on ‘ıı’ icon to pause the testing of all tests in the script folder. 
    • • To resume the testing of future tests in the script folder 
    • • In the ‘Actions’ column, click on ‘resume ’ icon to resume the testing of all tests in the script folder.  

How to upload bulk file for Script

• • To upload an excel script by using a bulk file, click on ‘Upload Bulk File’ option on top right.  

• • Click on ‘Choose File’ and select the excel file that contains all your scripts and then click on ‘Upload’.  

Note: The following three rows will show up: 

• • ‘Success Script’: All successfully read scripts will show up here. 

• • ‘Failed Script’: All failed read scripts will show up here. 

• • ‘Duplicate Script’: All duplicate scripts that are already present in the script database will show up here.  

Note: To successfully upload a bulk script (Refer to ‘Download Sample File’ for Bulk Script Sample): 

• • A new sheet must be created for every script. 

• • The first sheet should be followed as a template for all new scripts. It is recommended to copy this sheet while creating a new script to keep the template in tact. 

• • Following columns are applicable with respect to the following channels: 

• • Voice Inbound: All columns will be updated 

• • NLU Bot: All columns will be updated 

• • Chat: Only NLU support, Expected Message and Expected Output will be updated  

• • Email: Only NLU Support, Expected Message and Expected Output will be updated 

• • SMS: Only Expected Message and Expected Output will be updated 

• • Mandatory parameters include ‘Script Name’ and ‘Channel’. 

• • Script Name should be a ‘text’ value. 

• • Channel, NLU Support, DTMF Support, Use Step and Reply Type should be selected from the dropdown values. 

• • Steps should be filled automatically with periodical increments and be of positive integer/numeric type. 

• • Description, Expected Message and Expected Output should all be text values. 

• • DelayPause and Interruption should be a positive numeric/integer value. 

• • Language should be a text value. 

• • Skip Step should all be TRUE/ FALSE values. 

• • Folder Name should be a text value containing the name of an existing folder, allowing the script bulk upload the be assigned there. 

Editing, deleting or cloning a Service

• • Click on ‘Service’ present on the top left column. 

• • Under the ‘Action’ column: 

• • To edit the services, click on the ‘Edit’ icon. 

• • To delete the script, click on the ‘Delete’ icon.   

• • To clone/ duplicate a script, click on the ‘Save As’ icon. Rename the newly cloned script, select a folder if required, choose a channel, and provide the necessary details.  

Creating a Script

Script: It defines what the IVR or chat etc will send to QuickTest and what QuickTest will respond back with. 

Sample Script:  

IVR: Welcome to QuickTest! How can we help you? 

You: I would like to talk about new plans.  

IVR: We have four plans, Starter, Professional, Advanced and Enterprise. What would you like to talk about? 

You: Starter  

IVR: It’s a free plan for life and you get IVR chat and SMS testing as a part of the starter plan. Would you like to sign up for the same? 

You: Yes! 

Script definitions

• • Step: It is the prompts QuickTest and the customer will have. When using Step, you must always start from 0. Each prompt must then be rendered with a Step number. 

• • Expected Message: It is the message that the IVR/chat etc is expected to play when it is contacted.  

• • Expected Response: It is the reply QuickTest sends to the IVR. QuickTest is acting as the customer.  

• • Reply type: is either speech or DTMF. 

• • Delay Pause: It is how long you want QuickTest to wait before replying (in seconds). 

• • Select Language: Here, Default is the main language you select in the Sprint. However, if you have interactions that change language mid-flow, choose the language here. 

• • Interruption in seconds: It is the time QuickTest will listen to the response before interrupting. 

• • You can add more messages to represent your customers’ journey.  

• • Call_terminate: Enter this in the expected response field to end the test. 

• • Skip Step: If selected, the specific step will still be included in the test, but the confidence result for the specified test will not be included in the final calculation of the entire test. 

Note: Please select ‘Skip Step’ for every step you wish to omit from the final confidence calculation.  

• • Click ‘+’ after each step is defined and created.  

• • Click on ‘Save’.  

Commands you can use within scripts :  

• • Pipe:  

In ‘Expected Messages’, if you would like to combine multiple options within a single step, with each receiving an identical response, you can use a ‘pipe – | ’. This way, you can conveniently test all messages within a single prompt.  

For e.g., In Expected Messages,  

For customer support, press 1 | To check your account balance, press 2 | For billing inquiries, press 3. 

• • Pause:  

If you would like to add a ‘Pause’ between messages in a prompt, you can add ‘<pause=’number of seconds’>’ in the messages. This helps ensure that if there are extended pauses in the message, it will still be recognized as a single prompt by QuickTest.  

For e.g., In Expected Messages,  

Your account number is 12345 <pause=3>Press 1 if you’d like me to repeat. 

• • Phrase Matched:  

If you would like specific messages in your script to appear exactly as written during testing, you can add ‘phrase matched [‘text’]’. Note: This needs to be defined in ‘Description’ and is currently only for Voice Channels.  

For e.g., In Description, 

If the script has the phrase “Welcome to QuickTest” specified, it must appear with these exact words for the test to be considered successful.  

How to create a Script

Follow these steps: 

• • Click on ‘Script’ section on the top left column.  

• • Click on ‘Create Script’.  

• • Name the Script, select ‘Sub-Organization’ from dropdown if required and click on ‘Next’.  

• • Choose from voice channels such as Voice Inbound, Voice Outbound and NLU BOT or non-voice channels such as Chat, WhatsApp, Facebook, Email, SMS, API, Facebook, Web UI and click ‘Next’.  

CHANNEL
NLU Bot	Choose from NLU Support, DTMF Support and Use Step and select choices as required, you can also select multiple if required and click ‘Next’.  In ‘Add Messages’ populate ‘Steps’, ‘Description’, ‘Expected Message’, ‘Expected Response’, ‘Reply Type’, ‘DelayPause’, ‘Select Language (Default)’, and ‘Interruption’, and click ‘Save’.
Voice Inbound
Chat	Click on ‘NLU Support’ if required and click ‘Save’ In ‘Add Messages’ populate ‘Description’, ‘Expected Message’ and Expected Response’ and click ‘Save’.
Chatbot
Voice Outbound
Email	Click on ‘NLU Support’ if required and click ‘Save’ In ‘Add Messages’ populate ‘Description’, ‘Expected Message’ and Expected Response’ and click ‘Save’. Select ‘Canned Responses’ if required.   Note: Within Genesys, agents can choose ‘canned responses’ for emails. QuickTest can now access these canned responses from Genesys, making it easy to select the appropriate response key when scripting. Any changes in Genesys will be reflected automatically when running the test.
SMS  Outbound	In ‘Add Messages’ populate ‘Description’, ‘Expected Message’ and Expected Response’ and click ‘Save’.
Facebook
WhatsApp
API	In ‘Add Messages’ select API type from dropdown option ‘REST’ or ‘SOAP’, select ‘Request Method’ from dropdown option ‘GET’, ‘POST’ or ‘PUT’, populate ‘Post Data Request’, ‘Expected API Request’, ‘Key’ and ‘Value, and click ‘Save’.
Web UI	In ‘Add Messages’ populate ‘Steps’, ‘Description’, ‘Expected Message’ and ‘Expected Response ‘, Select from the dropdown options for ‘Expected Message Action’ and ‘Expected Response Action’. Click ‘Save’.

NLU, DTMF & STEP : 

• • NLU Support: If you select NLU support, QuickTest will respond to the IVR with speech.  

• • DTMF Support: If you select DTMF, QuickTest will respond to the IVR by sending DTMF tones based on your script. 

• • You must select either NLU support or DTMF or you may select both if your IVR has a combination of the two.  

• • Use Step: The message played by IVR is based on the steps which we have defined earlier. Using Step allows the users to test the flow exactly as they have been defined in the script. For example, if we expect the first message from the IVR as ‘Welcome to QuickTest! How can we help you?’ but we receive a different message while testing, the test will be marked as failed. This is due to the fact that the step did not exactly match. If we don’t use the step approach, all the messages in the entire script get checked. This means when the message received matches any of the messages in the script, the test will be considered a success, irrespective of the order.   

Note: To change language, click on ‘Settings’ on top right of the page, go to Profile from dropdown option -> Language and select your language and that sets as default.  

How to Edit, Copy, or Delete a Script

• • Click Script on the left-hand side

• • Click … under Action for the required Script
    
    • • Select the Edit icon to edit the script
    • • Select the Delete icon to delete the script
    • • Select the Save As icon to duplicate the script – this is useful if similar scripts need to be tested, rather than creating from scratch each time.
        
        • • Give the script a new name
        • • Page through the script making changes as required
        • • Click Save

Exporting or Importing a Script

• • Click Sprint on the left-hand side

• • Create a new script or edit an existing one

• • When on the ‘Add Messages’ section, click on … and select Import Script or Export Script.

Creating an Automated Test Sprint

Automated Testing: This is where you create a test case and start it automatically by clicking on it.  

Follow these steps:  

• • Select the ‘Test Method’ on the top left column. 

• • Select ‘Automatic Testing’. 

• • Click on ‘+Create Sprint’ to create a Sprint 

• • Name the Sprint and click on ‘Next’. 

• • Select the required Channel, Sub-Channel and enter Agent Info (if required) and select Success Criteria. (See Below for more details)  

• • Selecting a ‘Success Criteria’: This will determine whether the test is successful or if it failed, and the percentage confidence required. Select from: 

• • Confidence  

• • Agent Login  

• • Agent Answered  

• • Single Prompt Confidence  

• • Time Difference  

• • Custom User Data  

• • Customer User Data Validation  

• • Maximum Prompts  

• • Minimum Prompts  

• • Phrased Matched  

OR 

• • Select a ‘Multiple Criteria’: This will confirm if the desired threshold value has been met by the test cases. 

• • Click on ‘+Criteria’ to add multiple criteria having ‘and/or’ condition between them.  

• • When selecting ‘AND’, all criteria must be met for the test to be successful. If you select ‘OR’, the test will be rated as successful if any one criteria is met. 

• • Click on ‘+Criteria Set’ to add a new rule set that can have multiple criteria which can be added by clicking on ‘+Criteria’ as done previously or to remove multiple criteria click on ‘-Criteria Set’.  

• • To delete a ‘Criteria’ click on the respective icon located under ‘-Criteria Set’. 

• • Enter ‘Time difference’, ‘Confidence’, Maximum Prompts’, ‘Minimum Prompts’ or ‘Single Prompt Confidence’ from the dropdown list for ‘Multiple Criteria’s’ selected. For Genesys login channels you can add ‘Custom Sprint Validation’. 

• • Click on ‘Save’. 

• • Choose from the options to start testing now or later. 

• • Click on ‘Now’ to run the test. 

• • Click on ‘Start’ to initiate the test. This will display detailed results for each prompt. You can also ‘Edit Scripts’ and ‘Edit Sprints’ if any modifications are required to be done in the test script before execution.  

• • Once the test is complete, you can save the transcript from ‘Export Report’, play the audio recording from ‘Listen Audio’ or even download the recording file from ‘Download Audio’ for later analysis.  

• • Click on ‘Select Language’ and choose from the dropdown to translate your test transcripts into any Language so you can understand the text easily.  

• • Click on ‘Test History’ on the top right column to show all the test cases performed in this sprint. You can go back at any time to see this data by clicking on the Sprint in Automated Testing and then clicking on ‘Test History’.  In the test history section, for Genesys Voice Inbound and Elastic CCaas channels, when running a test, you can view the agent status with colour indicators. Yellow for logged in, green for on queue, blue for answering, and grey for logged out.
•  
  • Click on ‘Test Again’ to test the sprint again.  

Note: Here you can find action items as ‘edit’, ‘delete’ and ‘save as Sprint’ for each of the sprints. 

CHANNEL	SUB – CHANNEL	AGENT INFO
Chat	Genesys Chat	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu.   Click on ‘Next’.  Select from ‘Success Criteria’ or ‘Multiple Criteria’.
	Genesys Cloud Chat	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Select ‘RunCustomScript’ and select your script.   Click on ‘Next’.  In Agent Info, Enter ‘User Name’, ‘Password’, ‘Agent call duration’, ‘Organization Name’ and ‘Domain. Click on ‘Get Genesys Details’. This displays the ‘Get Queue’ list, ‘WrapupCode List and ‘Skill’. Select from the dropdown list   as required. It is mandatory to select ‘WrapupCode List’ and ‘Skill’.  Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.
	Genesys Cloud Web Messaging
	Five 9 Chat	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu.   Click on ‘Next’.  In Agent Info, Enter ‘User Name’, ‘Password’ and ‘Agent call duration’.   Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.
	AWS Connect Chat	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu.   Click on ‘Next’.  In Agent Info, Enter ‘User Name’, ‘Password’ and ‘Agent call duration’.   Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.
Email	Email	Enter ‘Number of calls’ and ‘Duration’. Select ‘From Email’ and ‘Language’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu.   Click on ‘Next’.  Select ‘Success Criteria’.
	Genesys Cloud Chat	Enter ‘Number of calls’ and ‘Duration’. Select ‘From Email’ and ‘Language’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Select ‘RunCustomScript’ and select your script.  Click on ‘Next’.   In Agent Info, Enter ‘User Name’, ‘Password’, ‘Agent call duration’, ‘Organization Name’ and ‘Domain. Click on ‘Get Genesys Details’. This displays the ‘Get Queue’ list, ‘WrapupCode List and ‘Skill’. Select from the dropdown list   as required.It is mandatory to select ‘WrapupCode List’ and ‘Skill’.  Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.
	Five9 Mail	Enter ‘Number of calls’ and ‘Duration’. Select ‘From Email’  and ‘Language’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu.   Click on ‘Next’.   In Agent Info, Enter ‘User Name’, ‘Password’, ‘Agent call duration’, ‘URL’, ‘StationID’ and ‘Skills’.   Note: To specify the capabilities of the Five9 agent in order  to handle the call, the skill must be specified. To add more ‘Skills’ click on the ‘+’ located on the right. To delete the ‘Skill’ click on the ‘…’ bin icon located on the right.  Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.
	Nice Email	Enter ‘Number of calls’ and ‘Duration’. Select ‘From Email’  and ‘Language’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu.   Click on ‘Next’.   In Agent Info, Enter ‘User Name’, ‘Password’, ‘Agent call duration’, ‘Login URL’, ‘AppName’, ‘Vendor Name’, ‘Business Unit Number’ and ‘StationID’. Note: To view further Agent Info details click here.   Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.
Voice Outbound	Five 9 Voice Outbound	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’   from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu.   Click on ‘Next’.   In Agent Info, Enter ‘User Name’, ‘Password’, ‘Phone   Number’, ‘Agent call duration’, ‘URL’ and ‘Skills’.   Note: To specify the capabilities of the Five9 agent in order  to handle the call, the skill must be specified. To add more ‘Skills’ click on the ‘+’ located on the right. To delete the ‘Skill’ click on the ‘…’ bin icon located on the right.  Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.
	Nice Voice Outbound	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’   from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Select ‘QuickTest Reply Voice’ from the dropdown options.   Click on ‘Next’.   In Agent Info, enter ‘User Name’, ‘Password’, ‘Agent call duration’, ‘Agent Login URL’, ‘Login URL’, ‘App Name’, ‘Vendor Name’, ‘Business Unit Name’, ‘Grant Type’ and ‘Scope’.   Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.
	Genesys Voice Outbound	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’   from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. From ‘Outbound Type’ select ‘Manual’ or ‘Campaign’. Select ‘RunCustomScript’ and select your script.  Click on ‘Next’.   In Agent Info, Enter ‘User Name’, ‘Password’, ‘Agent call duration’, ‘Organization Name’ and ‘Domain. Select ‘Get Phone’ and click on ‘Get Genesys Details’. This displays the ‘Get Queue’ list, ‘WrapupCode List and ‘Skill’. Select from    the dropdown list as required.It is mandatory to select ‘WrapupCode List’ and ‘Skill’.  Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.
SMS	SMS	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’   from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu.   Click on ‘Next’.  Select ‘Success Criteria’.
	Genesys Cloud SMS	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’   from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Select ‘RunCustomScript’ and select your script.  Click on ‘Next’.   In Agent Info, Enter ‘User Name’, ‘Password’, ‘Agent call duration’, ‘Organization Name’and ‘Domain’. Click on ‘Get Genesys Details’. This displays the ‘Get Queue’ list, ‘WrapupCode List and ‘Skill’. Select from the dropdown list   as required.It is mandatory to select ‘WrapupCode List’ and ‘Skill’.  Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.
API	Conversational API	Select ‘Add Request’ to proceed further.
	API	Enter ‘Duration’. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu.   Click on ‘Next’.  Select ‘Success Criteria’.
Voice Inbound	Genesys Voice Cloud	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’, ‘Speech Model’, ‘Prompt Timeout’ and ‘From Number’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Select ‘RunCustomScript’ and select your script.  Click on ‘Next’.   In Agent Info, Enter ‘User Name’, ‘Password’, ‘Agent call duration’, ‘Organization Name’and ‘Domain’, ‘Client ID’, and ‘Redirect URL’. Select ‘Get Phone’ and click on ‘Get Genesys Details’. This displays the ‘Get Queue’ list, ‘WrapupCode List and ‘Skill’. Select from the dropdown list as required.It is mandatory to select ‘WrapupCode List’ and ‘Skill’.   Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.     Note:  For ‘From Number’ you can either select your ‘Default number’ or ‘Unknown number’ to test from. An error message will appear for ‘Unknown Number’ if the pool has been exhausted.  In ‘Multiple Criteria’ and ‘Success Criteria’ you can validate the criteria and input parameters defined in ‘Custom User Data’ and ‘Customer Sprint Validation’.
	Five9 Voice Inbound	Enter ‘Number of calls’ and ‘Duration’. Select ‘From Number’ and ‘Language’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Enter ‘Prompt Timeout’, ‘Speech Model’ and ‘Genesys Account Details’.   Click on ‘Next’.   In Agent Info, Enter ‘User Name’, ‘Password’, ‘Phone   Number’, ‘Agent call duration’, ‘URL’ and ‘Skills’.   Note: To specify the capabilities of the Five9 agent in order  to handle the call, the skill must be specified. To add more ‘Skills’ click on the ‘+’ located on the right. To delete the   ‘Skill’ click on the ‘…’ bin icon located on the right.  Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.   Note:  For ‘From Number’ you can either select your ‘Default number’ or ‘Unknown number’ to test from. An error message will appear for ‘Unknown Number’ if the pool has been exhausted.  In ‘Multiple Criteria’ and ‘Success Criteria’ you can validate the criteria and input parameters defined in ‘Custom User Data’ and ‘Customer Sprint Validation’.
	Nice	Enter ‘Number of calls’ and ‘Duration’. Select ‘From Number’ and ‘Language’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Click on ‘Get Nice Details’. Select from the dropdown options for ‘Data Driven File’ if required.   Click on ‘Next’.   In Agent Info, enter ‘User Name’, ‘Password’, ‘Agent call duration’, ‘Agent Login URL’, ‘Login URL’, ‘App Name’, ‘Vendor Name’ and ‘Business Unit Name’. Note: To view further Agent Info details click here.   Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’. Enter ‘Test Execution Key’, ‘Test Key’ and select ‘Client Details’ from the dropdown options if required for Xray Details.
	AWS Connect	Enter ‘Number of calls’ and ‘Duration’. Select ‘From Number’ and ‘Language’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Enter ‘Prompt Timeout’, ‘Speech Model’ and ‘Genesys Account Details’.  Click on ‘Next’.   In Agent Info, enter ‘User Name’, ‘Password’, ‘Agent call duration’ and ‘Domain’.   Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’. Enter ‘Test Execution Key’, ‘Test Key’ and select ‘Client Details’ from the dropdown options.   Note:  For ‘From Number’ you can either select your ‘Default number’ or ‘Unknown number’ to test from. An error message will appear for ‘Unknown Number’ if the pool has been exhausted.
Chatbot	Google Dialogue	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu  Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’. Enter ‘Test Execution Key’, ‘Test Key’ and select ‘Client Details’ from the dropdown options if required.
NLU Bot	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’, ‘Speech Model’, ‘Prompt Timeout’ and ‘From Number’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu.   Click on ‘Next’.  Select from ‘Success Criteria’ or ‘Multiple Criteria’.  Note:  For ‘From Number’ you can either select your ‘Default number’ or ‘Unknown number’ to test from.  In ‘Multiple Criteria’ and ‘Success Criteria’ you can also validate the criteria and input parameters defined in ‘Custom User Data’ and ‘Customer Sprint Validation’.
Facebook	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’ and ‘From   Facebook’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu.   Click on ‘Next’.  Select ‘Success Criteria’.
WhatsApp	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’ and ‘From     Number’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu.   Click on ‘Next’.  Select ‘Success Criteria’.
Web UI	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’ from the drodown options. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Select ‘Genesys Account Details’ from the dropdown options if required.   Click on ‘Next’.  Select from ‘Success Criteria’ or ‘Multiple Criteria’. Enter ‘Test Execution Key’, ‘Test Key’ and select ‘Client Details’ from the dropdown options.

Note:  

• • ‘Number of Calls’: will always be set as default 1.  

• • ‘Duration (In Seconds)’: Duration is how long the individual test will run for. If the time of the test exceeds the duration set, it will terminate. 

• • ‘Language’: en-GB will be set as the default Language. To change you can select from the dropdown menu or to change the default language, see Profile. 

• • ‘From Number’: The default number is set as a UK number. In case you require a different number to generate the call from, see In-Country Dialing section. 

• • ‘Speech Model’: The default model is set as ‘command_and_search’. To change the default model type, see Profile. 

Creating a Scheduled Test Sprint

Set up a scheduled test to run a test at: 

• • A specific date and time. 

• • A repeated interval 

Follow these steps:  

• • Select the ‘Test Method’ on the top left column. 

• • Select ‘Scheduled Testing’. 

• • Click on ‘+Create Sprint’ to create a Sprint 

• • Name the Sprint and click on ‘Next’. 

• • The default testing of the sprint is done in the browser time zone. In case you require testing at a user-defined time zone, you can select from the ‘Select Timezone’ dropdown options.   

• • Note: Only for Folder Script, you can add comments in the ‘Add update Comments’ enabling you to identify your tests easily.  

• • Select ‘Date’ and ‘Time’ for the Scheduled Testing: 

• • To run a single scheduled test, select the ‘Start Date’ and ‘Time’. 

• • To run a test with scheduled repetition, click on ‘Repeat’ and choose the frequency of the tests from the drop-down menu. Select the ‘Start Date’, ‘End Date’ and ‘Time’.  

• • To customize the frequency of running the scheduled tests, select ‘Custom’ from ‘Select Repetition’. Select the ‘Start Date’ and ‘End Date’, select the days you would like the test from ‘Week(s)’, select ‘Hour’ and ‘Minute. You can even choose multiple ‘Weeks’, ‘Hours’, and ‘Minute’. To select a range of weeks, hours and/ or minutes, click on ‘Select Range’ and then click the desired start and end weeks, hours and/ or minutes. 

• • Click on ‘Add Schedule’ and all scheduled tests will be displayed on the right side.  

• • To delete any scheduled testing, click on ‘x’ located beside the specified ‘Date’. 

• • To edit any already scheduled test, click on the edit icon and define the new changes. Click on ‘Edit Schedule’ and that schedule will be updated.  

• • Select ’Pause Schedule’ to halt the testing of any future scheduled test.  

• • To pause a single scheduled test, select the ‘Start Date’ and ‘Time’. Click on ‘Pause Schedule’ and then ‘Add Schedule’. 

• • To pause a test with scheduled repetition, click on ‘Repeat’ and choose the frequency of the tests from the drop-down menu. Select the ‘Start Date’, ‘End Date’ and ‘Time’. Once selected click on ‘Pause Schedule’ and then ‘Add Schedule’.  

• • To pause any custom scheduled test, select ‘Custom’ from ‘Select Repetition’. Select the ‘Start Date’ and ‘End Date’, select the days you would like the test from ‘Week(s)’, select ‘Hour’ and ‘Minute. You can even choose multiple ‘Weeks’, ‘Hours’, and ‘Minute’. Once selected click on ‘Pause Schedule’ and then ‘Add Schedule’. 

• • To resume a scheduled test, select the desired test from ’All Schedules’ and click on ’x’ located beside the specified ‘Date’.  

• • Once the test is added to the schedule, click ‘Next’. 

• • Select the required Channel and Sub-Channel, enter Agent Info (if required) and select Success Criteria. (See Below for more details)  

• • Click on ‘Save’. 

• • Select ‘Success Criteria’: This will determine whether the test is successful or if it failed. Enter the following details: 

• • Select the ‘Success Criteria’ from the dropdown menu. 

• • Click on ‘Re-Run Failed’ option: This decides whether you want to receive alerts immediately after a test fails once, or if you want the test to repeat up to 5 times at an interval between 1 and 5 minutes. This test will repeat until: a) It is successful OR b) The Re-run count is reached. Select the ‘ReRun Count’ and ‘ReRun Minutes’ from the dropdown to set this criteria.  

• • Enter the email address (s) you wish to receive the notifications on. When entering multiple email addresses, separate each address with a ‘,’ no spaces, e.g:  mail1@xx.com,mail2@xx.com,mail3@xx.com 

• • Select ‘Send Email’ to choose whether to receive notifications only for failed tests, or for both successful and failed tests from the dropdown options. 

• • Select ‘Send SMS’ and/or ‘Send WhatsApp Notification’ and enter mobile number with country code to send SMS and/or WhatsApp notifications of test results. When entering multiple SMS and/or WhatsApp numbers, separate each number with a ‘,’ no spaces, e.g:  +448000000000,+4480000001 

• • Select ‘Send Webhook URL’ and enter Webhook URL in the text box to receive a notification on your desired system.  

OR 

• • Select ‘Multiple Criteria’: If you have selected a sub-channel that uses a Genesys, Five9 or Nice login you can also select ‘Multiple Criteria’ This will confirm if the desired threshold value has been met by the test cases. 

• • Click on ‘+Criteria’ to add multiple criteria having ‘and/or’ condition between them.  

• • When selecting ‘AND’, all criteria must be met for the test to be successful. If you select ‘OR’, the test will be rated as successful if any one criteria is met. 

• • Click on ‘+Criteria Set’ to add a new rule set that can have multiple criteria which can be added by clicking on ‘+Criteria’ as done previously or to remove multiple criteria click on ‘-Criteria Set’.  

• • To delete a ‘Criteria’ click on the respective icon located under ‘-Criteria Set’. 

• • Enter ‘Time difference’, ‘Maximum Prompts’, ‘Maximum Prompts’ ‘Confidence’ or ‘Single Prompt Confidence’ from the dropdown list for ‘Multiple Criteria’s’ selected. For Genesys login channels you can add ‘Custom Sprint Validation’.  

• • Click on ‘Save’. 

• • The scheduled Test Sprint will run at the selected date and time.  

• • The Test results can be viewed in ‘Reports’, Email/ WhatsApp notification if selected or by selecting the test in Test Methods.  

• • Selecting the Test in Scheduled Testing and then ‘Test History’ will display all scheduled tests case history.  

• • Click on individual test case to view detailed prompt result. 

• • Once the test is complete, you can save the transcript from ‘Export Report’, play the audio recording from ‘Listen Audio’ or even download the recording file from ‘Download Audio’ for later analysis.  

• • Click on ‘Select Language’ and choose from the dropdown to translate your test transcripts into any Language so you can understand the text easily.  

• • Click on ‘Test Again’ to test the sprint again.  

CHANNEL	SUB – CHANNEL	AGENT INFO
Chat	Genesys Chat	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Choose ‘Date Driven File’ from the dropdown options and select ‘RunCustomScript’ if required.  Click on ‘Next’.  Select  from ‘Success Criteria’ or ‘Multiple Criteria’.
	Five9 Chat	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Choose ‘Date Driven File’ from the dropdown options if required.  Click on ‘Next’.  Enter ‘User name’, ‘Password’ and ‘Agent Call Duration’.   Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.
	AWS Connect Chat	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Choose ‘Date Driven File’ and ‘ AWS Account Details’ from the dropdown options if required.  Click on ‘Next’.  Enter ‘User name’, ‘Password’ and ‘Agent Call Duration’.   Click on ‘Next’.   Select  from ‘Success Criteria’ or ‘Multiple Criteria’.
	Genesys Cloud Chat	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Choose ‘Date Driven File’ from the dropdown options, select ‘RunCustomScript’ and enter ‘Genesys Account Details’ if required.   Click on ‘Next’.  In Agent Info, Enter ‘User Name’, ‘Password’, ‘Agent call duration’, ‘Organization Name’ and ‘Domain’. Click on ‘Get Genesys Details’. This displays the ‘Get Queue’ list, ‘WrapupCode List and ‘Skill’. Select from the dropdown list as required. It is mandatory to select ‘WrapupCode List’ and ‘Skill’. Select from the ‘Genesys Agent List’ if required.   Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.
	Genesys Cloud Web Messaging
Email	Email	Enter ‘Number of calls’ and ‘Duration’. Select ‘From Email’ and ‘Language’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Choose ‘Date Driven File’ from the dropdown options if required.  Click on ‘Next’.  Select ‘Success Criteria’.
	Genesys Cloud Chat	Enter ‘Number of calls’ and ‘Duration’. Select ‘From Email’ and ‘Language’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Choose ‘Date Driven File’ from the dropdown options and enter ‘Genesys Account Details’ if required.   Click on ‘Next’.   In Agent Info, Enter ‘User Name’, ‘Password’, ‘Agent call duration’, ‘Organization Name’ and ‘Domain. Click on ‘Get Genesys Details’. This displays the ‘Get Queue’ list, ‘WrapupCode List and ‘Skill’. Select from the dropdown list as required.It is mandatory to select ‘WrapupCode List’ and ‘Skill’. Select from the ‘Genesys Agent List’ if required.   Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.
	Five9 Mail	Enter ‘Number of calls’ and ‘Duration’. Select ‘From Email’ and ‘Language’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Choose ‘Date Driven File’ from the dropdown options if required.  Click on ‘Next’.   In Agent Info, Enter ‘User Name’, ‘Password’, ‘Agent call duration’, ‘URL’, ‘StationID’ and ‘Skills’.   Note: To specify the capabilities of the Five9 agent in    order to handle the call, the skill must be specified. To add more ‘Skills’ click on the ‘+’ located on the right. To delete the ‘Skill’ click on the ‘…’ bin icon located on the right.  Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.
	Nice Email	Enter ‘Number of calls’ and ‘Duration’. Select ‘From Email’ and ‘Language’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Choose ‘Date Driven File’ from the dropdown options if required.  Click on ‘Next’.   In Agent Info, Enter ‘User Name’, ‘Password’, ‘Agent call duration’, ‘Login URL’, ‘AppName’, ‘Vendor Name’,   ‘Business Unit Number’ and ‘StationID’. Note: To view further Agent Info details click here.    Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.
Voice Outbound	Five 9 Voice Outbound	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Choose ‘Date Driven File’ from the dropdown options if required.  Click on ‘Next’.   In Agent Info, Enter ‘User Name’, ‘Password’, ‘Phone Number’, ‘Agent call duration’, ‘URL’ and ‘Skills’.   Note: To specify the capabilities of the Five9 agent in    order to handle the call, the skill must be specified. To add more ‘Skills’ click on the ‘+’ located on the right. To delete the ‘Skill’ click on the ‘…’ bin icon located on the right.  Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.
	Nice Voice Inbound	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’   from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Select ‘QuickTest Reply Voice’ from the dropdown options.   Click on ‘Next’.   In Agent Info, enter ‘User Name’, ‘Password’, ‘Agent call duration’, ‘Agent Login URL’, ‘Login URL’, ‘App Name’, ‘Vendor Name’, ‘Business Unit Name’, ‘Grant Type’ and ‘Scope’.   Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.
	Genesys Voice Outbound	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. From ‘Outbound Type’ select ‘Manual’ or ‘Campaign’. Select ‘RunCustomScript’ and select your script and, enter ‘Genesys Account Details’ if required.   Click on ‘Next’.   In Agent Info, Enter ‘User Name’, ‘Password’, ‘Agent call duration’, ‘Organization Name’ and ‘Domain. Select ‘Get Phone’ and click on ‘Get Genesys Details’. This displays the ‘Get Queue’ list, ‘WrapupCode List and ‘Skill’. Select  from the dropdown list as required.It is mandatory to select ‘WrapupCode List’ and ‘Skill’. Select ‘Genesys Agent List’ from the dropdown options if required.   Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.
SMS	SMS	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Choose ‘Date Driven File’ from the dropdown options if required.  Click on ‘Next’.  Select ‘Success Criteria’.
	Genesys Cloud SMS	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Select ‘RunCustomScript’ and select your script, enter ‘Genesys Account Details’ and select ‘Data Driven File’ from the dropdown options if required.  Click on ‘Next’.   In Agent Info, Enter ‘User Name’, ‘Password’, ‘Agent call duration’, ‘Organization Name’ and ‘Domain. Click on ‘Get Genesys Details’. This displays the ‘Get Queue’ list, ‘WrapupCode List and ‘Skill’. Select from the dropdown list as required.It is mandatory to select ‘WrapupCode List’ and ‘Skill’. Choose from ‘Genesys Agent List’ dropdown options if required.    Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.
API	Conversational API	Select ‘Add Request’ to proceed further.
	API	Enter ‘Duration’. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Select ‘Data Driven File’ from the dropdown options if required.  Click on ‘Next’.  Select ‘Success Criteria’.
Voice Inbound	Genesys Voice Cloud	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’, ‘Speech Model’, ‘Prompt Timeout’ and ‘From Number’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Choose ‘Date Driven File’ from the dropdown options, select ‘RunCustomScript’ and enter ‘Genesys Account Details’ if required.   Click on ‘Next’.   In Agent Info, Enter ‘User Name’, ‘Password’, ‘Agent call duration’, ‘Organization Name’ and ‘Domain. Select ‘Get Phone’ and click on ‘Get Genesys Details’. This displays the ‘Get Queue’ list, ‘WrapupCode List and ‘Skill’. Select from the dropdown list as required.It is mandatory to select ‘WrapupCode List’ and ‘Skill’. Select from the dropdown options for ‘Genesys Agent List’ if required.    Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.   Note:  For ‘From Number’ you can either select your ‘Default number’ or ‘Unknown number’ to test from. An error message will appear for ‘Unknown Number’ if the pool has been exhausted.   In ‘Multiple Criteria’ and ‘Success Criteria’ you can also validate the criteria and input parameters defined in ‘Custom User Data’ and ‘Customer Sprint Validation’.
	Five9 Voice Inbound	Enter ‘Number of calls’ and ‘Duration’. Select ‘From   Number’ and ‘Language’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu.   Click on ‘Next’.   In Agent Info, Enter ‘User Name’, ‘Password’, ‘Phone Number’, ‘Agent call duration’, ‘URL’ and ‘Skills’.   Note: To specify the capabilities of the Five9 agent in    order to handle the call, the skill must be specified. To add more ‘Skills’ click on the ‘+’ located on the right. To delete the ‘Skill’ click on the ‘…’ bin icon located on the right.  Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’.    Note:  For ‘From Number’ you can either select your ‘Default number’ or ‘Unknown number’ to test from. An error message will appear for ‘Unknown Number’ if the pool has been exhausted.  In ‘Multiple Criteria’ and ‘Success Criteria’ you can also validate the criteria and input parameters defined in ‘Custom User Data’ and ‘Customer Sprint Validation’.
	Nice	Enter ‘Number of calls’ and ‘Duration’. Select ‘From Number’ and ‘Language’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Select from the dropdown options for ‘Data Driven File’ if required.   Click on ‘Next’.   In Agent Info, enter ‘User Name’, ‘Password’, ‘Agent call duration’, ‘Agent Login URL’, ‘Login URL’, ‘App Name’, ‘Vendor Name’ and ‘Business Unit Name’. Note: To view further Agent Info details click here.   Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’. Enter ‘Test Execution Key’, ‘Test Key’ and select ‘Client Details’ from the dropdown options if required for Xray Details.
	AWS Connect	Enter ‘Number of calls’ and ‘Duration’. Select ‘From Number’ and ‘Language’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Enter ‘Prompt Timeout’, ‘Speech Model’ and ‘Genesys Account Details’.  Click on ‘Next’.   In Agent Info, enter ‘User Name’, ‘Password’, ‘Agent call duration’ and ‘Domain’.   Click on ‘Next’.   Select from ‘Success Criteria’ or ‘Multiple Criteria’. Enter ‘Test Execution Key’, ‘Test Key’ and select ‘Client Details’ from the dropdown options.   Note:  For ‘From Number’ you can either select your ‘Default number’ or ‘Unknown number’ to test from. An error message will appear for ‘Unknown Number’ if the pool has been exhausted.  In ‘Multiple Criteria’ and ‘Success Criteria’ you can also validate the criteria and input parameters defined in ‘Custom User Data’ and ‘Customer Sprint Validation’.
Chatbot	Google Dialogue	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu  Click on ‘Next’.   In Agent Info, enter ‘User Name’, ‘Password’, ‘Agent call duration’ and ‘Chatbot Type’.   Click on ‘Next’.  Select from ‘Success Criteria’ or ‘Multiple Criteria’. Enter ‘Test Execution Key’, ‘Test Key’ and select ‘Client Details’ from the dropdown options if required.
NLU Bot	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’, ‘Speech Model’, ‘Prompt Timeout’ and ‘From Number’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu.   Click on ‘Next’.  Select from ‘Success Criteria’ or ‘Multiple Criteria’.  Note:  For ‘From Number’ you can either select your ‘Default number’ or ‘Unknown number’ to test from.  In ‘Multiple Criteria’ and ‘Success Criteria’ you can also validate the criteria and input parameters defined in ‘Custom User Data’ and ‘Customer Sprint Validation’.
Facebook	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’ and ‘From Facebook’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu.   Click on ‘Next’.  Select ‘Success Criteria’.
WhatsApp	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’ and ‘From   Number’ from the dropdown menu. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu.   Click on ‘Next’.  Select ‘Success Criteria’.
Web UI	Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’ from the drodown options. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Select ‘Genesys Account Details’ from the dropdown options if required.   Click on ‘Next’.  Select from ‘Success Criteria’ or ‘Multiple Criteria’

Note:  

• • ‘Number of Calls’: will always be set as default 1.  

• • ‘Duration (In Seconds)’: Duration is how long the individual test will run for. If the time of the test exceeds the duration set, it will terminate. 

• • ‘Language’: en-GB will be set as the default Language. To change you can select from the dropdown menu or to change the default language, see Profile. 

• • ‘From Number’: The default number is set as a UK number. In case you require a different number to generate the call from, see In-Country Dialing section. 

• • ‘Speech Model’: The default model is set as ‘command_and_search’. To change the default model type, see Profile.  

Creating a Load Test Sprint

• • Select the ‘Test Method’ on the top left column. 

• • Select ‘Load Testing’. 

• • Click on ‘+Create Sprint’ to create a Sprint 

• • Name the Sprint and click on ‘Next’. 

• • Select NLU Bot and click on ‘Next’.  

• • Enter the following Channel details to run the test: 

• • ‘Load Name’: Enter the name of the load testing. 

• • ‘Number of Calls’ you want to test: This number determines the total number of calls that will be sent during the load test. 

• • ‘Duration’: Enter the duration of each call.  

• • ‘Language’: Your default language will be set here or you can select from the dropdown menu for different options. To change the default language, see Profile. 

• • ‘Service’ and ‘Script’: Select the Service and Script created earlier from the drop-down list. 

• • ‘Rampup Time’: This is the time in seconds before additional calls are placed 

• • ‘Rampup Number’: This is the number of calls to increase by each time. E.g., Number of calls = 100; ramp up time 5 seconds; ramp up number 10.  

• • ‘RunLoad Time’: Select ‘Run Load Time’ in minutes if you want to run the maximum number of concurrent calls for a defined time. E.g., once 100 calls are reached, keep placing 100 calls for 5 minutes. 

• • Click on ‘Next’. 

• • Selecting a ‘Success Criteria’: This will determine whether the test is successful or if it failed, and the percentage confidence required. Select from: 

• • Confidence  

• • Custom User Data  

• • Maximum Prompts  

• • Minimum Prompts  

• • Simple Prompt Confidence  

• • Time Difference 

OR 

• • Select a ‘Multiple Criteria’: This will confirm if the desired threshold value has been met by the test cases. 

• • Click on ‘+Criteria’ to add multiple criteria having ‘and/or’ condition between them.  

• • When selecting ‘AND’, all criteria must be met for the test to be successful. If you select ‘OR’, the test will be rated as successful if any one criteria is met. 

• • Click on ‘+Criteria Set’ to add a new rule set that can have multiple criteria which can be added by clicking on ‘+Criteria’ as done previously or to remove multiple criteria click on ‘-Criteria Set’.  

• • To delete a ‘Criteria’ click on the respective icon located under ‘-Criteria Set’. 

• • Enter ‘Time difference’, ‘Confidence’, Maximum Prompts’, ‘Minimum Prompts’ or ‘Single Prompt Confidence’ from the dropdown list for ‘Multiple Criteria’s’ selected.  

• • Click on ‘Save’. 

• • You are then given the option to start testing now or later. 

• • Click on ‘Now’ to run the test. 

• • Click on ‘Start’ to initiate the test, details of the tests in progress will be displayed. 

• • To stop the test, click on ‘Stop Test’ present on top right column. 

• • To see your previous tests, you can find all the details under ‘Test History’ column.  

How to create a Sprint by Template

• • To create sprint by using one of the existing templates, click on ‘Test Method’ on the top left column and then ‘Create Sprint by Template’ option on top right.  

• • From the list of defined Test Methods, click on either ‘Load Testing’, ‘Scheduled Testing’ or ‘Automated Testing’. 

• • Enter the Script Name. 

• • Select from the templates that you have already created and click on ‘Next’.  

• • The channel you selected when you created this template would be selected by default here. Click on ‘Next.  

• • Enter ‘Channel’ and ‘Sucess Criteria’ details and click on ‘Save’.  

• • Click here for specific “Channel’ and ‘Success Criteria’ details for Automated testing  

• • Click here for specific “Channel’ and ‘Success Criteria’ details for Scheduled testing 

• • Click here for specific “Channel’ and ‘Success Criteria’ details for Load testing 

How to create folder for Test Method

• • To perform testing of numerous test methods consecutively, repeatedly or even with tailored requirements, folders can be created. Click on ‘Create Folder’ option on top right of Test Methods and enter ‘Folder Name’.  

• • Select ‘Scheduled Testing’ or ‘Automated Testing’. 

• • Click on ‘Create Sprint’.  

• • Name the service, select ‘Folder Name’ from the dropdown options as per requirement and click ‘Next’. 

• • Enter ‘Channel’ and ‘Success Criteria’ details and click on ‘Save’.  

• • Click here for specific “Channel’ and ‘Success Criteria’ details for Automated testing  

• • Click here for specific “Channel’ and ‘Success Criteria’ details for Scheduled testing 

• • Click on ‘Folders’ under the ‘Schedule Testing’ tab, the sprint will be displayed under the previously selected folder.  

• • To edit the services in folder, click on the ‘Edit’ icon under ‘Action Column’. 

• • To delete the script in the folder, click on the ‘Delete’ icon under ‘Action Column’.   

• • To rename the folder, click on ‘Rename Folder’ icon under ‘Action Column’.  

• • Click on the folder name, to view the next run time and test type of the sprint in the folder. To pause/resume testing of an individual sprint in the folder, in the ‘Actions’ column click on ‘ıı’ icon to pause the testing and click on ‘ ’ icon to resume the testing. 

How to Pause/ Resume Scheduled Test Sprint/ Sprint Folder

• • Click on ‘Test Method’ on the top left column.  

• • From the list of defined Sprints, select ‘Scheduled Testing’ from the top left column. 

• • To halt the testing of: 

• • Any future scheduled tests, in the ‘Actions’ column, click on ‘ıı’ icon to pause the testing of all scheduled tests in the sprint. 

• • Any sprint folder, click on ‘Folders’, select the required folder, in the ‘Actions’ column click on ‘ıı’ icon to pause the testing of all tests in the sprint folder. 

• • To resume the testing of:  

• • Any future scheduled tests, in the ‘Actions’ column, click on ‘ ’ icon to resume the testing of all scheduled tests in the sprint. 

• • Any sprint folder, click on ‘Folders’, select the required folder, in the ‘Actions’ column, click on ‘ ’ icon to resume the testing of all scheduled tests in the sprint folder.

How to Run, Edit, and Delete existing Test Sprints

• • Click on ‘Test Method’ on the top left column.  

• • From the list of defined Sprints, click on either ‘Load Testing’, ‘Scheduled Testing’ or ‘Automated Testing’ from the top left column. 

• • To run an existing Automated Test Sprint, Scheduled Test or Load Test, click on the required Sprint and click on ‘Start’. 

• • To reschedule a Scheduled Test: 

• • Select actions on the right-hand side and click on the ‘Edit’ icon. 

• • Click ‘Next’ to go to the date & time page. 

• • Select required ‘Start date’, ‘run time’, ‘Repeat interval’, and ‘End date’ as required.  

• • Click on ‘Add schedule’.  

• • Click on ‘Next’ through the following set-up options and make your final changes.  

• • To edit or delete an existing Test Sprint, in the ‘actions’ column click on either ‘Edit’ or ‘Delete’ icon or ‘Save as’. 

How to create a Web/UI Channel Testing and Validate UI Behavior

• • Click on ‘Service’ present on the top left column.  

• • Click on ‘Create Service’. 

• • Name the service and click on ‘Next’. 

• • Select Chat as the channel and Genesys Chat as the sub-channels. 

• • Enter the ‘Chat API’ details or web URL and click on ‘Save’.  

• • Tap on ‘Script’ section on the top left column.  

• • Click on ‘Create Script’.  

• • Name the Script and click on ‘Next’.  

• • Select Chat as the channel and Genesys Chat as the sub-channels and click on ‘Next’.  

• • Click on ‘NLU Support’ and click ‘Save’ 

• • In ‘Add Messages’ populate ‘Steps’, ‘Description’, ‘Expected Message’ and Expected Response’ and click ‘Save’. 

• • Select the ‘Test Method’ on the top left column. 

For ‘Automated Testing’:  

• • Click on ‘+Create Sprint’ to create a Sprint 

• • Name the Sprint and click on ‘Next’. 

• • Select Genesys as a Channel and Genesys Chat as Sub-Channel. Click on ‘Next’.  

• • Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Select ‘RunCustomScript’ and from ‘Custom Sprint’ dropdown select ‘WebUI’. Click on ‘Next’  

• • In ‘Success Criteria’ select ‘All Steps’ from dropdown options and click on ‘Passed’ for ‘Select Criteria’. Click on ‘Save’. 

• • Once the test has been created select ‘Now’ to run execution of test immediately or ‘Later’.  

For ‘Scheduled Testing’:  

• • Click on ‘+Create Sprint’ to create a Sprint 

• • Name the Sprint and click on ‘Next’. 

• • Select ‘Date’ and ‘Time’ for the Scheduled Testing: 

• • To run a single scheduled test, select the ‘Start Date’ and ‘Time’. 

• • To run a test with scheduled repetition, click on ‘Repeat’ and choose the frequency of the tests from the drop-down menu. Select the ‘Start Date’, ‘End Date’ and ‘Time’. To customize the frequency of running the scheduled tests, select ‘Custom’ from ‘Select Repetition’. Select the ‘Start Date’ and ‘End Date’, select the days you would like the test from ‘Week(s)’, select ‘Hour’ and ‘Minute. You can even choose multiple ‘Weeks’, ‘Hours’, and ‘Minute’. 

• • Click on ‘Add Schedule’ and all scheduled tests will be displayed on the right side.  

• • To delete any scheduled testing, click on ‘x’ located beside the specified ‘Date’. 

• • Select Genesys as a Channel and Genesys Chat as Sub-Channel. Click on ‘Next’. 

• • Enter ‘Number of calls’ and ‘Duration’. Select ‘Language’. Select ‘Service’ and ‘Script’ that was created earlier from the dropdown menu. Select ‘RunCustomScript’ and from ‘Custom Sprint’ dropdown select ‘WebUI’. Click on ‘Next’.  

• • Select ‘Success Criteria’: This will determine whether the test is successful or if it failed. Enter the following details: 

• • In ‘Success Criteria’ select ‘All Steps’ from dropdown options and click on ‘Passed’ for ‘Select Criteria’. 

• • Click on ‘Re-Run Failed’ option: This decides whether you want to receive alerts immediately after a test fails once, or if you want the test to repeat up to 5 times at an interval between 1 and 5 minutes. This test will repeat until: a) It is successful OR b) The Re-run count is reached. Select the ‘ReRun Count’ and ‘ReRun Minutes’ from the dropdown to set this criteria.  

• • Enter the email address (s) you wish to receive the notifications on. When entering multiple email addresses, separate each address with a ‘,’ no spaces, e.g:  mail1@xx.com,mail2@xx.com,mail3@xx.com 

• • Select ‘Send Email’ to choose whether to receive notifications only for failed tests, or for both successful and failed tests from the dropdown options. 

• • Select ‘Send SMS’ and/or ‘Send WhatsApp Notification’ and enter mobile number with country code to send SMS and/or WhatsApp notifications of test results. When entering multiple SMS and/or WhatsApp numbers, separate each number with a ‘,’ no spaces, e.g:  +448000000000,+4480000001 

• • The scheduled Test Sprint will run at the selected date and time. 

Reports

There are several types of reports: 

1. 1. High Level Report: This shows the high-level results of the tests run, grouped by Sprint.  

• • Select the start and end dates from the top to view the testing results. 

• • For the selected date range, you can graphically see the number of sprints run and the number of times the sprint has been successful and/or failed.  

• • To filter specific reports of sprint folder tests and/or channels, select required ‘Folder Name’ and/or ‘Channel Name’ from the dropdown list.  

• • Below the graphs, the Sprint Name, number of times the sprint has run, the sprint’s success and fail count, channel type and test type will be displayed.  

• • To view individual results of the Sprint’s execution, click on required ‘Sprint Name’. This will show the ‘Results’, ‘Completion Date & Time’ and ‘Average Confidence’ of each Sprint for the date range selected. To filter failure/success/all results, click on ‘Search by Result’ on top right corner and select as required from the dropdown menu.  

• • To view the test history of any test result, click on ‘Test ID’. A detailed report of the sprint with all the prompts will be displayed along with the ‘Execution date & time’ the test was executed on. Click on ‘Failure’ under ‘Final Result’ to view the reason for the sprint failing. The reasoning will be based on failure to meet selected success criteria. You can save the transcript from ‘Export Report’, play the audio recording from ‘Listen Audio’ or even download the recording file from ‘Download Audio’ (only for Voice Channels) for later analysis.  

• • The High-Level Summary report can be downloaded as a PDF or into Excel. 

1. 1. Sprint Details Report: This shows details of every test case performed along with the date, time and result.  

• • Select the start and end dates from the top to view the testing results. To filter failure/success/all results select as required from the dropdown menu. 

• • To filter specific reports of sprint folder tests and/or channels, select required ‘Folder Name’ and/or ‘Channel Name’ from the dropdown list. 

• • For the selected date range, you can graphically see every sprint test performed along with its status.  

• • To view the test history of any test result, click on ‘Sprint Name’. A detailed report of the sprint with all the prompts and its confidence levels will be displayed.  

• • The Sprint Details Report can be downloaded as a PDF or into Excel. You will further see options of ‘Export Report’, ‘Listen Audio’, and ‘Download Audio’. (This option is available for all voice channels.)  

1. 1. Invoice Report: This shows how many tests you’ve performed so far. 

• • Select to display this month or the previous month.  

• • For the selected month, you can graphically view every sprint test that has been charged or has been free. The number of free and charged sprint test will depend on your Membership.  

• • Every call or sprint run will result into a ‘Unit’. The ‘Cost/Unit’ and ‘Total Cost’ for every Sprint Test can be viewed here.  

• • The report also shows tests exceeding the allowance limit for the plan which are chargeable. 

• • The Invoice report can be downloaded as a PDF or into Excel. 

1. 1. Load Sprint Report: This shows details of each load test. 

• • Select the start and end dates from the top to view the testing results. 

• • For the selected date range, all load tests will be displayed here with their ‘Load ClientID’, ‘Executed Date & Time’, ‘Success Count’ and ‘Failed Count’.  

• • Click on any Load Test to see the details of the calls in that Load Test.  

• • Click on ‘Sprint Message Details’ to see the details of that interaction. 

• • Click on ‘ClientID’ to see the test history of the load test. 

• • The Load Sprint report can be downloaded as a PDF or into Excel. 

1. 1. Script Folder Report: This shows details of each script test tested in a script folder. 

• • Select the start and end dates from the top to view the testing results. To filter failure/success/all results select as required from the dropdown menu. To view a specific folder, select the Script Folder from the dropdown list. Then click on ‘generate’.  

• • The test details for the Script Folder will be displayed. Here you can view the result of the test and confidence levels of individual prompts.  

1. 1. Sprint Folder Report: This shows details of each sprint test tested in a sprint folder. 

• • Select the start and end dates from the top to view the testing results. To filter failure/success/all results select as required from the dropdown menu. To view a specific folder, select the Sprint Folder from the dropdown list. Then click on ‘generate’.  

• • The test details for the Sprint Folder will be displayed. Here you can view the result of the test and confidence levels of individual prompts.  

1. 1. Audit Logs Report: This shows a chronological record of modifications made by users on actions and entities.  

• • Select the start and end dates from the top to view the log results. 

• • To view and filter the actions performed, select ‘Entity Name’ and ‘Action’ and choose from the dropdown menu. Then click on ‘generate’  

• • The ‘Entity’, ‘Name’, ‘Action’, ‘modified by’ and ‘Modified On’ details will appear.  

1. 1. SubOrg Report: This shows the number of interactions a sub-org has used and is allowed to use.  

• • Click on SubOrg Report to view the used and allowed interaction results for each SubOrg. 

• • Note: Admins can view comprehensive execution details of the interactions used by the SubOrg by clicking on the specific SubOrg.  

What is IVR Autodiscovery/ IVR Tree?

With IVR Autodiscovery/ IVR Tree, you can simply instruct QuickTest to examine your IVR. QuickTest will then generate a visual map displaying all the potential paths in your IVR. You can then automatically generate scripts to test the specific flows you desire.

How to create an IVR Tree for Call Flow?

Follow these steps:  

• • Click on IVR tree. Select ‘IVR Type’, ‘Prompt Timeout’, ‘Speech Model’ and ‘Language’ from the dropdown options.  

• • Enter ‘Terminate Conditions’ in the text box. Click on the ‘+’ icon if you want to add more conditions.  

• • In ‘Enter your Number’ input the number you wish QuickTest to retrieve the IVR flow from.  

• • Click on ‘Get IVR Tree’ to generate a visual map of your IVR, showing all the flows and nodes. It may take a few minutes for the IVR tree to be generated, as QuickTest gathers the information.  

• • Once the IVR Tree is ready, choose a specific flow and select the desired nodes. A tick mark should appear on each node you select. Note: You can use the ‘Zoom’ function to zoom in/ out for a more detailed or broader view.  

• • Scroll below the IVR Tree, a list of IVR prompts will be displayed. Select the prompts you want to include in your script.  

• • Click on ‘Create Script’ to automatically generate a script based on your chosen flow and nodes.  

• • Enter ‘Script Name’ and select ‘Next.  

• • Select a ‘Channel’ and click on ‘Next’.  

• • Select ‘NLU Support’ and ‘Use Step’ if required. 

• • In ‘Add Messages’, your selected IVR prompts will be added. You can now ‘Save’ your scripts and use them to create test cases.   

• • Click on ‘Export Excel’ to export the selected flow and nodes into an excel sheet.  

• • Click on ‘Lucid Chart CSV’ to export the IVR tree data in a CSV format that is compatible with the Lucid application. 

How to create an IVR Tree for Genesys Flow?

Follow these steps:  

• • In ‘Configuration’ section, select ‘Genesys oAuth Details’. Add your Genesys oAuth Account details. This includes adding the ‘Client Id’, ‘Client Secret’ and selecting ‘login URL’ from the dropdown options. Click ‘Save’ once details are entered.  

• • Click on IVR tree. Choose your preferred ‘Flow Type’ and ‘Flow Name’ from the dropdown menu.  

• • Click on ‘Get IVR Tree’ to generate a visual map of your IVR, showing all the flows and nodes. It may take a few minutes for the IVR tree to be generated, as QuickTest gathers the information.  

• • Once the IVR Tree is ready, choose a specific flow and select the desired nodes. A tick mark should appear on each node you select. Note: You can use the ‘Zoom’ function to zoom in/ out for a more detailed or broader view.  

• • Scroll below the IVR Tree, a list of IVR prompts will be displayed. Select the prompts you want to include in your script.  

• • Click on ‘Create Script’ to automatically generate a script based on your chosen flow and nodes.  

• • Enter ‘Script Name’ and select ‘Next.  

• • Select a ‘Channel’ and click on ‘Next’.  

• • Select ‘NLU Support’ and ‘Use Step’ if required. 

• • In ‘Add Messages’, your selected IVR prompts will be added. You can now ‘Save’ your scripts and use them to create test cases.   

• • Click on ‘Export Excel’ or ‘Export PDF’ to export the selected flow and nodes into an excel sheet or PDF file.  

• • Click on ‘Lucid Chart CSV’ to export the IVR tree data in a CSV format that is compatible with the Lucid application.  

What is Browser Calling?

‘Browser Calling’ is a web-based phone UI that enables you to have conversations and create scripts that can be saved. 

How to set up Browser Calling?

Follow these steps:  

• • Click on ‘Browser Calling’. To perform browser calling enter the following details:  

• • You can select the ‘Language’ from the dropdown list to generate prompts and scripts in a particular language. 

• • You can select ‘Speech Model’ from the drop-down options. This is the recognized language of the IVR.  

• • ‘Prompt Timeout’ provides more control during your interactions.  

• • ‘From Number’ is the number you would like to originate the call from.  

• • ‘Enter your number’ is the destination you would like the call to connect to.   

• • Note: Input phone number according to international format e.g., +44 for UK 

• • Note: Users must use ‘#’ to navigate through the IVR. E.g., after pressing ‘#’ on the dial pad, users should proceed by clicking ‘1’ for sales.  

• • Once details have been entered, click on the green phone icon to call and red phone icon to hang up. 
  • Click on ‘Browser Calling History’ to view the history of any interactions you have performed.

What is ChatBot Testing?

‘ChatBot Testing’ is similar to Browser Calling, only for ChatBots instead. You can use this to interact with your ChatBot and automatically create a script to use in your script to use in your automated and scheduled tests.

How to set up ChatBot Testing 

•  

• Navigate to ‘ChatBot’: Begin by clicking on the ‘ChatBot’ option from the left bar menu.

• Enter ChatBot Testing Details:

  • Select the ‘ChatBot Type’ and ‘ChatBot Details’ from the available dropdown options. Currently supported ChatBot types include Google Dialogflow CX, Genesys Cloud Chatbot, Google Dialogflow ES, and Amazon Lex.
  • You can save your ChatBot details for future tests in the Settings section by navigating to Configuration > ChatBot. For further guidance on setting this up, click here.

• Start the Test:

  • After selecting the ChatBot Type and entering ChatBot Details, click Start. A ChatBot window will open, allowing you to type your test messages.
  • To end the test, click Stop Test at any time. The interaction history will display, allowing you to click Save Script to save the session.

• View ChatBot History:

  • To review past interactions, click on ChatBot History to access records of previous tests.

What is Generative AI Testing?

With ‘Gen AI Testing’ QuickTest will automatically generate multiple scripts for various scenarios, eliminating the need to create multiple test scripts. Streamlining script generation, minimizing manual effort and accelerating testing processes for you. 

How to set up Gen AI Testing

Follow these steps to configure Gen AI Testing in QuickTest:

1. Navigate to the Gen AI Testing Section
   • Under the Chat Bot section, click on Gen AI Testing.
2. Create a Gen AI Bot
   • Click on Create a GenAI Bot.
   • Enter a name in the GenAI Bot Name field.
   • (Optional) Select the Blank Template checkbox to customize your template. Click Save once named.
   • Your newly created GenAI Bot will appear in the list on the left.
3. Customize Your Gen AI Bot
   • To Phone Number – Specify the number to call. The bot will initiate the call accordingly.
   • Language – Select the default communication language from the dropdown menu.
   • Temperature – Adjust creativity/randomness of responses using the slider (range: 0 to 2).
   • Knowledge Base – Upload files (JSON, TXT, CSV) or link a website and specify the industry. Click Add Document to upload a file or link a website.
   • LLM (Large Language Model) – Choose the preferred provider and model from the dropdown list. Note: Currently, LLM costs are covered by QuickTest. In the future, these costs may be passed to users.
   • Upload Additional Data – Enable the bot to retrieve relevant details from uploaded data files.
4. Customize Your Voice Bot 
   • Voice Selection – Choose a male or female voice from the dropdown list.
5. Save and Test Your Gen AI Bot
   • Click Save after configuring the settings.
   • Click Test GenAI Bot.
   • Enter the Number of Scenarios to Generate.
   • Click Fetch Scenarios to generate test cases.
6. View Gen AI Testing History
   • Generated scenarios can be tested multiple times with varied wording (e.g., 5, 10, or 20 iterations). Constraints like “angry customer” , “Non-native speaker”,  “Non-cooperative customer” etc can also be applied. If any scenario is missing, you can add custom ones as well.
   • Click GenAI History to review previous tests.
   • Select a Start Date and End Date to filter records.
   • View details such as: GenAI Request ID, Destination Details, Executed Date & Time

•  

What is Enhanced Proactive Monitoring ?

Enhanced Proactive Monitoring provides real-time monitoring of Genesys Flow Entry Points, enabling faster detection and resolution of issues. Simply configure a monitoring schedule for the entry points of interest, specifying the expected number of active calls and how frequently QuickTest should check the flow. If active calls fall below your specified threshold, QuickTest will automatically launch the designated test sprint and issue alerts if any failures are detected.

With the new Trunk Real-Time Entry Point feature, you can similarly monitor specific trunk entry points, set active call thresholds, and receive real-time alerts for prompt issue identification and resolution.

How to set up Enhanced Proactive Monitoring 

•  

• Access Proactive Monitoring:

  • Select Proactive Monitoring from the left menu, then choose Add Proactive Monitoring.

• Enter Monitoring Details:

  • Fill in the Job Name, select the Contact Center Type, Entry Point, Monitoring Type, Direction, Channel, and Login Details (configured in Settings), along with the relevant Entities.

• Configure Schedules:

  • Specify the Date, Start Time, and End Time for monitoring.
  • Set the Frequency (interval for call flow checks), choose applicable Weekdays, enter the Threshold details, and select the associated Sprint.
  • Enable notification options for receiving reports by SMS, WhatsApp, or Webhook by checking the corresponding boxes.

• Manage Schedules:

  • Use the sliding toggle icon to enable or disable schedules.
  • Click the + icon to add multiple schedules as needed.
  • Click Save once all details are complete.

• View Monitoring History:

  • To review progress and outcomes, select View Historic Data. You can filter by date to view specific schedule details.

What is Rapid Onboarding?

Rapid Onboarding enables the automatic setup of services, scripts, and scheduled sprints for NLU channels by uploading an Excel file. After setup, you can easily modify scripts as needed and schedule sprints to begin monitoring.

How to set up Rapid Onboarding?

• In the left menu, select Rapid Onboarding. Click Download Sample File to open a template. Enter your Name, Number, and Language details as required.
• Complete the Excel sheet with the necessary details, then upload it by clicking Upload.
• After uploading, please allow a few minutes for processing. You will receive an email notification from QuickTest once the onboarding process is complete.
• Upon completion, a status report will be sent to your email, and QuickTest will automatically create the services, scripts, and sprints.
• To review or edit any service, script, or sprint, navigate to the Service, Script, or Test Method sections in the left menu, and click Edit in the action column to make changes.

Account Management

You can find your Account Details are in the top right corner under Settings. 

My Profile  

• • In the ‘My Profile’ section you can update ‘Name’, ‘email’, ‘phone number’ ‘Time Zone’ and ‘Profile Picture’. You can also set a default ‘language’, ‘Speech model’ and ‘Prompt Timeout’. 
  • Click on the ‘SMS MFA’ to enable 2-factor authentication.

Change Password  

• • ‘Change Password’ is where you can change and update the login password. Enter your ‘Old Password’ and ‘New Password’. Click on ‘Update’ once details have been entered.  

Generate Token  

• • Select ‘Generate Token’ to produce your unique ApiKey and Token.  

• • When generating the ApiKey, it must be recorded in a secure location as QuickTest cannot recover it. 

• • A new ApiKey can be generated at any time.  

InCountry Dialling  

• • ‘InCountry Dialling’ enables you to buy a number to use for testing from your desired country to the IVR. (Some IVRs don’t accept international calls). 

• • After clicking on ‘Buy a number’, you can add the location and buy the number from the required location and activate it. 

• • When creating Sprints, select the ‘From Number’, from the pull down, select the number you have purchased, your test will now be originated from that number. 

Contact Us  

• • ‘Contact us’ to send messages to us at QuickTest. 

• • Enter your ‘Name’, ‘Email Address’, ‘Phone Number’ and ‘Message’. Once done click on ‘Send’.  

My Order  

You can find details about your payment methods and your order history.  

Order History  

• • ‘Order History’ shows which plan is in use month by month, you can upgrade, edit and cancel your plan here. 

Payment Details  

• • ‘Payment details’ show credit/debit card details which are in use for paid plans. 

Configuration

You can find details related to your scripts, sprints and test methods in the top right corner under Settings. 

Channel Profile 

You can add and edit default settings for your channels.  

Email Profile  

• • Select ‘Add Email’ and then enter ‘Email’, ‘Client ID’, ‘Tenant ID’, ‘Client Secret’ and then click ‘Submit’.  

• • To ‘edit’ or ‘delete’ the Email profile, click on respective icons under ‘Action’ in ‘Email Profile’. 

Facebook Profile  

• • Select ‘Add Facebook’ and then type ‘User Name’ followed by your ‘User Password’ and click on ‘Update’.  

• • To ‘edit’ or ‘delete’ the Facebook profile, click on respective icons under ‘Action’ in ‘Facebook Profile’.  

WhatsApp Profile  

• • Select ‘Add Number’ and then type ‘Country Code’ followed by your ‘from number’ and then click ‘Submit’.  

• • To create a session, scan the generated QR Code on the screen from your mobile.  

• • Click ‘Back’ to see the status of your number as ‘True’ if your number has been scanned and ‘False’ if not.  

• • To delete the session, click ‘Delete’ under the Action column.  

Templates  

You can add default sprint template preferences.  

Sprint Template  

• • Select ‘Add Sprint Template’ and then enter ‘Sprint Template Name’. Select desired channel. Enter ‘Duration’ and ‘Select Language’ from the dropdown options. Select ‘Success Criteria’ or ‘Multiple Criteria’. Click on ‘Update’ to make your new changes.  

• • To ‘edit’ or ‘delete’ the sprint template, click on respective icons under ‘Action’ and update your changes.  

Script Template  

• • Select ‘Add Script Template’ and then enter ‘Sprint Template Name’. Select desired channel and click on ‘Save’.  

• • To ‘edit’ or ‘delete’ the script template, click on respective icons under ‘Action’ and update your changes.  

Service Monitoring Data  

You can add custom parameters to check the health of your channels by conducting tests with pre-defined parameters.  

• • To define custom parameters click on ‘Service Monitoring Data’.  

• • Enter the ‘Name’ and select the ‘Channel Name’ from the dropdown options. Select the ‘Service Monitoring Parameters’ from the dropdown menu:   

• • Answering – Enter the ‘min’ and ‘max’ range of seconds the prompt should respond within for the parameter to be determined as successful, satisfactory, and failed.  

• • Correct Prompts: Enter the ‘min’ and ‘max’ range of percentage the prompt should be correct within for the parameter to be determined as successful, satisfactory, and failed. 

• • Welcome Prompt: Enter the ‘min’ and ‘max’ range of percentage the welcome prompt should be correct within for the parameter to be determined as successful, satisfactory, and failed. 

• • Responsiveness: Enter the ‘min’ and ‘max’ range of percentage the prompts responsiveness should be within for the parameter to be determined as successful, satisfactory and failed. 

• • Once these parameters have been customized, click on ‘Save’ and your test sprints will be calculated against the set parameters.  

Custom Sprint Validation  

• • ‘Custom Sprint Validation’ enables you to add criterias in ‘Multiple Criteria’ for your contact centre login channels. 

• • Click on ‘Add New Custom Sprint Validation’ 

• • Enter ‘Validation Name’, in ‘User Data’ enter ‘Key’ and ‘Value’, in ‘Script Validation’ enter ‘Key’ and ‘Value’.  

• • Once these details have been entered, in ‘User Data’ and ‘Script Validation’ it is mandatory to click on the ‘+’ icon and add another set of ‘User Data’ and ‘Script Validation’. To delete a step click on ‘x’ icon.  

• • Click on ‘Save’. 

• • To ‘edit’ or ‘delete’ a sprint validation, click on the respective icons under ‘Action’ and update your changes.  

Upload Data Driven File  

• • ‘Upload Data Driven File’ enables you to modify the ‘Expected Response’ of a script by simply updating a CSV file format rather than having to manually update the script every time.  

• • Click on ‘Upload File’, select required file and click on ‘Upload’.   

• • To delete a file, click ‘Delete’ under the Action column.  

• • To edit a file, click ‘Edit’ under the Action column. You can amend and upload the file with the same name and all changes will go into your scripts. Note: When editing a file, the new file will only be uploaded if it has the same saved name as the previous file.  

•  

Genesys Account Details  

• • To add multiple Genesys logins for test execution, click on ‘Add Genesys Account’.  

• • Enter the details for ‘Login Username’, ‘Login Password’, ‘Login URL’, ‘Login with Account’  and ‘Organization Name’. Click on ‘Save’.  

• • To ‘edit’ or ‘delete’ Account details, click on respective icons under ‘Action’ in ‘Genesys Account Details’.  

Genesys oAUTH Details  

• • To add multiple Genesys oAUTH logins for test execution, click on ‘Add Genesys oAUTH Details’.  

• • Enter the details for ‘Client ID, ‘Client Secret’ and ‘Login URL’. Click on ‘Save’.  

• • To ‘edit’ or ‘delete’ Account details, click on respective icons under ‘Action’ in ‘Genesys Account Details’.  

Client Application Detail   

• • To add multiple Client Application details for test execution, click on ‘Add Client Details’.  

• • Enter the details for ‘Client ID’ and ‘Client Name’. Click on ‘Save’.  

• • To ‘edit’ or ‘delete’ Account details, click on respective icons under ‘Action’ in ‘Client Application detail’.  

Repository Detail   

• • To add multiple Repository details for test execution, click on ‘Repository Detail’.  

• • Enter the details for ‘Account Name’, ‘Access Key’, ‘Secret Key’ and select the ‘Git Type’ and ‘Region’ from the dropdown. Click on ‘Save’.  

• • To ‘edit’ or ‘delete’ Account details, click on respective icons under ‘Action’ in ‘Repository detail’.  

XRAY Details  

• • Click on ‘Add Xray Details’. Enter the details for ‘Base URL’, ‘Client ID’, ‘Client Secret’ and ‘Account Name’. Click on ‘Save’.  

• • To ‘edit’ or ‘delete’ Xray Details, click on respective icons under ‘Action’ in ‘Xray Details’. 

Amazon Connect Details  

• • Click on ‘Add Amazon Connect Details’. Enter the details for ‘Account Name’, ‘AWS Access Key’, ‘AWS Secret Access Key’, ‘InstanceID’ and ‘Contact FlowID’. Click on ‘Save’.  

• • To ‘edit’ or ‘delete’ Amazon Connect Details, click on respective icons under ‘Action’ in ‘AWS Details’. 

Amazon Connect Voice Configuration

• • Click on ‘Add Amazon Connect Voice Configuration’. Enter the details for ‘Account Name’, ‘AWS Access Key’, ‘AWS Secret Access Key’, ‘s3 Bucket ARN’ and select ‘region’ from the dropdown. Click on ‘Save’.  

• • To ‘edit’ or ‘delete’ Amazon Connect Configuration Details, click on respective icons under ‘Action’ in ‘Amazon Connect Voice Configuration’. 

Chatbot Details  

• • Click on ‘Add Chatbot Details’. Enter the details for ‘Account Name’, ‘Location’, and ‘Agent ID’. Select ‘Chatbot Type’  and ‘Service Account File’ from the dropdown options and click on ‘Save’.  

• • To ‘edit’ or ‘delete’ Chatbot Details, click on respective icons under ‘Action’ in ‘Chatbot Details’. 

Chatbot Details – Bot2Bot Testing 

• • Click on ‘Bot2Bot Testing ’. Enter the details for ‘Account Name’. Add ‘key’  and ‘Value’ in bot info and click on ‘Save’.  

• • To ‘edit’ or ‘delete’ Chatbot Details, click on respective icons under ‘Action’ in ‘Chatbot Details’. 

ElasticCX CCaaS 

• • Click on ‘Add ElasticCX Environment ’. Enter the details for ‘User ID/Email’, ‘Password’, ‘Client ID’, ‘Secret Key’ and ‘Tenant ID’. Click on ‘Save’.  

• • To ‘edit’ or ‘delete’ ElasticCX CCaaS Environment Details, click on respective icons under ‘Action’ in ElasticCX CCaaS Environment ’. 

ElasticCX CCaaS – User Details 

• • Click on ‘Add ElasticCX Agent Login’. Enter the details for ‘Environment Name’, ‘Portal URL’, ‘API URI’, ‘Auth Key Name’ and ‘Touch Point ID’ from the dropdown. Click on ‘Save’.  

• • To ‘edit’ or ‘delete’ ElasticCX CCaaS Agent Login Details, click on respective icons under ‘Action’ in ElasticCX CCaaS Agent Login’. 

Custom Noise 

• • Click on ‘Add Custom Noise Details’. Enter the ‘Noise Name’ and upload your file. Click on ‘Save’.  

• • To ‘edit’ or ‘delete’ Custom Noise , click on respective icons under ‘Action’ in ‘Custom Noise’. 

Email Notification 

• • Click on ‘Add Email Notification Details’ to be notified for test alerts you want to receive. Select the ‘email type’ from the dropdown menu. Select if you would like the email notification to go to Admin or/and User. Click on ‘Save’.  

• • To ‘edit’ or ‘delete’ Email Notification , click on respective icons under ‘Action’ in ‘Email Notification’. 

Prem Genesys Details 

• • Click on ‘Prem Genesys Details’. Select the ‘Client Application’ from the dropdown, enter the ‘Environment Name’ and ‘Configuration Server Details’. Click on ‘Submit’.  

• • To ‘edit’ or ‘delete’ Prem Genesys Details , click on respective icons under ‘Action’ in Prem Genesys Details’. 

Notification

•  

• • Select the checkbox required to customize the email notifications you want to recive from QuickTest. Click on ‘Submit’ once done.  

•  

User Management

You can find details related to setting up new profiles, organizations and sub-organizations in the right top corner under Settings. 

User Profile

•  

Note: The admin is required to send the invitation using QuickTest to users. The recipient of the invitation must follow the link provided in the email and enter their details as mentioned. It is essential that they use the same email address to which the invitation was sent. By default, the recipient will have read-only access. Once the recipient completes the registration process, the admin can adjust their access level, granting them different permissions, such as read/run, read/run/write, or admin privileges. Additionally, the admin can assign them to any sub-organization as needed. 

• • To set up two factor authentication, click on ‘User Profile’ details. 

• • Select ‘SMS MFA’ box to activate 2FA.  

• • Note: An OTP (One Time Password) will be sent to your registered number on QuickTest that is mentioned under your profile. To receive an OTP on a different phone number, you will need to change your registered number on QuickTest. 

• • Click on ‘Update’. 

• • Logout of QuickTest and then Login on QuickTest, your 2FA will be set up and you will be required to enter the OTP sent to your registered phone number each time you login to QuickTest. 

Advanced User Management  

• • Click on ‘Advanced User Management’. Select ‘Add New Suborganization’ and enter suborganizations name.  

• • Enter ‘Allowed Interaction’ to assign number of allowed interactions for the sub-organization.  

• • To assign a member to a suborganization, select ‘User Management’ and click on the edit action on the members name.  

• • Select ‘Suborganization List’ and choose from the dropdown list to assign the member.   

Note:  

• • Services, scripts, test sprint and reports can be filtered by sub-organization, helping you view only relevant data. This can only be done by Admins.  

• • To identify test volumes that sub-organizations have used. Admins can assign ‘Allowed Interaction’ to each sub-org. When a sub-org has used 80% of their allowance, Admins are alerted. When the sub-org reaches 100%, tests are stopped unless Admins assign further tests.  

•  

Login Details  

• • To view your account’s log in history, click on ‘Login Details’ section under the dropdown options from Settings section located on top right corner.  

• • Select ‘Login Details’ to view login attempt time, authentication status, device name, city and country details.