Smoke test cases for customer usability

7 min read

No. of Test Case

Section

Test Case Name

Test Case Steps

Expected Outcome

CHAT

1.1.

Chat

User chat using “Chat with GPT” successfully

  1. User creates Space with “Chat with GPT” module

  2. Send the prompt in the chat of created space

User receives answer related to the prompted question.

1.2.

Chat

User successfully upload file in the chat

  1. User creates Space with Chat with GPT module

  2. And by default, upload in the space is enabled

  3. User upload several different types of files in the chat

All files are successfully uploaded and user can chat with the files.

1.3.

Chat

User successfully rename the chat

  1. There is already created chat in the space

  2. And user clicks on the ellipsis

  3. And clicks on “Rename” button

Modal window for changing the name of the chat is opened and user successfully change the name.

1.4.

Chat

User review recent chat

  1. User creates one chat by sending question

  2. And receives answer on it

On the Chat page, under “Recents” user sees previously created chat.

1.5.

Chat

User successfully delete the chat

  1. There is already created chat in the space

  2. And user clicks on ellipsis

  3. And clicks on “Delete” button

Modal window for deleting chat is opened and user successfully deletes the chat.

KNOWLEDGE BASE

2.1.

Knowledge Base

User successfully creates a folder and its subfolders

  1. User creates folder using New folder button

  2. And on that folder, using same button user creates additional 2 subfolders

User can see path of created folder and subfolders and can operate with it.
On the right side, on the folder user can see its permissions.

2.2.

Knowledge Base

User upload different types of files in the folder

  1. There is already created folder

  2. And in that folder, user clicks on the “Upload files”

  3. User starts with upload of different types of files: PDF, DOCX, XLSX, PPTX, CSV, HTML, MD, TXT

All selected files are successfully uploaded.

2.3.

Knowledge Base

User successfully rename the folder

  1. There is already created folder in the KB

  2. And user clicks on the button “Rename Folder”

Modal window for changing the name of the folder is opened and user change the name and receives green toast message that folder is renamed.

2.4.

Knowledge Base

User successfully delete the folder

  1. There is already created folder in the KB

  2. And user clicks on the button “Delete Folder”

User receives green toast message that folder is deleted.

2.5.

Knowledge Base

User tries to delete folder which has its subfolder

  1. There is already created folder in the KB

  2. And there is several created subfolders inside that folder

  3. And user try to click on the button “Delete Folder”

“Delete Folder” button is grey and disabled and tooltip message shows up: “Folder can only be deleted if empty.

BENCHMARKING

3.1.

Benchmarking

User creates Benchmarking report

  1. User download Benchmarking Template and gather typical user questions for assistants/workspaces and add them to column B, which should be named “Question.”

  2. And user add the exact name of the assistant to column C, which should be named “Assistant.”

  3. Then user fill out columns B (“Assistant”) and C (“Question”). The rest will be automatically filled in terms of naming. Columns D indicate whether there is an existing reference answer to compare with the new run. Since this is the first run, enter "No."

  4. User clicks on Drag and drop of the excel file in the benchmarking section in the Unique Platform and it upload the Excel File to the Benchmarking.

Downloaded file with automatically generated answers is ready for reviewing and classification.

  • If the questions were completed user will see a green tag indicating “ready” next to the file.

FEEDBACK

4.1.

Feedback

User creates Feedback report

  1. User is on the chat interface and answer for given question is provided

  2. User can choose either to give like or dislike to the provided answer

On the feedback page user can download report with all provided feedbacks on the chat interface page choosing desired date for the start date of the report.
Downloaded file is saved on the user’s computer.

ANALYTICS

5.1.

Analytics

User creates Request Chat Interactions

  1. User is on the Analytics Orders page

  2. And user select Start and End date for the report

  3. User choose desired Assistant/Space

  4. User clicks on Request Chat Interactions

The excel report with ANALYTICS TYPE “CHAT_INTERACTION” is created and placed on the top of the page and it can be downloaded.

5.2.

Analytics

User creates Request Active Users

  1. User is on the Analytics Orders page

  2. And user select Start and End date for the report

  3. User choose desired Assistant/Space

  4. User clicks on Request Active Users

The excel report with ANALYTICS TYPE “ACTIVE_USER” is created and placed on the top of the page and it can be downloaded.

5.3.

Analytics

User creates Request Reference Statistics

  1. User is on the Analytics Orders page

  2. And user select Start and End date for the report

  3. User choose desired Assistant/Space

  4. User clicks on Request Reference Statistics

The excel report with ANALYTICS TYPE “REFERENCE_STAT” is created and placed on the top of the page and it can be downloaded.

5.4.

Analytics

User creates Request Detailed User Interactions

  1. User is on the Analytics Orders page

  2. And user select Start and End date for the report (can’t be more than period of 14days)

  3. User choose desired Assistant/Space

  4. User clicks on Request Detailed User Interactions

The excel report with ANALYTICS TYPE “CHAT_INTERACTION_DETAILED” is created and placed on the top of the page and it can be downloaded.

5.5.

Analytics

User deletes already created report

  1. There is already created report on Analytics page for all analytics types

  2. User choose which report he would like to delete from offered existing reports: Request Chat Interactions/ Request Active Users/ Request Reference Statistics/ Request Detailed User Interactions

When clicking on the “Delete” button next to the report, targeted report is deleted.

USER MANAGEMENT

6.1.

User management

User search for certain member

  1. In the input field of User Mgmt page, user input string for finding preferred members

In the returned list, all member has entered string in its name/surname/email.

6.2.

User management

User add member to the targeted group

  1. User search for a member

  2. User clicks on the check box for that user

  3. Selection Action Bar shows up and provides options for actions such as "Add to Group" and "Remove from Group."

  4. User choose option “Add to Group”

When user choose targeted group and add member to that group, which is confirmed by green toast message, then on the User Mgmt page, in the Groups column, targeted group is added for that member.

6.3.

User management

User removes member from targeted group

  1. User search for a member

  2. User clicks on the check box for that user

  3. Selection Action Bar shows up and provides options for actions such as "Add to Group" and "Remove from Group."

  4. User choose option “Remove from Group”

When user choose targeted group and remove member from that group, which is confirmed by green toast message, then on the User Mgmt page, in the Groups column, targeted group is no more visible for that member.

SPACE MANAGEMENT

7.1.

Space Management

User creates the Space

  1. User is on the Space Mgmt page and clicks on the button “Create Space“

  2. User provide name for the space, add AI module assistant and define access for the members on that space

Space is successfully created with defined purpose and members.

7.2.

Space Management

User updates the Space

  1. There is already created Space with defined AI module and several members with its access

  2. User changes the name of the Space, changes AI module assistant and add additional member, but removes some members

All new changes/updates are applied and visible in the space and user can operate with newly defined space.

7.3.

Space Management

User deletes the Space

  1. There is already created Space with defined AI module and several members with its access

  2. User press “Delete” button (trash icon)

Space is successfully deleted.

APPS

8.1.

Apps

User creates an App via Apps section

  1. User clicks on the Create button (“+“ button)

  2. Add name and description of the app

  3. User clicks on “Save“ button

App is successfully created and visible in the App section under defined name.

8.2.

Apps

User creates an App via “Personal API key“ option

  1. User is on the user profile menu

  2. In the Personal API key section user generates API key

API key/App ID is shown in the Apps with information about it creation/expiration.

8.3.

Apps

User edits existing App

  1. There is already created App in the section Apps

  2. User enters it, make desired changes clicking on the button “Edit“

All new changes/updates are applied and visible in the app and user can operate with newly defined app.

8.4.

Apps

User deletes existing App

  1. There is already created App in the section Apps

  2. Via “Delete” button (trash icon) user deletes app

App is no longer available in the Apps section

AI MODULE TEMPLATES

9.1.

AI Module Templates

User creates custom AI Module

  1. User is on the AI Module Templates Section

  2. After clicking on the button “New AI Module“, user provides name for the module, choose Reference in code, check label for Custom Module, define Configuration and Definition and provides Weight

After clicking on the button “Create“, AI Module Template is successfully generated and available in the AI Module Templates section.

9.2.

AI Module Templates

User updates existing AI Module

  1. There is already created AI Module Template

  2. User starts entering changes for name, Reference in the code, Configuration and Definition and new Weight is provided

After clicking on the button “Save changes“, all changes/updates are applied and visible and user can operate with newly defined AI module.

9.3.

AI Module Templates

User deletes existing AI Module

  1. There is already created AI Module Template

  2. User clicks on “Delete“ button

AI module is successfully deleted and not available in the AI Module Templates section anymore.

Last updated