Skip to content

Updated Analyzer & Generator Agents #884

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
bharathk08 merged 3 commits into from
Dec 17, 2025
Merged

Updated Analyzer & Generator Agents #884

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
7d8f54d
Updated Analyzer & Generator Agents
bharathk08 Dec 17, 2025
f080f85
Update generator.md
bharathk08 Dec 17, 2025
398e56b
Merge branch 'dev' into DOC-750
bharathk08 Dec 17, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
75 changes: 58 additions & 17 deletions src/pages/docs/ai-agents/analyzer.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,47 +16,88 @@ contextual_links:
name: "Steps to Analyze Step Failures"
url: "#steps-to-analyze-step-failures"
- type: link
name: "Next Steps"
url: "#next-steps"
name: "Apply Fix Using Analyzer Agent"
url: "#apply-fix-using-analyzer-agent"
- type: link
name: "Report a Bug Using Analyzer Agent"
url: "#report-a-bug-using-analyzer-agent"
---

---

The Analyzer Agent in Testsigma is your intelligent assistant that autonomously reviews test executions. With just a single click, Analyzer Agent highlights the error type, pinpoints the root cause, and provides visual evidence captured during execution. It also suggests targeted fixes, ranging from code-level checks to configuration adjustments. This article discusses the Analyzer Agent in Testsigma.
The Analyzer Agent in Testsigma analyzes failed test steps and provides actionable insights. It identifies the error type, determines the root cause, provides visual evidence captured during execution, and suggests possible fixes. This article discusses how to analyze step failures and take action using the Analyzer Agent.

---

> <p id="prerequisites">Prerequisites</p>
>
> Before you begin, ensure that test plans have been executed and at least one test case includes failed steps.
> Before you begin, ensure that:
> 1. At least one test plan has been executed.
> 2. The test plan contains failed test cases.


---

## **Steps to Analyze Step Failures**

1. From the left navigation bar, go to **Run Results**.
1. From the left navigation bar, click **Run Results**.
![Run Results](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Nav_Run_Results_from_Dashboard.png)

2. Select the test plan that contains failed test steps.

3. Open the test case with failures and select the failed test step.

4. In the **Step Details** panel, click **Analyze with Agent**. This will open the **Analyzer Agent** overlay.
![Analyze with Agent](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Analyze_with_Agent_from_Results.png)

5. Wait for the **Analyzer Agent** to complete the analysis.

6. Review the analysis in **Analyzer Agent** overlay, which displays:
![Analysis](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Analysis_from_Analyzer_Agent.png)
- **Error Type**
- **Root Cause**
- **Visual Evidence**
- **Suggested Fixes**

2. Click the test plan that contains failed test steps.
---

## **Apply Fix Using Analyzer Agent**

1. From the **Analyzer Agent** overlay, select the fix you want to apply.
![Select Fix](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Select_Fix_Option.png)

2. Click **Apply Fix**.
![Apply Fix](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Apply_fix_from_Agent_Suggestion.png)

3. Click on the test case with failures and select the failed test step.
3. Wait for the **Analyzer Agent** to generate the required fix.

4. In the **Step Details** section, click **Analyze with Agent**.
![Analyze with Agent](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Atto_Testsigma/Analyze_Agent.png)
4. Click **Add Step**, **Update Step**, or **Update Step Settings**, as suggested by the **Analyzer Agent**.
![Update as per suggestion](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Update_Add_Step_Setting.png)

5. Wait for the **Analyzer Agent** to complete its review.
5. Verify that the changes are applied to the test step.
![Verify the changes](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Verify_the_Updated_Test_Step_from_Atto.png)

6. The overlay will display the **Error Type, Root Cause, Visual Evidence**, and **Suggestions**.
![Details from Agent](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Atto_Testsigma/Details_from_AAgent.png)
6. Rerun the test plan to validate the fix.

---

## **Next Steps**
## **Report a Bug Using Analyzer Agent**

1. From the **Analyzer Agent** overlay, click **Report Bug**.
![Report Bug](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Report_Bug_From_Agent.png)

2. Select the bug tracking application from **QA Agent** overlay.
![Select Bug Tracking App](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Select_Bug_Tracking_App_from_Overlay.png)

3. Review the prefilled bug details, such as **Team**, **Project**, and **Title**.
![Review Details](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Review_Prefilled_Bug_Details.png)

1. Click **Deep Analysis** for additional diagnostics.
> The fields displayed vary based on the selected bug tracking tool.

2. Click **Report Bug** to log the issue.
4. Click **Report Bug**.
![Report](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Report_Bug_Button_QA_Agent.png)

3. Click **Fix using Live Editor** to resolve the issue in live.
[[info | **NOTE**:]]
| To link the failure to an existing issue, click **Link to Issue**, search for the issue in the selected bug tracking application, and then click **Link to Ticket**.

![Next Steps](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Atto_Testsigma/Next_Steps_AAgent.png)
---
116 changes: 96 additions & 20 deletions src/pages/docs/ai-agents/generator.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,17 +18,29 @@ contextual_links:
- type: link
name: "Learn the Live Application Using Live Editor"
url: "#learn-the-live-application-using-live-editor"
- type: link
name: "Interactive Actions During Live Learning"
url: "#interactive-actions-during-live-learning"
- type: link
name: "Execute and Save the Test Case"
url: "#execute-and-save-the-test-case"
---

---

The Generator Agent in Testsigma allows you to quickly generate and automate test cases by analyzing application behavior and user workflows. Using generative AI, it converts manual test steps into actionable test steps, significantly simplifying the test authoring process. It supports various input sources for test generation, including Jira, Figma, Xray, video recordings, and files such as images and PDFs. You can use Testsigma Terminal to capture UI elements directly from the application, allowing you to generate fully executable test cases in just a few clicks. This article discusses using Generator Agent to accelerate test automation.
The Generator Agent in Testsigma enables you to generate and automate test cases by analyzing application behavior, user workflows, and supported input sources. It converts manual test steps into executable automated steps using AI, reducing manual effort during test creation.

You can generate test cases from sources such as Jira requirements, files, and prompts, and automate them using Atto’s Live Editor. During live learning, the Generator Agent captures application elements, allows you to record additional manual steps, and provides controls to pause, reset, or stop the learning session.

After automation, you can execute the test case locally, review the generated steps, and save the test case to the test case library. This article describes how to generate, automate, and manage test cases using the Generator Agent and Atto’s Live Editor in Testsigma.

---

> <p id="prerequisites">Prerequisites</p>
>
> Before you begin, ensure **Testsigma Terminal** is installed and the **Live Editor** is ready.
> Before you begin, ensure that:
> 1. Testsigma Terminal is installed.
> 2. Live Editor is ready for use.

---

Expand Down Expand Up @@ -59,43 +71,107 @@ The Generator Agent in Testsigma allows you to quickly generate and automate tes

![Files Input](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/ai_agents/add_files_4.png)

7. In the Prompt box, enter a detailed prompt that describes test cases want to generate and click **Generate with AI**.
7. In the Prompt field, enter a detailed description of the test cases to generate and click **Generate with AI**.
![Prompt](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/ai_agents/add_files_5.png)

8. Wait for Generator Agent to generate multiple test cases are generated based on the selected inputs.
8. Wait for the Generator Agent to generate test cases based on the selected inputs.

---

## **Learn the Live Application Using Live Editor**

1. From the generated test cases list, select a test case.

1. From the generated test cases list, expand a scenario and select a test case. This will open the Test Case Details dialog.
![Expand & Select](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Expand_Scenario_Select_Test.png)

[[info | **NOTE**:]]
| To start automating and interact live with the app, make sure the **Generator (Live App)** toggle is turned on. Go to **Settings > Preferences > Agentic AI > Generator**, and enable the toggle.
| ![Generator toggle](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Atto_Testsigma/Generator_Toggle.png)
| ![Generator toggle](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Atto_Testsigma/Generator_Toggle.png)

2. In the **Test Case Details** dialog, click the **Automated Steps** tab.
![Automated Steps](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Automated_Steps_Tab_Agentic_Learning.png)

2. Hover over **Agentic Learning (Beta)** and select an environment.
![Start Automating](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/ai_agents/learn_live_editor_1.png)
3. Hover over **Agentic Learning (Beta)** and select an environment. This will open Atto’s Live Editor.
![Env for Agentic Learning](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Env_for_Agentic_Learning.png)

3. This opens **Atto’s Live Editor** with the manual steps preloaded.
![Live Editor](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/ai_agents/learn_live_editor_2.png)
4. **Atto’s Live Editor** opens with the manual steps preloaded.

4. Click **Start Learning Live App**.
![Start Learning](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/ai_agents/learn_live_editor_3.png)
5. Click **Start Learning Live App** in **Atto’s Live Editor**.
![Start Learning Live App](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Learning_Live_App_from_Atto.png)

5. A Chrome instance opens, and the **Live Editor** starts learning elements by executing the manual test steps.
6. A Chrome browser opens and the Live Editor starts learning UI elements by executing the manual steps.

6. Once all test steps are executed successfully, click **Start Generating Automated Test Case** to review all the steps with learned elements.
![Start Generating Test Case](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/ai_agents/learn_live_editor_4.png)
7. After all steps execute successfully, click **Start Generating Automated Test Case** to review the learned steps.
![Generated Automated Test Case](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Generate_Automated_Case_from_Atto.png)

[[info | **NOTE**:]]
| You can modify test steps by providing additional inputs if needed.
| You can modify test steps by providing additional inputs if required.

---

## **Interactive Actions During Live Learning**

While Atto is learning application elements, you can control the learning session using the interactive actions available in the Atto’s Live Editor.

### **Reset the Learning Session**

Use Reset to clear all messages and stop the current learning session.
![Reset](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Reset_in_Atto_Learning.png)


**Result:**
- All in-progress actions are cleared.
- The active browser learning session is stopped.

### **Record Manual Steps**
Use Record Manual Steps to manually capture additional steps during the learning session and add them to the existing test case.
![Record Steps Manually](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Record_Steps_In_Atto.png)

**Steps:**

1. In the interactive panel, click **Record Manual Steps**.

2. Perform the required actions manually.

3. Click **Stop Recording**.
![Stop Recording](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Stop_Rec_in_Atto.png)

4. Under **Manual Recorded Steps**, select the steps you want to add.
![Select Steps](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Adding_Manual_Steps_from_Atto.png)

5. From the **Add Step(s) After** dropdown, select the step number.
![Step Number](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Step_Number_to_Add_Steps.png)

6. Click **Add Steps**.
![Add Steps](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Add_Steps_Confirmation_In_Atto.png)

7. The selected steps are added to the test case.
![Steps Added](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Steps_Added_to_Existing_Case.png)

### **Pause or Resume Learning**
1. Click **Pause** to temporarily stop the learning process.
![Pause](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Pause_Icon_In_Atto.png)

2. Click **Play** to resume the learning session.
![Resume](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Play_Icon_In_Atto.png)

### **Stop the Learning Session**

1. Click **Stop** to end the Atto’s learning session.
![Stop Learning](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Stop_Live_Learning_from_Atto.png)

2. This stops the live learning process and closes the active session.

---

## **Execute and Save the Test Case**

7. Click **Run Now** to execute the test case locally.
1. Click **Run Now** on the **Atto’s Live Editor** to execute the test case locally.
![Run Now](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Run_Automated_Case_from_Live_Editor.png)

8. Once the test case executes successfully, click **Accept** to save it to the test case library.
2. After successful execution, click **Accept** to save the test case to the test case library.
![Accept Case](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/Updated_Doc_Images/Accept_Automated_Case_from_Live_Editor.png)

[[info | **NOTE**:]]
| Even if a test case fails, you can accept it and update it later. **Reject** a test case only if it’s completely unrelated or unusable.
| You can accept a test case even if execution fails and update it later. **Reject** a test case only if it is unrelated or unusable.

---