Skip to main content

How-to: Monitor AI Agent Jobs

Learn how to use the Jobs page to track real-time AI activity. This guide explains how to monitor test automation generation, verify context synchronization, and identify specific file failures through the new sync warnings feature.

Updated today

The Jobs page in SQAI is your central hub for monitoring the real-time activity of automated tasks. It provides a transparent view into how AI agents are processing information and the status of your data synchronization.


Understanding the Jobs Overview

The Jobs page displays a list of all historical and active background tasks. Each entry allows you to verify at a glance if your operations are running smoothly:

  • Job Name: Identifies the specific operation, such as "Generate Test Automation" or "Sync Sharepoint to Vector Store".

  • Date Started/Ended: Provides a precise timestamp for when the AI agent began and finished its task.

  • Status: Indicates the current state of the job (e.g., SUCCEEDED, FAILED, or IN PROGRESS).


Tracking AI Agent Progress

When you initiate a complex task like generating code from a test case, SQAI launches a series of sequential sub-tasks. By clicking on an individual job, you can expand its details to see exactly what the AI agent is doing:

  1. Start Task Execution Container: The environment is prepared to handle your request.

  2. Information Extraction: The agent identifies your framework (e.g., Robot Framework) and analyzes existing repository patterns for reference.

  3. Code Generation & Pull Requests: The final step where the AI generates the code and pushes it to your linked repository, explaining the AI Agents thoughts and decisions throughout the process.


Monitoring Context Sync Status

To ensure your AI agents have the most up-to-date information, SQAI must synchronize external documentation (like SharePoint or Azure Wikis) into its internal Vector Store. The Jobs page allows you to verify this sync status:

  • Create Vector Store Index: Ensures the storage structure is ready.

  • Synchronize Documentation: Tracks the actual movement and processing of data from your documentation tools into SQAI's memory.

If a sync fails, the Jobs page will highlight where the process stopped, allowing for quick troubleshooting of your integration connections.

Sync Warnings

Sometimes a sync job will finish as SUCCEEDED WITH WARNINGS. This means the overall sync was successful, but specific files failed to process. A Warnings box at the bottom of the job details will list these problematic files, such as corrupted Excel spreadsheets or unsupported formats, so you can easily identify and fix them in SharePoint.
​

image


Summary Table: Common Job Types

Job Name

Primary Purpose

Generate Test Automation

Converting manual test cases into executable scripts.

Sync [Tool] to Vector Store

Updating SQAI's knowledge base with the latest documents.

Did this answer your question?