Agent activity

Connect lets you view various processing activities performed by the installed agents. You can review the state of processing and gain insight for any issues that have been encountered.

NOTE: If you have created API-based custom actions, these actions are not tracked on the agent activity page.

In addition to basic information about each activity, you can see the source or dataset the activity was performed against, the cluster for the agent that performed the activity, the number of documents (extracted attachments are not included in the count) or tables processed, and the status of the activity. If the activity, such as a hold or collection from a workspace, spans multiple datasets, the activity can be expanded in the list to view information about the individual datasets involved in the activity.

From the agent activity list, click a source (structured data) or dataset (unstructured data) name to go to the Manage Sources or Manage Datasets page with the source or dataset highlighted and the detail panel open. Click an agent cluster name to go to the Agent Clusters page with the cluster highlighted and the detail panel open. For an activity that completed with errors, click the "completed with errors" link to view the Activity error details. For a scan activity that "completed with errors" or "completed with ingestion errors", you can retry the activity.

If needed, you can cancel an in-progress file analysis activity. Processing is completed for any data items already in progress; the action is canceled for all remaining data items. File analysis actions include system file analysis actions such as a re-scan as a result of a grammar change to dataset or a dataset processing change from metadata-only to analyzed scan, as well as File Analysis actions taken from the ACTIVITY tab of a workbook detail panel.

You can view detailed information in the agent activity detail panel (open detail panel icon). In addition to what is available in the activity list, you can see the following activity information in the detail panel.

  • View the details of the selected agent activity, including the dataset and source against which the activity was initiated, job run ID, the user that initiated the activity, the agent cluster responsible for the activity, and the activity start time and status.

    The user defined for Initiated By is either the name of the Fusion user, system, or scheduled.

  • The ACTIVITY defines the tasks that were performed as part of the activity. Each task includes the name of the agent that performed that task, the number of documents processed, the time the task started, and the status of the task. If applicable, you can also see the number of documents no longer at the source location (documents have been deleted from the source since the last scan).

    Large tasks are typically be broken down into multiple work units and potentially distributed to several agents (within the cluster) to be performed in parallel, for greater efficiency. For these tasks, review the Work unit summary chart for an overview. Click VIEW DETAIL to open a pop-up window with the work unit details.

    In the work unit detail window, you can do the following.

    • Filter by agent.

    • Sort by work unit id or by duration (amount of time taken to completed the work unit for the task). The default sort is by work unit it, in descending order.

    • View work units that are currently processing, have errors, are completed, are ready (waiting for the agent to be available), are preparing, or have been canceled.

      If errors occur during processing, these errors will display on the ERRORS tab while processing continues.

    • Click the agent name to go to the Agent Clusters page with the agent highlighted and the detail panel open.

    • If an activity, task, or work unit completed with errors, click the "completed with errors" link to view the Activity error details.

  • For activities on unstructured datasets, click VIEW CONTENTS to go to the Research page in Analyze to view the list of documents against which the activity was performed. On the Research page, the Job run ID for the activity shows in the VIEWING CONTENT OF box above the filter panel.

Filter activity events

Use the filter panel to refine the list of datasets associated with agent activity events. As you add criteria to the filter, the list of datasets dynamically updates. The criteria you specifically select are shown at the top of the filter panel. Click the remove icon next to the selected criterion to remove it from the filter. Click the clear all icon (clear filter) to remove all of the selected criteria and return to the full list of datasets.

If you make no selections in the filter panel, all activity events for all datasets are returned. When you select filter criteria, the dataset list is limited based only on what is selected. When multiple selections are made within a single filter category (agent Status, Dataset Type, and so on), the item can match any of the criteria in that category. When selections are made across multiple filter categories, the dataset must match all the categories selected.

Activity error details

During processing, errors may occur and you will need to investigate. You can use the error details accessible on the Agent Activity page to narrow down the issue. When an activity completes with errors, you can click the "Completed with errors" link to view the activity error details. The activity error details include the error message, error type, agent that performed the action, job/work unit ID, count, and date and time the error occurred. The job/work unit ID value is the dataset name followed by an underscore and the work unit ID. The count is the number of items in the work unit. Use the ERROR TYPE filter above the error list to show either the ingestion errors or the processing errors.

The error message reflects the error reported in the Fusion log files. You can use the work unit ID and the time stamp to assist in locating the appropriate log file and error the agent identified. Click the copy icon (copy icon) to copy the error message to use as needed.

Retry scan activity

For scan activities that failed with errors or ingestion errors you can trigger the activity to rerun an additional time—only one retry per failed scan activity is allowed. When you retry a scan activity that "completed with errors" or "completed with ingestion errors", Fusion runs the scan activity again for only the data that failed.

NOTE: You can retry activities that are of the type "scan" and status "completed with errors" and "completed with ingestion errors".