Data Discovery Agent
The Data Discovery Agent is an AI-powered assistant that helps you find and explore your organization's data using plain-English questions. Instead of navigating complex database structures or writing technical queries, you simply type a question, and the agent finds the relevant data for you.
Key Capabilities
Zero-copy federated access - Data stays secure in its original location across multiple environments with no movement or duplication.
Intelligent knowledge graphs - Maps relationships across your entire data landscape, enabling semantic search that understands query meaning and context.
Complete visibility - Shows what data exists, where it lives, and how it connects while maintaining data sovereignty and security.
Discovery-layer architecture - Provides enterprise-scale data intelligence without compromising data integrity or location.
This topic explains how to use the Data Discovery Agent to query a Knowledge Cluster (KC) and review your results.
Important
The Data Discovery Agent allows you to view the source files used to generate the answers, rather than viewing the answers themselves.
To access this feature:
Go to Home page > Data Agent > Data Discovery Agent.
The Data Discovery page opens, and the AI Catalog tab displays all Knowledge Bases, grouped by data type.
Use the data type tabs and Search Box to quickly filter a specific table or file from the list.
To view the full metadata for any table, select it from the list. The Data Visualization page opens and displays the table's detailed metadata.
Create a KC before using the Data Discovery Agent. Refer to Knowledge Clusters for more information.
Click Agent.
The Data Discovery agent interaction panel opens from the left.
From the dropdown, select the KC you want to query.
Important
Only Knowledge Clusters you have already created appear in the dropdown. If the list is empty, create a Knowledge Cluster first. Refer to Knowledge Clusters for more information.
Type your question in natural language.
Example: "Which tables contain customer transaction data from the last quarter?"
Press Enter or click the submit
icon to run the search.The agent searches your selected Knowledge Cluster, retrieves the relevant data, and automatically maps relationships between the matching tables and files.
Click View Result.
The right panel displays filtered relevant information in two tabs.
Results tab - Only the tables and files from the Knowledge Cluster that match your query.
ER Diagram tab - A visual map of the relationships between those tables and files.
Click any table or file in the diagram to see its detailed metadata in the right panel.
Knowledge Clusters
A Knowledge Cluster (KC) is a named grouping within the Data Layer that combines one or more Knowledge Bases (KBs), whether structured, unstructured, or both, into a single, selectable unit. Instead of manually selecting individual KBs each time, you can assign a KC to an agent, granting it unified query access to all included sources in a single step.
To access this feature, go to the Home page > Data Agent > Data Discovery Agent and switch to the Knowledge Clusters tab.
Creating a Knowledge Cluster
Click Add Knowledge Cluster.
The Create Knowledge Cluster page opens.
Enter a Name and Description of the KC.
Click Add Knowledge Base.
The available KBs appear in the right panel.
Search and select the structured and/or unstructured KBs you want to include in the cluster.
Click Add.
The selected KBs are added to the cluster's KB list.
Note
To remove a KB from the list, click the Delete
icon next to it.Click Create.
A success message appears. The new KC is created and available on the Knowledge Cluster page.
Managing a Knowledge Cluster
After you create a KC, you can view and manage its details at any time from the Knowledge Cluster page. Each cluster provides three tabs that give you a complete picture of its setup.
To manage a KC, you have two options:
Click the KC card to access the full details view and navigate between all available sections.
Click the Ellipsis
icon on the KC card and select the option to jump to a specific section within the details page without navigating through the full view.
Note
The Entity-Relationship (ER) Diagram is currently under development and will be available in a future release.
Summary Tab
Use the Summary tab to view all KBs tagged to a KC and explore their metadata. To access the KC summary:
Select Summary from the Ellipsis menu.
The KBs tagged to the cluster are displayed.
Use the filters to find the required KB.
Select a KB to view its metadata. Refer to Viewing Metadata for more information.
Configuration Tab
Use the Configuration tab to review and update a KC's details. To access the KC configuration:
Select Config from the Ellipsis menu.
The cluster configuration is displayed.
Update the configuration as needed.
Click Update to save the changes.
Instructions Tab
The Instructions tab in a KC lets you create and manage instructions (prompts) specific to that KC. These instructions provide the AI with additional context about the KC, such as its purpose, content scope, or preferred response format.
Whenever an agent references this KC, the platform sends both the agent's master prompt and the KC-level instructions to the AI model together. This combined input helps the model generate responses that are more accurate, relevant, and aligned with the KC's content.
You can maintain multiple instruction versions, switch between them, compare different versions, and control which version is active at any time.
Important
Only the active instruction version is used when the agent processes queries against the KC.
Create an Initial Instruction
When you open the Instructions tab for the first time, the instruction text box is empty. Follow these steps to create your first instruction.
Enter your instruction text in the text box.
Select Markdown from the dropdown to render the instruction in Markdown alongside the plain text for quick validation.
After finalizing the instruction, click Update.
The instruction is saved as Version 1 and automatically set as the active instruction.
Create an Instruction Version
You can create additional instruction versions based on any existing version. To create a new instruction version:
Click Add.
The Create New Version window opens.
From the dropdown, select the base version you want to copy from.
To make this new version the active instruction, enable the Make Active option.
Click Create.
The new version is created from the base version you selected.
Edit the instruction in the text box as needed.
Select Markdown from the dropdown to render the instruction in Markdown alongside the plain text for quick validation.
Click Update to save the changes.
Compare Instruction Versions
The platform lets you review Instruction versions side by side, making it easy to spot differences and confirm which version best meets your needs before you activate one.
To compare Instruction versions:
Click Compare.
The Compare Versions window opens, displaying the active version alongside the currently displayed version.
Click the dropdown to switch between versions and compare the instructions.
Click X to close the window.
Set an Instruction Version as Active
Only one instruction version can be active at a time. To change the active version:
From the version dropdown, select the instruction version you want to activate.
Click the Ellipsis
icon next to Add.Note
The dropdown options are disabled for the active instruction version.
From the dropdown, select Mark this Version Active.
The selected version is now set as the active instruction.
View Instruction Audits
The platform keeps a complete history of every change made to a prompt instruction in the KC, including what changed, when it changed, and what events occurred.
To view changes made in the instruction:
Click the Ellipsis
icon next to Add.Click Audits.
The Instruction Audits window opens.
It shows a log of all saved versions of the instruction, along with the changes associated with each.
Select a version from the Version dropdown.
The audit log updates to display the change history for the selected version.
Delete an Instruction Version
Note
You cannot delete the active version. Set a different version as active before deleting.
From the dropdown, select the version you want to remove.
Click the Ellipsis
icon next to Add.From the dropdown, select Delete this Version.
The confirmation dialog box opens.
Click Delete.
The selected instruction version is removed.
Viewing Knowledge Cluster Audits
The Audits tab records all changes to the KC, allowing you to review and validate KC-level modifications. It supports change tracking and validation for administrators and technical users responsible for maintaining the integrity of the KC data source across the platform.
Switch to the Audits tab. It displays a list of all KC-level changes, sorted with the most recent change at the top. Each entry shows the type of change and the date and time it occurred.
Deleting a Knowledge Cluster
Use the Delete option to permanently remove a KC from the list. To remove a KC:
Select Delete from the Ellipsis menu on the card.
A confirmation dialog box opens.
Click Delete.
The KC is removed from the page.
Warning
Deleting a KC is permanent and cannot be undone. Any agents currently using the cluster will lose access to its associated KBs.