Manage the catalog

In Insights, the catalog is your central hub for all metadata from your connected data sources. Data sources can either be an Atlassian app or tool, such as Atlassian Data Lake or Teamwork Graph, or a third-party data warehouse, such as Databricks or BigQuery. Once a data source is connected, its metadata populates the catalog, making it ready for organization and teams to search and use.

Read how to connect a data source

In addition to schema and table metadata, the catalog stores the lineage of each catalog item. The lineage provides details of where the data comes from and how it is being used. This information can help you identify a table's upstream and downstream dependencies. When you connect a data source to Insights, lineage is automatically generated from SQL queries, such as:

• CREATE_TABLE_AS_SELECT

• CREATE_VIEW

• MERGE

• JOIN

View catalog items

Once you’ve connected to a data source, you can view the metadata from the data source in Insights.

To view your catalog items, select Catalog from the sidebar. Based on the data sources connected, you’ll be able to browse and select metadata from each data source.

To view catalog items in detail:

1. Select Catalog from the sidebar.

2. Select View all catalog items.

3. Select the catalog item you want to explore further.

4. Select Schema and Table tabs to view schemas and tables within a catalog item.

5. When viewing a table, you can select:

   1. Columns: To view the columns within a table.

   2. Lineage: To view where the data comes from and how it is being used.

   3. Preview: To see a preview of the data.

   4. Usage: To view details on where the data is being used.

   5. Documentation: To make notes about the catalog item.

Create descriptions for catalog items

You can create descriptions for catalog items either by manually adding one or generating one through Rovo. To do this:

1. Select Catalog from the sidebar.

2. Select View all catalog items.

3. Select the catalog item you want to add a description to.

4. In the Add description section, type in a description or hit tab on your keyboard to generate a description through Rovo. Generating a description through Rovo will also help Insights quickly build context for the catalog item.

Export catalog items

To export catalog items as a CSV:

1. Select Catalog from the sidebar.

2. Select View all catalog items.

3. Select the catalog item you want to export.

4. Select More actions (⋯) above a table or schema and select Export page as CSV.

Manage resource details

Admins can manage the details of a catalog item, including properties and related resources. To edit resource details:

1. Select Catalog from the sidebar.

2. Select View all catalog items.

3. Select the catalog item you want to edit, and select Show details (ⓘ). Here, you can add properties, such as owners and tags, related resources, and view metadata details.