• Get started
  • Documentation

Metadata collected from third-party data sources

This page provides information about the metadata that is collected when you connect to different third-party data sources. Read how to connect to a data source

Under Data context, select Catalog to see the third-party data sources you’ve connected to and the metadata that is collected.

Airflow

Metadata

Details

DAGs

  • Name

  • Description

  • Owners

  • URL

  • Runs

    • Name (ID of the Run)

    • Status

    • Created At (Timestamp)

    • Ended At (Timestamp)

Tasks

  • Name

  • Description

  • Started At (Timestamp)

  • Ended At (Timestamp)

BigQuery

Metadata

Details

Tables/Views

  • Name

  • Description

  • Last Updated Timestamp

  • Schema

  • Database

  • Frequent users

  • Policy tags

  • Labels

Fields (Referred to as Columns in Insights)

  • Name

  • Description

  • Type

  • Foreign Key

  • Primary Key

  • Policy tags

  • Labels

Stored procedures

 

Queries

 

Lineage

  • BQ Column <-> BQ Column

  • BQ Table <-> BQ Table

  • BQ Column <-> BQ View

  • BQ Table <-> Tables from other sources

  • BQ Table <-> Dashboards from other sources

  • BQ Table, Views <-> Runs from other sources

Preview of first 50 rows (Optional)

 

Databricks

Metadata

Details

Jobs

  • Title

  • URL

  • Job Runs

    • Status

    • Started at timestamp

    • Finished at timestamp

    • Error

Dashboard

  • Title

  • Description

  • Last updated at timestamp

  • External usage (Number of Views)

  • Owners

  • URL

Table

  • Title

  • Description

Columns

  • Title

  • Description

  • Type

Lineage via Unity Catalog

  • Databricks Table <-> Databricks Table

  • Databricks Column <-> Databricks Column

  • Databricks Table <-> Tables from other sources

Preview of first 50 rows (Optional)

 

dbt Cloud

dbt is a secondary integration that adds additional metadata on to your data warehouse or relational database tables. Before connecting dbt make sure to connect a data warehouse or relational database first. These include Snowflake, BigQuery, Postgres, Redshift, etc.

Metadata

Details

Models Metadata

  • Description

  • URL

  • Compiled SQL

  • Updated Time

Columns Metadata

  • Description

  • Tags

  • Updated Time

Tests

  • Name

  • Description

  • URL

  • Tags

  • Status

  • Error

  • Compiled code

Jobs

  • Name

  • URL

  • Job Runs

    • Status

    • Start Time

    • End Time

Metrics (Referred to as Glossary terms in Insights) on dbt v1.5 or less:

  • Name

  • Type

  • Dimensions

  • Time Grains

Lineage

  • dbt Jobs <-> external Tables

  • dbt Exposures <-> external Tables

Groups (Groups are referred to as USER_GROUPS in Insights)

 

Contracts (dbt Contracts are referred to as TEST in Insights)

 

Exposures

  • Type: dashboard, notebook, analysis, ml, or application

  • Name

  • Description

  • Tags

  • Owner

  • URL

Monitors

 

dbt Core

dbt is a secondary integration that adds additional metadata on to your data warehouse or relational database tables. Before connecting dbt make sure to connect a data warehouse or relational database first. These include Snowflake, BigQuery, Postgres, Redshift, etc.

Metadata

Details

Models

  • Description

  • URL

  • Compiled SQL

Columns

  • Description

  • Tags

  • Updated Time

Tests

  • Name

  • Description

  • URL

  • Tags

  • Status

  • Error

  • Compiled code

Metrics (Referred to as Glossary terms in Insights) on dbt v1.5 or less

  • Name

  • Type

  • Dimensions

  • Time Grains

Lineage

  • dbt Jobs <-> external Tables

  • dbt Exposures <-> external Tables

Groups (Groups are referred to as USER_GROUPS in Insights)

 

Contracts (dbt Contracts are referred to as TEST in Insights)

 

Exposures

  • name

  • description

  • tags

  • owners (from meta.owner)

  • url

  • type

    • The exposure type can be a dashboard, notebook, analysis, ml, or application

  • depends_on

Monitors

 

Fivetran

Metadata

Details

Jobs

  • Name

  • Description

  • Owners

  • URL

Lineage

  • Fivetran Jobs <-> Tables, Dashboards from other sources

Glue

Metadata

Details

Tables/Views

  • Name

  • Description

  • Last Updated Timestamp

  • Usage (Popularity)

  • Schema

  • Database

Columns

  • Name

  • Description

  • Type

Lineage

  • Glue Table <-> Glue Table

  • Glue Query <-> Glue Table

  • Glue Query <-> Tables, Dashboards from other sources

Google sheets

Metadata

Details

Tables

  • Name

  • Description

  • Columns

Looker

Metadata

Details

Dashboard

  • Name

  • Description

  • Tags

  • Last Updated Timestamp

  • External Usage

  • Folder

Look

  • Name

  • Description

  • URL

  • Folder

Explores

  • Name

  • Description

  • Tags

  • Fields (including Dimensions and Measures)

    • Description

    • Tags

    • SQL

Views

  • Name

  • Description

  • Tags

  • Dimensions

    • Description

    • Tags

    • SQL

  • Measures

    • Description

    • Tags

    • SQL

Lineage

  • Looker Dashboard -> Looker Look

  • Looker Explore <-> Looker Look

  • Looker View <-> Looker Explore (including the Field level relationships)

  • Looker Views and Fields <-> Tables and Columns from other sources

Microsoft SQL server

Metadata

Details

Tables and Views

  • Name

  • Description

  • Schema

  • Database

Columns

  • Name

  • Description

  • Type

  • Sort Order

  • Foreign Key

  • Primary Key

Column Profile

  • Min

  • Max

  • Median

  • STD Deviation

  • Value Distribution

  • Statistic Value Count

  • Percent Filled

  • Unique

MS SQL Stored Procedures

  • Creates lineage between the tables that are in the stored procedure

  • Adds the stored procedure under the Queries tab of the associated tables

Lineage

  • MS SQL Table <-> MS SQL Table

  • MS SQL Column <-> MS SQL Column

  • MS SQL Column <-> MS SQL View

  • MS SQL Table <-> MS SQL Table

  • MS SQL Table/View <-> Tables from other sources

  • MS SQL Table/View <-> Dashboards from other sources

  • MS SQL Table/View <-> Jobs from other sources

Preview on first 50 rows (Optional)

 

MySQL

Metadata

Details

Tables and Views

  • Name

  • Description

  • Schema

  • Database

Columns

  • Name

  • Description

  • Type

  • Sort Order

  • Foreign Key

  • Primary Key

Lineage

  • MySQL Table <-> MySQL Table

  • MySQL Column <-> MySQL Column

  • MySQL Column <-> MySQL View

  • MySQL Table <-> MySQL Table

  • MySQL Table/View <-> Tables from other sources

  • MySQL Table/View <-> Dashboards from other sources

  • MySQL Table/View <-> Jobs from other sources

Preview on first 50 rows (Optional)

 

Oracle

Metadata

Details

Tables

  • Name

  • Description

  • Schema

  • Database

Columns

  • Name

  • Description

  • Type

  • Sort Order

  • Foreign Key

  • Primary Key

Lineage

  • Oracle Table <-> Oracle Table

  • Oracle Column <-> Oracle Column

  • Oracle Table <-> Tables from other sources

  • Oracle Table <-> Dashboards from other sources

  • Oracle Table <-> Jobs from other sources

Preview on first 50 rows (Optional)

 

Postgres

Metadata

Details

Tables and Views

  • Name

  • Description

  • Last Updated Timestamp

  • Schema

  • Database

View Definition (Table Creation Query)

 

Columns

  • Name

  • Description

  • Type

  • Foreign Key

  • Primary Key

Lineage

  • Postgres Table <-> Postgres Table

  • Postgres View <-> Postgres Table

  • Postgres View <-> Postgres Column

  • Postgres Column <-> Postgres Column

  • Postgres Table/View <-> Tables from other sources

  • Postgres Table/View <-> Dashboards from other sources

  • Postgres Table/View <-> Jobs from other sources

Preview of first 50 rows (Optional)

 

PowerBI

Metadata

Details

Groups

  • Name

Reports

  • Name

  • Description

  • Owners

  • Usage (Number of views in PowerBI)

  • URL

  • Tags

  • Preview

Tiles

  • Name

  • Description

  • Owners

  • URL

  • Tags

Pages

  • Name

  • Tags

Datasets

  • Name

Tables

  • Name

  • Tags

Measures

  • Name

Dashboards

  • Name

  • Description

  • Owners

  • URL

  • Tags

  • Preview

DAX

 

Dataflows

  • Name

  • Description

  • Owner

Charts

  • Page Name

Lineage

  • PowerBI Table <-> PowerBI Report

  • PowerBI Tile <-> PowerBI Dashboard

  • PowerBI Tile <-> PowerBI Report

Quicksight

Metadata

Details

Analyses

  • Analysis Name

  • Analysis Last Updated At

  • Analysis URL

Sheets

  • Sheet Name

  • Sheet URL

Datasets

  • Dataset Name

Columns

  • Column Name

  • Column Type

Dashboards

  • Dashboard Name

  • Dashboard Last Updated At

  • Dashboard URL

Lineage

  • QuickSight Dataset <-> QuickSight Analysis

  • QuickSight Sheet <-> QuickSight Analysis

  • QuickSight Dashboard <-> QuickSight Analysis

  • QuickSight Dataset <-> Tables from other sources

Redshift

Metadata

Details

Tables

  • Name

  • Description

  • Schema

  • Database

  • External Usage (Popularity)

  • External Updated At

Views

  • Name

  • Description

  • Schema

  • Database

  • External Usage (Popularity)

  • External Updated At

Columns

  • Name

  • Description

  • Type

  • Foreign Key

  • Primary Key

Lineage

  • Redshift Column <-> Redshift Column

  • Redshift View <-> Redshift View

  • Redshift Table <-> Redshift Table

  • Redshift Table <-> Redshift View

  • Redshift Table <-> Dashboards from other sources

  • Redshift Table <-> Tables from other sources

  • Redshift Table, Views <-> Jobs from other sources

Preview of first 50 rows (Optional)

 

Snowflake

Metadata

Details

Tables

  • Name

  • Description

  • Last Updated Timestamp

  • External Usage (Popularity)

  • Schema

  • Database

  • Frequent Users

  • Tags

Views

  • Name

  • Description

  • Last Updated Timestamp

  • External Usage

  • Schema

  • Database

  • Frequent Users

  • Tags

Columns

  • Name

  • Description

  • Type

  • Foreign Key

  • Primary Key

  • Tags

Creation Query

 

Common Queries

 

Lineage

  • Snowflake Column <-> Snowflake Column

  • Snowflake Table <-> Snowflake Table

  • Snowflake Table <-> Dashboards from other sources

  • Snowflake Table <-> Jobs from other sources

  • Snowflake Column <-> Snowflake View

  • Snowflake Table <-> Snowflake View

Streamlit

  • Name

  • Comment

  • Url

Preview of first 50 rows (Optional)

 

Tableau

Metadata

Details

Published Data sources

  • Name

  • Description

  • Columns

  • Owners

Embedded Data sources

  • Name

  • Columns

  • Owners

Workbooks

  • Name

  • Description

  • Owners

  • URL

  • Updated At

  • Number of Views

Dashboard

  • Name

  • Description

  • Owners

  • URL

  • Updated At

  • Number of Views

Sheets

  • Name

  • URL

  • Owners

  • Number of Views

Fields

  • Name

  • Description

  • Type

Custom SQL Table

 

Lineage

  • Tableau Datasources <-> Tables from other sources

  • Tableau Fields <-> Columns from other sources

  • Tableau Datasources <-> Tableau Workbooks

  • Tableau Workbooks <-> Tableau Sheets

  • Tableau Dashboards <-> Tableau Sheets

  • Tableau Workbooks <-> Tableau Dashboards

 

Still need help?

The Atlassian Community is here for you.
Ask the Community
On this pageAirflowBigQueryDatabricksdbt Clouddbt CoreFivetranGlueGoogle sheetsLookerMicrosoft SQL serverMySQLOraclePostgresPowerBIQuicksightRedshiftSnowflakeTableau
CommunityQuestions, discussions, and articles