Fetching data

Data Manager is included in all Service Collection Premium and Enterprise plans.

You must have Data Manager admin and Adapter admin permissions to complete the tasks on this page.

Data sources are configured in the Data Manager UI, but run on your local instance using the Adapters client. Fetching your data source moves data into Data Manager as raw data.

You can:

  • fetch your data manually from the command line, or

  • schedule it using a tool such as Windows Task Scheduler or cron.

Each data source:

  • targets a single tool

  • includes configuration options, transforms, and functions

  • can be run multiple times

After a fetch is run, data appears as raw data in Data Manager. Fetch history is visible under Data Manager > Object classes > … > Audit logs.

When a data source names contain spaces, use standard double quotes " in the command line (avoid “smart quotes”).

Prerequisites

Before running the Adapters client, you must:

  • create a data source (from CSV, SQL, or a third‑party tool)

  • create an Adapters client token

  • record your Workspace ID

Fetching using the Adapters client (macOS)

  1. Open Terminal (Applications > Utilities > Terminal).

  2. Collect three items:

    • Workspace ID (for example, e44regc98-8d2r-3af7-011t-209p44716366)

    • Adapters token

    • Data source name (wrap in double quotes if it contains spaces)

  3. Navigate to the Data Manager clients:

    cd /Users/Shared/assets_data_manager
  4. Choose the correct client version:

    cd osx-arm64/assets-adapters-client # or cd osx-x64/assets-adapters-client
  5. Fetch the data:

    ./dm-adapters --run "<myJobName>" --workspace-id <workspaceId> --token <your-Adapters-token>

A success message indicates completion and lists any errors.

Fetching using the Adapters client (Windows)

  1. Open an elevated Command Prompt or Windows Terminal (Ctrl + Shift + Enter).

  2. Collect Workspace ID, Adapters token, and Data source name (quote if it contains spaces).

  3. Navigate to the Data Manager clients:

    cd c:\users\public\assets_data_manager
  4. Choose client version:

    cd win-x64\assets-adapters-client rem or cd win-x86\assets-adapters-client
  5. Fetch the data:

    dm-adapters.exe --run "<myJobName>" --workspace-id "<workspaceId>" --token "<your-Adapters-token>"

Fetching using the Adapters client (Linux)

  1. Open Terminal (for example, Ctrl + Alt + T).

  2. Collect Workspace ID, Adapters token, and Data source name.

  3. Navigate to the Data Manager clients:

    cd /Users/Shared/assets_data_manager
  4. Choose client version:

    cd linux-arm64/assets-adapters-client # or cd linux-x64/assets-adapters-client
  5. Fetch the data:

    ./dm-adapters --run "<myJobName>" --workspace-id <workspaceId> --token <your-Adapters-token>

Command‑line errors

Common errors and causes:

  • Error in line 1: Cannot find column 'cpu' in the Column Mappings.

    • Column name is incorrect, or

    • The data source column name includes spaces or differs from the mapping.

  • Line 280: The column count is not correct.

    • Number of column mappings doesn’t match the number of columns, or

    • Qualifier character is not configured but values contain delimiters.

  • Column 'whenCreated', date value '20/04/2009 1:47' cannot be converted to 'd/MM/yyyy HH:mm (8/02/2006 06:30).'

    • Date mask does not match the data format.

The Adapters client will also indicate if a newer client version is available or if the version in use has be obsoleted.

Still need help?

The Atlassian Community is here for you.