Skip to main content

Starting to Transfer Data from Postgres Database

Let's create a integration (Data Connector)

In Integration Page, you need to select data source type that will be used for transfering data.

In this case you choose Postgres Database.

Setup Integration.

Provide Credentials, the username and password will be stored into internal database

Once the integration done, you can start to create features of tool.

Start to create a job to transfer data from Postgres Database to other Postgres Database

In Transfer Data Page, you can create a job with existing data source integrated from first part.

Parameters to trasfer data:

  • sourceType: Using Postgres Database
  • targetType: Using Postgres Database
  • sourceSchema: Postgres Database Schema (public)
  • targetSchema: Postgres Database Schema (your own schema)
  • tableName: exact table name
  • chunkSize: split data in chunks when loading data to avoid database corrupted
  • loadType: in order to capture the right data, keep data consistency with Full Load and Incremental Load to load data. With Incremental Load will has to provide the delta column to identify the delta data.
  • scheduledDate: combine with isScheduled to automatic load data by daily, weekly, monthly.
  • isTruncated: has to be chosen with loadType to avoid duplicated data in target table.

With the following parameters above, we setup the transfer and schedule data transfer. Transfer Data Succeed.

That's it !!! You have setup the connection and transferred your data.