Starting to Transfer Data from Postgres Database
Let's create a integration (Data Connector)
In Integration Page, you need to select data source type that will be used for transfering data.
In this case you choose Postgres Database.
.
Provide Credentials, the username and password will be stored into internal database
Once the integration done, you can start to create features of tool.
Start to create a job to transfer data from Postgres Database to other Postgres Database
In Transfer Data Page, you can create a job with existing data source integrated from first part.
Parameters to trasfer data:
- sourceType: Using Postgres Database
- targetType: Using Postgres Database
- sourceSchema: Postgres Database Schema (public)
- targetSchema: Postgres Database Schema (your own schema)
- tableName: exact table name
- chunkSize: split data in chunks when loading data to avoid database corrupted
- loadType: in order to capture the right data, keep data consistency with
Full Load
andIncremental Load
to load data. WithIncremental Load
will has to provide the delta column to identify the delta data. - scheduledDate: combine with
isScheduled
to automatic load data by daily, weekly, monthly. - isTruncated: has to be chosen with
loadType
to avoid duplicated data in target table.
With the following parameters above, we setup the transfer and schedule data transfer. .
That's it !!! You have setup the connection and transferred your data.