Skip to content

Latest commit

 

History

History
57 lines (40 loc) · 1.39 KB

migration.md

File metadata and controls

57 lines (40 loc) · 1.39 KB

Migrate structures

  • Database: MySQL, PG.
  • Migrated Objects: database(mysql), schema(pg), table, comment, index, sequence(pg), constraints.

Example: MySQL -> MySQL

Refer to task templates and tutorial

Note

Structure migration is executed serially in a single thread. Notice the following configurations:

[extractor]
extract_type=struct

[sinker]
sink_type=struct
batch_size=1

[parallelizer]
parallel_type=serial
parallel_size=1

Failure strategy: interrupt(default), ignore.

  • interrupt: If a particular migration fails, the entire task will be terminated immediately.

  • ignore: If a migration fails, it will not affect the migration of other schemas, and the process will continue. However, the failure will be logged as an error.

[sinker]
conflict_policy=interrupt

Phased migration

In a complete data migration process that includes both structure migration and data migration, the task will be divided into three stages in order to accelerate data migration:

  1. Migrate table structures + primary/unique keys ( necessities for data migration);
  2. Data migration;
  3. Migrate indexes + constraints.

Thus, we offer 2 types of filtering:

Migrate table structures + primary/unique keys

[filter]
do_structures=database,table

Migrate indexes and constraints

[filter]
do_structures=constraint,index