Mage
Mage is Open-source data pipeline tool, used for Data Collection . Mage is an open source tool for building and managing data pipelines and machine learning workflows.
Prepare
When referring to this document to use Mage, please read and ensure the following points:
-
This application is installed by Websoft9 console.
-
Please check the application's usage license agreement to ensure compliance.
-
Configure the domain name or server security group opens external network ports for application access.
Getting started
Initial setup
- When completing the installation of Mage in the Websoft9 Console, get the applicaiton's Overview and Access information from My Apps
Run pipelines
The following is how to run pipelines by migrating MySQL data tables:
-
Prepare two databases: the source database and the target database.
-
Click New Pipelines > Data Integration, enter a name and create the pipeline.
-
Choose Select Source, select "MySQL", fill in the original database information in Configuration (Click Test Connection to verify the database information).
-
**Select the table you want to migrate.
-
Select destination select "MySQL", fill in the destination database information in Configuration (Click Test Connection to verify the database information).
-
Click on the left menu Triggers > Run@once > Run now, the corresponding table will be imported into the target database after execution.
Configuration options
- Multilingual (×)