sqlflow_public

History

j 979e222e68 first commit		2024-10-23 17:52:59 +08:00
..
grabit-mysql-1.png	first commit	2024-10-23 17:52:59 +08:00
grabit-mysql-2-database.png	first commit	2024-10-23 17:52:59 +08:00
grabit-mysql-3-database-parameters.png	first commit	2024-10-23 17:52:59 +08:00
grabit-mysql-4-sqlflow.png	first commit	2024-10-23 17:52:59 +08:00
grabit-mysql-5-sqlflow-result.png	first commit	2024-10-23 17:52:59 +08:00
grabit-mysql-6-data-lineage-result.png	first commit	2024-10-23 17:52:59 +08:00
grabit-mysql-command-line.md	first commit	2024-10-23 17:52:59 +08:00
readme.md	first commit	2024-10-23 17:52:59 +08:00

readme.md

Automated data lineage from MySQL (GUI Mode)

This article introduces how to discover the data lineage from MySQL scripts or the MySQL database and automatically update it. So the business users and developers can see the MySQL data lineage graph instantly.

Software used in this solution

SQLFlow Cloud Or SQLFlow on-premise version
Grabit tool for SQLFlow. It's free.

Install grabit tool

After download grabit tool, please check this article to see how to setup the grabit tool.

Discover data lineage in a MySQL database

After start up the grabit tool, this is the first UI. Click the database button.

Select mysql in the list

Set the database parameters. In this example, we only discover the data lineage in employees database.

note

1.The Database parameter is optional.

2.When the ExtractedDBSSchemas and ExcludedDBSSchemas parameters are null, all data for all databases is retrieved by default.

3.If you just want to get all the data in the specified database, you can use the following configuration to achieve this: ExtractedDBSSchemas: db/*.

After grabbing the metadata from the MySQL database, connect to the SQLFlow server. It would help if you had a premium account to access the SQLFlow Cloud.

Submit the database metadata to the SQLFlow server and get the data lineage
Check out the diagram via this url: https://sqlflow.gudusoft.com/#/job/latest

You may save the data lineage in JSON/CSV/GRAPHML format

The file will be saved under data\datalineage directory.

Further information

This tutorial illustrates how to discover the data lineage of a MySQL database in the grabit UI mode, If you like to automated the data lineage discovery, you may use the Grabit command line mode.

Discover MySQL data lineage in command line mode

This tutorial illustrates how to discover the data lineage of a MySQL database by submitting the database metadata to the SQLFlow Cloud version, You may set up the SQLFlow on-premise version on your server to secure your information.

For more options of the grabit tool, please check this page.

Grabit tool readme

The completed guide of SQLFlow UI

How to use SQLFlow