sqlflow_public/doc/readme.md

Gudu SQLFlow Documents

Firstly, use SQLFlow cloud to get the data lineage of your SQL and feel how the data lineage diagram can help you understand the data flow and the data transformation.

Secondly, use Dlineage command line tool to get the data lineage of your SQL in the XML/JSON format and see how the data lineage is organized in the JSON/XML format and start to know various elements and attributes in the data lineage.

Thirdly, check the basic concepts and elements of the data lineage.

Fourthly, check the detailed reference of the data lineage model.

Finally, integrate the SQLFlow Rest API/Java API/Widget into your project and get the data lineage of your SQL in the Rest API/Java/Python code/JavaScript code.

Concepts

• 1. Introduction
• 2. Direct dataflow
• 3. Indirect dataflow and pseudo column
• 4. Indirect dataflow: where clause and group by clause
• 5. Dataflow: column used in aggregate function
• 6. Dataflow chain
• 7. Intermediate result set
• 8. Join relation
• 9. Temporary table
• 10. Transforms

Data lineage model (TODO)

• 1. Introduction
• 2. Detailed reference

The structure and elements of the data lineage result(JSON/XML).

• 1. Introduction
• 2. Detailed reference

SQLFlow widget

• Introduction