sqlflow_public/databases/netezza/grabit-netezza-command-line.md

Automated data lineage from Netezza (Command Line Mode)

This article introduces how to discover the data lineage from netezza scripts or the netezza database and automatically update it. So the business users and developers can see the netezza data lineage graph instantly.

Software used in this solution

• SQLFlow Cloud Or SQLFlow on-premise version
• Grabit tool for SQLFlow. It's free.

Install grabit tool

After download grabit tool, please check this article to see how to setup the grabit tool.

Discover data lineage in a Netezza database

• Modify the conf-template\netezza-config-template to meet your environment.

Here is a sample config file: netezza-config that grabs metadata from the remote netezza database and sends the metadata to the SQLFlow Cloud to discover the data lineage.

It would help if you had a premium account to access the SQLFlow Cloud.

{
    "databaseType":"netezza",
    "optionType":1,
    "resultType":1,
    "databaseServer":{
        "hostname":"netezza ip address",
        "port":"5480",
        "username":"netezza user name",
        "password":"your password here",
        "database":"MY",
        "extractedDbsSchemas":"",
        "excludedDbsSchemas":"",
        "extractedStoredProcedures":"",
        "extractedViews":"",
        "enableQueryHistory":false,
        "queryHistoryBlockOfTimeInMinutes":30
    },
    "SQLFlowServer":{
        "server":"https://api.gudusoft.com",
        "serverPort":"",
        "userId":"your sqlflow premium account id",
        "userSecret":"your sqlflow premium account secret code"
    },
    "neo4jConnection":{
        "url":"",
        "username":"",
        "password":""
    },
    "isUploadNeo4j":0
}

• Run grabit command-line tool, you may find the grabit.log under the logs directory.

./start.sh /f netezza-config

• Check out the diagram via this url: https://sqlflow.gudusoft.com/#/job/latest

• You may save the data lineage in JSON/CSV/GRAPHML format.

  The file will be saved under data\datalineage directory.

• Run the grabit at a scheduled time

  Please check the instructions here