Used for setting up a mysql database for nomnom loading and then loading data tables into it.
Initialize a mysql database to allow tracking of loaded data.
Variables
Database where you want to run the script on.
Register a data_table on a mysql database. This allows NomNomData to load the data_table into an initialized database.
Variables
Metadata location your data is coming from. We support a few types and generally companies only have a few of these.
Data table that you want to load into your mysql database. As identified from your metadata catalog.
UUID of the Data table that you want to load into your mysql database. As identified from your metadata catalog.
Database where you want to run the script on.
Table name you want to load into specified via the notation schema_name.table_name. To specify special characters in table name you need to quote the table_name. Note special characters in table names is not recommended.
Load a data_table into a mysql database. Only allowed after a data_table has been registered on an initialized database.
Variables
Metadata location your data is coming from. We support a few types and generally companies only have a few of these.
Data table that you want to load into your mysql database. As identified from your metadata catalog.
UUID of the Data table that you want to load into your mysql database. As identified from your metadata catalog.
Database where you want to run the script on.
Table name you want to load into specified via the notation schema_name.table_name. To specify special characters in table name you need to quote the table_name. Note special characters in table names is not recommended.
AWS Credentials with access to the s3 bucket where the data table lives. Should also have access to a temp directory.
Path to a location where the s3 credentials have write access and read access. Needs to be in the same region/account/bucket where the mysql files live. If left blank the sytem will use the temp path defined in the aws connection if one exists.
RegEx of filter to apply for loading files. Can use <YYYY> sytax to load time ranges for current dates
Verifies registration and load a data_table into a mysql database. Only allowed after a database has been initilized initialized database.
Variables
Metadata location your data is coming from. We support a few types and generally companies only have a few of these.
Data table that you want to load into your mysql database. As identified from your metadata catalog.
UUID of the Data table that you want to load into your mysql database. As identified from your metadata catalog.
Database where you want to run the script on.
Table name you want to load into specified via the notation schema_name.table_name. To specify special characters in table name you need to quote the table_name. Note special characters in table names is not recommended.
AWS Credentials with access to the s3 bucket where the data table lives. Should also have access to a temp directory.
AWS IAM Credentials with access to the s3 bucket where the data table lives. Should also have access to a temp directory.
Path to a location where the s3 credentials have write access and read access. Needs to be in the same region/account/bucket where the mysql files live. If left blank the sytem will use the temp path defined in the aws connection if one exists.
RegEx of filter to apply for loading files. Can use <YYYY> sytax to load time ranges for current dates