Teak: Convert & Copy

Convert CSV files in one S3 location to JSON format and store them in another S3 location.

Convert and Copy

Convert data in one S3 bucket location from CSV to JSON format and store it in another S3 Bucket location.

Variables

Source Parameters

source_aws_connection

AWS Credentials with access to the source and target s3 locations.

source_bucket

S3 Bucket where you want to unload the data to.

source_s3_path

Path where original teak files are located.

column_names required

Header for the columns available from teak. You can use different names. Must be in order. Comma separated no spaces.

lookback required

Number of days based on the pattern to lookback

reprocess required

If True reprocess files even if you have already successfully processed those files before.

Target Parameters

target_bucket

S3 Bucket where you want to unload the data to.

target_s3_path required

Path where converted files will be transfered to.

Tracking Information

tracking_db required

Database where you store which files you have processed and their status

tracking_table required

Tracking schema and tablename where the file statuses will be stored

You can't use this until you register with us!