CLI
ETL
CLI
ETL
hotglue CLI commands for ETL
Programmatically manage your transformation scripts using the etl commands below.
ETL Download
Description
Clones the remote ETL script saved in hotglue to your local machine.
Sample
$ hotglue etl download [--overwrite] [--downloadTo]
✔ Finished: Verifying user and authorizing.
✔ Finished: Scanning for downloadable files.
ℹ Info: Downloading script files to ./scripts/tap.
✔ Finished: Downloading file: etl.ipynb.
┌───────────┬────────────┐
│ File │ Status │
├───────────┼────────────┤
│ etl.ipynb │ Downloaded │
└───────────┴────────────┘
Parameters
| Option | Default | Description |
|---|---|---|
--overwrite | ||
-o | false | When enabled, overwrites any files that already exist locally in the download to directory. |
--downloadTo | ||
-d | . | The directory to download the ETL to. Defaults to the local directory. |
ETL Deploy
Description
Deploys the local ETL script to hotglue.
Sample
$ hotglue etl deploy [--sourceFolder]
✔ Finished: Verifying user and authorizing.
✔ Finished: Validating flow and tap location.
✔ Finished: Preparing deployment target.
ℹ Info: Deploying ETL scripts.
✔ Finished: Pushing file: default/flows/bTHIweD0W/taps/cin7/etl/etl.ipynb.
┌─────────────────────────────────────────────────┬──────────┐
│ File │ Status │
├─────────────────────────────────────────────────┼──────────┤
│ default/flows/bTHIweD0W/taps/cin7/etl/etl.ipynb │ Deleted │
├─────────────────────────────────────────────────┼──────────┤
│ default/flows/bTHIweD0W/taps/cin7/etl/etl.ipynb │ Deployed │
└─────────────────────────────────────────────────┴──────────┘
Parameters
| Option | Default | Description |
|---|---|---|
--sourceFolder | ||
-s | . | The directory to upload the ETL script from. Defaults to the local directory. |
ETL Delete
Description
Deletes a deployed ETL script on hotglue.
Sample
$ hotglue etl delete
ℹ Info: Deleting ETL scripts for Tenant tenantId Flow flowId and Tap tapId to envId.
✔ Finished: Verifying user and authorizing.
✔ Finished: Deleting ETL scripts.
┌───────────┬─────────┐
│ File │ Status │
├───────────┼─────────┤
│ etl.ipynb │ Deleted │
└───────────┴─────────┘