td_load>: Treasure Data bulk loading¶
td_load> operator loads data from storages, databases, or services.
+step1:
td_load>: config/guessed.yml
database: prod
table: raw
Secrets¶
When you set those parameters, use digdag secrets command.
td.apikey: API_KEY
The Treasure Data API key to use when submitting Treasure Data bulk load jobs.
Options¶
td_load>: FILE.yml
Path to a YAML template file. This configuration needs to be guessed using td command. If you saved DataConnector job on Treasure Data, you can use Unique ID instead of YAML path.
Examples:
td_load>: imports/load.yml
td_load>: unique_id
database: NAME
Name of the database load data to.
Examples:
database: my_database
table: NAME
Name of the table load data to.
Examples:
table: my_table
endpoint: ADDRESS
API endpoint (default: api.treasuredata.com).
use_ssl: BOOLEAN
Enable SSL (https) to access to the endpoint (default: true).
Output parameters¶
td.last_job_id or td.last_job.id
The job id this task executed.
Examples:
52036074
td.last_job.num_records
The number of records of this job output.
Examples:
10