Release 0.9.3

Server mode changes

  • Project archives can now be stored in S3 instead of the database. This is configured using the archive.s3.bucket, archive.s3.credentials.access-key-id and archive.s3.credentials.secret-access-key configuration parameters.

Workflow changes

  • The emr> operator now uses ${secret:<key>} syntax.

  • The http> operator now allows secrets in headers, content and uri using ${secret:<key>} syntax.

  • Declaring secret access using _secrets is no longer necessary and has been deprecated.

  • It is now possible to use secrets in td_load> and embulk> configuration using ${secret:<key>} syntax.

  • The td_run> operator can now run a saved query by id. If the operator command is a number, the query with that id will be run.

  • The td_ddl> operator now allows entire parameter lists to be parameterized.

General Changes

  • Secret access limits and policies have been removed. Operators can now access any secret.

  • Backfills now run sequentially instead of all sessions in parallel.

  • The Digdag client now sends a User-Agent header that includes the build artifact version.

  • Project metadata compilation has been moved to the server. The project tarball no longer needs to include a .digdag.dig file when pushing.

Release Date

2017-01-17

Contributors

  • Daniel Norberg

  • Mitsunori Komatsu

  • Sadayuki Furuhashi