toolkit 2.5.0
Posted September 14, 2023 ‐ 1 min read
toolkit 2.5.0 release
Features
- it is possible to use env variable in project config files
- it is possible to set the default column type
- improve validation of table, kex naming
- improve loading of project - it’s faster and use less resources in Airflow
Changes
- sub-orchestration now uses end time for comparing with data age
- remove the option to send email from BigQuery transformation
- change behavior of using the filter in step
Bugfixes
- set datamart permission when datamart was kex was deleted and created again
- docker transformation now has really just output tables in the output
- sub orchestration now working correctly
- make destination in step copy optional
- fix the naming of AWS credentials during installation
- fix using custom transformation user for BigQuery
- fix demo project used in installation - now it uses proper SQL dialect
- fix union in step