Skip to content

v0.7.0
Compare
Choose a tag to compare
@jeremybeard jeremybeard released this 19 Apr 14:34
v0.7.0
0f6938b

Notable changes

  • Added hash, latest, translate, parse JSON, and Spark ML derivers
  • Added Impala DDL task
  • Added pluggable API for retrieving schemas
  • Added event framework to plug in custom code at various pipeline lifecycle events
  • Added capability to do dynamic configuration loading
  • Translation errors are now redirected to a new step instead of failing the pipeline
  • History tracking planners can assign a surrogate key to new records
  • Loop steps can update multiple parameters per iteration

Breaking changes

  • HBase output ‘mapping.rowkey’ configuration has been renamed to ‘mapping.rowkey.columns’
  • Tasks are now specified by a ‘task’ configuration object in the task step, where previously it was at the step level
  • Schemas are now specified by a commonly defined ‘schema’ configuration object, where previously there were different schema configurations for each Envelope component
  • Kafka input ‘encoding’ configuration has been removed. Envelope will now automatically determine the required encoding for the translator
  • Kudu output will now ignore duplicate key errors by default, where previously it would not. This can be overridden with the ‘insert.ignore’ configuration
Assets 3
Loading