Skip to content

Releases: HERMES-SOC/sdc_aws_sorting_lambda

v0.2.0

22 Mar 18:31
40c23bc
Compare
Choose a tag to compare

v0.2.0 (2023-03-22)

This release includes improvements in preparation for the upcoming second dataflow test. Since the last release, the improvements are as follows:

  • Added slack notification functionality to support sending slack messages to a slack channel for pipeline updates when provided the proper slack channel and token in the environmental variables.

Changelog

  • Add Slack Notification to Sorting Function by @dbarrous in #3

Full Changelog: v0.1.0...v0.2.0

v0.1.0

05 Oct 21:56
Compare
Choose a tag to compare

v0.1.0 (2022-10-05)

This release follows the HERMES Ground System data flow test that took place on 2022-09-28. This first release of the SDC AWS Sorting Lambda repo includes the following functionality

  • First iteration of the sorting lambda function, written in Python.
  • The sorting function sorts the files into the appropriate instrument bucket, and if it's a duplicate or invalid file sorts it into the unsorted bucket.
  • CI/CD Pipeline that tests and lints the code before deploying the function on AWS.
  • Logs object event to a timestream database.
  • In this release there is a known duplication bug if syncing the entire folder instead copying the new files individually into the incoming bucket. This is because when you sync the same folder, because the files are removed from the incoming, the sync command believes the files are new causing a lot of duplicates to be created.