Releases: awslabs/aws-athena-query-federation
Release v2023.18.1 of Athena Query Federation
This version includes improvements and bugfixes in some connectors. See here for changes since the last release.
Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:
-
Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".
-
Look for entries published by the "Amazon Athena Federation" author.
You can assert the validity of the binary distribution by comparing against the below cksums.
Athena Federation SDK jars
CheckSum | File |
---|---|
891182733 28294338 | aws-athena-federation-sdk-2023.18.1-withdep.jar |
3259058121 633602 | aws-athena-federation-sdk-2023.18.1.jar |
Athena Federation Connector Lambda jars
CheckSum | File |
---|---|
1289099269 42451291 | athena-aws-cmdb-2023.18.1.jar |
2932678151 46462687 | athena-cloudera-hive-2023.18.1.jar |
1021079053 42259163 | athena-cloudera-impala-2023.18.1.jar |
1911951404 37162482 | athena-cloudwatch-2023.18.1.jar |
2088111097 31050526 | athena-cloudwatch-metrics-2023.18.1.jar |
249684480 32717271 | athena-datalakegen2-2023.18.1.jar |
316277651 37996021 | athena-db2-2023.18.1.jar |
3361730298 32872176 | athena-docdb-2023.18.1.jar |
2565813415 32646512 | athena-dynamodb-2023.18.1.jar |
108435683 57714092 | athena-elasticsearch-2023.18.1.jar |
3209046396 92248977 | athena-gcs-2023.18.1.jar |
2466050806 76818901 | athena-google-bigquery-2023.18.1.jar |
2988867416 93553241 | athena-hbase-2023.18.1.jar |
2357555302 46463201 | athena-hortonworks-hive-2023.18.1.jar |
3258943047 44143044 | athena-kafka-2023.18.1.jar |
2455064608 50905970 | athena-msk-2023.18.1.jar |
1209696122 35502148 | athena-mysql-2023.18.1.jar |
3676385385 55075875 | athena-neptune-2023.18.1.jar |
3638120251 38171548 | athena-oracle-2023.18.1.jar |
543602779 32417327 | athena-postgresql-2023.18.1.jar |
2034809379 35643098 | athena-redis-2023.18.1.jar |
3773260484 33428266 | athena-redshift-2023.18.1.jar |
1952291644 33099927 | athena-saphana-2023.18.1.jar |
1307808253 64602545 | athena-snowflake-2023.18.1.jar |
3953448674 32721605 | athena-sqlserver-2023.18.1.jar |
3175962678 34931600 | athena-synapse-2023.18.1.jar |
1090587291 31325508 | athena-teradata-2023.18.1.jar |
3590870538 31628737 | athena-timestream-2023.18.1.jar |
3974706684 31165334 | athena-tpcds-2023.18.1.jar |
3690632561 30492735 | athena-udfs-2023.18.1.jar |
2660307944 32395625 | athena-vertica-2023.18.1.jar |
Athena Federation Connector Lambda zips
CheckSum | File |
---|---|
3417011914 85955220 | athena-gcs.zip |
1770185226 81324705 | athena-saphana.zip |
What's Changed
- support querying tables across databases for cloudera-hive (#1243)
- add data stream support for elasticsearch
- adding equals, toString, and hashCode to GetDataSourceCapabilitiesRequest
- [JDBC Fix] IN predicate with variable expression formed malformed SQL
- build(deps): bump ngdbc from 2.16.11 to 2.16.14 (#1238)
- build(deps): bump google-cloud-bigquery from 2.24.5 to 2.25.0 (#1237)
- build(deps): bump netty.version from 4.1.91.Final to 4.1.92.Final (#1236)
- build(deps): bump junit-bom from 5.9.2 to 5.9.3 (#1235)
- build(deps): bump google-cloud-resourcemanager from 1.17.0 to 1.18.0 (#1234)
- build(deps): bump google-cloud-storage from 2.22.0 to 2.22.1 (#1233)
- build(deps): bump jacoco-maven-plugin from 0.8.8 to 0.8.10 (#1232)
- build(deps): bump grpc-google-cloud-bigquerystorage-v1 (#1231)
- build(deps): bump aws-sdk.version from 1.12.454 to 1.12.459 (#1230)
- build(deps): bump aws-cdk.version from 1.199.0 to 1.200.0 (#1229)
Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.17.1..v2023.18.1
Release v2023.17.1 of Athena Query Federation
This version includes improvements and bugfixes in some connectors. See here for changes since the last release.
Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:
-
Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".
-
Look for entries published by the "Amazon Athena Federation" author.
You can assert the validity of the binary distribution by comparing against the below cksums.
Athena Federation SDK jars
CheckSum | File |
---|---|
1347508576 28204059 | aws-athena-federation-sdk-2023.17.1-withdep.jar |
612794459 632953 | aws-athena-federation-sdk-2023.17.1.jar |
Athena Federation Connector Lambda jars
CheckSum | File |
---|---|
2523859470 42354958 | athena-aws-cmdb-2023.17.1.jar |
1081009721 46372407 | athena-cloudera-hive-2023.17.1.jar |
3289367499 42168922 | athena-cloudera-impala-2023.17.1.jar |
4194990004 37072216 | athena-cloudwatch-2023.17.1.jar |
3746831661 30960250 | athena-cloudwatch-metrics-2023.17.1.jar |
1409805175 32627030 | athena-datalakegen2-2023.17.1.jar |
1445443224 37905779 | athena-db2-2023.17.1.jar |
4008388562 32781898 | athena-docdb-2023.17.1.jar |
3880963363 32556234 | athena-dynamodb-2023.17.1.jar |
542406834 57622449 | athena-elasticsearch-2023.17.1.jar |
1304162774 92158560 | athena-gcs-2023.17.1.jar |
2507045251 76536391 | athena-google-bigquery-2023.17.1.jar |
1293450867 93463015 | athena-hbase-2023.17.1.jar |
2456525496 46372957 | athena-hortonworks-hive-2023.17.1.jar |
3233168544 44052763 | athena-kafka-2023.17.1.jar |
3208987169 50815689 | athena-msk-2023.17.1.jar |
2738725878 35411907 | athena-mysql-2023.17.1.jar |
3172962310 54985595 | athena-neptune-2023.17.1.jar |
911523890 38081307 | athena-oracle-2023.17.1.jar |
1474493344 32327085 | athena-postgresql-2023.17.1.jar |
1813767336 35552819 | athena-redis-2023.17.1.jar |
2930012371 33338024 | athena-redshift-2023.17.1.jar |
2909145328 33009686 | athena-saphana-2023.17.1.jar |
1775614847 64512304 | athena-snowflake-2023.17.1.jar |
1951901067 32631363 | athena-sqlserver-2023.17.1.jar |
286207120 34841359 | athena-synapse-2023.17.1.jar |
1333293987 31235268 | athena-teradata-2023.17.1.jar |
2191864685 31538456 | athena-timestream-2023.17.1.jar |
1302806756 31075055 | athena-tpcds-2023.17.1.jar |
3923748428 30402456 | athena-udfs-2023.17.1.jar |
1357193872 32305346 | athena-vertica-2023.17.1.jar |
Athena Federation Connector Lambda zips
CheckSum | File |
---|---|
3944086861 85879769 | athena-gcs.zip |
2443890447 81099258 | athena-saphana.zip |
What's Changed
- [Bug Fix] [athena-cloudwatch] Stop lowercasing all schemas and tables, fix data integrity issue
- athena-timestream: Add pagination for doListTables
- Add PaginatedRequestIterator
- [Timestream] Add case-insensitive lookup to allow queries against cased dbs/tables to succeed
- build(deps): bump aws-cdk.version from 1.198.1 to 1.199.0 (#1219)
- build(deps): bump fasterxml.jackson.version from 2.14.2 to 2.15.0 (#1221)
- build(deps): bump vertica-jdbc from 12.0.3-0 to 12.0.4-0 (#1225)
- build(deps): bump mysql-connector-j from 8.0.32 to 8.0.33 (#1224)
- build(deps): bump snowflake-jdbc from 3.13.29 to 3.13.30 (#1223)
- build(deps): bump maven-checkstyle-plugin from 3.2.1 to 3.2.2 (#1222)
- build(deps): bump lettuce-core from 6.2.3.RELEASE to 6.2.4.RELEASE (#1220)
- build(deps): bump aws-sdk.version from 1.12.450 to 1.12.454 (#1218)
- Update cut_release.yml (#1217)
Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.16.2..v2023.17.1
Release v2023.16.2 of Athena Query Federation
This version includes improvements and bugfixes in some connectors. See here for changes since the last release.
Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:
-
Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".
-
Look for entries published by the "Amazon Athena Federation" author.
You can assert the validity of the binary distribution by comparing against the below cksums.
Athena Federation SDK jars
CheckSum | File |
---|---|
774421089 28095323 | aws-athena-federation-sdk-2023.16.2-withdep.jar |
1407983997 631548 | aws-athena-federation-sdk-2023.16.2.jar |
Athena Federation Connector Lambda jars
CheckSum | File |
---|---|
189731503 42246222 | athena-aws-cmdb-2023.16.2.jar |
364297972 46263671 | athena-cloudera-hive-2023.16.2.jar |
4090968800 42060185 | athena-cloudera-impala-2023.16.2.jar |
1218694276 36976933 | athena-cloudwatch-2023.16.2.jar |
4182206810 30851513 | athena-cloudwatch-metrics-2023.16.2.jar |
929912942 32518294 | athena-datalakegen2-2023.16.2.jar |
2893322158 37797043 | athena-db2-2023.16.2.jar |
2614192738 32673161 | athena-docdb-2023.16.2.jar |
310525440 32447497 | athena-dynamodb-2023.16.2.jar |
3456732252 57513716 | athena-elasticsearch-2023.16.2.jar |
3552026413 92049823 | athena-gcs-2023.16.2.jar |
1386494255 76427655 | athena-google-bigquery-2023.16.2.jar |
227268333 93354860 | athena-hbase-2023.16.2.jar |
1207377530 46264221 | athena-hortonworks-hive-2023.16.2.jar |
1287185985 43943674 | athena-kafka-2023.16.2.jar |
2792742500 50706595 | athena-msk-2023.16.2.jar |
2417662932 35302432 | athena-mysql-2023.16.2.jar |
404986945 54876858 | athena-neptune-2023.16.2.jar |
1678361833 37972571 | athena-oracle-2023.16.2.jar |
4019388370 32218349 | athena-postgresql-2023.16.2.jar |
3484660406 35433670 | athena-redis-2023.16.2.jar |
4245139591 33229288 | athena-redshift-2023.16.2.jar |
380990994 32901095 | athena-saphana-2023.16.2.jar |
3955655256 64411673 | athena-snowflake-2023.16.2.jar |
2722421933 32522627 | athena-sqlserver-2023.16.2.jar |
2725779463 34732623 | athena-synapse-2023.16.2.jar |
189912743 31126531 | athena-teradata-2023.16.2.jar |
3320115182 31427588 | athena-timestream-2023.16.2.jar |
3502614897 30966318 | athena-tpcds-2023.16.2.jar |
886541438 30293720 | athena-udfs-2023.16.2.jar |
415576451 32178276 | athena-vertica-2023.16.2.jar |
Athena Federation Connector Lambda zips
CheckSum | File |
---|---|
1549641596 85786007 | athena-gcs.zip |
1782627894 80817953 | athena-saphana.zip |
What's Changed
- Drop SerDe version to 2 for connectors until Athena Engine V2 receives resolution fix
- build(deps): bump ImpalaJDBC42 from 2.6.29.1035 to 2.6.30.1036 (#1215)
- build(deps): bump msal4j from 1.13.7 to 1.13.8 (#1214)
- build(deps): bump grpc-google-cloud-bigquerystorage-v1 from 2.34.2 to 2.35.0 (#1211)
- build(deps): bump google-cloud-bigquery from 2.24.4 to 2.24.5 (#1208)
- build(deps): bump google-cloud-resourcemanager from 1.16.0 to 1.17.0 (#1207)
- build(deps): bump redshift-jdbc42 from 2.1.0.13 to 2.1.0.14 (#1206)
- build(deps): bump jetty.version from 11.0.14 to 11.0.15 (#1205)
- build(deps): bump hbase.version from 2.5.3-hadoop3 to 2.5.4-hadoop3 (#1204)
- build(deps): bump google-cloud-storage from 2.21.0 to 2.22.0 (#1203)
- build(deps): bump aws-sdk.version from 1.12.445 to 1.12.450
Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.16.1..v2023.16.2
Release v2023.16.1 of Athena Query Federation
This version includes improvements and bugfixes in some connectors. See here for changes since the last release.
Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:
-
Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".
-
Look for entries published by the "Amazon Athena Federation" author.
You can assert the validity of the binary distribution by comparing against the below cksums.
Athena Federation SDK jars
CheckSum | File |
---|---|
3870742584 28095118 | aws-athena-federation-sdk-2023.16.1-withdep.jar |
452649490 631547 | aws-athena-federation-sdk-2023.16.1.jar |
Athena Federation Connector Lambda jars
CheckSum | File |
---|---|
3876905364 42245639 | athena-aws-cmdb-2023.16.1.jar |
4153054376 46263464 | athena-cloudera-hive-2023.16.1.jar |
1115656896 42057059 | athena-cloudera-impala-2023.16.1.jar |
3018073767 36976728 | athena-cloudwatch-2023.16.1.jar |
3475544197 30851308 | athena-cloudwatch-metrics-2023.16.1.jar |
3129732164 32518088 | athena-datalakegen2-2023.16.1.jar |
388066706 37796837 | athena-db2-2023.16.1.jar |
397687536 32672956 | athena-docdb-2023.16.1.jar |
2673061825 32447292 | athena-dynamodb-2023.16.1.jar |
3857145612 57513507 | athena-elasticsearch-2023.16.1.jar |
1612058836 96721222 | athena-gcs-2023.16.1.jar |
702692374 76423294 | athena-google-bigquery-2023.16.1.jar |
4019116186 93347479 | athena-hbase-2023.16.1.jar |
2208145556 46264013 | athena-hortonworks-hive-2023.16.1.jar |
173981796 43943467 | athena-kafka-2023.16.1.jar |
323950310 50706388 | athena-msk-2023.16.1.jar |
2179415089 35302227 | athena-mysql-2023.16.1.jar |
3693881957 54876654 | athena-neptune-2023.16.1.jar |
670408913 37972365 | athena-oracle-2023.16.1.jar |
2970675342 32218143 | athena-postgresql-2023.16.1.jar |
3086774122 35433465 | athena-redis-2023.16.1.jar |
3720788846 33226709 | athena-redshift-2023.16.1.jar |
1152995034 32900888 | athena-saphana-2023.16.1.jar |
1056449198 64411467 | athena-snowflake-2023.16.1.jar |
1011683411 32522421 | athena-sqlserver-2023.16.1.jar |
2802775143 34609228 | athena-synapse-2023.16.1.jar |
1426746849 31126326 | athena-teradata-2023.16.1.jar |
275492356 31427380 | athena-timestream-2023.16.1.jar |
3625116623 30966113 | athena-tpcds-2023.16.1.jar |
1152223290 30293514 | athena-udfs-2023.16.1.jar |
2720287683 32178070 | athena-vertica-2023.16.1.jar |
Athena Federation Connector Lambda zips
CheckSum | File |
---|---|
2812975538 89950687 | athena-gcs.zip |
3598162866 80838460 | athena-saphana.zip |
What's Changed
- Merge pull request #1212 from awslabs/master-ddb-ignore-no-kms-table
- return empty schema in ddb kms encrypted table when lambda role doesn't have access to KMS
- Merge pull request #1213 from awslabs/mysql-test-typo
- [athena-mysql Fix] Add testing for both order by directiosn in MySql test
- build(deps): bump protobuf-java from 3.22.2 to 3.22.3
- PR Review Updates
- Make sdk changes leaner
- Update Athena-Example and Documentation for Predicate Pushdown Changes
- Update SerDe to V4 and add backwards compatibilty support
- JDBC Aggregation Support, DynamoDB Limit Support, Order By Support, Parser Bug Fix
- Bump POM, fix checkstyle and bugs
- GetDataSourceCapabilities Impl, LIMIT support JDBC, Complex Expression Parser for JDBC
- Initial SDK Changes for Predicate Pushdown
- feat(athena-redshift): Support spill buckets using KMS CMK keys, passing role arn for lambda
Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.15.1..v2023.16.1
Release v2023.15.1 of Athena Query Federation
This version includes improvements and bugfixes in some connectors. See here for changes since the last release.
Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:
-
Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".
-
Look for entries published by the "Amazon Athena Federation" author.
You can assert the validity of the binary distribution by comparing against the below cksums.
Athena Federation SDK jars
CheckSum | File |
---|---|
143044011 28019960 | aws-athena-federation-sdk-2023.15.1-withdep.jar |
3268165024 557485 | aws-athena-federation-sdk-2023.15.1.jar |
Athena Federation Connector Lambda jars
CheckSum | File |
---|---|
3380286845 42170481 | athena-aws-cmdb-2023.15.1.jar |
3093052493 46179379 | athena-cloudera-hive-2023.15.1.jar |
426208953 41972976 | athena-cloudera-impala-2023.15.1.jar |
857368483 36901570 | athena-cloudwatch-2023.15.1.jar |
1148856696 30776150 | athena-cloudwatch-metrics-2023.15.1.jar |
1741786200 32434004 | athena-datalakegen2-2023.15.1.jar |
1996051552 37712754 | athena-db2-2023.15.1.jar |
3560962519 32597798 | athena-docdb-2023.15.1.jar |
2210551248 32371679 | athena-dynamodb-2023.15.1.jar |
808569119 57438344 | athena-elasticsearch-2023.15.1.jar |
2123528429 96646062 | athena-gcs-2023.15.1.jar |
2742342924 76339213 | athena-google-bigquery-2023.15.1.jar |
4231364584 93272321 | athena-hbase-2023.15.1.jar |
2406395843 46179929 | athena-hortonworks-hive-2023.15.1.jar |
2215782615 43868309 | athena-kafka-2023.15.1.jar |
1341806596 50631230 | athena-msk-2023.15.1.jar |
352350104 35216139 | athena-mysql-2023.15.1.jar |
1150988845 54801494 | athena-neptune-2023.15.1.jar |
2521515065 37888282 | athena-oracle-2023.15.1.jar |
118316999 32132061 | athena-postgresql-2023.15.1.jar |
1163336208 35358307 | athena-redis-2023.15.1.jar |
2086209832 33139054 | athena-redshift-2023.15.1.jar |
660180290 32816806 | athena-saphana-2023.15.1.jar |
850047180 64327384 | athena-snowflake-2023.15.1.jar |
411570709 32438336 | athena-sqlserver-2023.15.1.jar |
3704636922 34525145 | athena-synapse-2023.15.1.jar |
2756724771 31042243 | athena-teradata-2023.15.1.jar |
3748898417 31352222 | athena-timestream-2023.15.1.jar |
4197380824 30890955 | athena-tpcds-2023.15.1.jar |
2825978998 30218356 | athena-udfs-2023.15.1.jar |
211662514 32102912 | athena-vertica-2023.15.1.jar |
Athena Federation Connector Lambda zips
CheckSum | File |
---|---|
2059150309 89890649 | athena-gcs.zip |
1320015196 80710770 | athena-saphana.zip |
What's Changed
- [fix]athena-google-bigquery: return athena catalog name instead of project name from gbq. (#1200)
- DateTimeFormatterUtilTest: verify round trip packing unpacking
- build(deps): bump api-ldap-model from 2.1.2 to 2.1.3
- build(deps): bump jsii-runtime from 1.79.0 to 1.80.0
- build(deps): bump ojdbc8 from 21.9.0.0 to 23.2.0.0
- build(deps): bump netty.version from 4.1.90.Final to 4.1.91.Final
- build(deps): bump google-cloud-storage from 2.20.2 to 2.21.0
- build(deps): bump aws-sdk.version from 1.12.440 to 1.12.445
- build(deps): bump mongo-java-driver from 3.12.12 to 3.12.13
- build(deps): bump xml2js (#1197)
- workflows/cut_release: fix release version auto increment
Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.14.1..v2023.15.1
Release v2023.14.1 of Athena Query Federation
This version includes improvements and bugfixes in some connectors. See here for changes since the last release.
Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:
-
Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".
-
Look for entries published by the "Amazon Athena Federation" author.
You can assert the validity of the binary distribution by comparing against the below cksums.
Athena Federation SDK jars
CheckSum | File |
---|---|
3563656006 27997315 | aws-athena-federation-sdk-2023.14.1-withdep.jar |
301595864 557484 | aws-athena-federation-sdk-2023.14.1.jar |
Athena Federation Connector Lambda jars
CheckSum | File |
---|---|
1019824191 42147613 | athena-aws-cmdb-2023.14.1.jar |
2267665919 46156737 | athena-cloudera-hive-2023.14.1.jar |
1234534622 41950331 | athena-cloudera-impala-2023.14.1.jar |
768806824 36878923 | athena-cloudwatch-2023.14.1.jar |
2626937562 30753502 | athena-cloudwatch-metrics-2023.14.1.jar |
2200882004 32411359 | athena-datalakegen2-2023.14.1.jar |
844961568 37690111 | athena-db2-2023.14.1.jar |
1439136062 32575123 | athena-docdb-2023.14.1.jar |
2437886066 32349032 | athena-dynamodb-2023.14.1.jar |
3829401462 57415697 | athena-elasticsearch-2023.14.1.jar |
1169918071 96279333 | athena-gcs-2023.14.1.jar |
1300489848 76316750 | athena-google-bigquery-2023.14.1.jar |
1124573134 93249674 | athena-hbase-2023.14.1.jar |
1002962800 46157286 | athena-hortonworks-hive-2023.14.1.jar |
4067167925 43845665 | athena-kafka-2023.14.1.jar |
1071145095 50608586 | athena-msk-2023.14.1.jar |
1046851615 35193495 | athena-mysql-2023.14.1.jar |
1645828526 54778850 | athena-neptune-2023.14.1.jar |
3544258288 36117620 | athena-oracle-2023.14.1.jar |
1244557429 32109416 | athena-postgresql-2023.14.1.jar |
718757645 35335663 | athena-redis-2023.14.1.jar |
218200707 33116409 | athena-redshift-2023.14.1.jar |
3652219759 32794160 | athena-saphana-2023.14.1.jar |
3406623695 64304740 | athena-snowflake-2023.14.1.jar |
1948127488 32415693 | athena-sqlserver-2023.14.1.jar |
1158559163 34502501 | athena-synapse-2023.14.1.jar |
3078596866 31019599 | athena-teradata-2023.14.1.jar |
202626413 31329577 | athena-timestream-2023.14.1.jar |
2073325703 30868312 | athena-tpcds-2023.14.1.jar |
875563117 30195716 | athena-udfs-2023.14.1.jar |
700336835 32080268 | athena-vertica-2023.14.1.jar |
Athena Federation Connector Lambda zips
CheckSum | File |
---|---|
3146084142 89576013 | athena-gcs.zip |
3041665879 80639840 | athena-saphana.zip |
What's Changed
- publish_to_maven_central: use -am flag
- publish_to_maven_central: add athena-federation-integ-test
- Added Money type support for Postgres
- Remove *-dsv2
- Update publish_to_maven_central.yml
- Compatibility changes for certain Spark distributions
- Merge pull request #1179 from awslabs/cross-account-ddb
- [SDK + DDB] Add Cross-Account DynamoDB Table Access + Generic Cross-Account Credentials Provider
- build(deps): bump grpc-google-cloud-bigquerystorage-v1
- build(deps): bump msal4j from 1.13.6 to 1.13.7
- build(deps): bump commons-configuration2 from 2.8.0 to 2.9.0
- build(deps): bump google-cloud-bigquery from 2.21.0 to 2.24.4
- build(deps): bump aws-cdk.version from 1.198.0 to 1.198.1
- build(deps): bump aws-sdk.version from 1.12.435 to 1.12.440
- build(deps): bump google-cloud-resourcemanager from 1.15.0 to 1.16.0
- Update workflows/codeql-analysis again
- workflows/codeql-analysis: custom java build step
- workflows/cut_release: filter out athena-jdbc
Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.13.1..v2023.14.1
Release v2023.13.1 of Athena Query Federation
This version includes improvements and bugfixes in some connectors. See here for changes since the last release.
Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:
-
Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".
-
Look for entries published by the "Amazon Athena Federation" author.
You can assert the validity of the binary distribution by comparing against the below cksums.
Athena Federation SDK jars
CheckSum | File |
---|---|
106247132 27843525 | aws-athena-federation-sdk-2023.13.1-withdep.jar |
1683627323 555754 | aws-athena-federation-sdk-2023.13.1.jar |
Athena Federation Connector Lambda jars
CheckSum | File |
---|---|
2647384524 41965608 | athena-aws-cmdb-2023.13.1.jar |
1524122275 46002766 | athena-cloudera-hive-2023.13.1.jar |
3448108009 41796360 | athena-cloudera-impala-2023.13.1.jar |
2747324484 36725127 | athena-cloudwatch-2023.13.1.jar |
1938734417 30599709 | athena-cloudwatch-metrics-2023.13.1.jar |
3224821913 32257388 | athena-datalakegen2-2023.13.1.jar |
2653964697 37536141 | athena-db2-2023.13.1.jar |
1059426856 32421330 | athena-docdb-2023.13.1.jar |
3352525496 32194936 | athena-dynamodb-2023.13.1.jar |
3573705929 57261901 | athena-elasticsearch-2023.13.1.jar |
1167431189 96125539 | athena-gcs-2023.13.1.jar |
69544486 75695226 | athena-google-bigquery-2023.13.1.jar |
1935794288 93089387 | athena-hbase-2023.13.1.jar |
3923329631 46003314 | athena-hortonworks-hive-2023.13.1.jar |
312397252 43843091 | athena-kafka-2023.13.1.jar |
270383804 50606012 | athena-msk-2023.13.1.jar |
140119810 35039526 | athena-mysql-2023.13.1.jar |
1809837648 54612818 | athena-neptune-2023.13.1.jar |
2316746942 35963650 | athena-oracle-2023.13.1.jar |
3802162267 31955448 | athena-postgresql-2023.13.1.jar |
950037823 35181869 | athena-redis-2023.13.1.jar |
1563559772 32962436 | athena-redshift-2023.13.1.jar |
3609424473 32640191 | athena-saphana-2023.13.1.jar |
2898419139 64150767 | athena-snowflake-2023.13.1.jar |
2488717553 32261723 | athena-sqlserver-2023.13.1.jar |
3703871049 34348529 | athena-synapse-2023.13.1.jar |
2297934003 30865628 | athena-teradata-2023.13.1.jar |
2305222628 31175779 | athena-timestream-2023.13.1.jar |
1535457638 30714517 | athena-tpcds-2023.13.1.jar |
967577577 30041922 | athena-udfs-2023.13.1.jar |
3471837433 31926474 | athena-vertica-2023.13.1.jar |
Athena Federation Connector Lambda zips
CheckSum | File |
---|---|
4117460929 89437756 | athena-gcs.zip |
2528793740 80227285 | athena-saphana.zip |
What's Changed
- bump redshift to preferred driver version
- workflows: use aws-athena-query-federation group
- workflows/cut_release: temporary changes
- Update workflow/cut_release to include the zips as well
- Workflows updates (#1161)
- workflows/cut_release: Use ubuntu-latest instead of self-hosted (#1160)
- Add github workflow to cut a release (#1159)
- Fix typo in Kafka (#1158)
- Add athena-federation-sdk-dsv2 and adapted connectors
- Add AthenaFederationIpcOption for backwards compatibility with Arrow 2.0.0
- Fixed accessing domain endpoints that are in a VPC when using auto_discover_endpoint.
- athena-gcs: Update GcsUtilsTest for coerce (#1145)
- build(deps): bump msal4j from 1.13.5 to 1.13.6 (#1150)
- build(deps): bump aws-cdk.version from 1.197.0 to 1.198.0 (#1147)
- build(deps): bump jsii-runtime from 1.78.1 to 1.79.0 (#1151)
- build(deps): bump google-cloud-storage from 2.20.1 to 2.20.2 (#1155)
- build(deps): bump jqwik from 1.7.2 to 1.7.3 (#1154)
- build(deps): bump ngdbc from 2.16.10 to 2.16.11 (#1153)
- build(deps): bump hadoop-common from 3.3.4 to 3.3.5 (#1149)
- build(deps): bump aws-sdk.version from 1.12.431 to 1.12.435 (#1146)
Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.12.1..v2023.13.1
Release v2023.12.1 of Athena Query Federation
This version includes improvements and bugfixes in some connectors. See here for changes since the last release.
Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:
-
Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".
-
Look for entries published by the "Amazon Athena Federation" author.
You can assert the validity of the binary distribution by comparing against the below cksums.
CheckSum | File |
---|---|
1845195280 554586 | aws-athena-federation-sdk-2023.12.1.jar |
2565088674 27841074 | aws-athena-federation-sdk-2023.12.1-withdep.jar |
What's Changed
- athena-gcs: Fix StorageMetadata::getCompatibleFieldType (#1142)
- Update maven_push.yml
- updated getInt() to getLong() to fetch record count (#1143)
- Update maven_push.yml
- Add support for TIMESTAMPMICROTZ
- Add support unpacked timestamps with timezones
- Add ArrowSchemaUtils.remapArrowTypesWithinField
- build(deps): bump ngdbc from 2.15.12 to 2.16.10 (#1131)
- build(deps): bump google-cloud-resourcemanager from 1.14.0 to 1.15.0 (#1129)
- build(deps): bump postgresql from 42.5.4 to 42.6.0 (#1128)
- build(deps): bump surefire.failsafe.version from 3.0.0-M9 to 3.0.0 (#1127)
- build(deps): bump aws-sdk.version from 1.12.425 to 1.12.431 (#1140)
- build(deps): bump slf4j-log4j.version from 2.0.6 to 2.0.7 (#1130)
- build(deps-dev): bump equalsverifier from 3.14 to 3.14.1 (#1132)
- build(deps): bump netty.version from 4.1.89.Final to 4.1.90.Final (#1133)
- build(deps): bump jsii-runtime from 1.77.0 to 1.78.1 (#1134)
- build(deps): bump snowflake-jdbc from 3.13.28 to 3.13.29 (#1136)
- build(deps): bump aws-sdk.version from 1.12.425 to 1.12.430 (#1126)
- build(deps): bump aws-cdk.version from 1.196.0 to 1.197.0 (#1125)
- build(deps): bump jettison from 1.5.3 to 1.5.4 (#1137)
Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.11.1..v2023.12.1
Release v2023.11.1 of Athena Query Federation
This version includes improvements and bugfixes in some connectors. See here for changes since the last release.
Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:
-
Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".
-
Look for entries published by the "Amazon Athena Federation" author.
You can assert the validity of the binary distribution by comparing against the below cksums.
CheckSum | File |
---|---|
1722592411 551184 | aws-athena-federation-sdk-2023.11.1.jar |
1859491083 27835357 | aws-athena-federation-sdk-2023.11.1-withdep.jar |
What's Changed
- GCS connector fix partition column value issue (#1120)
- athena-dynamodb: Improve ddb sort key pushdown handling (#1122)
- Don't depend on Google Guava toImmutableList (#1119)
- domain.predicate.Constraints: Fix close() method signature (#1116)
- Some of the SortedRangeSet static utility functions public (#1118)
- Enhance BlockAllocatorImpl to take in a shared RootAllocator (#1117)
- codeql-analysis.yml: skip duplicate actions (#1114)
- build(deps): bump protobuf-java from 3.22.0 to 3.22.2 (#1111)
- build(deps): bump jsii-runtime from 1.76.0 to 1.77.0 (#1113)
- build(deps): bump google-cloud-storage from 2.19.0 to 2.20.1 (#1109)
- build(deps): bump aws-sdk.version from 1.12.420 to 1.12.425 (#1108)
- build(deps): bump aws-cdk.version from 1.195.0 to 1.196.0 (#1107)
- .github/workflows/maven_push.yml: target java 8 to ensure source compatibility (#1106)
Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.10.1..v2023.11.1
Release v2023.10.1 of Athena Query Federation
This version includes improvements and bugfixes in some connectors. See here for changes since the last release.
Binary distribution of the SDK can be found here. For pre-built versions of the connector and UDF suite please:
-
Navigate to Serverless Application Repository and search for "athena-federation". Also check the checkbox labeled "Show apps that create custom IAM roles or resource policies".
-
Look for entries published by the "Amazon Athena Federation" author.
You can assert the validity of the binary distribution by comparing against the below cksums.
CheckSum | File |
---|---|
3004269374 551040 | aws-athena-federation-sdk-2023.10.1.jar |
405396809 27834365 | aws-athena-federation-sdk-2023.10.1-withdep.jar |
What's Changed
- .github/workflows/maven_push.yml enhancements (#1103)
- Merge pull request #1102 from awslabs/msk-pagination-get-splits
- Apply same diff to kafka
- Add pagination for MSK doGetSplits
- GCS connector fix for uploaded partition folder issue (#1099)
- Make source compatible with Java 8 (#1100)
- build(deps): bump google-cloud-resourcemanager from 1.13.0 to 1.14.0 (#1095)
- build(deps): bump jetty.version from 11.0.13 to 11.0.14 (#1094)
- build(deps): bump maven-compiler-plugin from 3.10.1 to 3.11.0 (#1093)
- build(deps-dev): bump equalsverifier from 3.13.2 to 3.14 (#1098)
- build(deps): bump aws-sdk.version from 1.12.415 to 1.12.420 (#1092)
- build(deps): bump aws-cdk.version from 1.194.0 to 1.195.0 (#1091)
- Get rid of environment variable mocking
- Refactor code to not use System.getenv directly
- build(deps-dev): bump log4j2Version from 2.19.0 to 2.20.0
- build(deps): bump spotbugs-annotations from RELEASE to 4.7.3
- build(deps): bump snakeyaml from 1.33 to 2.0
- build(deps): bump msal4j from 1.13.4 to 1.13.5
- build(deps): bump google-cloud-storage from 2.18.0 to 2.19.0
- build(deps): bump maven-assembly-plugin from 3.4.2 to 3.5.0
- build(deps): bump snowflake-jdbc from 3.13.27 to 3.13.28
- build(deps): bump ngdbc from 2.15.10 to 2.15.12
- build(deps): bump aws-cdk.version from 1.193.0 to 1.194.0
- build(deps): bump aws-sdk.version from 1.12.410 to 1.12.415
- build(deps): bump jsii-runtime from 1.75.0 to 1.76.0 (#1076)
Full Changelog: https://github.com/awslabs/aws-athena-query-federation/compare/v2023.8.3..v2023.10.1