v0.12.0
Breaking changes
This release has some breaking changes users should be aware of.
- For the new Pandas on Spark implementation only Pandas 1.5.3 and below will be supported due to Pandas 2.0 compatibility issues with Spark 3.
- Users wishing to use the older
SparkCompare
can continue to do so usingLegacySparkCompare
- Users wishing to use the older
- Spark 3.1.x support will be dropped
- Python 3.8 support is dropped
What's Changed
- Pandas on Spark refactor by @fdosani in #275
- Fix suffix on all mismatches reports by @fdosani in #293
- Update pandas support to 2.2.2 by @mark-thm in #295
- bump pandas actions to 2.2.2 by @fdosani in #296
- Fugue count matching rows by @fdosani in #294
- Release v0.12.0 by @fdosani in #297
Full Changelog: v0.11.3...v0.12.0