- Add support for Spark 3.4.x and Spark 3.5.x
- Add support for Spark 3.3.x, remove support for Spark 3.0.x
- Add capability to create custom spark representatino for protobuf messages (see
withMessageEncoder
). - Using the above feature, we added
withSparkTimestamps
that representsgoogle.protobuf.Timestamp
as spark timestamp.
- We now cross-build for latest 3 major version of Spark.
- Protobuf maps are now represented as Spark in maps. Prior to this change maps were represented as a list of key-value structs. (#79)