-
Notifications
You must be signed in to change notification settings - Fork 392
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Build new Spark-Tensorflow-Connector for scala 2.12 #194
Comments
You can build 2.12 by yourself!!! |
Also, you use spark-tfrecord https://github.com/linkedin/spark-tfrecord, that support scala 2.12. |
It would be great to have an example of how to build this for Spark 3.x and Tensorflow 2.x I tried a number of combinations with no success. I can build the jar, but it writes an empty TFRecord file. If others have successfully built the jar for Spark 3.x and Tensorflow 2.x I'd love to hear the details. |
@dennisobrien Hi, try this: https://github.com/wuxianxingkong/spark-tfrecord (Built with spark 3.1.1 and scala 2.12) |
It would be super helpful if TF team could kindly help releasing spark-tensorflow-connector built with scala 2.12 to maven artifact 🙌 Right now the best workaround seems to be |
Spark has released 3.x which built with scala 2.12, but th newest version of Spark-Tensorflow-Connector is built with scala 2.11 which means not compatiable with spark 3.x. Maven repository is still 2.11.
The text was updated successfully, but these errors were encountered: