Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TensorFlow Lite tests failing with TensorFlow 2.7+ #903

Open
guillaumekln opened this issue Nov 15, 2021 · 1 comment
Open

TensorFlow Lite tests failing with TensorFlow 2.7+ #903

guillaumekln opened this issue Nov 15, 2021 · 1 comment
Labels

Comments

@guillaumekln
Copy link
Contributor

The following test cases are failing with TensorFlow 2.7 and are currently disabled:

FAILED opennmt/tests/tflite_test.py::TFLiteTest::testTFLiteInterpreter_0
FAILED opennmt/tests/tflite_test.py::TFLiteTest::testTFLiteInterpreter_1
FAILED opennmt/tests/tflite_test.py::TFLiteTest::testTFLiteInterpreter_3

cc @gcervantes8

@gcervantes8
Copy link
Contributor

It seems that with TensorFlow 2.7, the models that are no longer exporting with TensorFlow Lite are:

  • RNN-based models with Luong Attention decoder
  • Relative Transformer models

I tried fixing the error with the RNN models by changing the output shape, and attention shape in the decoding while loop back to tf.TensorShape(()), but that didn't seem to fix it.

I don't really know how to fix the error with Relative Transformer models, it's a strange error.

The good thing about TensorFlow 2.7 is that quantization now works for Transformer models.

@guillaumekln guillaumekln changed the title TensorFlow Lite tests failing with TensorFlow 2.7 TensorFlow Lite tests failing with TensorFlow 2.7+ Mar 10, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants