Vietnamese support #651
-
I really want to ask about the roadmap for the upcoming supported languages. Is Vietnamese available? |
Beta Was this translation helpful? Give feedback.
Answered by
micheleriva
Mar 1, 2024
Replies: 1 comment 2 replies
-
Hi! This means:
You can find a reference implementation here: https://github.com/askorama/orama/blob/main/packages/tokenizers/src/tokenizer-mandarin/src/tokenizer.ts It would really help if a native speaker could help with this. We'd try our best to support any contribution in that sense. |
Beta Was this translation helpful? Give feedback.
2 replies
Answer selected by
hckhanh
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hi!
I think we could probably try to add official support to Vietnamese via https://github.com/vunb/vntk or some other similar toolkit.
This means:
You can find a reference implementation here: https://github.com/askorama/orama/blob/main/packages/tokenizers/src/tokenizer-mandarin/src/tokenizer.ts
It would really help if a native speaker could help with this. We'd try our best to support any contribution in that sense.