Question: Using Lucene 8?

[nicenemo]

Any plans in using a more modern Lucene version, like version 8?

According to Elastic (known from ElasticSearch) later Lucene versions perform better. I tried building with Lucene 8 and 6.0.0. Both gave compile errors with Java 8.

[danielnaber]

No plans yet, as we use some low-level stuff (e.g. at https://github.com/languagetool-org/languagetool/blob/1ed565ff6297c3e4e978057b92d66ea891486136/languagetool-wikipedia/src/main/java/org/languagetool/dev/index/LanguageToolFilter.java) that I found difficult to port to the new version when I last tried. PRs are very welcome, though.

[nicenemo]

I am Interested in using it in combination with GraalVM native.
Assuming I have ported the code. To proceed and get the tests running I have to recreate the ngrams and their lucene representation with the newer Lucene library first?

[danielnaber]

Sorry for the late reply. I don't think the ngram will need to be re-created, I think the indexes can be converter to the latest Lucene (maybe step by step from one version of Lucene to the next).

[miurahr]

No plans yet, as we use some low-level stuff (e.g. at https://github.com/languagetool-org/languagetool/blob/1ed565ff6297c3e4e978057b92d66ea891486136/languagetool-wikipedia/src/main/java/org/languagetool/dev/index/LanguageToolFilter.java) that I found difficult to port to the new version when I last tried. PRs are very welcome, though.

I would like to work with Lucene 8.11.3, that is latest library support Java 8, and update for ngram data, etc. and send you PR when completed.

There are three component that use Lucene; langaugetool-dev, languagetool-core and languagetool-wikipedia.
@danielnaber

[miurahr]

Hi, I have also upgrade ngram data, and now it works well for me.
Please check #10810 for details.