Missing english stopwords?

[jankovicsandras]

Hi,

The following files include (or generate) stopwords for several languages, but english is not on the list, despite the Snowball project has english stopword list.

https://github.com/quickwit-oss/tantivy/blob/main/src/tokenizer/stop_word_filter/gen_stopwords.py

https://github.com/quickwit-oss/tantivy/blob/main/src/tokenizer/stop_word_filter/stopwords.rs

tantivy/src/tokenizer/stop_word_filter/gen_stopwords.py

Line 3 in d5d2d41

LANGUAGES = [

LANGUAGES = [
    "danish",
    "dutch",
    "finnish",
    "french",
    "german",
    "hungarian",
    "italian",
    "norwegian",
    "portuguese",
    "russian",
    "spanish",
    "swedish",
]

The englist stopword list exists in the Snowball project: https://snowballstem.org/algorithms/english/stop.txt

[jankovicsandras]

Also Irish and Indonesian:

https://snowballstem.org/algorithms/irish/stop.txt

https://snowballstem.org/algorithms/indonesian/stop.txt