Unrecognized languages should not default to English

[Popolechien]

Following up on a discussion in openzim/overview#51 (comment), it appears that when a language is not recognized (prob. because it lacks proper ISO code), then it defaults to appearing in the English selection, which is already more than large enough.

The expected behaviour would be to be listed under a new others language category to be added to the menu.

[rgaudin]

Removing the bug label as this was done on purpose. I'm afraid an others language would not help much as people are not likely to look at it… unless it's in the beginning of the list but then that's highlighting it too much for what it's worth.

@anupulu what would you suggest?

[Popolechien]

Well in that case seeing as the odds of having someone building a Napolitan hotspot and not speaking Italian feel pretty remote I would rather have them not be listed at all.

[anupulu]

My initial thoughts:
I would not remove any languages without knowing if someone might actually be using them. But we don't know that, right?

Having "Other languages" or "Unrecognized languages" as an option might not be an ideal solution, but it would probably be found by someone who has that specific need, even if most people would not look at it.

[kelson42]

@rgaudin I hope I understand the problem fully, but IMHO we should build some kind of maintenance tool allowing to identify unrecognised languages. Unrecognized languages been the one available in the catalog (see https://kiwix-tools.readthedocs.io/en/latest/kiwix-serve.html#catalog-v2-entries) but not in the libkiwix (see https://kiwix-tools.readthedocs.io/en/latest/kiwix-serve.html#catalog-v2-languages). We could run such a tool as part of the libkiwix CI for example.

[rgaudin]

I feel like we're going in circles. Maybe it would be better to take 15mn to talk it through.

[kelson42]

Considering openzim/overview#51 has been sorted out. Do we have any other blockers to fix this issue?

[rgaudin]

There's no blocker