Search by Japanese language

[js2ymmks]

I am creating a Japanese documentation site, but the search does not work correctly. It seems that I cannot search for more than three consecutive Japanese characters, although two characters are not a problem. The same is true for other Japanese sites that are already open to the public. I would appreciate any comments.

mkdocs, version 1.3.0
mkdocs-material-8.2.14

[squidfunk]

Thanks for asking. Please provide a self-contained, reproducible example.

[js2ymmks]

Thank you for your reply.
The code is simple, but the search results are not as expected.
I can't search for more than 3 kanji characters.
I would appreciate your comments.

For example.
防御 OK
防御率 NG

mkdocs.yml

site_name: My Docs
theme:
  name: material
  language: ja
  features:
    - search.highlight
plugins:  
  - search: 
      lang: ja

index.md

# Welcome to MkDocs
## Project 日本語検索

6イニング3自責点は ERA (Earned Run Average＝防御率) にすると 4.5 となり、あまり良いとは言えないように見えるが、2010年シーズン以降の MLB 全体の防御率が 4.08 (2010)、3.94 (2011)、4.01 (2012) であることを見れば、現在でも妥当なラインだと思われる。

[squidfunk]

Thanks for providing the example. I believe this is a bug in TinySegmenter which is used by lunr-languages, the library we use to provide multi-language support. If I run the string through TinySegmenter, it is indeed not segmented, thus not found. However, if I prepend something, TinySegmenter seems to cut correctly. Unfortunately, this is nothing we can fix in Material for MkDocs, but which must be fixed upstream as part of lunr-languages.

Example

• ERA防御率 is segmented into ERA | 防御 | 率
• 防御率 is not segmented at all

[js2ymmks]

Thank you for analyzing the cause of the problem.
Unfortunately, the results show that the Japanese search has not yet reached a usable level.

[squidfunk]

If we can find another way for proper segmentation, I'm more than happy to integrate it into Material for MkDocs. However, the only one I know is TinySegmenter, with all of its problems. I can't write a segmenter myself due to my missing knowledge of Japanese.

[js2ymmks]

I'm a front engineer and not highly knowledgeable in scripting, but I'll look into the Japanese search functionality of Material for MkDocs to help solve the problem!