Search supports multiple languages

[zjy365]

Search supports multiple languages
When I was using flexsearch, I wanted to set up Chinese search, and the content of the document was in Chinese, but it couldn't be searched.
I tried a lot of things, referring to these links

• Search function multi-language support alex-shpak/hugo-book#80
• About Chinese Support travis-r6s/gridsome-plugin-flexsearch#23
• About Chinese Support travis-r6s/gridsome-plugin-flexsearch#23 (comment)
• https://github.com/nextapps-de/flexsearch#cjk-word-break-chinese-japanese-korean

[colinwilson]

Should be a way to incorporate this as an option(s) in the theme config.

[zjy365]

@colinwilson
I tried to modify this part of the code in flexsearch.html, but it didn't work

    var index = new FlexSearch.Document({
        // charset: "latin:default",
        tokenize: {{ .Site.Params.flexsearch.tokenize | default "forward" }},
        minlength: {{ .Site.Params.flexsearch.minQueryChar | default 0}},
        cache: {{ .Site.Params.flexsearch.cache | default 100 }},
        optimize: {{ .Site.Params.flexsearch.optimize | default true }},
        document: {
        id: 'id',
        store: [
            "href", "title", "description"
        ],
        index: ["title", "description", "content"]
        }
    });

I added this code

  encode: false,
  tokenize: function(str){
    return str.replace(/[\x00-\x7F]/g, "").split("");
  }

[colinwilson]

To be honest, this is what I was intending to try.

I'll have a closer look at this when I have more time over the coming weekend.

[yangchuansheng]

any progress?