Updated tokenizer to better matching when search for code snippets#32261

lunny merged 5 commits intogo-gitea:maingo-gitea/gitea:mainfrom

bsofiato:feature/sane-tokenizerbsofiato/gitea:feature/sane-tokenizerCopy head branch name to clipboard