Problem while porting a grammar with unicode identifiers #525
Description
Hi, I've been trying to port tree-sitter-bsl for a while, but I'm facing unclear errors like this:
It is obviously a unicode problem, because similar tests in latin pass perfectly normal:
I wonder whether this error related to the uncompatible ABI version (tree-sitter-bsl generates parcer.c with LANGUAGE_VERSION 15, while scripts from this repo generate only LANGUAGE_VERSION 14) or to your translation from a regular grammar to semgrep-grammar thing. I tried commenting ocaml-tree-sitter simplify src/grammar.json.orig src/grammar.json in /core/scripts/ocaml-tree-sitter-gen-c but with no luck.
I've also searched for similar issues directly in the tree-sitter repo, but they seem to be resolved long time ago, so it's either a problem with tree-sitter-bsl or with the translation process to semgrep grammar.
Do you have any suggestions for future investigations? I'm in contact with tree-sitter-bsl maintainer if necessary.