Skip to content

Commit c01728f

Browse files
authored
Update PlainLineTokenizer.lex
include \p{Letter} in the {Identifier} initial character match
1 parent 23e91d9 commit c01728f

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/org/opensolaris/opengrok/search/context/PlainLineTokenizer.lex

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -394,7 +394,7 @@ import org.opensolaris.opengrok.analysis.Scopes.Scope;
394394
%}
395395

396396
//WhiteSpace = [ \t\f\r]+|\n
397-
Identifier = [a-zA-Z_] [a-zA-Z0-9_]*
397+
Identifier = [a-zA-Z\p{Letter}_] [a-zA-Z\p{Letter}0-9\p{Number}_]*
398398
Number = [0-9]+|[0-9]+\.[0-9]+| "0[xX]" [0-9a-fA-F]+
399399
Printable = [\@\$\%\^\&\-+=\?\.\:]
400400

0 commit comments

Comments
 (0)