Skip to content

Commit e9d99c6

Browse files
authored
Add underscore to tokenizer identifier function (#75)
Allows for using underscore in variable names
1 parent 67de203 commit e9d99c6

File tree

2 files changed

+2
-1
lines changed

2 files changed

+2
-1
lines changed

.gitignore

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1 +1,2 @@
11
/target
2+
/.idea

src/tokenizer.rs

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -175,7 +175,7 @@ impl Tokenizer {
175175
loop {
176176
let chr = self.peek();
177177

178-
if chr.is_alphanumeric() {
178+
if chr.is_alphanumeric() || chr == '_' {
179179
literal.push(chr);
180180
self.advance();
181181
} else {

0 commit comments

Comments
 (0)