tokenize.jl: don‘t hardcode unicode ops range

pthariensflame · pthariensflame · commit 7a526e1750c9 · 2025-07-12T18:40:13.000-07:00
diff --git a/src/julia/tokenize.jl b/src/julia/tokenize.jl
@@ -173,7 +173,7 @@ function optakessuffix(k)
         k == K"!"   ||
         k == K".'"  ||
         k == K"->"  ||
-        K"¬" <= k <= K"∜"
+        K"BEGIN_UNICODE_OPS" <= k <= K"END_UNICODE_OPS"
     )
 end
 

Original file line number	Diff line number	Diff line change
`@@ -173,7 +173,7 @@ function optakessuffix(k)`
`173`	`173`	`k == K"!" \|\|`
`174`	`174`	`k == K".'" \|\|`
`175`	`175`	`k == K"->" \|\|`
`176`		`- K"¬" <= k <= K"∜"`
	`176`	`+ K"BEGIN_UNICODE_OPS" <= k <= K"END_UNICODE_OPS"`
`177`	`177`	`)`
`178`	`178`	`end`
`179`	`179`