unexpected EOF

[fdncred]

I tried rebuilding everything today to get on the latest tree-sitter-nu and now get this. Any guesses?

❯ topiary format toolkit.nu
[2025-12-02T19:20:37Z ERROR topiary::error] Error parsing query file
[2025-12-02T19:20:37Z ERROR topiary::error] Cause: QueryError { row: 355, column: 18, offset: 5575, message: "Unexpected EOF", kind: Structure }
Error: nu::shell::non_zero_exit_code

  × External command had a non-zero exit code
   ╭─[entry #42:1:1]
 1 │ topiary format toolkit.nu
   · ───┬───
   ·    ╰── exited with code 4
   ╰────

[blindFS]

Weird, never saw that kind of error. Your topiary-cli version BTW?

[fdncred]

I was on Windows and just did cargo install topiary-cli so I guess that's whatever the most recent release is.

[blindFS]

I was on Windows and just did cargo install topiary-cli so I guess that's whatever the most recent release is.

Yeah, could be some kind of regression of the new version of topiary-cli, not sure.

[blindFS]

@mkatychev Sorry to bother again, do you happen to have any clue?

[mkatychev]

This looks like an error in the query file, is "latest" this commit SHA: 47d4b4f5369c0cae866724758ae88ef07e10e4f1?

EDIT:
You can try calling topiary coverage but I haven't wired up rich error reporting for parsing a query file yet sadly, could you try adding the -verbose flag?

[blindFS]

This looks like an error in the query file, is "latest" this commit SHA: 47d4b4f5369c0cae866724758ae88ef07e10e4f1?

Yes, tree-sitter-nu.

Query files of tree-sitter-nu are not parsed by topiary, right? The error definitely refers to languages/nu.scm, the line number matches.

[blindFS]

topiary coverage

This is from my mac.

Details

  × Unmatched queries: 27
     ╭─[/nix/store/mbky9fa71xibrc5818x5wc3ln593w6kj-topiary-nushell-config/languages/nu.scm:93:1]
  92 │     )
  93 │     (short_flag "=" @prepend_antispace @append_antispace)
     ·     ▲
     ·     ╰── unmatched
  94 │     (long_flag "=" @prepend_antispace @append_antispace)
     ·     ▲
     ·     ╰── unmatched
  95 │     (env_var "=" @prepend_antispace @append_antispace)
     ·     ▲
     ·     ╰── unmatched
  96 │
  97 │     ;; indentation
  98 │     [
  99 │       "["
 100 │       "("
 101 │       "...("
 102 │       "...["
 103 │       "...{"
 104 │     ] @append_indent_start @append_empty_softline
 105 │
 106 │     [
 107 │       "]"
 108 │       "}"
 109 │       ")"
 110 │     ] @prepend_indent_end @prepend_empty_softline
 111 │
 112 │     ;; change line happens after || for closure
 113 │     "{" @append_indent_start
 114 │     (
 115 │       "{" @append_empty_softline
 116 │       .
 117 │       (parameter_pipes)? @do_nothing
 118 │     )
 119 │
 120 │     ;; let/mut expression
 121 │     (_
 122 │       value: (pipeline
 123 │         .
 124 │         (pipe_element) @append_indent_start
 125 │         .
 126 │         (comment)*
 127 │         .
 128 │         ["err>|" "out>|" "e>|" "o>|" "err+out>|" "out+err>|" "o+e>|" "e+o>|" "|"]
 129 │       ) @append_indent_end
 130 │     )
 131 │
 132 │     ;; assignment
 133 │ ╭─▶ (_
 134 │ │     rhs: (pipeline
 135 │ │       .
 136 │ │       (pipe_element) @append_indent_start
 137 │ │       .
 138 │ │       (comment)*
 139 │ │       .
 140 │ │       ["err>|" "out>|" "e>|" "o>|" "err+out>|" "out+err>|" "o+e>|" "e+o>|" "|"]
 141 │ │     ) @append_indent_end
 142 │ ├─▶ )
     · ╰──── unmatched
 143 │
 144 │     ;; space/newline between parameters
 145 │     (parameter_pipes
 146 │       (
 147 │         (parameter) @append_space
 148 │         .
 149 │         (parameter)
 150 │       )?
 151 │     ) @append_space @append_spaced_softline
 152 │
 153 │     (parameter_bracks
 154 │       (parameter) @append_space
 155 │       .
 156 │       (parameter) @prepend_empty_softline
 157 │     )
 158 │
 159 │ ╭─▶ (parameter_parens
 160 │ │     (parameter) @append_space
 161 │ │     .
 162 │ │     (parameter) @prepend_empty_softline
 163 │ ├─▶ )
     · ╰──── unmatched
 164 │
 165 │ ╭─▶ (parameter
 166 │ │     flag_capsule: _ @prepend_space
 167 │ ├─▶ )
     · ╰──── unmatched
 168 │
 169 │ ╭─▶ (parameter
 170 │ │     "," @delete
 171 │ ├─▶ )
     · ╰──── unmatched
 172 │
 173 │     ;; attributes
 174 │ ╭─▶ (attribute
 175 │ │     (attribute_identifier)
 176 │ │     (_)? @prepend_space
 177 │ ├─▶ ) @append_hardline
     · ╰──── unmatched
 178 │
 179 │ ╭─▶ (attribute_list
 180 │ │     ";" @delete @append_hardline
 181 │ ├─▶ )
     · ╰──── unmatched
 182 │
 183 │     ;; declarations
 184 │     (decl_def
 185 │       (long_flag)? @prepend_space @append_space
 186 │       quoted_name: _? @prepend_space @append_space
 187 │       unquoted_name: _? @prepend_space @append_space
 188 │       (returns)?
 189 │       (block) @prepend_space
 190 │     )
 191 │
 192 │ ╭─▶ (returns
 193 │ │     ":"? @do_nothing
 194 │ ├─▶ ) @prepend_space
     · ╰──── unmatched
 195 │
 196 │ ╭─▶ (returns
 197 │ │     type: _ @append_spaced_softline
 198 │ │     .
 199 │ │     type: _
 200 │ ├─▶ )
     · ╰──── unmatched
 201 │
 202 │     (decl_use (_) @prepend_space)
 203 │     (decl_extern (_) @prepend_space)
     ·     ▲
     ·     ╰── unmatched
 204 │     (decl_module (_) @prepend_space)
     ·     ▲
     ·     ╰── unmatched
 205 │
 206 │     ;; newline
 207 │     (comment) @prepend_input_softline @append_hardline
 208 │
 209 │     ;; TODO: pseudo scope_id to cope with
 210 │     ;; https://github.com/tree-sitter/tree-sitter/discussions/3967
 211 │     (nu_script
 212 │       (_) @append_begin_scope
 213 │       .
 214 │       (_) @prepend_end_scope @prepend_input_softline
 215 │       (#scope_id! "consecutive_scope")
 216 │     )
 217 │
 218 │     (block
 219 │       (_) @append_begin_scope
 220 │       .
 221 │       (_) @prepend_end_scope @prepend_input_softline
 222 │       (#scope_id! "consecutive_scope")
 223 │     )
 224 │
 225 │     (val_closure
 226 │       (_) @append_begin_scope
 227 │       .
 228 │       (_) @prepend_end_scope @prepend_input_softline
 229 │       (#scope_id! "consecutive_scope")
 230 │     )
 231 │
 232 │     (block
 233 │       "{" @append_space
 234 │       "}" @prepend_space
 235 │     )
 236 │
 237 │     ;; HACK: temporarily disable formatting after special comment
 238 │     ;; abuse capture `@do_nothing` for the predicate
 239 │ ╭─▶ (nu_script
 240 │ │     (comment) @do_nothing
 241 │ │     .
 242 │ │     (_) @leaf
 243 │ │     (#match? @do_nothing "topiary: disable")
 244 │ ├─▶ )
     · ╰──── unmatched
 245 │
 246 │ ╭─▶ (block
 247 │ │     (comment) @do_nothing
 248 │ │     .
 249 │ │     (_) @leaf
 250 │ │     (#match? @do_nothing "topiary: disable")
 251 │ ├─▶ )
     · ╰──── unmatched
 252 │
 253 │ ╭─▶ (val_closure
 254 │ │     (comment) @do_nothing
 255 │ │     .
 256 │ │     (_) @leaf
 257 │ │     (#match? @do_nothing "topiary: disable")
 258 │ ├─▶ )
     · ╰──── unmatched
 259 │
 260 │     (val_closure
 261 │       "{" @append_space
 262 │       .
 263 │       (parameter_pipes)? @do_nothing
 264 │     )
 265 │
 266 │     (val_closure "}" @prepend_space)
 267 │
 268 │     ;; control flow
 269 │     (ctrl_if
 270 │       "if" @append_space
 271 │       condition: _ @append_space
 272 │       then_branch: _
 273 │       "else"? @prepend_input_softline
 274 │     )
 275 │
 276 │ ╭─▶ (ctrl_for
 277 │ │     "for" @append_space
 278 │ │     "in" @prepend_space @append_space
 279 │ │     body: _ @prepend_space
 280 │ ├─▶ )
     · ╰──── unmatched
 281 │
 282 │ ╭─▶ (ctrl_while
 283 │ │     "while" @append_space
 284 │ │     condition: _ @append_space
 285 │ ├─▶ )
     · ╰──── unmatched
 286 │
 287 │ ╭─▶ (ctrl_match
 288 │ │     "match" @append_space
 289 │ │     scrutinee: _? @append_space
 290 │ │     (match_arm)? @prepend_spaced_softline
 291 │ │     (default_arm)? @prepend_spaced_softline
 292 │ │     "}"? @prepend_spaced_softline
 293 │ ├─▶ )
     · ╰──── unmatched
 294 │
 295 │     (match_pattern "|" @prepend_spaced_softline @append_space)
     ·     ▲
     ·     ╰── unmatched
 296 │
 297 │     ;; data structures
 298 │ ╭─▶ (command_list
 299 │ │     [
 300 │ │       (cmd_identifier)
 301 │ │       (val_string)
 302 │ │     ] @append_space @prepend_spaced_softline
 303 │ ├─▶ )
     · ╰──── unmatched
 304 │
 305 │     (command
 306 │       flag: _? @prepend_input_softline
 307 │       arg_str: _? @prepend_input_softline
 308 │       arg_spread: _? @prepend_input_softline
 309 │       arg: _? @prepend_input_softline
 310 │     )
 311 │
 312 │ ╭─▶ (redirection
 313 │ │     file_path: _? @prepend_input_softline
 314 │ ├─▶ ) @prepend_input_softline
     · ╰──── unmatched
 315 │
 316 │     (list_body
 317 │       entry: _ @append_space
 318 │       .
 319 │       entry: _ @prepend_spaced_softline
 320 │     )
 321 │
 322 │ ╭─▶ (record_body
 323 │ │     entry: _ @append_space
 324 │ │     .
 325 │ │     entry: _ @prepend_spaced_softline
 326 │ ├─▶ )
     · ╰──── unmatched
 327 │
 328 │     ;; match_arm
 329 │ ╭─▶ (val_list
 330 │ │     (list_body)
 331 │ │     .
 332 │ │     rest: _ @prepend_spaced_softline
 333 │ ├─▶ )
     · ╰──── unmatched
 334 │
 335 │ ╭─▶ (val_table
 336 │ │     row: _ @prepend_spaced_softline
 337 │ ├─▶ )
     · ╰──── unmatched
 338 │
 339 │     ;; type notation
 340 │ ╭─▶ (collection_type
 341 │ │     [
 342 │ │       type: _
 343 │ │       key: _
 344 │ │     ] @append_delimiter
 345 │ │     .
 346 │ │     key: _ @prepend_space
 347 │ │     (#delimiter! ",")
 348 │ ├─▶ )
     · ╰──── unmatched
 349 │
 350 │ ╭─▶ (composite_type
 351 │ │     type: _ @append_delimiter
 352 │ │     .
 353 │ │     type: _ @prepend_space
 354 │ │     (#delimiter! ",")
 355 │ ├─▶ )
     · ╰──── unmatched
     ╰────
  help: Query coverage: 51.79%

[mkatychev]

And you're able to reproduce it? It looks like whatever is on line 354 of your query file is probably containing an unclosed s-expression, you can run topiary config show-sources to see which query file is used (higher row takes precedence).

EDIT: when I get around I need to wire up the query file parsing to work with NodeSpan to get the richer error reporting like in topiary coverage

[blindFS]

And you're able to reproduce it? It looks like whatever is on line 354 of your query file is probably containing an unclosed s-expression, you can run topiary config show-sources to see which query file is used (higher row takes precedence).

No I can't reproduce it.

[mkatychev]

Then @fdncred would have to follow the steps suggested until I can spit out the specific file and location in the document:
#45 (comment)

draft PR for better reporting of query parsing:
tweag/topiary#1139

[fdncred]

Thanks for helping to troubleshoot @mkatychev!

❯ topiary config show-sources
╭───────────┬────────────────────────────────────────────────────────────────────────┬───────────────┬─────────╮
│ source    │ path                                                                   │ languages.ncl │ queries │
├───────────┼────────────────────────────────────────────────────────────────────────┼───────────────┼─────────┤
│ CLI       │ \\?\C:\Users\username\source\repos\forks\topiary-nushell\languages.ncl │ ✅            │ ❌      │
├───────────┼────────────────────────────────────────────────────────────────────────┼───────────────┼─────────┤
│ workspace │ C:\Users\username\source\repos\forks\nushell\.topiary                  │ ❌            │ ❌      │
├───────────┼────────────────────────────────────────────────────────────────────────┼───────────────┼─────────┤
│ OS        │ C:\Users\username\AppData\Roaming\topiary\config                       │ ❌            │ ❌      │
├───────────┼────────────────────────────────────────────────────────────────────────┼───────────────┼─────────┤
│ built-in  │ <built-in>                                                             │ ✅            │ ✅      │
╰───────────┴────────────────────────────────────────────────────────────────────────┴───────────────┴─────────╯

my languages.ncl file

{
  languages = {
    nu = {
      extensions = ["nu"],
      grammar.source.path = "C:/Users/username/source/repos/forks/tree-sitter-nu/nu.dll",
      symbol = "tree_sitter_nu",
    },
  },
}

[blindFS]

@mkatychev is it possible that this is because the nu.dll is built by an incompatible version of tree-sitter-cli?

[mkatychev]

@mkatychev is it possible that this is because the nu.dll is built by an incompatible version of tree-sitter-cli?

That's probable, topiary 0.6x -> 0.7x upgraded the treesitter ABI version but that doesn't explain where the error is happening and we can't reproduce it, has @fdncred directly looked at the query file proper? If so what was the result of topiary check my-nushell-query-file.scm?

There should be a force option in topiary prefetch to force rebuild the grammar dylib

[fdncred]

where is my-nushell-query-file.scm? i'll do the test tomorrow.