How can I non-destructively run a pre-render script or use a filter to convert from wikilink embeddings to quarto embeddings?

[roderfeen]

Description

This is a follow up to an earlier question on embedding sections of notes.

I would like to, at calling quarto render, convert wikilink/foam type markdown note embeddings (![[note#section-id]]) to quarto type embeddings ({{<external path/note#section-id >}} using the quarto-external extension).

As I understand, a lua filter or pre-render script would be the way to go. However, a python pre-render script appears to edit the files destructively, i.e. not just for the render, but making permanent substitutions of foam type to quarto type strings in the original .qmd file. Moreover I understand lua filters act "too late" in the process to be able to achieve what I want (INPUT --reader--> AST --filter--> AST --writer--> OUTPUT)

The pre-render script basically looks up the absolute path of the ![[note]] embedded, and replaces the foam string to the corresponding quarto-external string. I also found the Obsidian exporter, but I would prefer to do it at render time so that I don't have to duplicate files and can directly integrate my knowledge management system with the manuscripts/projects I create from the notes I make.

I could provide the script/filters I tried creating, but my question right now is only whether my understanding is correct, and whether script/filter is the right approach for my case?

Many thanks.

Using vscode and wsl2 with ubuntu distro on windows 11

[mcanouil]

You are in control of your pre-render script, not Quarto.
Refactor your script to not be destructive, possibly combined with a post-render script.

If your changes are only text changes and there are no code cells you want to compute from those files, Lua filter should work just fine.
Unfortunately, it's a bit hidden, but you can control when your filters runs (still after code cells computations), so you could have your filter runs before Quarto processes the Markdown into its own AST: https://quarto.org/docs/prerelease/1.4/lua_changes.html#more-precise-targeting-of-ast-processing-phases

[roderfeen]

Thanks Mickaël, good to know it's probably just a problem with my script. And that's useful to know about pre and post filters. I will try some things.