Lua filters applying too late? Cannot detect already ignored tags

[Abastro]

Hello.

I am following
https://pandoc.org/lua-filters.html#building-images-with-tikz,
but it does not seem to work - pandoc simply ignores all the tikz tags before applying my lua filters.
(Or is the filter not up to date?)

So, is there a way to make it not ignore the tag?
Thanks in advance!

[tarleb]

Please provide more info: what's the input, how do you invoke pandoc, which versions are you using?

[Abastro]

Input

manifolds-and-first-order.tex is a lengthy tex document, which include the portion

\begin{tikzcd}
  x \rar & y \\
  z \rar & w
\end{tikzcd}

I don't think the other parts would matter.

Invocation of pandoc

pandoc --lua-filter ../../filters/latex.lua -o my.html manifolds-and-first-order.tex --mathjax -v
I checked ../../filters/latex.lua is the correct lua script file.

Lua script file

local system = require 'pandoc.system'

local tikz_doc_template = [[
\documentclass[crop,tikz]{standalone}
\usepackage{xcolor}
\usepackage{tikz}
\usepackage{tikz-cd}
\begin{document}
\nopagecolor
%s
\end{document}
]]

local function tikz2image(src, filetype, outfile)
  system.with_temporary_directory('tikz2image', function (tmpdir)
    system.with_working_directory(tmpdir, function()
      local f = io.open('tikz.tex', 'w')
      f:write(tikz_doc_template:format(src))
      f:close()
      print("Pre-convert, working dir " .. tmpdir)
      os.execute('pdflatex tikz.tex --no-shell-escape')
      print("Post-convert")
      if filetype == 'pdf' then
        os.rename('tikz.pdf', outfile)
      else
        os.execute('pdf2svg tikz.pdf ' .. outfile)
      end
    end)
  end)
end

extension_for = {
  html = 'svg',
  html4 = 'svg',
  html5 = 'svg',
  latex = 'pdf',
  beamer = 'pdf' }

local function file_exists(name)
  local f = io.open(name, 'r')
  if f ~= nil then
    io.close(f)
    return true
  else
    return false
  end
end

local function starts_with(start, str)
  return str:sub(1, #start) == start
end


function RawBlock(el)
  print('block found')
  if starts_with('\\begin{tikzpicture}', el.text) or starts_with('\\begin{tikzcd}', el.text) then
    local filetype = extension_for[FORMAT] or 'svg'
    local fbasename = pandoc.sha1(el.text) .. '.' .. filetype
    local fname = system.get_working_directory() .. '/' .. fbasename
    if not file_exists(fname) then
      print("Writing tikz image to: " .. fname)
      tikz2image(el.text, filetype, fname)
      print("Wrote tikz image to: " .. fname)
    end
    return pandoc.Para({pandoc.Image({}, fbasename)})
  else
   return el
  end
end

Pandoc Version

pandoc 3.2.1
Features: -server +lua
Scripting engine: Lua 5.4
User data directory: /home/abastro/.local/share/pandoc
Copyright (C) 2006-2024 John MacFarlane. Web: https://pandoc.org
This is free software; see the source for copying conditions. There is no
warranty, not even for merchantability or fitness for a particular purpose.

[tarleb]

Try invoking pandoc with --from=latex+raw_tex.

[Abastro]

Thank you, this works like a charm!