juliac: log entrypoints and nonstandard typedefs

[timholy]

To facilitate creating bindings for other programming languages, this adds logging to the juliac buildscript, optionally outputting a logfile that describes the entrypoints (signatures and return types) and nonstandard typedefs that appear in the entrypoint specifications.

My Makefile skills are rudimentary at best, so please do check that aspect with particular care.

[timholy]

OK, this is getting more ambitious but running into issues. I'm now trying to actually use the library and not seeing the names I need:

tim@kenzo:~/src/julia/test/trimming$ make JULIA='../../julia --startup-file=no' BIN=.
../../julia --startup-file=no -t 1 -J /home/tim/src/julia/usr/bin/../lib/julia/sys.so --startup-file=no --history-file=no --output-o hello-o.a --output-incremental=no --strip-ir --strip-metadata --experimental --trim /home/tim/src/julia/usr/bin/../share/julia/juliac/juliac-buildscript.jl /home/tim/src/julia/test/trimming/hello.jl --output-exe true
gcc -march=native -mtune=native -m64 -o hello -Wl,--whole-archive hello-o.a -Wl,--no-whole-archive   -std=gnu11 -I'/home/tim/src/julia/usr/include/julia' -fPIC  -lm -L'/home/tim/src/julia/usr/lib' -Wl,--export-dynamic -L'/home/tim/src/julia/usr/lib/julia' -Wl,-rpath,'/home/tim/src/julia/usr/lib/julia' -Wl,-rpath,'/home/tim/src/julia/usr/lib' -ljulia -ljulia-internal
../../julia --startup-file=no -t 1 -J /home/tim/src/julia/usr/bin/../lib/julia/sys.so --startup-file=no --history-file=no --project=/home/tim/src/julia/test/trimming -e "using Pkg; Pkg.instantiate()"
../../julia --startup-file=no -t 1 -J /home/tim/src/julia/usr/bin/../lib/julia/sys.so --startup-file=no --history-file=no --project=/home/tim/src/julia/test/trimming --output-o basic_jll-o.a --output-incremental=no --strip-ir --strip-metadata --experimental --trim /home/tim/src/julia/usr/bin/../share/julia/juliac/juliac-buildscript.jl /home/tim/src/julia/test/trimming/basic_jll.jl --output-exe true
gcc -march=native -mtune=native -m64 -o basic_jll -Wl,--whole-archive basic_jll-o.a -Wl,--no-whole-archive   -std=gnu11 -I'/home/tim/src/julia/usr/include/julia' -fPIC  -lm -L'/home/tim/src/julia/usr/lib' -Wl,--export-dynamic -L'/home/tim/src/julia/usr/lib/julia' -Wl,-rpath,'/home/tim/src/julia/usr/lib/julia' -Wl,-rpath,'/home/tim/src/julia/usr/lib' -ljulia -ljulia-internal
../../julia --startup-file=no -t 1 -J /home/tim/src/julia/usr/bin/../lib/julia/sys.so --startup-file=no --history-file=no --output-o libsimple-o.a --output-incremental=no --strip-ir --strip-metadata --experimental --trim /home/tim/src/julia/usr/bin/../share/julia/juliac/juliac-buildscript.jl /home/tim/src/julia/test/trimming/libsimple.jl --output-lib true ./bindinginfo_libsimple.log
gcc -march=native -mtune=native -m64 -shared -o ./libsimple.so ./libsimple-o.a -lm -L'/home/tim/src/julia/usr/lib' -Wl,--export-dynamic -L'/home/tim/src/julia/usr/lib/julia' -Wl,-rpath,'/home/tim/src/julia/usr/lib/julia' -Wl,-rpath,'/home/tim/src/julia/usr/lib' -ljulia -ljulia-internal
gcc -march=native -mtune=native -m64 -I. -I/home/tim/src/julia/test/trimming -I/home/tim/src/julia/usr/bin/../lib -o capplication capplication.c -lm -L'/home/tim/src/julia/usr/lib' -Wl,--export-dynamic -L'/home/tim/src/julia/usr/lib/julia' -Wl,-rpath,'/home/tim/src/julia/usr/lib/julia' -Wl,-rpath,'/home/tim/src/julia/usr/lib' -ljulia -ljulia-internal  -Wl,-rpath=. -L. -lsimple   -std=gnu11 -I'/home/tim/src/julia/usr/include/julia' -fPIC
/usr/bin/ld: /tmp/cczir9hy.o: in function `main':
capplication.c:(.text+0x8f): undefined reference to `copyto_and_sum'
/usr/bin/ld: capplication.c:(.text+0xf4): undefined reference to `countsame'
collect2: error: ld returned 1 exit status
make: *** [Makefile:58: capplication] Error 1

tim@kenzo:~/src/julia/test/trimming$ nm -D libsimple.so
                 w _ITM_deregisterTMCloneTable
                 w _ITM_registerTMCloneTable
                 w __cxa_finalize
                 w __gmon_start__
tim@kenzo:~/src/julia/test/trimming$

[JeffBezanson]

Try -Wl,--whole-archive libsimple-o.a -Wl,--no-whole-archive.

[timholy]

Thanks. I think this may be ready. One caveat is that I haven't finished the package that parses the logfile to generate the .h file (this one was written manually); it might not hurt to wait to merge this until I know that won't encounter any unexpected road blocks.

[timholy]

I can now verify that it works nicely. https://github.com/JuliaInterop/JuliaLibWrapping.jl

[topolarity]

Thanks for taking the initiative on this, this is lovely!

Some thoughts on the implementation, but I am definitely in favor of the feature 👍

[timholy]

This looks great, many thanks!

[timholy]

This looks very good. Only small quibbles, then I think this is ready to merge.

[timholy]

IIUC there isn't a "meaningful" test of this escaping.

[vtjnash]

It looks like we have a number of copies of this now running around (test_print_str_escape_json, json_repr). Can we potentially combine them, or at least put them all in a single file to include as needed, so that we can make sure they all use the same logic?

[timholy]

Oh, and if we don't want the support for recursive types to regress, we should add a test for that too.

[timholy]

Not quite sure how to fix the test failure here...I can't even seem to run these tests locally anymore.