cm3-unix64le-d5.11.1-20210610

[jaykrell]

wget https://github.com/modula3/cm3/releases/download/cm3-d5.11.0-20210608/cm3-boot-unix64le-d5.11.1-20210610.cpp.gz
gunzip cm3-boot-unix64le-d5.11.1-20210610.cpp.gz
g++ -g -pthread -o cm3 cm3-boot-unix64le-d5.11.0-20210610.cpp
sudo rm -rf /cm3  # optionally remove previous
sudo mkdir -p /cm3/bin
sudo chown -R $USER /cm3
mv cm3 /cm3/bin
wget https://github.com/modula3/cm3/archive/refs/tags/cm3-d5.11.0-20210608.tar.gz 
tar xf cm3-d5.11.0-20210608.tar.gz 
# "cm3" is twice in these paths, the repo and the tag.
cd cm3-cm3-d5.11.1-20210610
# Remove some stuff that is not used.
rm -rf m3-sys/m3cc 
rm -rf m3-sys/m3gdb 
cd scripts/python
sudo apt-get install python2
export PATH=/cm3/bin:$PATH
./boot2min.py c
# At this point you have a working compiler and runtime, and
# "extra" build was done so the compiler built itself.
# And then optionally build more (somewhat error prone).
./do-cm3-all.py buildship c 

The configuration sometimes defaults to using the gcc backend.
Edit /cm3/bin/cm3.cfg, put this line first:

readonly M3_BACKEND_MODE = "C"

(i.e. for the AMD64 targets, this is already the default for ARM64 and RISCV64).

You will want:

export PATH=/cm3/bin:$PATH

in .bashrc or similar.

This for 64bit little endian Unix.
e.g. Linux, Mac, Solaris, BSD, amd64, arm64, riscv64.

There is plenty of support for 32bit, big endian, Windows, etc. but this is a sort of "binary" release that does not support everything.
This is the first known release of cm3 of this kind, leveraging the C backend to avoid distributing binaries or assembly and targeting multiple systems with one distribution.

---

This discussion was created from the release cm3-unix64le-d5.11.1-20210610.

[VictorMiasnikov]

Please, fix in description:

- wget https://github.com/modula3/cm3/releases/download/cm3-d5.11.0-20210608/cm3-boot-unix64le-d5.11.1-20210610.cpp.gz
+ wget https://github.com/modula3/cm3/releases/download/unix64le-d5.11.1-20210610/cm3-boot-unix64le-d5.11.1-20210610.cpp.gz

-wget https://github.com/modula3/cm3/archive/refs/tags/cm3-d5.11.0-20210608.tar.gz 
+wget https://github.com/modula3/cm3/archive/refs/tags/unix64le-d5.11.1-20210610.tar.gz

Thanks!

P.S.

On 2021-06-16 this "sub-Isssue" has fixed. Thank!

[tkurtbond]

When I compile this I get:

new source -> compiling dtoa.c
../src/Csupport/dtoa.c:294:13: error: unused function 'StoreincFunction' [-Werror,-Wunused-function]
static void StoreincFunction (ULong** a, ULong hi, ULong lo)
            ^
1 error generated.
  compile_c => 1
C compiler failed compiling: ../src/Csupport/dtoa.c

and then later I get

compilation failed => not building library "libm3core.a"
Fatal Error: package build failed

[tkurtbond]

With that fix I was able get much further along, but eventually ./do-cm3-all.py buildship c stopped with the following errors:

new opaque info -> recompiling HVSplit.m3
new opaque info -> recompiling ZSplit.m3
new opaque info -> recompiling TSplit.m3
new opaque info -> recompiling ButtonVBT.m3
new opaque info -> recompiling PackSplit.m3
 -> archiving libm3ui.a
Undefined symbols for architecture x86_64:
  "_XftCharExists", referenced from:
      _XScrnFont__XftMetrics in XScrnFont_m.o
  "_FcPatternGetInteger", referenced from:
      _XScrnFont__XftIntProp in XScrnFont_m.o
  "_FcPatternGetDouble", referenced from:
      _XScrnFont__XftRealProp in XScrnFont_m.o
  "_XftFontOpenXlfd", referenced from:
      _XScrnFont__FontLookup in XScrnFont_m.o
  "_XftGlyphExtents", referenced from:
      _XScrnFont__XftMetrics in XScrnFont_m.o
  "_XftFontOpenName", referenced from:
      _XScrnFont__FontLookup in XScrnFont_m.o
      _XScrnFont__FontBuiltIn in XScrnFont_m.o
  "_XftColorAllocValue", referenced from:
      _XPaint__DrawXftText in XPaint_m.o
  "_XftDrawCreate", referenced from:
      _XPaint__DrawXftText in XPaint_m.o
  "_XftCharIndex", referenced from:
      _XScrnFont__XftMetrics in XScrnFont_m.o
  "_XftDrawString8", referenced from:
      _XPaint__DrawXftText in XPaint_m.o
  "_FcPatternGetString", referenced from:
      _XScrnFont__XftTextProp in XScrnFont_m.o
  "_XftDrawDestroy", referenced from:
      _XPaint__DrawXftText in XPaint_m.o
ld: symbol(s) not found for architecture x86_64
clang: error: linker command failed with exit code 1 (use -v to see invocation)
  make_lib => 1
librarian failed building: m3ui
Fatal Error: package build failed
/cm3   -DM3_BACKEND_MODE=C -DBUILD_DIR=AMD64_DARWIN -ship -DROOT=/Users/tkb/sw/src/cm3/wrk/cm3-wrk -DTARGET=AMD64_DARWIN +++
 ==> /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-comm/sharedobjgen done

== package /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-db/odbc ==

 +++ /Users/tkb/sw/versions/cm3/git/bin/cm3   -DM3_BACKEND_MODE=C -DBUILD_DIR=AMD64_DARWIN   -build -DROOT=/Users/tkb/sw/src/cm3/wrk/cm3-wrk -DTARGET=AMD64_DARWIN +++
 ==> /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-db/odbc done

 +++ /Users/tkb/sw/versions/cm3/git/bin/cm3   -DM3_BACKEND_MODE=C -DBUILD_DIR=AMD64_DARWIN -ship -DROOT=/Users/tkb/sw/src/cm3/wrk/cm3-wrk -DTARGET=AMD64_DARWIN +++
 ==> /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-db/odbc done

== package /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-db/mysql ==

 +++ /Users/tkb/sw/versions/cm3/git/bin/cm3   -DM3_BACKEND_MODE=C -DBUILD_DIR=AMD64_DARWIN   -build -DROOT=/Users/tkb/sw/src/cm3/wrk/cm3-wrk -DTARGET=AMD64_DARWIN +++
 ==> /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-db/mysql done

 +++ /Users/tkb/sw/versions/cm3/git/bin/cm3   -DM3_BACKEND_MODE=C -DBUILD_DIR=AMD64_DARWIN -ship -DROOT=/Users/tkb/sw/src/cm3/wrk/cm3-wrk -DTARGET=AMD64_DARWIN +++
 ==> /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-db/mysql done

== package /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-db/postgres95 ==

 +++ /Users/tkb/sw/versions/cm3/git/bin/cm3   -DM3_BACKEND_MODE=C -DBUILD_DIR=AMD64_DARWIN   -build -DROOT=/Users/tkb/sw/src/cm3/wrk/cm3-wrk -DTARGET=AMD64_DARWIN +++
 ==> /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-db/postgres95 done

 +++ /Users/tkb/sw/versions/cm3/git/bin/cm3   -DM3_BACKEND_MODE=C -DBUILD_DIR=AMD64_DARWIN -ship -DROOT=/Users/tkb/sw/src/cm3/wrk/cm3-wrk -DTARGET=AMD64_DARWIN +++
 ==> /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-db/postgres95 done

== package /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-db/db ==

 +++ /Users/tkb/sw/versions/cm3/git/bin/cm3   -DM3_BACKEND_MODE=C -DBUILD_DIR=AMD64_DARWIN   -build -DROOT=/Users/tkb/sw/src/cm3/wrk/cm3-wrk -DTARGET=AMD64_DARWIN +++
 ==> /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-db/db done

 +++ /Users/tkb/sw/versions/cm3/git/bin/cm3   -DM3_BACKEND_MODE=C -DBUILD_DIR=AMD64_DARWIN -ship -DROOT=/Users/tkb/sw/src/cm3/wrk/cm3-wrk -DTARGET=AMD64_DARWIN +++
 ==> /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-db/db done

== package /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-db/smalldb ==

 +++ /Users/tkb/sw/versions/cm3/git/bin/cm3   -DM3_BACKEND_MODE=C -DBUILD_DIR=AMD64_DARWIN   -build -DROOT=/Users/tkb/sw/src/cm3/wrk/cm3-wrk -DTARGET=AMD64_DARWIN +++
 ==> /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-db/smalldb done

 +++ /Users/tkb/sw/versions/cm3/git/bin/cm3   -DM3_BACKEND_MODE=C -DBUILD_DIR=AMD64_DARWIN -ship -DROOT=/Users/tkb/sw/src/cm3/wrk/cm3-wrk -DTARGET=AMD64_DARWIN +++
 ==> /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-db/smalldb done

== package /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-db/stablegen ==

 +++ /Users/tkb/sw/versions/cm3/git/bin/cm3   -DM3_BACKEND_MODE=C -DBUILD_DIR=AMD64_DARWIN   -build -DROOT=/Users/tkb/sw/src/cm3/wrk/cm3-wrk -DTARGET=AMD64_DARWIN +++
 ==> /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-db/stablegen done

 +++ /Users/tkb/sw/versions/cm3/git/bin/cm3   -DM3_BACKEND_MODE=C -DBUILD_DIR=AMD64_DARWIN -ship -DROOT=/Users/tkb/sw/src/cm3/wrk/cm3-wrk -DTARGET=AMD64_DARWIN +++
 ==> /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-db/stablegen done

== package /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-db/stable ==

 +++ /Users/tkb/sw/versions/cm3/git/bin/cm3   -DM3_BACKEND_MODE=C -DBUILD_DIR=AMD64_DARWIN   -build -DROOT=/Users/tkb/sw/src/cm3/wrk/cm3-wrk -DTARGET=AMD64_DARWIN +++
 ==> /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-db/stable done

 +++ /Users/tkb/sw/versions/cm3/git/bin/cm3   -DM3_BACKEND_MODE=C -DBUILD_DIR=AMD64_DARWIN -ship -DROOT=/Users/tkb/sw/src/cm3/wrk/cm3-wrk -DTARGET=AMD64_DARWIN +++
 ==> /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-db/stable done

== package /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-ui/X11R4 ==

 +++ /Users/tkb/sw/versions/cm3/git/bin/cm3   -DM3_BACKEND_MODE=C -DBUILD_DIR=AMD64_DARWIN   -build -DROOT=/Users/tkb/sw/src/cm3/wrk/cm3-wrk -DTARGET=AMD64_DARWIN +++
 ==> /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-ui/X11R4 done

 +++ /Users/tkb/sw/versions/cm3/git/bin/cm3   -DM3_BACKEND_MODE=C -DBUILD_DIR=AMD64_DARWIN -ship -DROOT=/Users/tkb/sw/src/cm3/wrk/cm3-wrk -DTARGET=AMD64_DARWIN +++
 ==> /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-ui/X11R4 done

== package /Users/tkb/sw/src/cm3/wrk/cm3-wrk/m3-ui/ui ==

 +++ /Users/tkb/sw/versions/cm3/git/bin/cm3   -DM3_BACKEND_MODE=C -DBUILD_DIR=AMD64_DARWIN   -build -DROOT=/Users/tkb/sw/src/cm3/wrk/cm3-wrk -DTARGET=AMD64_DARWIN +++
 *** execution of [<function _BuildGlobalFunction at 0x10800ac80>, <function _ShipFunction at 0x10800acf8>] failed ***

I don't know if it makes a difference, but /usr/X11R6 and /usr/X11 are symlinks to /private/var/select/X11, and the lib subdirectory of that contains only libXft.2.dylib, with a symlink to that as libXft.dylib - no libXft.a in sight. Using nm on that shows:

$ nm /usr/X11/lib/libXft.dylib | grep -E "(_XftCharExists|_FcPatternGetInteger|_FcPatternGetDouble|_XftFontOpenXlfd|_XftGlyphExtents|_XftFontOpenName|_XftColorAllocValue|_XftDrawCreate|_XftCharIndex|_XftDrawString8|_FcPatternGetString|_XftDrawDestroy)"
                 U _FcPatternGetDouble
                 U _FcPatternGetInteger
                 U _FcPatternGetString
000000000000c081 T _XftCharExists
000000000000c09a T _XftCharIndex
0000000000002f3e T _XftColorAllocValue
0000000000006e63 T _XftDrawCreate
000000000000709d T _XftDrawCreateAlpha
000000000000701b T _XftDrawCreateBitmap
0000000000007192 T _XftDrawDestroy
000000000000775b T _XftDrawString8
0000000000009420 T _XftFontOpenName
0000000000009546 T _XftFontOpenXlfd
000000000000879f T _XftGlyphExtents

I use Homebrew as my package manager on macOS, and /usr/local/lib has links to /usr/local/Cellar/libxft/2.3.3/lib for libXft.a, libXft.dynlib, and libXft.2.dynlib, if the lack of a libXft.a matters.

Is it possible to disable the building of m3ui?

[tkurtbond]

Thanks to some advice I tried ./do-cm3-min.py buildship c instead, thinking to skip over the problem with m3-ui, and that seemed to finish fine. Then I changed to a directory with a src subdirectory with a very simple Modula-3 program and did a cm3 -build, and that seemed to finish ok and produced an executable in AMD64_DARWIN. However, when I ran the program I got the error:

dyld: Library not loaded: @executable_path/../lib/libm3parseparams.5.dylib
  Referenced from: /Users/tkb/current/m3/m3cp/AMD64_DARWIN/m3cp
  Reason: image not found
Abort trap: 6

[ghost]

The issue with executables not working on AMD64_DARWIN is probably DYLD_LIBRARY_PATH. Everything seems to work for me if I set:

export DYLD_LIBRARY_PATH=$HOME/cm3/lib

The problem with libm3ui is a little more involved. It turns out that there is no current X11 configuration in the sources for AMD64_DARWIN. There's one for ARM64_DARWIN, but AMD64_DARWIN just picks up an old config for PowerPC from Darwin.common. The config for the ARM machines is the same one needed for AMD64, so I copied the line

SYSTEM_LIBS{"X11"} = ["-L/opt/X11/lib", "-lXft", "-lfontconfig", "-lXaw", "-lXmu", "-lXext", "-lXt", "-lSM", "-lICE", "-lX11" ]

from $HOME/cm3/bin/config/ARM64_DARWIN to the bottom of $HOME/cm3/bin/config/AMD64_DARWIN and the UI libraries now build. I will see about a patch tomorrow. (Everything in do-cm3-all.py builds up to libvoronoi, which I haven't yet investigated.)

Other than that, I can confirm that #672 fixes the build issues, and everything after that including HEAD builds fine. I'm on an Intel MacBook, MacOS 11.5.2, XCode 12.5.1, XQuartz 2.8.1, and most dependencies installed through MacPorts.

[jaykrell]

You aren't supposed to need DYLD_LIBRARY_PATH, in that we use @executable_path/../lib or such for cm3, and full paths for non-cm3?
X11, yeah, sorry, could be. I'll have to retest that. This is why we need pkg-config, I think.

[ghost]

I realize using DYLD_LIBRARY_PATH is a workaround, but it does seem to be necessary at this time. To be clear, cm3 works perfectly well without it, the workaround is only necessary for executables generated outside the tree. I can confirm that @executable_path/../lib/libm3.5.dylib is being baked into those as well, so that's the problem. I'll look into it.