[FEATURE] Support for alpine linux

[shakedfb]

Is your feature request related to a problem you encounter with mysql-memory-server?

Yes
When trying to run the mysql server on Alpine linux (common in ci infra), after installing libaio and numactl, there's the following error:
Error relocating /tmp/mysqlmsn/binaries/8.0.42/mysql/bin/mysqld: posix_fallocate64: symbol not found
Error relocating /tmp/mysqlmsn/binaries/8.0.42/mysql/bin/mysqld: fedisableexcept: symbol not found

Describe the solution you'd like

I'd like to see if you can add a binary that supports alpine

API changes

None

Additional context

None

Pull Request

• Tick this if you would be willing to create a pull request to implement this feature.

[Sebastian-Webster]

Hi @shakedfb, thank you for opening this issue. Adding Alpine Linux support would probably just require a check for if the package is running on a system that is running Alpine Linux and then downloading a MySQL musl binary if you are on Alpine. The Linux distro check is already in this package so that is fine, it's the MySQL musl binary that is the problem. As far as I can tell MySQL does not officially support musl and there aren't any CDNs hosting musl MySQL binaries.

I'll look into compiling MySQL for musl. I'll leave this issue open in the meantime if you or anyone else has any contributions they want to make to this matter.

[shakedfb]

@Sebastian-Webster thank you for the reply and the in depth explanation, I'll try to investigate this as well and add a contribution if I manage to make progress on this.

[Sebastian-Webster]

Sweet, thank you! That would be great!

[Sebastian-Webster]

Just a progress update so far...

I was originally compiling the binary on an Alpine Linux virtual machine and I was able to get it to about ~65% complete before an error would show up. I ended up switching to a Docker Alpine image so the steps I make are reproducible. The compilation is currently stuck at about 24% with the following error:

651.0 [ 24%] Building CXX object plugin/x/CMakeFiles/mysqlx.dir/src/sql_statement_builder.cc.o
652.6 [ 24%] Building CXX object plugin/x/CMakeFiles/mysqlx.dir/src/sql_user_require.cc.o
653.0 In file included from /tmp/mysql-9.3.0/plugin/x/src/sql_user_require.h:31,
653.0                  from /tmp/mysql-9.3.0/plugin/x/src/sql_user_require.cc:26:
653.0 /tmp/mysql-9.3.0/plugin/x/src/interface/ssl_session_options.h:45:11: error: 'int64_t' does not name a type
653.0    45 |   virtual int64_t ssl_verify_depth() const = 0;
653.0       |           ^~~~~~~
653.0 /tmp/mysql-9.3.0/plugin/x/src/interface/ssl_session_options.h:31:1: note: 'int64_t' is defined in header '<cstdint>'; this is probably fixable by adding '#include <cstdint>'
653.0    30 | #include <vector>
653.0   +++ |+#include <cstdint>
653.0    31 | 
653.0 /tmp/mysql-9.3.0/plugin/x/src/interface/ssl_session_options.h:46:11: error: 'int64_t' does not name a type
653.0    46 |   virtual int64_t ssl_verify_mode() const = 0;
653.0       |           ^~~~~~~
653.0 /tmp/mysql-9.3.0/plugin/x/src/interface/ssl_session_options.h:46:11: note: 'int64_t' is defined in header '<cstdint>'; this is probably fixable by adding '#include <cstdint>'
653.0 /tmp/mysql-9.3.0/plugin/x/src/interface/ssl_session_options.h:47:11: error: 'int64_t' does not name a type
653.0    47 |   virtual int64_t ssl_sessions_reused() const = 0;
653.0       |           ^~~~~~~
653.0 /tmp/mysql-9.3.0/plugin/x/src/interface/ssl_session_options.h:47:11: note: 'int64_t' is defined in header '<cstdint>'; this is probably fixable by adding '#include <cstdint>'
653.0 /tmp/mysql-9.3.0/plugin/x/src/interface/ssl_session_options.h:49:11: error: 'int64_t' does not name a type
653.0    49 |   virtual int64_t ssl_get_verify_result_and_cert() const = 0;
653.0       |           ^~~~~~~
653.0 /tmp/mysql-9.3.0/plugin/x/src/interface/ssl_session_options.h:49:11: note: 'int64_t' is defined in header '<cstdint>'; this is probably fixable by adding '#include <cstdint>'
653.8 /tmp/mysql-9.3.0/plugin/x/src/sql_user_require.cc: In member function 'ngs::Error_code xpl::Sql_user_require::check_x509(const xpl::iface::Ssl_session_options&) const':
653.8 /tmp/mysql-9.3.0/plugin/x/src/sql_user_require.cc:63:15: error: 'const class xpl::iface::Ssl_session_options' has no member named 'ssl_get_verify_result_and_cert'
653.8    63 |   if (options.ssl_get_verify_result_and_cert() != X509_V_OK)
653.8       |               ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
654.1 make[2]: *** [plugin/x/CMakeFiles/mysqlx.dir/build.make:1465: plugin/x/CMakeFiles/mysqlx.dir/src/sql_user_require.cc.o] Error 1
654.1 make[1]: *** [CMakeFiles/Makefile2:27611: plugin/x/CMakeFiles/mysqlx.dir/all] Error 2
654.1 make: *** [Makefile:166: all] Error 2
------
Dockerfile:14
--------------------
  12 |     WORKDIR mysql-9.3.0/build
  13 |     RUN cmake ..
  14 | >>> RUN make
  15 |     RUN make install
  16 |     
--------------------
ERROR: failed to solve: process "/bin/sh -c make" did not complete successfully: exit code: 2

I did manage to resolve this error without making changes to the MySQL code in the Alpine VM but I have forgotten what I did in the VM to fix that so I haven't been able to fix it in Docker yet. I am still continuing work on this.

[Sebastian-Webster]

Using MariaDB for Alpine Linux could be a last resort alternative but I'd rather get MySQL working for Alpine instead of using MariaDB on Alpine. The differences are small enough that it shouldn't matter for most, but it's not exactly 1:1 and I wouldn't want to create any incompatibility issues for anyone.

[Sebastian-Webster]

According to the following MySQL Bug Reports:
https://bugs.mysql.com/bug.php?id=80322
https://bugs.mysql.com/bug.php?id=110808
https://bugs.mysql.com/bug.php?id=112995

MySQL versions 8.0.2, 8.0.36, and 8.4.0 explicitly support compilation on Alpine, and support for compilation on Alpine (musl) is even mentioned in those versions' release notes.

v8.0.2 release notes
v8.0.36 release notes
v8.4.0 release notes

I've tried replicating that success and compiling all 3 of those versions on Alpine but it still failed and got an error about 75% through the compilation process. If anyone could successfully compile those versions and be able to create instructions that can reproduce the success then that would be great.

Given the bug reports, it does seem like there will be some amount of MySQL versions that won't support musl libc at all so if we can get some binaries for musl libc created, it seems like we'll have to make changes to the mysql-memory-server documentation to mention what versions are available for Alpine and other musl-based distros and add a check in run time to inform the user if they are trying to run a MySQL version without musl support on Alpine and tell them what versions can be ran on their OS.

[Sebastian-Webster]

I so far have MySQL v9.4.0 and v9.3.0 compiling on Alpine Linux for both amd64 and arm64 architectures. It seems like MySQL Router and the MySQL X Plugin have issues with musl-libc so in the MySQL server builds I'm making I'm leaving those out of it. Right now I'm working on seeing if other versions can be built on Alpine and automatically attesting and releasing the compiled builds. It'll take a while to get this all done but Alpine Linux support should be coming to this package soon if all goes well. I'll come back here with any updates along the way.

[Sebastian-Webster]

The MySQL binaries for this package will be sourced from this repository Sebastian-Webster/mysql-server-musl-binaries.

Right now I can only get 9.x and 8.4.x reliably compiling so for this package I'll probably only add support for 9.x and 8.4.x on Alpine until things improve in the other repository. I'm open to any pull requests to expand version support.

[Sebastian-Webster]

The MySQL on Alpine binaries do not support MySQL X and since all MySQL binaries ran with the package currently support MySQL X, this will be a breaking change. There are a few changes I've been thinking of making for a v2.0.0 but haven't made them since they weren't necessary enough to create a breaking change so I'll work on those to get them all in a single breaking change release. This will take a while to be released in a main version as a result of that.