Is there a recipe for yocto building?

[arielmol]

I tried the trivial, but got confused as ola requires a native ola to build itself, so the trivial way is not that trivial. I wonder if anyone has already prepared a yocto recipe?

[peternewman]

Not that I'm aware of, some discussion here:
http://lists.openembedded.org/pipermail/openembedded-devel/2014-July/096999.html

Or Buildroot:
https://github.com/beagleboard/buildroot/blob/master/package/ola/ola.mk

You just need to deal with cross-compilation.

See also:
https://gist.github.com/simark/1167861bfabe21dd7658
https://github.com/s-light/acme_ola_crosscompile
#489
https://opendmx.net/index.php/Cross_Compiling_OLA

[arielmol]

Well that's an awesome start, I tried creating the recipe but stopped around the native build. It seems the first link is already beyond what I achieved. I will test it and fix the build, maybe I can make it work.

[arielmol]

I have routinely built ola for ARM on the pi, but not using yocto, this helps a lot.

[arielmol]

Yocto rocko uses libftdi1 not libftdi0 so configure fails

$PKG_CONFIG --exists --print-errors "libftdi1 >= 0.18"

But modifying line:

ola/configure.ac

Line 624 in 00dc86a

[PKG_CHECK_MODULES([libftdi], [libftdi >= 0.18], [have_libftdi="yes"],

to
[PKG_CHECK_MODULES([libftdi], [libftdi1 >= 0.18], [have_libftdi="yes"],

Makes it finish ok. I think this is related to #1012

[arielmol]

Right now with the libftdi1 fix, I can build ola natively on a yocto-generated image (if I provide all necessary *dev pakages). But when cross compiling I get into errors. Yocto first builds ola-native (in my case for x86_64) then it should build for the target (ARM). But ola-native fails, it seems it is looking for an folder (common/rdm/) that is just not there while running protoc.

ERROR: ola-native-0.10.6-r0 do_compile: Function failed: do_compile (log file is located at /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/temp/log.do_compile.30212)
ERROR: Logfile of failure stored in: /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/temp/log.do_compile.30212
Log data follows:
| DEBUG: Executing shell function do_compile
| NOTE: make -j 8
| + cd /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/build
| + do_compile
| + autotools_do_compile
| + oe_runmake
| + oe_runmake_call
| + bbnote make -j 8
| + [ -p /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/temp/fifo.30212 ]
| + printf %b\0 bbnote make -j 8
| + make -j 8
|
| + cd /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/build
| + do_compile
| + autotools_do_compile
| + oe_runmake
| + oe_runmake_call
| + bbnote make -j 8
| + [ -p /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/temp/fifo.30212 ]
| + printf %b\0 bbnote make -j 8
| + make -j 8
| /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/recipe-sysroot-native/usr/bin/protoc --cpp_out common/protocol --proto_path ../git/common/protocol ../git/common/protocol/Ola.proto
| /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/recipe-sysroot-native/usr/bin/protoc --cpp_out common/protocol --proto_path ../git/common/protocol ../git/common/protocol/Ola.proto
|
| /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/recipe-sysroot-native/usr/bin/protoc --cpp_out common/protocol --proto_path ../git/common/protocol ../git/common/protocol/Ola.proto
| /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/recipe-sysroot-native/usr/bin/protoc --cpp_out common/protocol --proto_path ../git/common/protocol ../git/common/protocol/Ola.proto
| /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/recipe-sysroot-native/usr/bin/protoc --plugin=protoc-gen-cppservice=./protoc/ola_protoc_plugin --cppservice_out common/protocol --proto_path ../git/common/protocol ../git/common/protocol/Ola.proto
| /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/recipe-sysroot-native/usr/bin/protoc --plugin=protoc-gen-cppservice=./protoc/ola_protoc_plugin --cppservice_out common/protocol --proto_path ../git/common/protocol ../git/common/protocol/Ola.proto
|
| /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/recipe-sysroot-native/usr/bin/protoc --plugin=protoc-gen-cppservice=./protoc/ola_protoc_plugin --cppservice_out common/protocol --proto_path ../git/common/protocol ../git/common/protocol/Ola.proto
| /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/recipe-sysroot-native/usr/bin/protoc --plugin=protoc-gen-cppservice=./protoc/ola_protoc_plugin --cppservice_out common/protocol --proto_path ../git/common/protocol ../git/common/protocol/Ola.proto
| /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/recipe-sysroot-native/usr/bin/protoc --cpp_out common/rdm --proto_path ../git/common/rdm ../git/common/rdm/Pids.proto
|
| /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/recipe-sysroot-native/usr/bin/protoc --cpp_out common/rdm --proto_path ../git/common/rdm ../git/common/rdm/Pids.proto
| /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/recipe-sysroot-native/usr/bin/protoc --cpp_out common/rdm --proto_path ../git/common/rdm ../git/common/rdm/Pids.proto
|
| /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/recipe-sysroot-native/usr/bin/protoc --cpp_out common/rdm --proto_path ../git/common/rdm ../git/common/rdm/Pids.proto
| /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/recipe-sysroot-native/usr/bin/protoc --cpp_out common/rpc --proto_path ../git/common/rpc ../git/common/rpc/Rpc.proto
|
| /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/recipe-sysroot-native/usr/bin/protoc --cpp_out common/rpc --proto_path ../git/common/rpc ../git/common/rpc/Rpc.proto
| /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/recipe-sysroot-native/usr/bin/protoc --cpp_out common/rpc --proto_path ../git/common/rpc ../git/common/rpc/Rpc.proto
|
| /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/recipe-sysroot-native/usr/bin/protoc --cpp_out common/rpc --proto_path ../git/common/rpc ../git/common/rpc/Rpc.proto
| [libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: Ola.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.)
|
| [libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: Ola.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.)
| [libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: Pids.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.)
|
| [libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: Pids.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.)
| [libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: Rpc.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.)
|
| [libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: Rpc.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.)
| [libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: Ola.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.)
| common/rpc/: No such file or directory
|
| [libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: Ola.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.)
| common/rpc/: No such file or directory
| Makefile:18000: recipe for target 'common/rpc/Rpc.pb.cc' failed
| make: *** [common/rpc/Rpc.pb.cc] Error 1
| make: *** Waiting for unfinished jobs....
|
| Makefile:18000: recipe for target 'common/rpc/Rpc.pb.cc' failed
| make: *** [common/rpc/Rpc.pb.cc] Error 1
| make: *** Waiting for unfinished jobs....
| [libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: Ola.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.)
|
| [libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: Ola.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.)
| common/protocol/
| common/protocol/:
| : No such file or directory
| No such file or directory
|
|
| [libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: Ola.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.)
|
| [libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: Ola.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.)
| Makefile:17994: recipe for target 'common/protocol/OlaService.pb.cpp' failed
| make: *** [common/protocol/OlaService.pb.cpp] Error 1
|
| Makefile:17994: recipe for target 'common/protocol/OlaService.pb.cpp' failed
| make: *** [common/protocol/OlaService.pb.cpp] Error 1
| [libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: Pids.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.)
| common/rdm/: No such file or directory
| Makefile:17997: recipe for target 'common/rdm/Pids.pb.cc' failed
| make: *** [common/rdm/Pids.pb.cc] Error 1
|
| [libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: Pids.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.)
| common/rdm/: No such file or directory
| Makefile:17997: recipe for target 'common/rdm/Pids.pb.cc' failed
| make: *** [common/rdm/Pids.pb.cc] Error 1
| common/rdm/: No such file or directory
| [libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: Rpc.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.)
|
| common/rdm/: No such file or directory
| [libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: Rpc.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.)
| Makefile:17997: recipe for target 'common/rdm/Pids.pb.h' failed
| make: *** [common/rdm/Pids.pb.h] Error 1
|
| Makefile:17997: recipe for target 'common/rdm/Pids.pb.h' failed
| make: *** [common/rdm/Pids.pb.h] Error 1
| common/rpc/: No such file or directory
|
| common/rpc/: No such file or directory
| common/protocol/: No such file or directory
| Makefile:17994: recipe for target 'common/protocol/OlaService.pb.h' failed
| make: *** [common/protocol/OlaService.pb.h] Error 1
|
| common/protocol/: No such file or directory
| Makefile:17994: recipe for target 'common/protocol/OlaService.pb.h' failed
| make: *** [common/protocol/OlaService.pb.h] Error 1
| common/protocol/: No such file or directory
|
| common/protocol/: No such file or directory
| Makefile:17991: recipe for target 'common/protocol/Ola.pb.h' failed
| make: *** [common/protocol/Ola.pb.h] Error 1
|
| Makefile:17991: recipe for target 'common/protocol/Ola.pb.h' failed
| make: *** [common/protocol/Ola.pb.h] Error 1
| Makefile:18000: recipe for target 'common/rpc/Rpc.pb.h' failed
| make: *** [common/rpc/Rpc.pb.h] Error 1
|
| Makefile:18000: recipe for target 'common/rpc/Rpc.pb.h' failed
| make: *** [common/rpc/Rpc.pb.h] Error 1
| common/protocol/: No such file or directory
|
| common/protocol/: No such file or directory
| Makefile:17991: recipe for target 'common/protocol/Ola.pb.cc' failed
| make: *** [common/protocol/Ola.pb.cc] Error 1
| + die oe_runmake failed
| + bbfatal_log oe_runmake failed
| + [ -p /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/temp/fifo.30212 ]
|
| Makefile:17991: recipe for target 'common/protocol/Ola.pb.cc' failed
| make: *** [common/protocol/Ola.pb.cc] Error 1
| + die oe_runmake failed
| + bbfatal_log oe_runmake failed
| + [ -p /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/temp/fifo.30212 ]
| ERROR: oe_runmake failed
| + printf %b\0 bbfatal_log oe_runmake failed
| + exit 1
| + bb_exit_handler
| + ret=1
| + echo WARNING: exit code 1 from a shell command.
| WARNING: exit code 1 from a shell command.
| + exit 1
|
| + printf %b\0 bbfatal_log oe_runmake failed
| + exit 1
| + bb_exit_handler
| + ret=1
| + echo WARNING: exit code 1 from a shell command.
| WARNING: exit code 1 from a shell command.
| + exit 1
| ERROR: Function failed: do_compile (log file is located at /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/temp/log.do_compile.30212)

• do_rm_work
• mkdir -p /home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/debianutils-native/4.8.1.1-r0/pseudo/
  ERROR: Task (virtual:native:/home/ariel/projects/poky/meta-rpi/recipes-misc/ola/ola_git.bb:do_compile) failed with exit code '1'

[arielmol]

I can confirm common/rdm is not there:
/home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/build

[arielmol]

I removed the rdm-tests and ran with config flags:
--disable-unittests --disable-rdm-tests --disable-python-libs --disable-java-libs --disable-all-plugins --enable-dummy

Got less errors but still specific to missing folder, attached the log:
log.txt

[peternewman]

Do you need FTDI? I'd suggest adding --disable-libftdi to configure instead, which should stop the error, given we don't yet support libftdi1 (as you say, due to #1012 ).

common/rpc will likely be missing too etc I suspect.

Can we see the Yocto config you're using, or ideally can you try and run the cross compile outside of Yocto?

It's failing on the core protobuf stuff, rather than anything specific to the RDM tests, so disabling them won't help. Basically, without this core stuff, OLA can't be compiled.

[peternewman]

It's trying to write the file into common/rpc:

/home/ariel/projects/poky/rpi/tmp/work/x86_64-linux/ola-native/0.10.6-r0/recipe-sysroot-native/usr/bin/protoc --cpp_out common/rpc --proto_path ../git/common/rpc ../git/common/rpc/TestService.proto
[libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: Ola.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.)
[libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: Ola.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.)
[libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: Pids.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.)
[libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: Rpc.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.)
common/rpc/: No such file or directory
[libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: Rpc.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.)
Makefile:18000: recipe for target 'common/rpc/Rpc.pb.cc' failed
make: *** [common/rpc/Rpc.pb.cc] Error 1

So I think it's actually complaining that the folder path doesn't exist (common/rpc).

[arielmol]

As you can see, in my latest run i got --disable-all-plugins --enable-dummy

Please see the log.txt attached before. No plugins still give
common/rpc/: No such file or directory

[arielmol]

I think the line should be ../git/common/rpc

/home/<snip>/usr/bin/protoc --cpp_out ../git/common/rpc --proto_path ../git/common/rpc ../git/common/rpc/TestService.proto

Right now it is
/home/<snip>/usr/bin/protoc --cpp_out common/rpc --proto_path ../git/common/rpc ../git/common/rpc/TestService.proto

../git/common/rpc does exist.

[peternewman]

It shouldn't be ../git/, I'm assuming that's where you're source is, but you're trying to build into the build folder?

Everywhere it says --cpp_out common/rpc or equivalent in common/rpc/Makefile.mk and similar, add $(top_builddir) to the start of that path, e.g. --cpp_out $(top_builddir)/common/rpc and see if that improves it.

If it does, I'll open a PR with a more complete set of changes.

[arielmol]

Just to test, I generated a symlink to the missing path, and it passes. So it's just a matter to replace that path with the correct one.

Please check this: https://gist.github.com/desert/e10c17c8da12d0ff31f0e1799cc22f06

I guess LINE 15 is the needed path. But how to add it?