Docker build for multi-architecture amd/arm

[lfoppiano]

Finally I nailed it!

This PR provide a multi-architecture build for amd64/arm64. I've switched to the eclipse-adoptium-17-jdk/jre but, for the moment, I'm using ubuntu 20.04 (focal) instead of ubuntu 22. For now Is limited to the manual build for the CRF only image.

This requires some tests, here here the resulting image.

This PR should help to solve #1089 and #928

[coveralls]

coverage: 40.754% (-0.01%) from 40.767%
when pulling 7ea5f74 on multi-arch-docker-image
into f501033 on master.

[heijligers]

I'm getting

rosetta error: failed to open elf at /lib64/ld-linux-x86-64.so.2

when trying to run on macos m1

[lfoppiano]

@heijligers which image did you try?

This one was correctly built with multi arch and arm support: lfoppiano/grobid:latest-crf-multi-arch but I did not manage to get it to work in a stable way.

My next step was to try to solve this issue with spawning process by looking on a way to have a conditional decision in the Dockerfile

Any help is welcome for this issue 🙂

[AaronNGray]

I am currently working on this for the default CRF Docker (Docker.crf) .

This needs work :-

• ARM64 builds of a number of libraries
• generalizing for different architectures
• releases implementing for all the various sub project repos involved

There seems a number of libraries involved :-

• tini - https://github.com/krallin/tini
• pdfalto - https://github.com/kermitt2/pdfalto
• libwapiti - https://github.com/kermitt2/wapiti
• libcrfpp - https://github.com/taku910/crfpp/
• libjip - https://github.com/ninia/jep

tini

https://github.com/krallin/tini
There is a current release of tini for ARM64 :-
https://github.com/krallin/tini/releases/download/v0.19.0/tini-arm64
I have tried this and it works.

pdfalto

https://github.com/kermitt2/pdfalto
This builds fine on x64, and armhf, but has a compile overload call issue with ICU C++.
#1230 (comment)

libwapiti

https://github.com/kermitt2/wapiti

libcrfpp

https://github.com/taku910/crfpp/

libjep

https://github.com/ninia/jep
libjep is a library for Embed Python in Java it involved JNI. This potentially is more complex depending upon the ARM64 JNI support.

I will update this comment as a tracking comment as I make progress.

[AaronNGray]

@lfoppiano It seems the way to deal with multi platform and multi architecture OS/ARCH builds is with build and buildx :-

docker build --platform linux/amd64,linux/arm64 -t */*:* .

docker buildx build \
--push \
--platform linux/arm/v7,linux/arm64/v8,linux/amd64 \ --tag <username>/<repo>:<tag> .

https://github.com/docker/buildx?tab=readme-ov-file#building-multi-platform-images

This should work across multiple docker images :-

https://github.com/AaronNGray/docker-arch-test