Cannot upgrade CMake within wizard

[tanderson92]

This issue is very similar to #1317, except this is about using the wizard (I do not yet have a working recipe).

In short I do not find it possible to obtain a recent CMake for the build environment. (The same CMake version is still shipped with BinaryBuilder on my julia v1.12 as was present 2 years ago in #1317). This is problematic for me as I need a CMake >= 3.25 in order to set BLA_PKGCONFIG_BLAS. However, the following does not result in a wizard environment with the desired CMake:

julia> using Pkg
julia> using BinaryBuilder
julia> BinaryBuilder.HostBuildDependency(PackageSpec(; name="CMake_jll", version = v"3.31.9"))

as when I get dumped to a shell I see:

sandbox:${WORKSPACE}/srcdir # cmake --version
cmake version 3.21.7

Nor do I see any other cmake available anywhere in the resulting environment. Using the suggestion of using apk to upgrade cmake doesn't work for the same error mentioned in #1317. (I can provide a full wizard log if desired.)

How does one obtain a recent CMake?

[giordano]

Quoting from https://docs.binarybuilder.org/stable/#Manually-create-or-edit-build_tarballs.jl

The wizard is a great tool, especially to get started with BinaryBuilder and create your first simple recipes for new packages. However, it lacks the full control of all options you can use in a build_tarballs.jl script.

The only solution is really not to use the wizard. If you don't have a fully working build recipe yet, start from a simple one, enter the debug shell with --debug=begin, run the commands in the shell and copy-paste in the script the commands you ran. That's pretty much my standard workflow. The wizard automates the copy-paste business, but it's otherwise very limited

[tanderson92]

Thank you for the advice; I see what you mean now by the intended workflow. Forgive me for my ignorance with these tools, but I can't seem to get a recent CMake using the scripts either:

sandbox:${WORKSPACE}/srcdir/dmk # cmake --version
cmake version 3.21.7

The script is:

build_tarballs.jl.txt

[giordano]

There are lots of examples, search for cmake_jll

[tanderson92]

Thanks @giordano but I had already done precisely that. The script I attached shows I used a HostBuildDependency just as some of those examples do. (Nor does BuildDependency change anything). It appears to have no effect. Moreover, neither does apk del cmake in the script (despite its output appearing in the log) as the resulting environment still has that cmake. Any ideas?

[giordano]

https://github.com/JuliaPackaging/Yggdrasil/blob/0fe1526ed8b71c87b7b43ef1f9a6057210fa1970/S/ssht/build_tarballs.jl#L16-L17

[giordano]

Wait, do you get

sandbox:${WORKSPACE}/srcdir/dmk # cmake --version
cmake version 3.21.7

only inside the debug shell? In that case you have to run again apk del cmake, because changes to the rootfs (e.g. apk commands) are lost when you enter the debug shell.

[tanderson92]

Ah I see I did not know that; indeed, I was not running that again in the debug shell. But when I run apk del cmake there is no shadowed version that it uncovers. I simply have no cmake in the path at all. Also I did have that apk del cmake command in the script above but it does not appear to work (no newer cmake that is shadowed).

In fact even running the build scripts for other jlls in Yggdrasil, I do not see the cmake in the debug environment. It seems like a bigger problem with my BinaryBuilder environments than just my script.

[tanderson92]

I see, indeed the shell has a different version. Yes, BinaryBuilder is using the specified JLL cmake version. Thank you for the help!

I still don't understand how it is that the debug shell doesn't have that cmake visible, even after apk del cmake.

[giordano]

I still don't understand how it is that the debug shell doesn't have that cmake visible, even after apk del cmake.

That confuses me, but I don't really have the time to look into this, sorry

[tanderson92]

@giordano I am confused too but fortunately I made progress and got past the CMake problems. Thank you so much for the help.