Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add a manylinux image for building X86_64 wheels #27

Merged
merged 20 commits into from
Nov 20, 2022
Merged

add a manylinux image for building X86_64 wheels #27

merged 20 commits into from
Nov 20, 2022

Conversation

jameslamb
Copy link
Collaborator

@jameslamb jameslamb commented Nov 5, 2022

Working on microsoft/LightGBM#5514.

How I tested this

Ran the following, with environment variables based on https://github.com/microsoft/LightGBM/blob/master/.vsts-ci.yml.

For different combinations of COMPILER and TASK.

docker run \
    --rm \
    --pull always \
    --entrypoint="" \
    --env AZURE='true' \
    --env BUILD_DIRECTORY=/usr/local/src/LightGBM \
    --env COMPILER=gcc \
    --env CONDA_ENV=test-env \
    --env DOTNET_CLI_TELEMETRY_OPTOUT='true' \
    --env DOTNET_SKIP_FIRST_TIME_EXPERIENCE='true' \
    --env OS_NAME=linux \
    --env PRODUCES_ARTIFACTS='true' \
    --env PYTHON_VERSION='3.10' \
    --env SETUP_CONDA='false' \
    --env TASK=bdist \
    --workdir /usr/local/src \
    -it lightgbm/vsts-agent:manylinux_2_28_x86_64-dev2 \
    bash -c 'export PATH="/opt/miniforge/bin:${PATH}"; git clone --recursive https://github.com/microsoft/LightGBM.git --branch ci/build-manylinux-x86_64-wheels && cd ./LightGBM && ./.ci/setup.sh && ./.ci/test.sh'

@jameslamb jameslamb changed the title WIP: adding a manylinux image for building X86_64 wheels WIP: add a manylinux image for building X86_64 wheels Nov 9, 2022
@@ -0,0 +1,93 @@
#!/bin/bash
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This file was exactly copied from https://github.com/guolinke/lightgbm-ci-docker/blob/master/dockers/ubuntu-14.04/start_azure.sh. I didn't change anything ini it.

@jameslamb jameslamb changed the title WIP: add a manylinux image for building X86_64 wheels add a manylinux image for building X86_64 wheels Nov 19, 2022
@jameslamb jameslamb marked this pull request as ready for review November 19, 2022 05:22
@guolinke
Copy link
Owner

Is this ready to merge?

@jameslamb
Copy link
Collaborator Author

Thanks @guolinke !

I believe it's ready to merge, yes. I've been testing it on microsoft/LightGBM#5580 all jobs are successful there.

Ideally I'd like @StrikerRUS 's opinion but I know he hasn't been able to spend much time on open source recently. I think we should merge this.

@guolinke guolinke merged commit c256d9c into dev Nov 20, 2022
guolinke pushed a commit that referenced this pull request Nov 21, 2022
* Update publish_image.yml

* Create Dockerfile

* Update Dockerfile

* Update Dockerfile

* Update publish_image.yml

* Update Dockerfile

* Update Dockerfile

* [ci] update docker action versions

* add a manylinux image for building X86_64 wheels (#27)

* Trigger workflow for `dev2` branch

* have GitHub Actions try building clang from source

* comment out unnecessary jobs

* minimize clang build

* actually install after building

* add gcc RPATH to clang

* use clang11, build libc++

* add PoCL and Java

* fix trailing slash

* add remaining components and clean up

* fix JAVA_HOME

* java-devel

* install sudo

* set JAVA_HOME to a location with jni.h

* save clang to figure out what is happening

* switch to symlinks for libc++

* uncomment

* add /usr/local/lib64 to LD_LIBRARY_PATH

Co-authored-by: Nikita Titov <nekit94-08@mail.ru>

* differentiate between builds in CI job names

Co-authored-by: Nikita Titov <nekit94-08@mail.ru>
@jameslamb jameslamb deleted the dev2 branch November 30, 2022 03:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants