Mirrored_Repos/veloren
1
0
Fork 0
mirror of https://gitlab.com/veloren/veloren.git synced 2024-08-30 18:12:32 +00:00
Code Issues Packages Projects Releases Wiki Activity
yusdacra/chore/nix
veloren/.gitlab/CI/build.gitlab-ci.yml

191 lines
6.6 KiB
YAML
Raw Permalink Normal View History

fix ci, which was broken by merging unittests and check
2021-01-23 22:05:24 +00:00
unittests:
extends: .recompile-branch
stage: build
Use new multi image cache scheme in the CI and consolidate runner tag specification so that it is easier to modify
2021-05-20 04:21:53 +00:00
image: registry.gitlab.com/veloren/veloren-docker-ci/cache/quality:${CACHE_IMAGE_TAG}
fix ci, which was broken by merging unittests and check
2021-01-23 22:05:24 +00:00
variables:
GIT_DEPTH: 9999999999999
script:
Use new multi image cache scheme in the CI and consolidate runner tag specification so that it is easier to modify
2021-05-20 04:21:53 +00:00
- ln -s /dockercache/target target
ci fails sporadically, remove file so it doesnt fail that often till we have a bettter toolchain
2021-03-23 07:59:37 +00:00
- rm -r target/debug/incremental/veloren_* || echo "all good" # TMP FIX FOR 2021-03-22-nightly
Extract voxygen/src/i18n.rs into own crate - New crate (i18n), currently under voxygen directory - Updated CI to run localization test from i18n, not from voxygen
2021-05-04 08:55:40 +00:00
- cargo test --package veloren-i18n --lib test_all_localizations -- --nocapture --ignored
unittest fix
2021-03-23 10:15:33 +00:00
- rm -r target/debug/incremental* || echo "all good" # TMP FIX FOR 2021-03-22-nightly
add asset_tweaks to unittests on CI
2021-06-08 19:46:45 +00:00
- cargo test --features asset_tweak
fix ci, which was broken by merging unittests and check
2021-01-23 22:05:24 +00:00
retry:
max: 2
change(ci): split up stages into separate files
2020-05-14 15:37:34 +00:00
benchmarks:
Moved coverage and benchmarks to only run post-merge.
2021-04-17 22:49:11 +00:00
extends: .post-merge
CI cleanup - switching more to rules syntax - clean up some templates - EITHER optional builds or build builds - ordering
2020-06-12 11:09:56 +00:00
stage: build
Use new multi image cache scheme in the CI and consolidate runner tag specification so that it is easier to modify
2021-05-20 04:21:53 +00:00
image: registry.gitlab.com/veloren/veloren-docker-ci/cache/bench:${CACHE_IMAGE_TAG}
upload benchmark to central ci db ```sql CREATE TABLE benchmarks( "timestamp" timestamptz NOT NULL DEFAULT (current_setting('veloren.timestamp')::timestamptz), branch text NOT NULL DEFAULT current_setting('veloren.branch'), sha text NOT NULL DEFAULT current_setting('veloren.sha'), "group" text NULL, "function" text NULL, "value" text NULL, throughput_num numeric NULL, throughput_type text NULL, sample_measured_value numeric NOT NULL, unit text NULL, iteration_count numeric NULL ); ```
2020-09-29 23:58:35 +00:00
tags:
- veloren-benchmark
change(ci): document and add retries + fmt
2020-05-14 16:12:22 +00:00
script:
- unset DISABLE_GIT_LFS_CHECK
Use new multi image cache scheme in the CI and consolidate runner tag specification so that it is easier to modify
2021-05-20 04:21:53 +00:00
- ln -s /dockercache/target target
ci fails sporadically, remove file so it doesnt fail that often till we have a bettter toolchain
2021-03-23 07:59:37 +00:00
- ls -la target/*
- rm -r target/debug/incremental/veloren_* || echo "all good" # TMP FIX FOR 2021-03-22-nightly
- rm -r target/release/incremental/veloren_* || echo "all good" # TMP FIX FOR 2021-03-22-nightly
Fix benchmarks by removing the rest of the incremental folder
2021-06-01 21:24:56 +00:00
- rm -r target/debug/incremental/* || echo "all good" # TMP FIX FOR 2021-03-22-nightly
- rm -r target/release/incremental/* || echo "all good" # TMP FIX FOR 2021-03-22-nightly
ci fails sporadically, remove file so it doesnt fail that often till we have a bettter toolchain
2021-03-23 07:59:37 +00:00
- cargo bench || exit 0 #temp fix
it seems like that the TAGUUID must start with a Alphabetic char
2020-12-11 23:20:57 +00:00
- TAGUUID="Z$(cat /dev/urandom | tr -dc 'a-zA-Z0-9' | fold -w 16 | head -n 1)" || echo "ignore this returncode, dont ask me why, it works"
escape ENV variables with a randomly generated 16 char tag. remove installation of postgres client and move it to docker container
2020-11-09 08:53:34 +00:00
- echo $TAGUUID
upload benchmark to central ci db ```sql CREATE TABLE benchmarks( "timestamp" timestamptz NOT NULL DEFAULT (current_setting('veloren.timestamp')::timestamptz), branch text NOT NULL DEFAULT current_setting('veloren.branch'), sha text NOT NULL DEFAULT current_setting('veloren.sha'), "group" text NULL, "function" text NULL, "value" text NULL, throughput_num numeric NULL, throughput_type text NULL, sample_measured_value numeric NOT NULL, unit text NULL, iteration_count numeric NULL ); ```
2020-09-29 23:58:35 +00:00
- echo 'SET veloren.timestamp = "'"$(git show --no-patch --no-notes --pretty='%cd' HEAD)"'";' > upload.sql
escape ENV variables with a randomly generated 16 char tag. remove installation of postgres client and move it to docker container
2020-11-09 08:53:34 +00:00
- echo "SET veloren.branch = \$${TAGUUID}\$${CI_COMMIT_REF_NAME}\$${TAGUUID}\$;" >> upload.sql
- echo "SET veloren.sha = \$${TAGUUID}\$${CI_COMMIT_SHA}\$${TAGUUID}\$;" >> upload.sql
fix upload of benchmarks
2021-04-18 18:01:26 +00:00
- find target/criterion -wholename "*new/*.csv" -exec echo '\copy benchmarks ("group", "function", "value", throughput_num, throughput_type, sample_measured_value, unit, iteration_count) from '"'{}' csv header" >> upload.sql \;
upload benchmark to central ci db ```sql CREATE TABLE benchmarks( "timestamp" timestamptz NOT NULL DEFAULT (current_setting('veloren.timestamp')::timestamptz), branch text NOT NULL DEFAULT current_setting('veloren.branch'), sha text NOT NULL DEFAULT current_setting('veloren.sha'), "group" text NULL, "function" text NULL, "value" text NULL, throughput_num numeric NULL, throughput_type text NULL, sample_measured_value numeric NOT NULL, unit text NULL, iteration_count numeric NULL ); ```
2020-09-29 23:58:35 +00:00
- cat upload.sql
change cidb settings
2021-06-03 15:26:09 +00:00
- PGPASSWORD="${CIDBPASSWORD}" PGSSLROOTCERT="./.gitlab/ci-db.crt" psql "sslmode=verify-ca host=grafana.veloren.net port=15432 dbname=benchmarks" -U hgseehzjtsrghtjdcqw -f upload.sql;
change(ci): document and add retries + fmt
2020-05-14 16:12:22 +00:00
retry:
max: 2
change(ci): split up stages into separate files
2020-05-14 15:37:34 +00:00
Fixing Tarpaulin isn't easy. So first off all we had to update the toolchain, i think everything in september is okay, but we got with this current version. Then we had to update several dependencies, which broke: - need a specific fix of winit, i think we want to get rid of this with iced, hopefully, because its buggy as hell. update wayland client to 0.27 - use a updated version of glutin which has wayland-client 0.27 and no longer the broke version 0.23 - update conrod to use modern copypasta 0.7 - use `packed_simd_2` instead of `packed_simd` as the owner of the create abandoned the project. - adjust all the coding to work with the newer glutin and winit version. that also includes fixing a macro in one of the dependencies that did some crazy conversion from 1 event type to another event type. It was called `convert_event` - make a `simd` feature which is default and introduce conditional compiling. AS I HAVE NO IDEA OF SIMD AND THE CODE. AND I DIDN'T INTRODUCE THE ERROR IN THE FIRST PLACE, WE PANIC FOR NON SIMD CASE FOR NOW. BUT IT WORKS FOR TESTS. - tarpaulin doesnt support no-default-features. so we have to `sed` them away. semms fair.
2020-09-29 12:29:18 +00:00
# Coverage is needed on master for the README.md badge to work
fix clippy after toolchain update
2020-10-26 18:52:45 +00:00
# tmp remove simd as it doesnt work with tarpaulin: https://github.com/rust-lang/rust/issues/77529
Fixing Tarpaulin isn't easy. So first off all we had to update the toolchain, i think everything in september is okay, but we got with this current version. Then we had to update several dependencies, which broke: - need a specific fix of winit, i think we want to get rid of this with iced, hopefully, because its buggy as hell. update wayland client to 0.27 - use a updated version of glutin which has wayland-client 0.27 and no longer the broke version 0.23 - update conrod to use modern copypasta 0.7 - use `packed_simd_2` instead of `packed_simd` as the owner of the create abandoned the project. - adjust all the coding to work with the newer glutin and winit version. that also includes fixing a macro in one of the dependencies that did some crazy conversion from 1 event type to another event type. It was called `convert_event` - make a `simd` feature which is default and introduce conditional compiling. AS I HAVE NO IDEA OF SIMD AND THE CODE. AND I DIDN'T INTRODUCE THE ERROR IN THE FIRST PLACE, WE PANIC FOR NON SIMD CASE FOR NOW. BUT IT WORKS FOR TESTS. - tarpaulin doesnt support no-default-features. so we have to `sed` them away. semms fair.
2020-09-29 12:29:18 +00:00
coverage:
Moved coverage and benchmarks to only run post-merge.
2021-04-17 22:49:11 +00:00
extends: .post-merge
Fixing Tarpaulin isn't easy. So first off all we had to update the toolchain, i think everything in september is okay, but we got with this current version. Then we had to update several dependencies, which broke: - need a specific fix of winit, i think we want to get rid of this with iced, hopefully, because its buggy as hell. update wayland client to 0.27 - use a updated version of glutin which has wayland-client 0.27 and no longer the broke version 0.23 - update conrod to use modern copypasta 0.7 - use `packed_simd_2` instead of `packed_simd` as the owner of the create abandoned the project. - adjust all the coding to work with the newer glutin and winit version. that also includes fixing a macro in one of the dependencies that did some crazy conversion from 1 event type to another event type. It was called `convert_event` - make a `simd` feature which is default and introduce conditional compiling. AS I HAVE NO IDEA OF SIMD AND THE CODE. AND I DIDN'T INTRODUCE THE ERROR IN THE FIRST PLACE, WE PANIC FOR NON SIMD CASE FOR NOW. BUT IT WORKS FOR TESTS. - tarpaulin doesnt support no-default-features. so we have to `sed` them away. semms fair.
2020-09-29 12:29:18 +00:00
stage: build
Use new multi image cache scheme in the CI and consolidate runner tag specification so that it is easier to modify
2021-05-20 04:21:53 +00:00
image: registry.gitlab.com/veloren/veloren-docker-ci/cache/tarpaulin:${CACHE_IMAGE_TAG}
Fixing Tarpaulin isn't easy. So first off all we had to update the toolchain, i think everything in september is okay, but we got with this current version. Then we had to update several dependencies, which broke: - need a specific fix of winit, i think we want to get rid of this with iced, hopefully, because its buggy as hell. update wayland client to 0.27 - use a updated version of glutin which has wayland-client 0.27 and no longer the broke version 0.23 - update conrod to use modern copypasta 0.7 - use `packed_simd_2` instead of `packed_simd` as the owner of the create abandoned the project. - adjust all the coding to work with the newer glutin and winit version. that also includes fixing a macro in one of the dependencies that did some crazy conversion from 1 event type to another event type. It was called `convert_event` - make a `simd` feature which is default and introduce conditional compiling. AS I HAVE NO IDEA OF SIMD AND THE CODE. AND I DIDN'T INTRODUCE THE ERROR IN THE FIRST PLACE, WE PANIC FOR NON SIMD CASE FOR NOW. BUT IT WORKS FOR TESTS. - tarpaulin doesnt support no-default-features. so we have to `sed` them away. semms fair.
2020-09-29 12:29:18 +00:00
script:
Use new multi image cache scheme in the CI and consolidate runner tag specification so that it is easier to modify
2021-05-20 04:21:53 +00:00
- ln -s /dockercache/target target
ci fails sporadically, remove file so it doesnt fail that often till we have a bettter toolchain
2021-03-23 07:59:37 +00:00
- rm -r target/debug/incremental/veloren_* || echo "all good" # TMP FIX FOR 2021-03-22-nightly
Fixing Tarpaulin isn't easy. So first off all we had to update the toolchain, i think everything in september is okay, but we got with this current version. Then we had to update several dependencies, which broke: - need a specific fix of winit, i think we want to get rid of this with iced, hopefully, because its buggy as hell. update wayland client to 0.27 - use a updated version of glutin which has wayland-client 0.27 and no longer the broke version 0.23 - update conrod to use modern copypasta 0.7 - use `packed_simd_2` instead of `packed_simd` as the owner of the create abandoned the project. - adjust all the coding to work with the newer glutin and winit version. that also includes fixing a macro in one of the dependencies that did some crazy conversion from 1 event type to another event type. It was called `convert_event` - make a `simd` feature which is default and introduce conditional compiling. AS I HAVE NO IDEA OF SIMD AND THE CODE. AND I DIDN'T INTRODUCE THE ERROR IN THE FIRST PLACE, WE PANIC FOR NON SIMD CASE FOR NOW. BUT IT WORKS FOR TESTS. - tarpaulin doesnt support no-default-features. so we have to `sed` them away. semms fair.
2020-09-29 12:29:18 +00:00
- find ./* -name "Cargo.toml" -exec sed -i 's/, "simd"]/]/g' {} \;
- find ./* -name "Cargo.toml" -exec sed -i 's/"simd"]/]/g' {} \;
- sed -i 's/vek /#vek /g' ./Cargo.toml;
fix clippy after toolchain update
2020-10-26 18:52:45 +00:00
- cargo tarpaulin -v -- --test-threads=2
Fixing Tarpaulin isn't easy. So first off all we had to update the toolchain, i think everything in september is okay, but we got with this current version. Then we had to update several dependencies, which broke: - need a specific fix of winit, i think we want to get rid of this with iced, hopefully, because its buggy as hell. update wayland client to 0.27 - use a updated version of glutin which has wayland-client 0.27 and no longer the broke version 0.23 - update conrod to use modern copypasta 0.7 - use `packed_simd_2` instead of `packed_simd` as the owner of the create abandoned the project. - adjust all the coding to work with the newer glutin and winit version. that also includes fixing a macro in one of the dependencies that did some crazy conversion from 1 event type to another event type. It was called `convert_event` - make a `simd` feature which is default and introduce conditional compiling. AS I HAVE NO IDEA OF SIMD AND THE CODE. AND I DIDN'T INTRODUCE THE ERROR IN THE FIRST PLACE, WE PANIC FOR NON SIMD CASE FOR NOW. BUT IT WORKS FOR TESTS. - tarpaulin doesnt support no-default-features. so we have to `sed` them away. semms fair.
2020-09-29 12:29:18 +00:00
retry:
max: 2
change(ci): split up stages into separate files
2020-05-14 15:37:34 +00:00
CI cleanup - switching more to rules syntax - clean up some templates - EITHER optional builds or build builds - ordering
2020-06-12 11:09:56 +00:00
#linux, windows, macos builds here as template
.tlinux:
Use new multi image cache scheme in the CI and consolidate runner tag specification so that it is easier to modify
2021-05-20 04:21:53 +00:00
image: registry.gitlab.com/veloren/veloren-docker-ci/cache/release-linux:${CACHE_IMAGE_TAG}
change(ci): document and add retries + fmt
2020-05-14 16:12:22 +00:00
script:
Use new multi image cache scheme in the CI and consolidate runner tag specification so that it is easier to modify
2021-05-20 04:21:53 +00:00
- ln -s /dockercache/target target
ci fails sporadically, remove file so it doesnt fail that often till we have a bettter toolchain
2021-03-23 07:59:37 +00:00
- rm -r target/release/incremental/veloren_* || echo "all good" # TMP FIX FOR 2021-03-22-nightly
Added default-publish feature and updated build scripts.
2021-06-26 15:43:39 +00:00
- export VELOREN_USERDATA_STRATEGY=executable
- cargo build --release -p veloren-voxygen --no-default-features --features default-publish
- cargo build --release -p veloren-server-cli
change(ci): document and add retries + fmt
2020-05-14 16:12:22 +00:00
- cp -r target/release/veloren-server-cli $CI_PROJECT_DIR
- cp -r target/release/veloren-voxygen $CI_PROJECT_DIR
artifacts:
paths:
- veloren-server-cli
- veloren-voxygen
- assets/
- LICENSE
expire_in: 1 week
change(ci): split up stages into separate files
2020-05-14 15:37:34 +00:00
CI cleanup - switching more to rules syntax - clean up some templates - EITHER optional builds or build builds - ordering
2020-06-12 11:09:56 +00:00
.twindows:
Use new multi image cache scheme in the CI and consolidate runner tag specification so that it is easier to modify
2021-05-20 04:21:53 +00:00
image: registry.gitlab.com/veloren/veloren-docker-ci/cache/release-windows:${CACHE_IMAGE_TAG}
change(ci): document and add retries + fmt
2020-05-14 16:12:22 +00:00
script:
CI tweaks, make windows build use posix mingw and copy necessary DLL files
2021-04-22 01:56:18 +00:00
- update-alternatives --set x86_64-w64-mingw32-gcc /usr/bin/x86_64-w64-mingw32-gcc-posix
- update-alternatives --set x86_64-w64-mingw32-g++ /usr/bin/x86_64-w64-mingw32-g++-posix
Use new multi image cache scheme in the CI and consolidate runner tag specification so that it is easier to modify
2021-05-20 04:21:53 +00:00
- ln -s /dockercache/target target
ci fails sporadically, remove file so it doesnt fail that often till we have a bettter toolchain
2021-03-23 07:59:37 +00:00
- rm -r target/release/incremental/veloren_* || echo "all good" # TMP FIX FOR 2021-03-22-nightly
Added default-publish feature and updated build scripts.
2021-06-26 15:43:39 +00:00
- export VELOREN_USERDATA_STRATEGY=executable
- cargo build --target=x86_64-pc-windows-gnu --release -p veloren-voxygen --no-default-features --features default-publish
- cargo build --target=x86_64-pc-windows-gnu --release -p veloren-server-cli
change(ci): document and add retries + fmt
2020-05-14 16:12:22 +00:00
- cp -r target/x86_64-pc-windows-gnu/release/veloren-server-cli.exe $CI_PROJECT_DIR
- cp -r target/x86_64-pc-windows-gnu/release/veloren-voxygen.exe $CI_PROJECT_DIR
CI tweaks, make windows build use posix mingw and copy necessary DLL files
2021-04-22 01:56:18 +00:00
- cp /usr/lib/gcc/x86_64-w64-mingw32/7.3-posix/libgcc_s_seh-1.dll $CI_PROJECT_DIR
- cp /usr/lib/gcc/x86_64-w64-mingw32/7.3-posix/libstdc++-6.dll $CI_PROJECT_DIR
- cp /usr/x86_64-w64-mingw32/lib/libwinpthread-1.dll $CI_PROJECT_DIR
change(ci): document and add retries + fmt
2020-05-14 16:12:22 +00:00
artifacts:
paths:
- veloren-server-cli.exe
- veloren-voxygen.exe
- assets/
- LICENSE
CI tweaks, make windows build use posix mingw and copy necessary DLL files
2021-04-22 01:56:18 +00:00
- libgcc_s_seh-1.dll
- libstdc++-6.dll
- libwinpthread-1.dll
change(ci): document and add retries + fmt
2020-05-14 16:12:22 +00:00
expire_in: 1 week
change(ci): split up stages into separate files
2020-05-14 15:37:34 +00:00
CI cleanup - switching more to rules syntax - clean up some templates - EITHER optional builds or build builds - ordering
2020-06-12 11:09:56 +00:00
.tmacos:
Use native macos runner for builds
2021-06-01 19:33:41 +00:00
tags: ["veloren-macos"]
before_script:
- source $HOME/.cargo/env
- cargo --version
- export DISABLE_GIT_LFS_CHECK=true
- export VELOREN_ASSETS="$(pwd)/assets"
- echo "VELOREN_ASSETS=$VELOREN_ASSETS"
- export RUSTFLAGS="-D warnings"
change(ci): document and add retries + fmt
2020-05-14 16:12:22 +00:00
script:
Use native macos runner for builds
2021-06-01 19:33:41 +00:00
- export MACOSX_DEPLOYMENT_TARGET="10.13"
Added default-publish feature and updated build scripts.
2021-06-26 15:43:39 +00:00
- export VELOREN_USERDATA_STRATEGY=executable
- cargo build --release -p veloren-voxygen --no-default-features --features default-publish
- cargo build --release -p veloren-server-cli
Use native macos runner for builds
2021-06-01 19:33:41 +00:00
- cp -r target/release/veloren-server-cli $CI_PROJECT_DIR
- cp -r target/release/veloren-voxygen $CI_PROJECT_DIR
change(ci): document and add retries + fmt
2020-05-14 16:12:22 +00:00
artifacts:
paths:
- veloren-server-cli
- veloren-voxygen
- assets/
- LICENSE
expire_in: 1 week
CI cleanup - switching more to rules syntax - clean up some templates - EITHER optional builds or build builds - ordering
2020-06-12 11:09:56 +00:00
Use native macos runner for builds
2021-06-01 19:33:41 +00:00
# e.g. post merge and scheduled builds
.tmacos-master-cache:
cache:
key: "macos-master-cache"
paths:
- target/
# e.g. optional builds from MRs
.tmacos-mr-cache:
cache:
key: "macos-mr-cache"
paths:
- target/
CI cleanup - switching more to rules syntax - clean up some templates - EITHER optional builds or build builds - ordering
2020-06-12 11:09:56 +00:00
# build on release or master
linux:
extends:
- .tlinux
- .release
windows:
extends:
- .twindows
- .release
macos:
extends:
- .tmacos
- .release
Use native macos runner for builds
2021-06-01 19:33:41 +00:00
- .tmacos-master-cache
CI cleanup - switching more to rules syntax - clean up some templates - EITHER optional builds or build builds - ordering
2020-06-12 11:09:56 +00:00
have a seperate stage for scheduled builds
2021-04-23 15:47:55 +00:00
# build on schedule quickfix till airshipper 0.5
air-linux:
extends:
- .tlinux
- .release-nightly-tmp-fix-airshipper
air-windows:
extends:
- .twindows
- .release-nightly-tmp-fix-airshipper
air-macos:
extends:
- .tmacos
- .release-nightly-tmp-fix-airshipper
Use native macos runner for builds
2021-06-01 19:33:41 +00:00
- .tmacos-master-cache
have a seperate stage for scheduled builds
2021-04-23 15:47:55 +00:00
CI cleanup - switching more to rules syntax - clean up some templates - EITHER optional builds or build builds - ordering
2020-06-12 11:09:56 +00:00
# if NOT release or master, allow optional builds
opt-linux:
extends:
- .tlinux
- .optional-release
opt-windows:
extends:
- .twindows
- .optional-release
opt-macos:
extends:
- .tmacos
fix localization test
2020-07-12 02:38:11 +00:00
- .optional-release
Use native macos runner for builds
2021-06-01 19:33:41 +00:00
- .tmacos-mr-cache
Reference in New Issue Copy Permalink