Commit Graph
107 Commits
Author SHA1 Message Date
Travis NielsenandSébastien Han 40cfc9c70e ci: only build amd64 for PRs
The PRs only test against amd64 and have no need for the arm64
builds. This will save several minutes of build time.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
Co-authored-by: Sébastien Han <seb@redhat.com>
2020-09-08 16:18:39 -06:00
Sébastien Han 9a06d059f0 ci: change local disk path
With the recent aws instance type the disk naming changed too, so
replace xvdc with nvme0n1.

Closes: https://github.com/rook/rook/issues/6189
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-31 22:04:46 +02:00
Travis Nielsen 68b3789bba ci: run integration tests on k8s 1.19
With the pending release of k8s 1.19 we need to start running
the integration tests on 1.19. In master we remove support for
1.14 to keep the last five releases running in master.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-08-28 08:35:45 -06:00
Sébastien Han 575b00f4c3 ci: only run unit tests on official build
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-27 22:33:54 +02:00
Sébastien Han 58c8de95be ci: add modcheck github workflow
Add a new github workflow to verify with mod check.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-27 12:15:41 +02:00
Travis Nielsen cb8111c042 ci: check for official build string properly
The version of Jenkins has changed such that setting the official build env
var is no longer comparing correctly. Now we will only assume the env
var is set by the PR to false, therefore the tests need to compare
against false instead of true.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-07-13 13:53:57 -06:00
Sébastien Han 33a90a10d1 ci: more debug
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-08 22:49:25 -06:00
Sébastien Han 4e8f7e725d ci: auto-detect storage provider
If the PR follows our contribution guideline https://rook.io/docs/rook/master/development-flow.html#commit-structure
and then the PR title contains for example "ceph: add a feature", then
the CI will run the ceph storage integration tests.

Closes: https://github.com/rook/rook/issues/5612
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-08 11:24:54 +02:00
Sébastien Han 01784a4b59 ci: do not run when no code changes
If no Golang files were modified we don't want to run the integration
test.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-05 18:04:19 +02:00
Sébastien Han c9d306fe61 ci: do not run the pipeline if PR is draft
If the PR is a draft, it's not ready for review and most likely the CI
pipeline should not run as the code might be broken in some places.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-03 10:19:28 +02:00
Adam Kraitman 1731f9cb25 build: Enabling buildDiscarder
Enabling buildDiscarder which keeps only the newest 200 builds

Signed-off-by: Adam Kraitman <akraitma@redhat.com>
2020-05-26 17:43:15 +03:00
Satoru Takeuchi e96009c26d ceph: prepare PVCs for OSD on PVC test inside the integration test
The PVCs for OSD on PVC test is prepared before running the integration test.
In addition, users are forced to run this script for this by themselves.
To avoid this problem, running this script inside the integration test.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-05-14 05:14:27 +09:00
Juan Miguel Olmo Martínez 4b492e6f39 ceph: manager integration tests
Ceph orchestrator device ls
Ceph orchestrator status
Ceph orchestrator host ls
Ceph orchestrator create OSD
Ceph orchestrator ls

[test ceph]

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2020-05-04 11:32:56 +02:00
Satoru Takeuchi bf27b0f5c4 ceph: allow to set the device for OSD in the integration test
The device name for OSD is fixed to /dev/xvdc. It works fine in the CI.
However, the name would be different in the developer's local environment.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-04-17 23:24:03 +09:00
Travis Nielsen c4e712bbd2 tests: convert cli params to env vars
The command line flags parsing inside an init() method was causing
issues at runtime when trying to add certain new features, which
is a limitation of the flag parsing. We now move away from using
any command line flags in the tests and only use environment variables
to simplify adding new parameters to the tests.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-14 07:29:18 -06:00
Travis Nielsen dcc1e2a291 Merge pull request #5117 from travisn/test-k8s-1.18
Test rook on K8s 1.18
2020-03-30 16:48:04 -06:00
Travis Nielsen 0a5a17cf51 build: tidy the go modules before the release build
The go modules are changed by the install of the junit
tool for the unit tests. Before the release build we need
to ensure that the modules are tidied.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-03-30 15:33:28 -06:00
Travis Nielsen 0e1ccce61a build: use git checkout instead of git restore
The CI is using an older version of git that doesn't
recognize git restore.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-03-30 13:05:25 -06:00
Travis Nielsen 9a615eef99 build: check for modified files in build
The master build is publishing with the dirty tag so we
need to ensure that the files do not remain modified.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-03-30 12:15:53 -06:00
Travis Nielsen a3a7a10236 build: test rook on k8s 1.18
With the release of k8s 1.18 we now will run the integration
tests on 1.14 through 1.18 in master.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-03-30 11:14:14 -06:00
Travis Nielsen 816d8286e4 build: ensure files are not modified during build
The recent change to go modules is causing a file to change
during the build, which results in a dirty tag to be
generated.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-03-27 14:14:15 -06:00
Travis Nielsen adba744320 build: ensure go.sum is updated with every build
Every developer should commit all the files that need to be changed
in a given set of changes. The go.sum file was not being generated
as expected since the update to go modules. Since the Jenkinsfile
was running make mod.check, the build was ending up with a modified
file, which caused a dirty tag on the build. Now it is expected
that each PR will merge with the corresponding go.sum changes.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-03-26 15:42:06 -06:00
moricho 7d0215d820 ci: switch to use go.mod.check target
This switches to use `go.mod.check` target instead of `go.vendor.check` target.

Signed-off-by: moricho <ikeda.morito@gmail.com>
2020-03-17 16:48:43 +09:00
moricho 2beb731a7e go: move to gomodules
This switches Rook to use `go mod` instead of `dep` for
dependencies management.

Signed-off-by: moricho <ikeda.morito@gmail.com>
2020-03-17 16:47:53 +09:00
Ashish Ranjan 2238ccbfa6 Jenkins: Updates jenkins file to pre clean the k8s cluster
This commit updates the jenkins file to pre clean the k8s cluster before the running the integeration tests.

Signed-off-by: Ashish Ranjan <aranjan@redhat.com>
2020-02-05 12:20:58 +05:30
Ashish Ranjan 4eff5e0730 ceph: updated jenkins file for executing localPathPV.sh
This commit updates jenkins file for executing localPathPV.sh during
bootstrapping of k8s cluster. The localPathPV.sh script is responsible
for creating localPathPVs over disks in the nodes.

Signed-off-by: Ashish Ranjan <ashishranjan738@gmail.com>
2020-02-04 16:06:06 +05:30
Alexander Trost 3a27d87ecc test: update k8s versions for CI
The CI will now use the current latest K8S releases.
v1.15: v1.15.9
v1.16: v1.16.6
v1.17: v1.17.2

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2020-01-25 10:10:32 +01:00
Travis Nielsen 1e67902248 build: run tests on k8s 1.17.1
Checking that the flex driver tests succeed on 1.17.1 as well

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-01-15 20:32:49 -07:00
Travis Nielsen a02c2c3089 tests: run integration tests on k8s 1.17 and remove 1.12
With the release of K8s 1.17 Rook needs to test on this new version.
The integration tests will now run the tests across K8s 1.13-1.17.
The pattern has been to run the tests across the most recent five
versions.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-01-08 07:18:53 -08:00
Travis Nielsen eb1dadccb2 build: always use the version suffix from tag pipeline
The version suffix such as alpha.0, beta.0, or rc.0 only apply
when running the tag pipeline or the release build. Otherwise,
we don't want to use the suffix from the master build.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2019-12-09 17:43:29 -07:00
egafford 59adfc04b5 test: functional default baseTestDir for remote k8s master
Using the current working directory as the base test directory
fails with an unclear error message when running mkfs for OSDs
if tests are run when the k8s master node is not running on
localhost.

This change creates a new flag for the test suite to set the
base test directory, but uses a default that is safe for
virtualized test environments ("/data").

Fixes: #4205
Signed-off-by: egafford <egafford@redhat.com>
2019-11-08 12:15:02 -05:00
travisn 4ef3ffb8e4 test: add k8s 1.16 to the integration test matrix
With the desire to run the integration tests on the five
most recent versions of K8s, 1.16 is added and 1.11
is removed from the integration test matrix.

Signed-off-by: travisn <tnielsen@redhat.com>
2019-10-19 12:46:01 -06:00
travisn ac8f0dff09 tests: by default run the minimum test matrix in PRs
The CI runs the integration tests on several versions of K8s. By default
the integration tests have all been running on all versions of K8s. With the
recent option to run a minimum matrix for ceph tests it has shown to be reliable
for PRs and is much faster to have the test distribution.

Master and release builds will still run the full set of test suites on all
versions of K8s.

Signed-off-by: travisn <tnielsen@redhat.com>
2019-10-14 10:23:04 -06:00
travisn bd672de7db ceph: allow running minimal test matrix for ceph tests
There are six test suites and six k8s versions where we currently run
the tests. For efficiency we can restrict the testing to one suite
per k8s version. Bigger or riskier changes should still run the full
set of suites on all versions. To trigger the smaller test matrix, add
[test ceph min] to the PR description

Signed-off-by: travisn <tnielsen@redhat.com>
2019-09-18 23:06:49 -06:00
Sameer Kulkarni 9816fc7ce6 yugabytedb: integration tests and scripts
Signed-off-by: Sameer Kulkarni <samkulkarni20@gmail.com>
2019-08-27 22:45:14 +05:30
travisn be8a25e07e trigger the integration tests for all branches if tags not set
The integration tests for storage providers will be skipped
for example if [test ceph] is specified. If the [test] tag
is not specified, all tests should be run. If the tag is not
specified, the Jenkinsfile will pass null, which needs to be
handled by the test code deciding to run all the tests.

Signed-off-by: travisn <tnielsen@redhat.com>
2019-07-23 10:53:22 -06:00
Sébastien Han ea1da23bf3 ci: do not skip if null
If no storage provider is found, let's assign env.testProvider with an
empty string so that we wil run all the tests.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-07-22 21:53:44 +02:00
travisn d40e490444 allow executing tests specific to a storage provider
Since most PRs are focused on a single storage provider,
the tests for other storage providers do not need to be
run. The CI will allow skipping tests for other storage
providers by specifying keywords in the PR description.
Similar to [skip ci], you can now specify [test storage-provider].
For example, [test ceph] will only trigger the test
suites for ceph and none of the other storage providers.

Signed-off-by: travisn <tnielsen@redhat.com>
2019-07-17 23:29:52 -06:00
travisn 368d4189ae tests: Add k8s 1.15 and remove 1.10 from integration tests
Signed-off-by: travisn <tnielsen@redhat.com>
2019-07-03 17:53:44 -06:00
Santosh Pillai d6f63166a0 Optionally collect all CI logs using [all logs] flag
Signed-off-by: Santosh Pillai <sapillai@redhat.com>
2019-05-03 12:46:18 +05:30
travisn dd94fd14e3 tests: add k8s 1.14 to the integration test matrix
Signed-off-by: travisn <tnielsen@redhat.com>
2019-04-25 15:53:19 -06:00
travisn 9ab90994aa build: publish the master build before integration tests
The master build will be published as soon as the basic build and unit tests
are completed. This ensures that the generated help documentation matches
what is in master and the latest master published build matches
the yaml files in master. The longer the delay between merging and
publishing, the more likely users are to run into issues with
test deployments. This change minimizes the gap.

Signed-off-by: travisn <tnielsen@redhat.com>
2019-04-18 07:18:31 -06:00
travisn 0230400e27 build: remove 1.8 and 1.9 and add 1.13 to integration tests
Signed-off-by: travisn <tnielsen@redhat.com>
2018-12-19 23:42:01 -07:00
Yannis Zarkadas b23d874856 cassandra: integration tests and scripts
Simple integration test for Cassandra.
Boilerplate in setup scripts for Jenkins.

Signed-off-by: Yannis Zarkadas <yanniszarkadas@gmail.com>
2018-12-05 12:50:09 +02:00
Alexander Trost ac19f85fbb Allow specifying custom Ceph user and secret name for mounting
Introduce mount security mode for basic multi tenancy

Fixes #2164.

This adds three new parameters/options to StorageClass/flexvolume entry:
* `mountUser`
* `mountSecret`
* `mountSecretNamespace`

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2018-12-04 20:17:15 +01:00
mickymiek f93128b2d9 make sure integration tests works on k8s 1.12
Signed-off-by: mickymiek <meunie_m@etna-alternance.net>
2018-10-10 17:12:51 +02:00
Bassam Tabbara 2464e32857 add vendor checks
this commit updates dep to version 0.5, and adds a check during
CI runs that enforces that the vendor dependencies have not changed.
There is a now a makefile target `make vendor.check` that performs
this check. Also removed the requirement that PR run make vendor as
this will be done by CI.

Signed-off-by: Bassam Tabbara <bassam@upbound.io>
2018-09-30 08:10:42 -07:00
Alexander Trost c1da6999bf Merge pull request #2060 from galexrt/fix_981
build: Only install helm if needed and use a temp path
2018-09-12 19:22:19 +02:00
Alexander Trost 5d8d2b5b5a build: Only install helm if needed and use a temp path
Resolves #981

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2018-09-11 14:21:48 +02:00
Ganesh Maharaj Mahalingam 099380ba61 Enable CI system logs in artifacts and fixup log names
This is a temporary patch to help us figure out what is causing the random
issues on concurrent builds and re-using an instance.

This patch also makes the log names concise and consistent across all versions.

Signed-off-by: Ganesh Maharaj Mahalingam <ganesh.mahalingam@intel.com>
2018-09-06 20:42:24 -07:00