tests: by default run the minimum test matrix in PRs

The CI runs the integration tests on several versions of K8s. By default
the integration tests have all been running on all versions of K8s. With the
recent option to run a minimum matrix for ceph tests it has shown to be reliable
for PRs and is much faster to have the test distribution.

Master and release builds will still run the full set of test suites on all
versions of K8s.

Signed-off-by: travisn <tnielsen@redhat.com>
This commit is contained in:
travisn committed 2019-10-14 10:23:04 -06:00
1 parent 43b5a9692e
commit ac8f0dff09
2 files changed
+12 -9

No files matched your search

+5 -6
View File
@@ -184,12 +184,11 @@ These options should **not** be used if there are any changes to code which is s
storage providers. If there is any risk of affecting another storage provider, all tests should
be executed in the CI.
### [test ceph min]
### [test full]
By default all the ceph test suites run on all versions of K8s. For more efficient
CI times, we can choose to run each test suite on only one K8s version by using the tag:
In master and release builds, all test suites will run on all supported versions of K8s.
In PR builds, all the test suites will run on some version of K8s. For bigger changes,
it is recommended to run all test suites on all versions of K8s by using the tag:
```
[test ceph min]
[test full]
```
This option should only be used for changes with lower risk.
Vendored
+7 -3
View File
@@ -30,14 +30,18 @@ pipeline {
if (body.contains("[all logs]")) {
env.getLogs = "all"
}
if (!body.contains("[test full]")) {
// By default run the min test matrix (all tests run, but will be distributed on different versions of K8s).
// This only affects the PR builds. The master and release builds will always run the full matrix.
env.testArgs = "min-test-matrix"
}
// extract which specific storage provider to test
if (body.contains("[test cassandra]")) {
env.testProvider = "cassandra"
} else if (body.contains("[test ceph]")) {
env.testProvider = "ceph"
} else if (body.contains("[test ceph min]")) {
env.testProvider = "ceph"
env.testArgs = "min-test-matrix"
} else if (body.contains("[test cockroachdb]")) {
env.testProvider = "cockroachdb"
} else if (body.contains("[test edgefs]")) {