Commit Graph
475 Commits
Author SHA1 Message Date
Michael Adam a5f07a1543 build: update s5cmd to version v2.2.1
This is the latest available version.
The previously used version v2.0.0 was very outdated.

Fixes: #12883

Co-authored-by: subham rai subhamkrai <srai@redhat.com>
Signed-off-by: Michael Adam <obnox@samba.org>
Signed-off-by: Subham Rai subhamkrai <srai@redhat.com>
  signed-off-by: Travis Nielsen <tnielsen@redhat.com>
    Co-authored-by: Travis Nielsen <tnielsen@redhat.com>
(cherry picked from commit cef43e1155)
2023-09-15 15:17:41 +00:00
Michael Adam e680f4e302 ci: simplify the docs-check workflow by extracting functionality
This simplifies the docs-check workflow definition by extracting  functionality
directly coded into the workflow file into new make targets 'check-docs'
and 'check-helm-docs' and replacing the code in the workflow file by the simple invocation of
new make targets. As a side effect, it makes it easily possible for a
developer to check locally if they forgot to commit any autogenerated
docs.

Signed-off-by: Michael Adam <obnox@samba.org>
(cherry picked from commit 04670d3f76)
2023-09-01 17:33:05 +00:00
parth-gr 63d9f8f41a external: change cluster_name to k8s_cluster_name
it was confusing if we are calling a ceph cluster name
or k8s cluster name, so re-named

Signed-off-by: parth-gr <paarora@redhat.com>
(cherry picked from commit 98c4567219)
2023-08-31 14:14:25 +00:00
subhamkrai 9858f214e9 ci: upgrade the kubernetes versions for ci
since, kubernetes v1.28.0 release upgrading the
latest k8s version to v.1.28.0 excepth objectSuite
tes.

Signed-off-by: subhamkrai <srai@redhat.com>
(cherry picked from commit 90d81e11b6)
2023-08-28 16:06:27 +00:00
subhamkrai ddcb9efa9a ci: enable tmate when in debug mode
we don't want to wait for extra 10min once the ci passed,
so we'll add a check if `debug-ci` label is added or debug runner
is triggered from UI then only start tmate. Also, updaing the
development doc and rook test doc.

Signed-off-by: subhamkrai <srai@redhat.com>
(cherry picked from commit a223b6777b)
2023-08-28 14:32:18 +00:00
Travis Nielsen 19ab9ff504 Merge pull request #12792 from rook/mergify/bp/release-1.12/pr-12788
build: update go version to 1.21 from 1.20 (backport #12788)
2023-08-28 08:28:24 -06:00
Michael Adam 1d6da86be0 ci: update the docs check workflow to run make docs instead of make helm-docs
Signed-off-by: Michael Adam <obnox@samba.org>
(cherry picked from commit 585c9a51fc)
2023-08-25 17:52:22 +00:00
subhamkrai 42adedbefe build: update go version to 1.21 from 1.20
Signed-off-by: subhamkrai <srai@redhat.com>
(cherry picked from commit e9cc7ed7b9)
2023-08-25 14:43:01 +00:00
travisn 4ad2d1fe1a build: update the go modules to the latest
Run make go.mod.update to update the go modules to
the latest references.

Signed-off-by: travisn <tnielsen@redhat.com>
(cherry picked from commit 138624a3b0)
2023-08-22 15:19:20 -06:00
travisn 17e3e68576 build: remove go modules under apis directory
The go package dependencies (go.mod and go.sum) were created
under the pkg/apis directory to simplify the dependencies for
other projects referencing the rook repo. The downside is that
the dependabot can no longer open a working and valid PR since
the bot is not aware of the go.mod and go.sum in the apis directory.

Since the reduction of dependencies for vault in #12455,
the list of extra dependencies is not quite so extensive.
We are putting effort into shrinking the dependency list instead
of using the modules files in the apis subdirectory.

Note that #12419 updated the dependencies for the latest controller
runtime which also increased the size of the modules
list in the pkgs subdirectory, which means the difference
in dependencies in the pkgs subdirectory is no longer
signficant anyway.

Signed-off-by: travisn <tnielsen@redhat.com>
(cherry picked from commit 1a4917de78)

# Conflicts:
#	.github/workflows/update_dependabot_bundler_pr.yml
2023-08-22 19:51:31 +00:00
subhamkrai 382d2722af ci: create toolbox-operator early in ci
moving the toolbox-operator creation early in
ci, so that by the time we wait for others pods
to come up, toolbox-operator will be ready or
will wait for 180s.

Signed-off-by: subhamkrai <srai@redhat.com>
(cherry picked from commit bffa766b4f)
2023-08-16 16:42:44 +00:00
travisn d4215f25b0 ci: disable tmate for build actions
The build and release actions will rarely ever need to be
debugged. To make them more efficient and reduce their
runtime, we remove the tmate action so it won't add 10
unnecessary minutes to the end of the action.

Signed-off-by: travisn <tnielsen@redhat.com>
(cherry picked from commit 90a95ce57d)
2023-08-15 21:07:35 +00:00
subhamkrai f1f27ed70e ci: add free disk action to release/master ci
I missed adding the action which free some disk space
which may help with low resource issues.

Signed-off-by: subhamkrai <srai@redhat.com>
(cherry picked from commit 2eee0c7e1e)
2023-08-10 19:39:43 +00:00
parth-gr 6d480aad0f ci: update the objectsuite test timeout to 40m
While running object test we need some more time
to run the cosi test completely so increasing the timeout

Also update timeout of ntegration-tests-on-release.yaml

Signed-off-by: parth-gr <paarora@redhat.com>
(cherry picked from commit 8617e2e924)
2023-08-09 17:45:41 +00:00
parth-gr f995cd1efa ci: improve the canary toolbox operator pod check
the wait command is provided by kubernetes so
instead of using manually shell hack using the wait
command

Signed-off-by: parth-gr <paarora@redhat.com>
(cherry picked from commit 64d3df4fcd)
2023-08-09 14:20:47 +00:00
parth-gr 0f1d90b0b6 object: fix s5cmd for s3 endpoint verification
add a new toolbox yaml manifest which will use the
rook image instead of ceph image
for running s5 cmd container needs to run with rook image

closes: https://github.com/rook/rook/issues/12227

Signed-off-by: parth-gr <paarora@redhat.com>
(cherry picked from commit 8a3f058329)
2023-08-04 14:20:13 +00:00
subhamkrai 1df9dff8ce ci: update the release test timeout to 40m
recentally, upgrade tests are getting
longer than 30m to pass since reef upgrade.
So, increasing the timeout to 40m.

Signed-off-by: subhamkrai <srai@redhat.com>
(cherry picked from commit 07bb18feba)
2023-08-03 13:38:01 +00:00
Travis Nielsen 88a92ff77a Merge pull request #12648 from rook/mergify/bp/release-1.12/pr-12608
ci: skip mgr pod restart count upgrade 1.22.x suite (backport #12608)
2023-08-02 11:35:25 -06:00
subhamkrai 6a3cad9a2d ci: add github action to free space in runner
adding github action to free space in runner
which will help us avoiding mon low space error

Signed-off-by: subhamkrai <srai@redhat.com>
(cherry picked from commit 334a632ecd)
2023-08-02 16:16:16 +00:00
subhamkrai d55f8c853a ci: increase upgrade test timeout to 40m
with reef, we are now upgrading 2 ceph versions which
takes time to complete the ci.

Signed-off-by: subhamkrai <srai@redhat.com>
(cherry picked from commit e139fd20be)
2023-08-02 16:03:46 +00:00
travisn 545568aa04 ci: run object suite in master and release branches
The object suite was being skipped in master and release
branches. Since the object suite was only running in PRs
it was not noticed if there were any issues in the master
branch or release branches. Now we run it in these branches
in addition to the PRs.

Signed-off-by: travisn <tnielsen@redhat.com>
(cherry picked from commit 8fd46a46d3)
2023-08-01 18:21:03 +00:00
Nikhil-Ladha e2c92d16ce external: added an optional flag for enabling v2 mon port
Added a new flag `--v2-port-enable` to enable the v2 mon port.

Signed-off-by: Nikhil-Ladha <nikhilladha1999@gmail.com>
(cherry picked from commit 5daddbe379)
2023-07-31 19:20:56 +00:00
Blaine Gardner 15f3146cab multus: revise kube config/client loading
The previous client loader routine assumed KUBECONFIG would be set in
CLI environments. Instead, now take this approach:

1. If KUBECONFIG is set, that is the de-facto override that informs the
   tool it is being run in a CLI environment.
2. Otherwise, try creating a client from the default kube config file.
3. If that fails, assume the tool is running in a Kubernetes Pod.

This will continue supporting dev/test environments so that building the
rook container is not necessary for development. It also allows support
for highly opinionated environments (like deployed by OpenShift CSVs)
where it's not possible to install the Rook operator without also
deploying a CephCluster.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
(cherry picked from commit cc9514ad6c)
2023-07-28 17:26:24 +00:00
Travis Nielsen 3660846467 Merge pull request #12586 from rook/mergify/bp/release-1.12/pr-12572
build(deps): bump wagoid/commitlint-github-action from 5.4.1 to 5.4.3 (backport #12572)
2023-07-27 12:47:03 -06:00
subhamkrai 2c5672ab65 test: fix upgrade suite for 1.27.x version
the upgrade suite for version 1.27.x is failing
due
```
debug 2023-07-24T19:11:20.264+0000 7f3395a82c80 -1 error: monitor data filesystem reached concerning levels of available storage space (available: 5% 4.4 GiB)
you may adjust 'mon data avail crit' to a lower value to make this go away (default: 5%)
```
so adding mon setting to start on `compact` also adding
other setting present in cluster-test.yaml.

Signed-off-by: subhamkrai <srai@redhat.com>
(cherry picked from commit e8e8a4673a)
2023-07-26 15:48:23 +00:00
dependabot[bot] e8df41fe3e build(deps): bump wagoid/commitlint-github-action from 5.4.1 to 5.4.3
Bumps [wagoid/commitlint-github-action](https://github.com/wagoid/commitlint-github-action) from 5.4.1 to 5.4.3.
- [Changelog](https://github.com/wagoid/commitlint-github-action/blob/master/CHANGELOG.md)
- [Commits](https://github.com/wagoid/commitlint-github-action/compare/v5.4.1...v5.4.3)

---
updated-dependencies:
- dependency-name: wagoid/commitlint-github-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
(cherry picked from commit d5f5f0b64e)
2023-07-25 20:51:32 +00:00
subhamkrai 1d34907cf5 ci: add detached mode in tmate
with detached mode, we don't need to wait for the
tests to complete. Now, we can get inside tmate before
the tests start and we can monitor the tests.

By default, this mode will wait at the end of the job for
a user to connect and then to terminate the tmate session.
If no user has connected within 10 minutes after the post-job step started,
it will terminate the tmate session and quit gracefully.

Signed-off-by: subhamkrai <srai@redhat.com>
(cherry picked from commit f171e1c037)
2023-07-25 20:47:47 +00:00
Travis Nielsen cc754e83b7 Merge pull request #12498 from rook/mergify/bp/release-1.12/pr-12423
test: add support Ceph Reef v18 with updated integration tests (backport #12423)
2023-07-17 07:34:12 -06:00
parth-gr c8b4a26d0d external: pin the default csi subvolume
set the csi subvolume to pin type distributed and pin setting 1
So to statically balance the PVs across all MDS ranks

Signed-off-by: parth-gr <paarora@redhat.com>
(cherry picked from commit 53413e5a24)
2023-07-13 15:40:36 +00:00
Javier af7a063bf7 test: support Ceph Reef v18 with updated integration tests
update test files to support the next version of ceph, ceph reef v18

Signed-off-by: Javier <sjavierlopez@gmail.com>
(cherry picked from commit 46cb9435a6)
2023-07-11 00:05:43 +00:00
subhamkrai 51341669dc ci: fix tmate access issue
we need make `limit-access-to-actor: false` and also
in the right place where tmate `uses` is called for
composite yaml.

Signed-off-by: subhamkrai <srai@redhat.com>
(cherry picked from commit ab297afa0e)
2023-07-10 12:57:58 +00:00
subhamkrai 70f29be748 ci: fix ci test encryption-pvc-kms-vault-token-auth
we need to wait for the rgw pod to be delete and not
only the cephobjectsore, sometime the pod could be in
terminating state. Also, in some place it require proper
command to wait for pod to be ready/delete and get the
pod name only.

Signed-off-by: subhamkrai <srai@redhat.com>
2023-07-05 14:49:18 +05:30
Sheetal Pamecha eee31f2b72 ci: update the minimum kubernetes version supported
For v1.12 update the minimum K8s version supported to v1.22,
and run CI against the most recent six versions.

Signed-off-by: Sheetal Pamecha <spamecha@redhat.com>
2023-06-25 22:01:40 +05:30
travisn 05bebc1615 ci: require go 1.20 in the builds
To update to the latest go modules we need to restrict golang
support to 1.20 for now.

Signed-off-by: travisn <tnielsen@redhat.com>
2023-06-22 16:37:10 -06:00
travisn ee80061c74 ci: update golangci linter to go 1.20
The linter requires updating wait.Poll methods to more recent
given the new dependencies for the controller runtime.

Signed-off-by: travisn <tnielsen@redhat.com>
2023-06-21 17:05:10 -06:00
Travis Nielsen e9bd40c347 Merge pull request #12398 from rook/dependabot/github_actions/actions/setup-go-4
build(deps): bump actions/setup-go from 1 to 4
2023-06-19 09:06:07 -06:00
dependabot[bot] a10fd1490a build(deps): bump actions/checkout from 2 to 3
Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 3.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v2...v3)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-06-19 12:59:22 +00:00
dependabot[bot] 6f039d58cb build(deps): bump actions/setup-go from 1 to 4
Bumps [actions/setup-go](https://github.com/actions/setup-go) from 1 to 4.
- [Release notes](https://github.com/actions/setup-go/releases)
- [Commits](https://github.com/actions/setup-go/compare/v1...v4)

---
updated-dependencies:
- dependency-name: actions/setup-go
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-06-19 12:59:21 +00:00
parth-gr 8175bc0218 build: make crds should be able to build generated docs
Currently, if there is any change in the API we need to separately
run the make generate-crd-docs but with this change
make crds will also update the generated docs

Also improved the file locations

Closes: https://github.com/rook/rook/issues/12310

Signed-off-by: parth-gr <paarora@redhat.com>
2023-06-15 20:11:23 +05:30
subhamkrai b75624af8c ci: add missing closing bracket in the script
there is error in the script to check if there
is any changes on go.mod or go.sum line.

```
/home/runner/work/_temp/dc877811-e494-4d57-ab19-a37942eac23d.sh: line 1: unexpected EOF while looking for matching `)'
```

instead of this `if [[ $(git status | grep -E '(go.mod|go.sum)' ]]; then` it will be
`if [[ $(git status | grep -E '(go.mod|go.sum)') ]]; then`

Signed-off-by: subhamkrai <srai@redhat.com>
2023-06-13 19:39:17 +05:30
subhamkrai 2181597add ci: fix the trigger of dependabot bundler pr
IMO, earlier we're triggering the dependabot in wrong
branches `"dependabot/bundler**"` instead it should be
`"dependabot/go_modules/**"` since it create branches with
the above syntax.
For example:
dependabot/go_modules/golang.org/x/sync-0.2.0

Fixes: #12352

Signed-off-by: subhamkrai <srai@redhat.com>
2023-06-13 13:08:35 +05:30
Travis Nielsen 56b3bf90e6 Merge pull request #12316 from Javlopez/bugfix/12306-arm64-daily-integration-tests-are-failing
ci: fix minikube execution
2023-06-01 14:09:50 -06:00
Javier 7d862e6cbe ci: fix minikube execution
add docker to the pipeline to allow minikube able to use docker driver

Signed-off-by: Javier <sjavierlopez@gmail.com>
2023-05-31 18:14:35 -06:00
travisn e0705a5656 ci: daily rgw tests to run against ceph main
The daily rgw tests were mistakenly running against an old
latest-master-devel ceph tag instead of the newer
latest-main-devel ceph tag. Now the daily rgw tests will
be run against the latest and greatest as expected.

Signed-off-by: travisn <tnielsen@redhat.com>
2023-05-31 14:10:14 -06:00
Travis Nielsen 3b4ba859fd Merge pull request #12267 from parth-gr/fix-rgw-ci
ci: catch error in ci for external rgw server canary test
2023-05-31 12:42:12 -06:00
Travis Nielsen 9eb4bc8d05 Merge pull request #12311 from parth-gr/ci-tmate
ci: update tmate to run successfully with public ssh
2023-05-31 11:11:55 -06:00
parth-gr 74a4a9c5c2 ci: update tmate to run successfully with public ssh
Currently tmate was not accessible and showing access denied,

Update limit-access-to-actor to true, which register tmate with a
public ssh key
https://github.com/mxschmitt/action-tmate#use-registered-public-ssh-keys

Signed-off-by: parth-gr <paarora@redhat.com>
2023-05-31 19:13:09 +05:30
parth-gr ef4fa96e26 ci: catch error in ci for external rgw server canary test
currently we just print the error is anything fails in
script for rgw, So by that there is no panic or
failiure of script if something wrong happened,

Added Explicittly forcing to catch the error from
the error message that is thrown

Closes: https://github.com/rook/rook/issues/12244

Signed-off-by: parth-gr <paarora@redhat.com>
2023-05-31 18:42:52 +05:30
Blaine Gardner b2babf01d2 Merge pull request #12282 from BlaineEXE/multus-validation-ci-test
test: add CI e2e test for multus validation test
2023-05-31 01:37:14 +02:00
Gabriel Morishita c29765e55f ci: adding path ignore to documentations
The main objective of this commit is to stop CI to run tests when only documentations are changed. We did that by adding the Documentation and design folder into paths-ignore key on CI files.

Signed-off-by: Gabriel Morishita <gabrielmorishita@hotmail.com>
2023-05-30 14:34:37 -03:00