Commit Graph
509 Commits
Author SHA1 Message Date
sp98 345f92961b ci: filter both 14 and 64 disks in CI
github ci runner is allocating both 14 and 64 Gb disks to the setup.
Rook CI currently hard codes the lsblk with a 14G filter.
This PR updates the filter to use either 14G or 64G disks.

Signed-off-by: sp98 <sapillai@redhat.com>
2023-11-06 13:30:10 +05:30
dependabot[bot] 0fdaf5a8ca build(deps): bump wagoid/commitlint-github-action from 5.4.3 to 5.4.4
Bumps [wagoid/commitlint-github-action](https://github.com/wagoid/commitlint-github-action) from 5.4.3 to 5.4.4.
- [Changelog](https://github.com/wagoid/commitlint-github-action/blob/master/CHANGELOG.md)
- [Commits](https://github.com/wagoid/commitlint-github-action/compare/v5.4.3...v5.4.4)

---
updated-dependencies:
- dependency-name: wagoid/commitlint-github-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-02 21:55:14 +00:00
travisn dfa522d906 ci: update helm linter to v2.6.0
The helm linter was failing with v2.4.0. Now
update the version of the action to the latest
and greatest.

Signed-off-by: travisn <tnielsen@redhat.com>
2023-10-31 11:20:57 -06:00
Blaine Gardner 76b90e1a96 Merge pull request #13097 from step-security-bot/stepsecurity_remediation_1698170726
ci: Harden GitHub Actions permissions
2023-10-24 12:25:14 -06:00
StepSecurity Bot beef4e2cde test: limit permissions in github actions
Automatic PR from app.stepsecurity.io (initiated by BlaineEXE) to limit 
permissions in github actions to only those needed.

Signed-off-by: StepSecurity Bot <bot@stepsecurity.io>
2023-10-24 18:05:30 +00:00
Blaine Gardner f90e069ba9 test: add govulncheck to look for go vulnerabilities
govulncheck is a static code analyzer that scans more deeply than Snyk.
Additionally, because govulncheck checks the code itself, it can rule
out vulnerabilities that are present in dependencies but that are not
used in Rook's code path.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
2023-10-24 11:47:10 -06:00
Travis Nielsen 703f594f4c Merge pull request #12860 from parth-gr/mds-liveness
mds: improve the mds liveness probe calls
2023-10-10 08:21:00 -06:00
parth-gr 3d4036547c ci: check mds liveness probe unit test from the CI run
Signed-off-by: parth-gr <paarora@redhat.com>
2023-10-10 18:56:36 +05:30
parth-gr 98125c78b9 ci: add a test to check the script result in idempotent output
Signed-off-by: parth-gr <paarora@redhat.com>
2023-10-05 19:48:38 +05:30
Blaine Gardner 0c721e05d5 multus: allow node profiles in validation test
Add the ability to specify node profiles in the multus validation test.

This addresses a few points of early feedback on the validation tool.
Statements below critique the tool's behavior before this patch.
1. The tool assumes all daemons are on public and cluster network, which
   means users who have a significantly smaller cluster net (a
   design choice) cannot run a single test to determine if Rook is
   likely to install correctly.
2. The tool does not have placement options to select only a subset of
   Kubernetes nodes to run validation on.
3. Users of multus seem to have a dedicated pool of storage nodes more
   often than the average Rook install. This makes sense for security-
   and perforance-minded users. The tool cannot run a single test to
   verify storage-only and general-workload nodes at one time.

These points are addressed by allowing users to specify configurations
for different "NodeTypes."

Each NodeType config has options for selecting the number of OSDs as
well as the number of other (non-OSD) Ceph daemons. This limits the
unnecessary exhaustion of cluster network addresses from critique 1.

Each NodeType config has its own placement (critique 2).

Users can define as many NodeTypes as needed to test the network for
their planned CephCluster. Specifically, this allows the tool to test
storage-only nodes and generalized-workload nodes at the same time. An
arbitrary number of NodeTypes are allowed to support even more highly
specialized cluster setups, such as multiple tiers of storage nodes
where some storage-only nodes may run more OSDs than others.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
2023-10-04 15:26:35 -06:00
Blaine Gardner bf9e5dc1f5 ci: make use of caching in actions/setup-go
The GH action to set up Golang (actions/setup-go) has cache
functionality. For cache hits, this saves ~2 minutes for each run. In
order for the cache to hit, caching must not be disabled, and the code
must be checked out before setting up Golang.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
2023-10-04 13:41:56 -06:00
Redouane Kachach b3dd74ea20 docs: fixing some spelling issues
closes: https://github.com/rook/rook/issues/12987

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2023-10-03 13:50:17 +02:00
subhamkrai e14f8c7710 ci: remove workaround for clean disk action
The issues are fixed from the clean disk action
repo and we shouldn't require any workaround. Also,
I'm not using git revert to revert the commit is earlier
clean disk action was mentioned in every CI which was
duplicate and now we have placed the action to composite yaml

Signed-off-by: subhamkrai <srai@redhat.com>
2023-09-29 19:17:01 +05:30
subhamkrai 3267576307 ci: fix github action free disk space
Since `google-cloud-sdk` is renamed with `google-cloud-cli`,
the github action is failing to remove the older name and this
is causing ci issues. Applying changes suggested by community to
manually remove some packages to resolve the issue.

Signed-off-by: subhamkrai <srai@redhat.com>
2023-09-28 18:56:59 +05:30
travisn 0a4ce46727 ci: skip encryption pvc kms test if needed
The skip_ci label was not being respected by the
encryption-pvc-kms-ibm-kp canary test.

Signed-off-by: travisn <tnielsen@redhat.com>
2023-09-25 11:17:23 -06:00
d3bc9aafee ci: suppress snyk MPL license warnings
Fixes: #12930

This patch introduces a  .snyk policy file that lets snyk suppress the warnings
 about  the MPL license in projects pulled in as dependencies.

Additinally, this  fixes a typo in the name of the snyk workflow
file

Signed-off-by: Michael Adam <obnox@samba.org>
Co-authored-by: Travis Nielsen <tnielsen@redhat.com>
Co-authored-by: Blaine Gardner <b.blaine.gardner@gmail.com>
2023-09-25 19:10:15 +02:00
Blaine Gardner 750ae02265 Merge pull request #12922 from BlaineEXE/update-multus-canary-test
test: update multus canary test
2023-09-19 11:28:13 -06:00
Blaine Gardner 3e2e906ea7 test: update multus canary test
Update the multus canary test to reflect modern knowledge about how it
should be configured.

No longer test for the network device in OSD pods. Pods will utterly
fail to start if Multus is unable to attach interfaces.
Instead, look to the OSD map to test the connections more wholistically.
OSDs must have map IPs that include both public and cluster network.
This implicitly tests that the interfaces exist in the Pod, and it
additionally verifies other details, like Ceph `*_network` configs are
set propertly.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
2023-09-18 17:15:23 -06:00
Travis Nielsen 950a0e861c Merge pull request #12917 from rook/dependabot/github_actions/aws-actions/configure-aws-credentials-4
build(deps): bump aws-actions/configure-aws-credentials from 3 to 4
2023-09-18 07:41:37 -06:00
dependabot[bot] 3db03cd9a0 build(deps): bump aws-actions/configure-aws-credentials from 3 to 4
Bumps [aws-actions/configure-aws-credentials](https://github.com/aws-actions/configure-aws-credentials) from 3 to 4.
- [Release notes](https://github.com/aws-actions/configure-aws-credentials/releases)
- [Changelog](https://github.com/aws-actions/configure-aws-credentials/blob/main/CHANGELOG.md)
- [Commits](https://github.com/aws-actions/configure-aws-credentials/compare/v3...v4)

---
updated-dependencies:
- dependency-name: aws-actions/configure-aws-credentials
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-09-18 12:41:43 +00:00
dependabot[bot] 22bae1cccd build(deps): bump docker/login-action from 2 to 3
Bumps [docker/login-action](https://github.com/docker/login-action) from 2 to 3.
- [Release notes](https://github.com/docker/login-action/releases)
- [Commits](https://github.com/docker/login-action/compare/v2...v3)

---
updated-dependencies:
- dependency-name: docker/login-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-09-18 12:41:40 +00:00
cef43e1155 build: update s5cmd to version v2.2.1
This is the latest available version.
The previously used version v2.0.0 was very outdated.

Fixes: #12883

Co-authored-by: subham rai subhamkrai <srai@redhat.com>
Signed-off-by: Michael Adam <obnox@samba.org>
Signed-off-by: Subham Rai subhamkrai <srai@redhat.com>
  signed-off-by: Travis Nielsen <tnielsen@redhat.com>
    Co-authored-by: Travis Nielsen <tnielsen@redhat.com>
2023-09-15 16:16:47 +02:00
dependabot[bot] 14f0a9e772 build(deps): bump actions/checkout from 3 to 4
Bumps [actions/checkout](https://github.com/actions/checkout) from 3 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v3...v4)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-09-04 12:33:02 +00:00
Travis Nielsen 3468a4a43f Merge pull request #12816 from obnoxxx/simplify-workflow
Simplify docs-check workflow by extracting functionality
2023-09-01 11:32:00 -06:00
Michael Adam 04670d3f76 ci: simplify the docs-check workflow by extracting functionality
This simplifies the docs-check workflow definition by extracting  functionality
directly coded into the workflow file into new make targets 'check-docs'
and 'check-helm-docs' and replacing the code in the workflow file by the simple invocation of
new make targets. As a side effect, it makes it easily possible for a
developer to check locally if they forgot to commit any autogenerated
docs.

Signed-off-by: Michael Adam <obnox@samba.org>
2023-09-01 18:17:02 +02:00
Travis Nielsen a06fd8a54d Merge pull request #12811 from parth-gr/external-name
external: change cluster_name to k8s_cluster_name
2023-08-31 08:14:00 -06:00
parth-gr 98c4567219 external: change cluster_name to k8s_cluster_name
it was confusing if we are calling a ceph cluster name
or k8s cluster name, so re-named

Signed-off-by: parth-gr <paarora@redhat.com>
2023-08-30 14:07:58 +05:30
Travis Nielsen 3ea9db4e3c Merge pull request #12748 from subhamkrai/upgrade-k8s-to-1.28.0
ci: upgrade the kubernetes versions for ci
2023-08-28 10:05:26 -06:00
Travis Nielsen 833731aea3 Merge pull request #12784 from subhamkrai/skip-10min-tmate
ci: enable tmate when in debug mode
2023-08-28 08:31:39 -06:00
dependabot[bot] c5510a28be build(deps): bump aws-actions/configure-aws-credentials from 2 to 3
Bumps [aws-actions/configure-aws-credentials](https://github.com/aws-actions/configure-aws-credentials) from 2 to 3.
- [Release notes](https://github.com/aws-actions/configure-aws-credentials/releases)
- [Changelog](https://github.com/aws-actions/configure-aws-credentials/blob/main/CHANGELOG.md)
- [Commits](https://github.com/aws-actions/configure-aws-credentials/compare/v2...v3)

---
updated-dependencies:
- dependency-name: aws-actions/configure-aws-credentials
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-08-28 12:23:56 +00:00
subhamkrai 90d81e11b6 ci: upgrade the kubernetes versions for ci
since, kubernetes v1.28.0 release upgrading the
latest k8s version to v.1.28.0 excepth objectSuite
tes.

Signed-off-by: subhamkrai <srai@redhat.com>
2023-08-28 10:35:44 +05:30
subhamkrai a223b6777b ci: enable tmate when in debug mode
we don't want to wait for extra 10min once the ci passed,
so we'll add a check if `debug-ci` label is added or debug runner
is triggered from UI then only start tmate. Also, updaing the
development doc and rook test doc.

Signed-off-by: subhamkrai <srai@redhat.com>
2023-08-26 11:14:08 +05:30
Blaine Gardner 6a0f5fbf42 Merge pull request #12774 from obnoxxx/multus-validation-job-autogen
Multus validation job automated update
2023-08-25 11:51:40 -06:00
Michael Adam 585c9a51fc ci: update the docs check workflow to run make docs instead of make helm-docs
Signed-off-by: Michael Adam <obnox@samba.org>
2023-08-25 18:37:16 +02:00
subhamkrai e9cc7ed7b9 build: update go version to 1.21 from 1.20
Signed-off-by: subhamkrai <srai@redhat.com>
2023-08-25 12:23:21 +05:30
travisn 1a4917de78 build: remove go modules under apis directory
The go package dependencies (go.mod and go.sum) were created
under the pkg/apis directory to simplify the dependencies for
other projects referencing the rook repo. The downside is that
the dependabot can no longer open a working and valid PR since
the bot is not aware of the go.mod and go.sum in the apis directory.

Since the reduction of dependencies for vault in #12455,
the list of extra dependencies is not quite so extensive.
We are putting effort into shrinking the dependency list instead
of using the modules files in the apis subdirectory.

Note that #12419 updated the dependencies for the latest controller
runtime which also increased the size of the modules
list in the pkgs subdirectory, which means the difference
in dependencies in the pkgs subdirectory is no longer
signficant anyway.

Signed-off-by: travisn <tnielsen@redhat.com>
2023-08-21 15:13:33 -06:00
subhamkrai bffa766b4f ci: create toolbox-operator early in ci
moving the toolbox-operator creation early in
ci, so that by the time we wait for others pods
to come up, toolbox-operator will be ready or
will wait for 180s.

Signed-off-by: subhamkrai <srai@redhat.com>
2023-08-16 20:44:46 +05:30
Travis Nielsen 71f078c0fc Merge pull request #12694 from parth-gr/ci-objectsuite-time
ci: update the objectsuite test timeout to 40m
2023-08-09 11:45:05 -06:00
parth-gr 8617e2e924 ci: update the objectsuite test timeout to 40m
While running object test we need some more time
to run the cosi test completely so increasing the timeout

Also update timeout of ntegration-tests-on-release.yaml

Signed-off-by: parth-gr <paarora@redhat.com>
2023-08-09 22:47:06 +05:30
parth-gr 64d3df4fcd ci: improve the canary toolbox operator pod check
the wait command is provided by kubernetes so
instead of using manually shell hack using the wait
command

Signed-off-by: parth-gr <paarora@redhat.com>
2023-08-08 22:06:21 +05:30
Travis Nielsen 8e1090b3be Merge pull request #12624 from parth-gr/s5-cmd
object: fix s5cmd for s3 endpoint verification
2023-08-04 08:19:28 -06:00
parth-gr 8a3f058329 object: fix s5cmd for s3 endpoint verification
add a new toolbox yaml manifest which will use the
rook image instead of ceph image
for running s5 cmd container needs to run with rook image

closes: https://github.com/rook/rook/issues/12227

Signed-off-by: parth-gr <paarora@redhat.com>
2023-08-04 18:29:05 +05:30
subhamkrai 2eee0c7e1e ci: add free disk action to release/master ci
I missed adding the action which free some disk space
which may help with low resource issues.

Signed-off-by: subhamkrai <srai@redhat.com>
2023-08-03 20:26:55 +05:30
subhamkrai 07bb18feba ci: update the release test timeout to 40m
recentally, upgrade tests are getting
longer than 30m to pass since reef upgrade.
So, increasing the timeout to 40m.

Signed-off-by: subhamkrai <srai@redhat.com>
2023-08-03 14:27:54 +05:30
Travis Nielsen d89758da38 Merge pull request #12634 from subhamkrai/fix-canary-test
ci:  fix all the canary test
2023-08-02 10:15:38 -06:00
Travis Nielsen 086680c8df Merge pull request #12608 from subhamkrai/fix-upgrade-suite-1.22.x
ci: skip mgr pod restart count upgrade 1.22.x suite
2023-08-02 10:03:04 -06:00
subhamkrai e139fd20be ci: increase upgrade test timeout to 40m
with reef, we are now upgrading 2 ceph versions which
takes time to complete the ci.

Signed-off-by: subhamkrai <srai@redhat.com>
2023-08-02 20:17:06 +05:30
subhamkrai 334a632ecd ci: add github action to free space in runner
adding github action to free space in runner
which will help us avoiding mon low space error

Signed-off-by: subhamkrai <srai@redhat.com>
2023-08-02 19:58:39 +05:30
travisn 90a95ce57d ci: disable tmate for build actions
The build and release actions will rarely ever need to be
debugged. To make them more efficient and reduce their
runtime, we remove the tmate action so it won't add 10
unnecessary minutes to the end of the action.

Signed-off-by: travisn <tnielsen@redhat.com>
2023-08-01 15:40:56 -06:00
travisn 8fd46a46d3 ci: run object suite in master and release branches
The object suite was being skipped in master and release
branches. Since the object suite was only running in PRs
it was not noticed if there were any issues in the master
branch or release branches. Now we run it in these branches
in addition to the PRs.

Signed-off-by: travisn <tnielsen@redhat.com>
2023-08-01 11:52:55 -06:00