Commit Graph
13292 Commits
Author SHA1 Message Date
Artem Torubarov 3f2d0eb1f8 mgr: lookup cluster crd on active mgr watch
Signed-off-by: Artem Torubarov <artem.torubarov@clyso.com>
2024-07-24 12:09:19 +02:00
subham rai cf2462fca3 Merge pull request #14486 from travisn/daily-upgrade-on-master
tests: Daily ceph upgrade tests on rook master
2024-07-24 10:03:36 +05:30
Travis Nielsen 1d8d55e1ad tests: daily ceph upgrade tests on rook master
The daily ceph upgrade tests were running on Rook v1.13.
This was causing the squid upgrade tests to fail since
1.13 does not support Squid. The purpose of the upgrade
tests is to test the ceph upgrades, therefore the daily
tests will just test them based on rook master.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2024-07-23 16:19:19 -06:00
Blaine Gardner cec77d7faa Merge pull request #14464 from parth-gr/external-upgrade
external: fix the output of user config
2024-07-23 10:05:21 -06:00
Blaine Gardner a2b0b6449c object: add hosting.advertiseEndpoint config
Add CephObjectStore spec.hosting.advertiseEndpoint configuration. This
provides a clear documented default for which endpoint Rook "advertises"
to dependent resources like CephObjectStores, OBCs, and COSI
Buckets/Accesses and allows users to override the default behavior if
desired.

The current default is to round-robin an endpoint from
spec.hosting.dnsNames, which has proven to be troublesome for some
users' object store configurations. This change provides much-needed
disambiguation for users.

This may be a breaking change for some existing spec.hosting.dnsNames
users. This is unexpected but is documented.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
2024-07-22 14:43:51 -06:00
parth-gr cb30f66862 external: fix the output of user config
currently the output in the cm was not human readable
and can not easily used to create a config.ini file

Also for now removed the support of printing arg in upstream

Signed-off-by: parth-gr <partharora1010@gmail.com>
2024-07-22 22:23:57 +05:30
Travis Nielsen 5328c06d4e Merge pull request #14478 from yingshanghuangqiao/master
core: Fix some misspelled comments
2024-07-22 10:45:11 -06:00
Travis Nielsen 2903995448 Merge pull request #14481 from rook/dependabot/go_modules/github-dependencies-f4e564e1f1
build(deps): bump github.com/aws/aws-sdk-go from 1.54.19 to 1.54.20 in the github-dependencies group
2024-07-22 10:37:40 -06:00
Blaine Gardner 12e8727b20 Merge pull request #14473 from obnoxxx/token-permissions
ci: fix excessive token permissions
2024-07-22 08:36:10 -06:00
yingshanghuangqiao 3d672a726a core: fix some comments
Signed-off-by: yingshanghuangqiao <yingshanghuangqiao@foxmail.com>
2024-07-22 22:09:52 +08:00
dependabot[bot] cb0bc4f3cd build(deps): bump github.com/aws/aws-sdk-go
Bumps the github-dependencies group with 1 update: [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go).


Updates `github.com/aws/aws-sdk-go` from 1.54.19 to 1.54.20
- [Release notes](https://github.com/aws/aws-sdk-go/releases)
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.54.19...v1.54.20)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: github-dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-07-22 12:10:54 +00:00
Michael AdamandBlaine Gardner 9b2b9b7be2 ci: fix excessive token permissions
Fixes: #14466

The OpenSSF scorecard report

https://scorecard.dev/viewer/?uri=github.com/rook/rook

warns about excessive token-permissions in the rook project's github CI
workflows.

This bulk change aims at improving this by

1. adding top-level read permissions where missing for integration tests.
2. adding write permissions as needed for the auto-assign workflow.
3. removing the warned-about and unused create-tag workflow

Signed-off-by: Michael Adam <obnox@samba.org>
Co-authored-by: Blaine Gardner <b.blaine.gardner@gmail.com>
2024-07-22 12:34:01 +02:00
Satoru Takeuchi c8f9e6549d Merge pull request #14457 from travisn/deviceclass-update
osd: Update the device class if desired state changes
2024-07-19 10:06:58 +09:00
Travis Nielsen 88e952a3ac osd: update the device class if desired state changes
Normally the device class of an OSD is determined at provisioning
and is not updated thereafter. In some scenarios the admin may
want to force update the device class to a new value. The device
classes can be updated by first setting allowDeviceClassUpdate
in the storage spec of the cephcluster, then updating the
device class specified on the deviceSets or other OSDs.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2024-07-17 13:54:21 -06:00
Travis Nielsen 3ccdb53cb6 Merge pull request #14258 from subhamkrai/add-cephfs-fencing
mds: block of active mds ip only
2024-07-17 11:48:01 -06:00
Blaine Gardner b287aa9254 Merge pull request #14460 from BlaineEXE/design-vhost-updates
doc: update vhost-style S3 bucket design
2024-07-17 11:17:39 -06:00
subham rai b4f99fb5cc Merge pull request #14356 from subhamkrai/csi-operator-design
docs: design for csi operator integration with rook
2024-07-17 14:21:06 +05:30
subhamkrai 9f1b64be54 mds: block of active mds ip only
currently, it was blocking both the mds ip
instead its should block ip of of mds which is in
the same node which is down.

Signed-off-by: subhamkrai <srai@redhat.com>
2024-07-17 13:30:35 +05:30
subham rai a9e192b363 Merge pull request #14468 from Madhu-1/fix-log-rotation
csi: fix template render in logRotation
2024-07-17 12:56:54 +05:30
subhamkrai 73ea725c99 docs: design for csi operator integration with rook
this commits adds desgin doc for integrating the new csi operator
with rook.

Signed-off-by: subhamkrai <srai@redhat.com>
2024-07-17 12:41:54 +05:30
Madhu Rajanna cb87c3a845 csi: fix template render in logRotation
the templateParam need to be updated
with the right values before we are
rendering the template.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2024-07-17 08:15:30 +02:00
subhamkrai efe6ef4e45 csi: revert remove cephFs networkFence code temporarily
This reverts commit bd4250f56e.

Signed-off-by: subhamkrai <srai@redhat.com>
2024-07-17 11:36:15 +05:30
Blaine Gardner 00f20b1212 doc: update vhost-style S3 bucket design
Update the vhost-style S3 bucket access design doc to reflect recent
user feedback and configuration issues. The primary goal is to add a
field to disambiguate for users and Rook which endpoint should be used
for CephObjectStoreUsers, OBCs, and COSI buckets.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
2024-07-16 16:50:50 -06:00
Travis Nielsen 9967b161f9 Merge pull request #14420 from YiteGu/make-kube-api-limit-configurable
csi: make kube apiserver qps configurable
2024-07-16 07:40:56 -06:00
yite.gu 80541a23c9 csi: make kube apiserver qps configurable
This commit adds the flexibility to configure kube apiserver qps
as per the user requirement and also keeps the existing values as
the default one.

Signed-off-by: yite.gu <yitegu0@gmail.com>
2024-07-16 18:39:16 +08:00
Travis Nielsen 525648e42c Merge pull request #14459 from rook/dependabot/go_modules/github-dependencies-fb6482a7be
build(deps): bump github.com/aws/aws-sdk-go from 1.54.15 to 1.54.19 in the github-dependencies group
2024-07-15 16:45:46 -06:00
Travis Nielsen e499fcad37 Merge pull request #14454 from travisn/squid-support
core: Add support for Ceph Squid
2024-07-15 12:44:04 -06:00
Travis Nielsen 22d4139b74 core: add support for ceph squid
With the release of the first squid RC, we add squid
to the supported versions and add tests to run
Rook against the squid release.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2024-07-15 10:04:32 -06:00
dependabot[bot] dee06bb136 build(deps): bump github.com/aws/aws-sdk-go
Bumps the github-dependencies group with 1 update: [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go).


Updates `github.com/aws/aws-sdk-go` from 1.54.15 to 1.54.19
- [Release notes](https://github.com/aws/aws-sdk-go/releases)
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.54.15...v1.54.19)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: github-dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-07-15 12:16:03 +00:00
harshitasao 54f9bf0d73 ci: added the scorecard github action and its badge
Signed-off-by: harshitasao <harshitasao@gmail.com>
2024-07-13 11:57:07 +05:30
Travis Nielsen 689b39de4f Merge pull request #14057 from travisn/deviceclass-log
pool: Return error if device class update fails
2024-07-12 08:50:35 -06:00
Travis Nielsen da73421d7e Merge pull request #14396 from parth-gr/csi-logrotate-file
csi: add log rotation for csi cephfs nfs pod containers
2024-07-12 08:41:45 -06:00
parth-gr 4ca8b12e12 csi: add log rotation for csi cephfs nfs pod containers
Use the same logrotate flow of rbd, as merged in #14305

1) Make the csi cephfs and nfs container logs persisted in a file

2) Use the cephcluster api specs to configure the log rotate

3) Add log rotation to rotate the log file and
Add a sidecar log collector container

And some fixes on the implementation:

1) Add a operator namespace in the log file path

2) Only add volume to the container if logrotate is enabled

Closes: https://github.com/rook/rook/issues/12809, https://github.com/rook/rook/issues/14429

Signed-off-by: parth-gr <partharora1010@gmail.com>
2024-07-12 12:50:35 +05:30
subham rai 76d2886f17 Merge pull request #14432 from rook/dependabot/go_modules/github-dependencies-fc54c511fc
build(deps): bump the github-dependencies group across 1 directory with 4 updates
2024-07-12 10:03:44 +05:30
Blaine Gardner 67772a296b Merge pull request #14451 from BlaineEXE/multus-reset-test-line
multus: reset validation tool debounce time to 30
2024-07-11 14:53:12 -06:00
Blaine Gardner 65dc27845f Merge pull request #14451 from BlaineEXE/multus-reset-test-line
multus: reset validation tool debounce time to 30
2024-07-11 12:06:22 -06:00
Blaine Gardner 5884f1c900 multus: reset validation tool debounce time to 30
Reset the Multus validation tool debounce time to its intended 30 second
value. It was changed to 5 for testing, and the change was accidentally
committed.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
2024-07-11 11:27:33 -06:00
Blaine Gardner fd3f4c8f41 Merge pull request #14230 from BlaineEXE/multus-validation-test-add-host-checking
multus: add host checking to validation tool
2024-07-11 11:06:40 -06:00
Blaine Gardner 33f5407dd4 multus: add host checking to validation tool
In order to help users check that they have implemented the newly-added
Multus host configuration prerequisites, add a check to the validation
tool to verify connectivity.

Because users who are already running clusters with Multus enabled, add
a flag that allows users to only check for host configuration
prerequisites. This mode will not start the large number of clients that
would normally be started because those clients could disrupt a running
Rook cluster negatively.

Host checking pods require host network access. Many Kubernetes
distributions have pod security features enabled. In order to allow
non-Vanilla distros to run this tool, allow specifying a service account
that pods will run as, which can be configured by the admin to allow
test pods.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
2024-07-10 13:41:38 -06:00
Travis Nielsen 0bea31ef7f pool: return error if device class update fails
Updating the device class swallowed any error if updated
for the pool. The error was not even logged, so we couldn't
troubleshoot why the new crush rule was not applied.
Log the error for troubleshooting and also fail the pool
reconcile since the desired configuration was not applied.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2024-07-10 12:59:43 -06:00
Travis Nielsen 28addd1301 Merge pull request #14216 from thotz/update-cosi-images
object: update cosi images
2024-07-10 12:47:07 -06:00
Travis Nielsen a08a34e5e3 Merge pull request #14447 from travisn/stretch-crush-rule
pool: Skip updating crush rules for stretch clusters
2024-07-10 11:45:07 -06:00
Travis Nielsen b92bbba671 pool: skip updating crush rules for stretch clusters
Pools in stretch clusters must all specify the same
CRUSH rule. No pools can use a different rule. When there
is a change in the device class, we do not even expect to update
the crush rules in a stretch cluster. Different device classes
are not supported in stretch clusters, and it's expected to be
a homogenous environment. Therefore, skip all crush rule updates
in stretch clusters.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2024-07-10 11:08:31 -06:00
Jared Watts 8241a2239d Merge pull request #14443 from jbw976/update-meeting-freq
docs: update README with new community meeting frequency
2024-07-09 15:00:01 -07:00
Jared Watts ead2acedb8 docs: update README with new community meeting frequency
Signed-off-by: Jared Watts <jbw976@gmail.com>
2024-07-09 13:51:37 -07:00
Travis Nielsen b8bcd71929 Merge pull request #14421 from subhamkrai/update-go-mods
build: update controller runtime to v0.18.4
2024-07-08 10:10:10 -06:00
Travis Nielsen 1fe1a2bc23 Merge pull request #14406 from parth-gr/logrotate-csi-odf
csi: add securityContext to csi containers
2024-07-08 10:08:40 -06:00
parth-gr 2ca0d1390b csi: add securityContext to csi containers
With the recent enhancements csi containers for using
logrotate, they need to run with securityContext to privileged,
on platform like openshift.
Used the ROOK_HOSTPATH_REQUIRES_PRIVILEGED flag
wich is set with operator deployment to see
if the securityCOntext is needed or not

Closes: https://github.com/rook/rook/issues/14400

Signed-off-by: parth-gr <partharora1010@gmail.com>
2024-07-08 18:47:26 +05:30
Travis Nielsen 6a9f17882d Merge pull request #14422 from parth-gr/external-seamless-upgrade4
external: config file should have more priority then defaults
2024-07-05 10:56:31 -06:00
parth-gr 7cfbe09a94 external: config file should have more priority then defaults
Priority: command-line-args > config.ini file values > default values
Currently default was having more priority so fixed it

Signed-off-by: parth-gr <partharora1010@gmail.com>
2024-07-05 14:55:08 +05:30