Commit Graph
10066 Commits
Author SHA1 Message Date
Blaine Gardner 910eca098d Merge pull request #12589 from rook/mergify/bp/release-1.12/pr-12466
osd: configure backend store (backport #12466)
2023-07-26 10:04:42 -06:00
Blaine Gardner 690338aa1e Merge pull request #12602 from rook/mergify/bp/release-1.12/pr-12578
test: fix upgrade suite for 1.27.x version (backport #12578)
2023-07-26 09:49:05 -06:00
subhamkrai 2c5672ab65 test: fix upgrade suite for 1.27.x version
the upgrade suite for version 1.27.x is failing
due
```
debug 2023-07-24T19:11:20.264+0000 7f3395a82c80 -1 error: monitor data filesystem reached concerning levels of available storage space (available: 5% 4.4 GiB)
you may adjust 'mon data avail crit' to a lower value to make this go away (default: 5%)
```
so adding mon setting to start on `compact` also adding
other setting present in cluster-test.yaml.

Signed-off-by: subhamkrai <srai@redhat.com>
(cherry picked from commit e8e8a4673a)
2023-07-26 15:48:23 +00:00
Alexander Trost 7d5cfea91d Merge pull request #12594 from rook/mergify/bp/release-1.12/pr-12592 2023-07-26 16:15:29 +02:00
subhamkrai ec76ca6b87 build: cosi driver is missing from olm list
adding cosi driver list in olm list as it is
being missed in csv crd list generated by
other project.

Signed-off-by: subhamkrai <srai@redhat.com>
(cherry picked from commit 884a5c1c18)
2023-07-26 11:02:10 +00:00
Blaine Gardner a0413e3233 Merge pull request #12584 from rook/mergify/bp/release-1.12/pr-12579
ci: add detached mode in tmate (backport #12579)
2023-07-25 15:43:16 -06:00
sp98 5d51214ad5 osd: configure backend store
Configure osd backend store from the cephCluster spec

Signed-off-by: sp98 <sapillai@redhat.com>
(cherry picked from commit c13d34f8d3)
2023-07-25 21:21:20 +00:00
subhamkrai 1d34907cf5 ci: add detached mode in tmate
with detached mode, we don't need to wait for the
tests to complete. Now, we can get inside tmate before
the tests start and we can monitor the tests.

By default, this mode will wait at the end of the job for
a user to connect and then to terminate the tmate session.
If no user has connected within 10 minutes after the post-job step started,
it will terminate the tmate session and quit gracefully.

Signed-off-by: subhamkrai <srai@redhat.com>
(cherry picked from commit f171e1c037)
2023-07-25 20:47:47 +00:00
Blaine Gardner e417b4b1a1 Merge pull request #12582 from rook/mergify/bp/release-1.12/pr-12574
doc: update the external doc format (backport #12574)
2023-07-25 14:46:02 -06:00
parth-gr 581e089215 docs: update the external doc format
Cephobjectstore is not formated correctly
https://rook.io/docs/rook/v1.12/CRDs/Cluster/external-cluster/#connect-to-an-external-object-store

Signed-off-by: parth-gr <paarora@redhat.com>
(cherry picked from commit 8a445ef0cb)
2023-07-25 16:19:30 +00:00
Travis Nielsen a4dc1b7265 Merge pull request #12551 from travisn/release-1.12.0
build: Update the release version to v1.12.0
v1.12.0
2023-07-18 16:10:49 -06:00
Travis Nielsen 40f70dd8b5 Merge pull request #12550 from rook/mergify/bp/release-1.12/pr-12548
cosi: The COSI driver should be disabled by default (backport #12548)
2023-07-18 16:08:49 -06:00
travisn e511e7ce83 build: update the release version to v1.12.0
For the minor release update the docs and example manifests
to v1.12.0.

Signed-off-by: travisn <tnielsen@redhat.com>
2023-07-18 15:35:55 -06:00
travisn f1afd25624 cosi: handle deletion of the cosi driver
The controller was attempting to delete the cosi driver
again and again, always failing the reconcile when the
driver did not exist. Since the desired state is for the
driver not to exist when disabled, return a successful
reconcile.

Signed-off-by: travisn <tnielsen@redhat.com>
(cherry picked from commit 4c98669148)
2023-07-18 21:31:19 +00:00
travisn 1119da1409 cosi: document enabling the cosi driver
Add steps for enabling the cosi driver that is disabled
by default. Also add an introduction to the COSI driver
and a section for prerequisites.

Signed-off-by: travisn <tnielsen@redhat.com>
(cherry picked from commit 4145ecec37)
2023-07-18 21:31:19 +00:00
travisn 6e39f35741 cosi: change the default deployment strategy to never
While experimental, the cosi driver should not be enabled by
default.

Signed-off-by: travisn <tnielsen@redhat.com>
(cherry picked from commit 990cb40043)
2023-07-18 21:31:19 +00:00
Travis Nielsen d5b6405bdb Merge pull request #12546 from rook/mergify/bp/release-1.12/pr-12544
cosi: Correct capitalization for auto policy (backport #12544)
2023-07-18 14:40:05 -06:00
Travis Nielsen 102f99407d Merge pull request #12542 from rook/mergify/bp/release-1.12/pr-12460
object: align spelling of user admin capabilities with ceph (backport #12460)
2023-07-18 14:39:27 -06:00
travisn 5dc023b512 cosi: correct capitalization for auto policy
The CephCOSIDriver deploymentStrategy requires Auto, Never,
or Always. Change the example to Auto.

Signed-off-by: travisn <tnielsen@redhat.com>
(cherry picked from commit 182211d26c)
2023-07-18 20:06:11 +00:00
Peter Goron 21007c1cbe object: align spelling of user admin capabilities with ceph
users & buckets admin capabilities aren't spelled the same
way between rook crd (singular) and ceph (plural). It's a bit
misleading when comparing ceph admin cap and rook users.

Signed-off-by: Peter Goron <peter.goron@gmail.com>
(cherry picked from commit 40eed236cf)
2023-07-18 19:23:56 +00:00
Travis Nielsen 1d5a3a27d9 Merge pull request #12539 from rook/mergify/bp/release-1.12/pr-12502
external: support custom ceph keyring file (backport #12502)
2023-07-18 13:21:02 -06:00
Travis Nielsen 96fa6daf4a Merge pull request #12540 from rook/mergify/bp/release-1.12/pr-12415
object: adding ceph cosi driver (backport #12415)
2023-07-18 13:20:43 -06:00
Jiffin Tony Thottan ce716d538c object: intial cosi driver controller design
Adding CephCOSIDriver CRD and controller. The controller will bring up
the ceph cosi driver when first object store is created in the rook
operator namespace. Then admin can defined COSI CRDs like BucketClass
and BucketAccessClass for different object stores deployed via Rook.
Using the BucketClass and BucketAccessClass, user can define
BucketAccess for backend bucket in the RGW. The CephCOSIDriver CRD
defines configuration options for ceph cosi driver. In the first version
its usability is minimal. Even if it is not defined Rook will bring up
the ceph cosi driver with default values.

Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
(cherry picked from commit b48dc8a335)
2023-07-18 18:12:53 +00:00
Angelos Kolaitis 5d76723686 external: support custom ceph keyring file
When the ceph.conf is not in a well-known location, it is typical
for a custom ceph.keyring to be required as well. Currently, the
create-external-cluster-resources.py only tries to load the keyring
from well-known paths, and fails.

This commit adds a new optional argument `--keyring` to help in this
situation. When specified, create-external-cluster-resources.py will
attempt to use this as the keyring to authenticate with Ceph.

Signed-off-by: Angelos Kolaitis <neoaggelos@gmail.com>
(cherry picked from commit c021256e96)
2023-07-18 17:20:12 +00:00
Travis Nielsen 64b4d637b9 Merge pull request #12527 from rook/mergify/bp/release-1.12/pr-12515
Upgrade doc v1.12 (backport #12515)
2023-07-18 08:30:25 -06:00
Travis Nielsen 0422f805e2 Merge pull request #12531 from rook/mergify/bp/release-1.12/pr-12530
test: update reef as default version (backport #12530)
2023-07-18 08:29:49 -06:00
Javier 3df489326a test: update reef as default version
update ceph to reef as default version

Signed-off-by: Javier <sjavierlopez@gmail.com>
(cherry picked from commit d17109a5f5)
2023-07-17 21:15:40 +00:00
Blaine Gardner 7281496a4d Merge pull request #12528 from rook/mergify/bp/release-1.12/pr-12327
Add option to disable synchronization traffic for RGWs (breaking release note) (backport #12327)
2023-07-17 12:21:59 -06:00
Lucas Henry 332bac5ca2 rgw: add option to disable synchronization traffic
Some users want to deploy two CephObjectStores for a single Zone. The first
configures RGWs to process the synchronization of the data, while the second
CephObjectStore configures the client RGWs.

Currently, this can be implemented by setting the RGW option
'rgw_run_sync_thread' in the 'rook-config-override' ConfigMap, though it is not
really user friendly.

Ref: https://docs.ceph.com/en/latest/radosgw/config-ref/#confval-rgw_run_sync_thread

This commit adds a new option in the CephObjectStore CRD as defined in issue
https://github.com/rook/rook/issues/12272. The new option
'disableMultisiteSyncTraffic' determine whether the operator should disable the
multisite sync threads for the RGWs.

If the option is set to 'false', or if the option is not specified, the operator
does nothing. This ensures that the multisite sync threads will not be enabled
for users that disabled explicitely the multisite sync threads either manually
or with the 'rook-config-override' ConfigMap.

This commit also recommends to use two objectstore when scaling Ceph Objectstore
Multisite replication, with one objectstore configured with disabled replication
traffic.

Signed-off-by: Lucas Henry <polyedre@disroot.org>
(cherry picked from commit 393d09347e)
2023-07-17 17:30:14 +00:00
Blaine Gardner 181ca91a8f docs: use imperative language in health verifcation doc
Following with the latest efforts to improve Rook docs, convert the
health verification doc to use imperative language and avoid use of "you".

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
(cherry picked from commit 03d8fcf932)
2023-07-17 16:56:53 +00:00
Blaine Gardner b9883b45bd docs: use imperative language in rook/ceph upgrade docs
Following with the latest efforts to improve Rook docs, convert the Rook
and Ceph upgrade docs to use imperative language and avoid use of "you".

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
(cherry picked from commit 5a1f3f7b8c)
2023-07-17 16:56:53 +00:00
Blaine Gardner de9db4b5be docs: update upgrade docs to add ceph reef support
Ceph Reef v18 is supported by Rook v1.12 even though it is still in
pre-release. Add Reef support to docs, and note that Pacific support
will be dropped in the next Rook release.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
(cherry picked from commit b3438a8b60)
2023-07-17 16:56:52 +00:00
Travis Nielsen cc754e83b7 Merge pull request #12498 from rook/mergify/bp/release-1.12/pr-12423
test: add support Ceph Reef v18 with updated integration tests (backport #12423)
2023-07-17 07:34:12 -06:00
Blaine Gardner b20c8a8128 Merge pull request #12510 from rook/mergify/bp/release-1.12/pr-12477
external: pin the default csi subvolume (backport #12477)
2023-07-13 12:35:29 -06:00
parth-gr c8b4a26d0d external: pin the default csi subvolume
set the csi subvolume to pin type distributed and pin setting 1
So to statically balance the PVs across all MDS ranks

Signed-off-by: parth-gr <paarora@redhat.com>
(cherry picked from commit 53413e5a24)
2023-07-13 15:40:36 +00:00
Javier af7a063bf7 test: support Ceph Reef v18 with updated integration tests
update test files to support the next version of ceph, ceph reef v18

Signed-off-by: Javier <sjavierlopez@gmail.com>
(cherry picked from commit 46cb9435a6)
2023-07-11 00:05:43 +00:00
Travis Nielsen 8bfdb2558c Merge pull request #12497 from rook/mergify/bp/release-1.12/pr-12492
core: add check for pv access modes' multinode support (backport #12492)
2023-07-10 16:56:21 -06:00
Rakshith R 87240d9e7d core: add check for pv access modes' multinode support
During faster node loss recovery,
Rook needs to check and blocklist only rbd pvs
that do not support multinode access modes such as
ReadOnlyMany(ROX) and ReadWriteMany(RWX).
This commit adds check for the same.

Signed-off-by: Rakshith R <rar@redhat.com>
(cherry picked from commit 12e2cd550f)
2023-07-10 17:00:17 +00:00
mergify[bot] ea32cc42cb Merge pull request #12494 from rook/mergify/bp/release-1.12/pr-12484
ci: fix tmate access issue (backport #12484)
2023-07-10 13:43:21 +00:00
subhamkrai 51341669dc ci: fix tmate access issue
we need make `limit-access-to-actor: false` and also
in the right place where tmate `uses` is called for
composite yaml.

Signed-off-by: subhamkrai <srai@redhat.com>
(cherry picked from commit ab297afa0e)
2023-07-10 12:57:58 +00:00
Travis Nielsen 2d095e44f6 Merge pull request #12488 from travisn/release-1.12.0-beta.0
build: Set the release version for the v1.12 beta
v1.12.0-beta.0
2023-07-07 15:11:13 -06:00
travisn 0b7949805f build: set the release version for the v1.12 beta
For the new 1.12 branch set the beta release version
to v1.12.0-beta.0.

Signed-off-by: travisn <tnielsen@redhat.com>
2023-07-07 12:16:20 -06:00
Travis Nielsen 65f413ce1f Merge pull request #12286 from subhamkrai/fix-node-loss-rbd
core: faster recovery from rbd rwo node loss
v1.12.0-alpha.0
2023-07-07 10:35:59 -06:00
subhamkrai 39b5c057ce core: faster recovery from rbd rwo node loss
in the existing node watcher, we'll check for node update
event and see if there are `out-of-service` taints are applied
and `ROOK_WATCH_FOR_NODE_FAILURE` is enabled in rook-ceph-operator-configmap,
if then we'll create the networkFence cr and delete the cr if nodes come back.
And, added the unit test too.

Signed-off-by: subhamkrai <srai@redhat.com>
2023-07-07 21:16:25 +05:30
Travis Nielsen 3ffec84100 Merge pull request #12462 from Madhu-1/fix-holderpod
csi: update csi holder daemonset template
2023-07-07 08:32:00 -06:00
Travis Nielsen 18e2502a69 Merge pull request #12295 from subhamkrai/remve-default-scc
security: remove default scc privileges
2023-07-07 08:24:37 -06:00
subhamkrai 48f84b37e8 security: drop all capabilities to the container
adding drop `ALL` capabilities in rook operator container
as this is not required and will remove warning in ocp cluster.

Signed-off-by: subhamkrai <srai@redhat.com>
2023-07-07 17:06:48 +05:30
Travis Nielsen 854bc7d980 Merge pull request #12143 from parth-gr/IPV6-external
external: add support for IPV6 ceph daemons
2023-07-06 15:39:05 -06:00
Travis Nielsen 46dd374e30 Merge pull request #12478 from Rakshith-R/csi/rm-checks
csi: drop checks for k8s version below the support minimum version
2023-07-06 11:53:47 -06:00
Travis Nielsen 11018f0d41 Merge pull request #12479 from Rakshith-R/csi/upgrade-sidecar-v
csi: update csi sidecars' image version
2023-07-06 10:29:47 -06:00