Commit Graph
372 Commits
Author SHA1 Message Date
parth-gr 7fa4e5eac1 external: add support for multisite in external cluster
Add support for realm, zone and zonegroup

Signed-off-by: parth-gr <paarora@redhat.com>
(cherry picked from commit b60da0b8c1)
2023-04-13 13:56:07 +00:00
parth-gr 44c44d637e external: add alias rbd pool name to support . pools name
if restricted permission was on the . was appended to k8s secret and
failed to create the secret so added a alias name is user wan't to suuport
pool with . in name

Signed-off-by: parth-gr <paarora@redhat.com>
(cherry picked from commit 6c3dabcf5f)
2023-04-12 15:43:34 +00:00
travisn e6e98074ea core: update default image to ceph v17.2.6
With the release of ceph v17.2.6, the examples and the base
image for the operator are updated to pick up the latest
and greatest.

Signed-off-by: travisn <tnielsen@redhat.com>
(cherry picked from commit 609ac91cb1)
2023-04-12 06:15:52 +00:00
Travis Nielsen c20b9bf74c Merge pull request #12043 from rook/mergify/bp/release-1.11/pr-12028
external: do not enforce rbd, cephfs and rgw flags for the external cluster (backport #12028)
2023-04-11 11:40:32 -06:00
Travis Nielsen c8b7570e50 Merge pull request #12060 from rook/mergify/bp/release-1.11/pr-12051
helm: drop snapshot.storage.k8s.io/v1beta1 (backport #12051)
2023-04-11 11:39:28 -06:00
sp98 45288d9f26 core: add clusterID to MCS spec
ClusterID uniquely identifies a cluster. It is used as a prefix to
nslookup exported services.
For example: <clusterid>.<svc>.<ns>.svc.clusterset.local

Signed-off-by: sp98 <sapillai@redhat.com>
(cherry picked from commit aefe0054c4)
2023-04-11 16:50:02 +00:00
Mathieu Parent 439d45db82 helm: drop snapshot.storage.k8s.io/v1beta1
v1 exists since k8s v1.20

Signed-off-by: Mathieu Parent <mathieu.parent@insee.fr>
(cherry picked from commit 1578d55b4d)
2023-04-10 19:41:10 +00:00
parth-gr 0b636126f3 external: do not enforce rbd, cephfs and rgw flags for the external cluster
there might be a user who only wants to use rbd, so don't enforce them
to to create all the pools and pass the flags

Closes: https://github.com/rook/rook/issues/11846
Signed-off-by: parth-gr <paarora@redhat.com>
(cherry picked from commit e734911532)
2023-04-06 14:53:05 +00:00
Travis Nielsen 39c3affa05 Merge pull request #12040 from travisn/release-1.11.3
build: Update release version to v1.11.3
2023-04-05 14:04:53 -06:00
travisn 82e9b43855 build: update release version to v1.11.3
For the patch release update the examples and docs to
v1.11.3.

Signed-off-by: travisn <tnielsen@redhat.com>
2023-04-05 13:25:35 -06:00
parth-gr 055a4ca711 external: name correction of validate_rgw_metadata_ec_pool_name function
The function is used for rbd so it should be name to validate_rbd_metadata_ec_pool_name

Signed-off-by: parth-gr <paarora@redhat.com>
(cherry picked from commit 626d1c44ff)
2023-04-05 18:20:56 +00:00
Travis Nielsen 519b02398e Merge pull request #11959 from rook/mergify/bp/release-1.11/pr-11899
csi: make AttachRequired as configurable (backport #11899)
2023-04-04 14:28:55 -06:00
Travis Nielsen 4f9b1e835e Merge pull request #12014 from rook/mergify/bp/release-1.11/pr-11980
mgr: disable the prometheus module by crds (backport #11980)
2023-04-03 16:49:53 -06:00
travisn 88e0bba18d ci: canary test should enable the prometheus module
The canary test is waiting for the prometheus module,
which is now disabled by default. For the canary test,
we need to enable the prometheus module for the external
cluster test.

Signed-off-by: travisn <tnielsen@redhat.com>
(cherry picked from commit 558732d0ae)
2023-04-03 21:58:30 +00:00
parth-gr f3edbae3bb external: make rgw call separate from cephfs and rbd
if the rge endint is not reachable don't block the creation
of rbd and cephfs sc, just print the error instead of raising exception

Signed-off-by: parth-gr <paarora@redhat.com>
(cherry picked from commit e44df84687)
2023-03-31 15:36:00 +00:00
xiaobaowen 6e171c3218 mgr: disable the prometheus module by crds
Signed-off-by: xiaobaowen <xiaobaowen@deeproute.ai>
(cherry picked from commit e7254c2a1b)
2023-03-31 14:17:33 +00:00
Madhu Rajanna 3abc7f9705 csi: make AttachRequired as configurable
adding a option to make AttachRequired field
as configurable and added a comment to explain
the consequences of changing the default value

resolves: #11805

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
(cherry picked from commit 4c710de791)
2023-03-22 13:59:50 +00:00
Madhu Rajanna c6e48823af nfs: add csi-attacher to NFS provisioner
Add attacher sidecar to NFS provisioner pod
to avoid mounting RWO volumes on two nodes

details: https://github.com/rook/rook/issues/10692

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
(cherry picked from commit 4bdab21db0)
2023-03-22 13:59:49 +00:00
travisn 9e5706fd87 build: update release version to v1.11.2
For the patch release update the docs and examples
to v1.11.2

Signed-off-by: travisn <tnielsen@redhat.com>
2023-03-21 13:18:52 -06:00
travisn 44f6455247 core: set key rotation default in code instead of crds
The defaults in CRDs cause an update and trigger a new
reconcile if the value is not set. For the key rotation
setting, the default was only being updated when the kms
feature was enabled. This update was causing the reconcile
to fail in the kms tests. With the default now in code,
the default can remain empty and no cr update will trigger
a new reconcile unexpectedly.

Signed-off-by: travisn <tnielsen@redhat.com>
(cherry picked from commit cd94ed7ddc)
2023-03-21 18:16:43 +00:00
Sheetal Pamecha 6825beb1b6 external: use f-strings for formatting
Replace the old formatting method with the f-string
and fix few pylint errors

Signed-off-by: Sheetal Pamecha <spamecha@redhat.com>
(cherry picked from commit (6dbbc9d)
Signed-off-by: Sheetal Pamecha <spamecha@redhat.com>
2023-03-21 10:25:18 +05:30
Travis Nielsen 257f09dfce Merge pull request #11923 from rook/mergify/bp/release-1.11/pr-11908
rgw: enableRGWDashboard can be configured by custom (backport #11908)
2023-03-20 12:41:55 -06:00
root 0a972a0850 rgw: allow the rgw dashboard to be disabled
The rgw dashboard can be disabled by the setting in the
CephObjectStore `gateway.dashboardEnabled` if set to false.

Signed-off-by: xiaobaowen <xiaobaowen@deeproute.ai>
(cherry picked from commit 253d4123f6)
2023-03-17 14:19:29 +00:00
Matt 98d6289752 external: pool and metadata ec pools were reversed in scripts
Pool and Metadata Pool Appear to be reversed.

dataPool needs to contain the EC Data pool
pool needs to contain the Metadata Pool
Closes: https://github.com/rook/rook/issues/11918

Signed-off-by: Matt P <dragon@fbdragon.co.uk>
(cherry picked from commit 8bdabf85a8)
2023-03-17 00:02:34 +00:00
Richard Bateman f9f72c326b nfs: add hostNetwork option for the ganesha daemon
Add a hostNetwork option for a Ganesha server.
This allows you to use host networking for the cluster but still
use regular pod networking for NFS Ganesha servers

Signed-off-by: Richard Bateman <taxilian@gmail.com>
(cherry picked from commit 0ca9da23e8)
2023-03-13 18:14:57 +00:00
Vincent Kling 28ba8ef839 manifest: add missing quote
Signed-off-by: Vincent Kling <v.kling@vinniict.nl>
(cherry picked from commit bd857cc5c5)
2023-03-13 15:20:17 +00:00
Travis Nielsen dadde56367 Merge pull request #11877 from rook/mergify/bp/release-1.11/pr-11864
core: add fsid to the additionalPrinterColumns on cephcluster custom resource (backport #11864)
2023-03-10 10:48:40 -07:00
xiaobaowen aa029cdbf4 core: add fsid to the additionalPrinterColumns on cephcluster custom resource
Signed-off-by: xiaobaowen <xiaobaowen@deeproute.ai>
(cherry picked from commit df95c1add0)
2023-03-10 14:55:07 +00:00
travisn 817e63823f docs: clarify device class use on all pools
If the device class property is specified on any pool,
it must be specified on all pools so the pg autoscaler
will remain healthy.

Signed-off-by: travisn <tnielsen@redhat.com>
(cherry picked from commit 38981f2649)
2023-03-08 19:20:28 +00:00
Rakshith R 2e6ae0a958 docs: add documentation for encryption key rotation
Signed-off-by: Rakshith R <rar@redhat.com>
(cherry picked from commit 340dbe05b4)
2023-03-08 16:37:34 +00:00
Rakshith R 30692ca9c8 osd: add capability to reconcile key rotation cron jobs
This commits adds code to reconcile key rotation cron jobs.

Signed-off-by: Rakshith R <rar@redhat.com>
(cherry picked from commit f39a32fcdb)
2023-03-08 16:37:33 +00:00
Rakshith R 542906be28 osd: add rotate-key functionality to rook's key-management cmd
This commit adds functionality to be able to rotate
key encryption key of encrypted PVC backed OSDs.
Necessary changes such as adding update functionality
to kms and rbac changes are made as well.

Signed-off-by: Rakshith R <rar@redhat.com>
(cherry picked from commit 71e011f731)
2023-03-08 16:37:32 +00:00
Rakshith R 198de5a76d core: add KeyRotationSpec to cephcluster CR
This commit adds KeyRotationSpec to cephcluster CR
to support encryption key rotation feature.
If enabled Rook will create a cronjob for each
encrypted PVC based OSD with given schedule set
to rotate their respective key encryption key.

Signed-off-by: Rakshith R <rar@redhat.com>
(cherry picked from commit 46dd2eb5ff)
2023-03-08 16:37:31 +00:00
travisn 35b31f92aa build: update release version to v1.11.1
For the patch release the examples and docs are updated
to v1.11.1

Signed-off-by: travisn <tnielsen@redhat.com>
2023-03-07 15:07:28 -07:00
Travis Nielsen 0640427e14 Merge pull request #11843 from rook/mergify/bp/release-1.11/pr-11842
monitoring: Remove alerts that don't apply to rook (backport #11842)
2023-03-07 14:37:18 -07:00
Redouane Kachach 9a3e5c4e94 Revert "mgr: remove mgr sidecar"
This reverts commit ff75ec96b7.

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
(cherry picked from commit 456a0c328c)
2023-03-07 18:28:25 +00:00
travisn f3de021b55 monitoring: remove alerts that don't apply to rook
When the alerts were updated from the ceph repo, the cephadm
alerts were removed, now we also remove two other alerts that
don't apply to rook clusters. The pool growth warning alert
and prometheus job missing alerts need to be removed
as also seen in https://github.com/rook/rook/pull/10109.

Signed-off-by: travisn <tnielsen@redhat.com>
(cherry picked from commit fd25eeecf1)
2023-03-06 23:34:31 +00:00
gauravsitlani 5bea2695c8 manifest: fix whitespace issues
Signed-off-by: gauravsitlani <gauravsitlani@riseup.net>
(cherry picked from commit 75ec7bffc0)
2023-03-03 17:45:13 +00:00
parth-gr 1344036419 external: add realm support for external cluster
if a cluster won't use the deafult realm and try to
execute the python script it will fail to vaildate rgw
as the rgw-admin-user would be created on default realm
So creating user in specific realm if the realm name is passed

Signed-off-by: parth-gr <paarora@redhat.com>
(cherry picked from commit 96ea7817f8)
2023-03-01 19:43:40 +00:00
travisn dc4995f090 build: set the release version to v1.11.0
For the new minor rook release we set the examples and documentation
to v1.11.0

Signed-off-by: travisn <tnielsen@redhat.com>
2023-02-27 16:37:21 -07:00
sp98 c69c5a16fd core: export mon and OSD services
Signed-off-by: sp98 <sapillai@redhat.com>
(cherry picked from commit 7292ac5927)
2023-02-27 10:23:43 -07:00
sp98 069f9b6732 core: multiClusterService API spec changes
Add API changes for export services to peer cluster

Signed-off-by: sp98 <sapillai@redhat.com>
(cherry picked from commit dd941de241)
2023-02-27 16:50:55 +00:00
parth-gr 4c92a2e93a build: update k8s version to 1.26.1
Update the Kubernetes API version used to 1.26.1, and start testing
against Kubernetes version 1.26.1 in CI.

Co-authored-by: parth-gr <paarora@redhat.com>
Co-authored-by: Blaine Gardner <blaine.gardner@redhat.com>

Signed-off-by: parth-gr <paarora@redhat.com>
Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
(cherry picked from commit 69ae9569cd)
2023-02-24 22:13:45 +00:00
Madhu Rajanna 3d65f951d8 csi: update cephcsi to v3.8.0
updating the cephcsi image to v3.8.0
release and also removing support for
3.6.0 as its deprecated and not supported
any more.

More details at
https://github.com/ceph/ceph-csi/releases/tag/v3.8.0
and https://github.com/ceph/ceph-csi/tree/release-v3.8
\#ceph-csi-container-images-and-release-compatibility

fixes #11688

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
(cherry picked from commit b01180580c)
2023-02-22 15:30:15 +00:00
Redouane Kachach 0207134140 mgr: remove mgr sidecar
With the new mgr HA implementation (based on readiness probe) we
don't need the mgr sidecar (live-watch) anymore. This commit is
intended to remove all the related code.

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
(cherry picked from commit ff75ec96b7)
2023-02-22 05:20:00 +00:00
ahgraber 030a09dfef monitoring: remove cephadm ruleset
Remove cephadm ruleset, as they don't apply to rook

Signed-off-by: ahgraber <ahgraber@ninerealmlabs.com>
(cherry picked from commit 568623d92b)
2023-02-21 16:56:45 +00:00
ahgraber 43c28ad5bd monitoring: align with ceph/ceph prometheus alerts
Update rook prometheus localrules files to align with ceph/ceph prometheus alerts

Signed-off-by: ahgraber <ahgraber@ninerealmlabs.com>
(cherry picked from commit ad2308d655)
2023-02-21 16:56:45 +00:00
Madhu Rajanna f8cb8cf635 csi: add missing node access to cephfs driver
Node access is only needed when we are using
volumeBindingMode: WaitForFirstConsumer in
the storageclass its not required for Immediate
BindingMode.

fixes: #11694

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
(cherry picked from commit 1cfa7eefae)
2023-02-17 19:19:14 +00:00
subhamkrai 7be92f732c build: add rbac which are required
adding necessary rbac and also updating
csv-gen script.

Closes: https://github.com/rook/rook/issues/10141
Signed-off-by: subhamkrai <srai@redhat.com>
(cherry picked from commit 4699e8885a)
2023-02-17 18:12:51 +00:00
Rakshith R f03fb156f0 docs: add documentation about rbd read affinity
This commit documents steps to enable read affinity
for rbd volumes.

Signed-off-by: Rakshith R <rar@redhat.com>
(cherry picked from commit f8c7a62c3b)
2023-02-16 15:00:33 +00:00