Commit Graph
267 Commits
Author SHA1 Message Date
Madhu Rajanna 80a96f8f32 csi: customize plugin volumes and volumemounts
This option open-up volumes and volumemounts
for user customization of the rbd,cephfs,nfs
plugin daemonset.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-09-16 09:57:37 +05:30
Travis Nielsen b4dcc9b633 Merge pull request #10990 from parth-gr/mon-ci-health
ci: add mon_data_avail_warn to canary ci test
2022-09-15 10:09:34 -06:00
parth-gr df8493d77b ci: add mon_data_avail_warn to canary ci test
ceph cluster on ci mostly have health error
mon disk low on size,
so overriding the min aval capacity to 0 from 30% default so this
error can be removed

Closes: rook#10971

Signed-off-by: parth-gr <paarora@redhat.com>
2022-09-15 15:20:47 +05:30
Travis Nielsen eaee34872b Merge pull request #10912 from parth-gr/restricted-upgrade
docs: add upgrade steps for multi-tenant custer
2022-09-14 07:44:07 -06:00
parth-gr 0ad1b52005 docs: add upgrade steps for multi-tenant custer
Currently for external clustr multitenancy is only applicable for new
deployments, but adding doc change so multi-tenancy can be achieved for
upgraded cluster also

Closes: https://github.com/rook/rook/issues/10678
Signed-off-by: parth-gr <paarora@redhat.com>
2022-09-14 12:48:18 +05:30
Travis Nielsen d7ca581ef9 Merge pull request #10700 from jdloft/fix-growth-rule
monitoring: fix pool growth warning grouping
2022-09-13 11:31:47 -06:00
Blaine Gardner 697f34fcee Merge pull request #10950 from BlaineEXE/nfs-kerberos-implementation
nfs: add kerberos client security support
2022-09-13 10:05:14 -06:00
Blaine Gardner 2b0eaa974f Merge pull request #10909 from subhamkrai/remove-import-error
external: fix import errors for python2
2022-09-13 08:49:12 -06:00
Blaine Gardner 005000212c nfs: add kerberos client security support
Add support for enabling kerberos for client authentication.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2022-09-13 08:46:52 -06:00
subhamkrai 9a952df419 external: fix import errors for python2
remove duplicate import urllib.parse which is handled below
with try and except no need to import separately. Also, change
the way to get the python version.

Signed-off-by: subhamkrai <srai@redhat.com>
2022-09-13 10:59:18 +05:30
Travis Nielsen 384fc4ab92 Merge pull request #10931 from parth-gr/rgw-fix-ceph-version
external: do not add info=read cap if ceph version doesn't support it
2022-09-12 15:15:47 -06:00
Travis Nielsen ef3f55460c Merge pull request #10728 from thotz/multisite-delete-zone-pools
rgw: delete zone/pools for multisite configuation
2022-09-12 13:42:42 -06:00
Jiffin Tony Thottan c98628eb0f rgw: delete zone/pools for multisite configuation
Allow option to delete the zone/pools created by ceph object zone CR.

Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2022-09-12 21:44:55 +05:30
Rakshith R 3c5a2f4142 csi: add topology provisioning support
This commit adds topology provisioning
support. This makes modification to rbac,
csi deployment and daemonset.

Signed-off-by: Rakshith R <rar@redhat.com>
2022-09-12 16:10:18 +05:30
parth-gr 54425803b6 external: do not add info=read cap if ceph version doesn't support it
The rgw ip validation feature was needing to update the rgw user
cap to add info=read permission, but this permission is only backported
till ceph pacific, so we added a check that only add this cap
when ceph version support it,
But this cap was also adding with the other caps, so removed it from there
Now it will only add this cap if ceph version support it

Signed-off-by: parth-gr <paarora@redhat.com>
2022-09-09 15:46:18 +05:30
Rakshith R 9c4592720c csi: add NFS expansion support
This commit adds resizer sidecar to
NFS driver and required storageclass
and rbac changes.

Signed-off-by: Rakshith R <rar@redhat.com>
2022-09-08 16:15:37 +05:30
Rakshith R f8eb2a2fbc csi: add NFS clone support
This commit reqired yaml and docs
changes too for NFS clone support.

Signed-off-by: Rakshith R <rar@redhat.com>
2022-09-08 16:15:37 +05:30
Rakshith R 73042c7531 csi: add NFS snapshot support
This commit adds snapshotter sidecar to
NFS driver and required yamls and docs too.

Signed-off-by: Rakshith R <rar@redhat.com>
2022-09-08 16:15:37 +05:30
Travis Nielsen 08c787e8d6 Merge pull request #10777 from yati1998/remove-vol-rep
rbd-mirror: remove volume replication sidecar
2022-09-07 08:27:07 -06:00
Travis Nielsen 46a832fe98 Merge pull request #10899 from khrisrichardson/found-unexpected-end-of-stream
manifest: fix unexpected end of stream
2022-09-07 07:41:32 -06:00
yati1998 9b4361b379 rbdmirror: remove volume replication sidecar
The volume replication operator is being moved to
kubernetes-csi-addons. This commit hence, removes
the volume replication sidecar and updates the
related documentation.
It will also update the csi-addons sidecar version
to the latest one.

Closes: #10655

Signed-off-by: yati1998 <ypadia@redhat.com>
2022-09-07 14:49:19 +05:30
Khris Richardson 9614428f54 manifest: fix unexpected end of stream
Signed-off-by: Khris Richardson <khris.richardson@gmail.com>
2022-09-06 15:04:06 -07:00
Travis Nielsen 1bbf8f7a43 Merge pull request #10791 from Rakshith-R/use-cephcsi-nfsnodeplugin
csi: use cephcsi image for nfs nodeserver + holder design
2022-09-06 10:52:30 -06:00
Rakshith R 7722226521 csi: remove nfs image
This commit remove nfs image
since it is no longer needed.
Cephcsi itself will act as nfs
nodeserver.

Signed-off-by: Rakshith R <rar@redhat.com>
2022-09-02 14:16:15 +05:30
Humble Chirammal 32ecc37d37 csi: change the default fsgroup policy for CSI driver object
This commit change the default fsgroup policy for csi driver object
to "File" type which is the better/correct setting for the CSI volumes
We have been using default value which is "ReadWriteOnceWithFSType".
with this change backward compatibility should be preserved.

Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2022-09-01 10:11:39 +05:30
Humble Chirammal 6ef366dc34 csi: use the latest sidecars for ceph csi driver
at present, the csi sidecars are older versions and not in parity
with the latest ceph csi release v3.7.0. This commit update the
same to make it.

Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2022-08-31 14:43:00 +05:30
Blaine Gardner 6c8f2e414f build: remove psp from common.yaml generation
Due to an oversight, PSP resources were left in generation of
common.yaml from #10797. Resolve that by setting
pspEnable=false when generating common.yaml.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2022-08-29 10:41:41 -06:00
Blaine Gardner 1e9bbae583 docs: move PSPs from common.yaml to psp.yaml
Also update docs. Use `make gen-rbac` to generate psp.yaml.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2022-08-25 16:39:52 -06:00
Madhu Rajanna 6a650e1c9d csi: make cephcsi 3.6.0 as minimum supported version
Setting the min version to 3.7 will make upgrade
difficult. If someone is using any different/custom
version, this means they won't be able to upgrade to
rook v1.10 unless they also update their csi image
at the same time. If we set the min version to 3.6,
it will give some time buffer to allow them to
change the csi driver later.

ref: https://github.com/rook/rook/pull/10759#discussion_r953014295

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-08-24 08:48:09 +05:30
Travis Nielsen cc15c94e6c Merge pull request #10736 from pkalever/clusterName-metadata
CSI: provide a way to supply `--setmetadata` and `--clustername` to the csi driver
2022-08-23 13:06:27 -06:00
Travis Nielsen f02ffef8da Merge pull request #10503 from humblec/cephfs-file-policy
csi: change the fsgrouppolicy for CephFS driver to "File" mode
2022-08-23 13:00:50 -06:00
Prasanna Kumar Kalever e376c17bfb csi: provide a way to set --clustername at csi driver
One can now use the operator configmap for CSI_CLUSTER_NAME variable
for setting ClusterName on the RBD images and CephFS subvolume.
This will be useful in cases like for example, when two container orchestrator
clusters (Kubernetes/OCP) are using a single ceph cluster.

Signed-off-by: Prasanna Kumar Kalever <prasanna.kalever@redhat.com>
2022-08-23 12:12:02 +05:30
Prasanna Kumar Kalever b5b8cbf6ae csi: provide a way to enable --setmetadata at csi driver
One can now tweak the operator configmap for CSI_ENABLE_METADATA boolean to
enable/disable setting of PV/PVC/PVCNamespace &
snapshot-name/snapshot-namespace/snapshotcontent-name on the RBD images
and CephFS subvolume.

Signed-off-by: Prasanna Kumar Kalever <prasanna.kalever@redhat.com>
2022-08-23 12:11:02 +05:30
Madhu Rajanna 52d410a99b csi: update cephcsi to v3.7.0 release
As cephcsi v3.7.0 is released updating
CephCSI to v3.7.0 in Rook and defaulting
the minimum version to v3.7.0

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-08-23 07:53:35 +05:30
Travis Nielsen 9395ebaa1d Merge pull request #10725 from t3hmrman/docs/add-ceph-client-crd-examples
docs: add examples for CephClient CRD use & libcephsqlite
2022-08-22 15:47:03 -06:00
vados 21566ab839 docs: add examples for CephClient CRD use & libcephsqlite
The documentation previously did not cover how to use the CephClient
CRD in a realistic use case. This commit improves the documentation
on the general usage and also specificallyw with libcephsqlite.

Closes: https://github.com/rook/rook/issues/10689
Signed-off-by: vados <vados@vadosware.io>
2022-08-23 06:05:32 +09:00
zhucan 1da927e40e object: generated code
Signed-off-by: zhucan <zhucan.k8s@gmail.com>
2022-08-22 14:46:56 +08:00
Jiffin Tony Thottan 8003e764f9 rgw: add custom endpoint list option for zone
User can define his desired endpoint list in Zone CR so that it will
overwrite the default service name for rgw.

Resolves #6432

Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
Signed-off-by: Jiffin Tony Thottan <jthottan@redhat.com>
2022-08-17 10:03:12 +05:30
Travis Nielsen 768602bbe8 Merge pull request #10709 from travisn/ceph-17.2.3
manifest: Update default version of ceph to v17.2.3
2022-08-12 07:35:25 -06:00
Travis Nielsen f02fadc531 manifest: update default version of ceph to v17.2.3
For the Rook v1.10 release we want the latest version of Quincy to
be the default deployment. Updating to v17.2.3 with the latest
patch release.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-08-11 16:55:03 -06:00
Blaine Gardner b98efbb320 nfs: add support for running SSSD as a sidecar
Implement the SSSD sidecar design for NFS.

Because NFS documents are getting long, create an NFS
`Storage-Configuration` section with separated topics to keep the `NFS
Overview` document sane.

Adjust the SSSD design to allow any VolumeSource, not just ConfigMaps.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2022-08-11 14:59:23 -06:00
Jamison Lofthouse f553034351 monitoring: fix pool growth warning grouping
Predict linear will continue to predict on exporter data from old pods.
We can take the max value for every hour in the 2 day window before we
linearly predict to get the most conservative estimate. This will only
affect the hour in which a new mgr pod is started.

Fixes #10691

Signed-off-by: Jamison Lofthouse <jamison.lofthouse@gmail.com>
2022-08-11 13:53:28 -07:00
Travis Nielsen 24e416069a core: update controller runtime to v0.6.2
The dependencies in controller runtim v0.5 were getting old
and causing go module issues on macos. Now with the update to
v0.6.2 the module dependency issue is solved. For another
day we should update the controller runtime to even newer.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-08-11 12:41:11 -06:00
Travis Nielsen 93013f7594 manifest: update manifests for latest references
The manifests are regenerated with the latest go references.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-08-11 12:31:49 -06:00
Mudit Agarwal 40081cbcd2 Revert "csi: remove attacher sidecar from CephFS rook deployment"
This reverts commit 4bfd88dc4d.

Signed-off-by: Mudit Agarwal <muagarwa@redhat.com>
2022-08-10 13:04:14 +05:30
Blaine Gardner 97129d8a0b Merge pull request #10673 from BlaineEXE/sssd-design
docs: SSSD-NFS design
2022-08-08 14:35:41 -06:00
Sébastien Masset 4427c85845 manifest: fix example RoleBindings
This enables deployment of CephClusters in multiple namespaces in clusters where PSPs are enforced.

Missing bindings:
 * rook-ceph-cmd-reporter-psp
 * rook-ceph-default-psp
 * rook-ceph-mgr-psp
 * rook-ceph-mgr-system
 * rook-ceph-osd-psp
 * rook-ceph-purge-osd-psp
 * rook-ceph-rgw-psp

Signed-off-by: Sébastien Masset <sebastien.masset@orange.com>
2022-08-08 17:47:27 +02:00
Blaine Gardner 7787699bab docs: add SSSD to nfs design doc
Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2022-08-05 10:21:11 -06:00
parth-gr c1a16d300e external: fix cluster id naming in import-external-cluster script
Cluster_ID variable that we export from python script was different
from what we going to use in import script so changed it

Signed-off-by: parth-gr <paarora@redhat.com>
2022-08-05 17:30:39 +05:30
yati1998 4bfd88dc4d csi: remove attacher sidecar from CephFS rook deployment
CephFS CSI driver dont have/advertise controller publish/unpublish
capabilities, thus dont need attacher sidecar for its operations.
The presence of external-attacher adds on overhead and issues wrt
attachment in various scenarios. One of them would be the lack of
performance on syncing volumeattachment from api server..etc.
More or less we don't have controller publish and unpublish capabilities,
so we should not make use of this sidecar and cause
unnecessary addon here thus other issues.

similar changes have been added to CSI
https://github.com/ceph/ceph-csi/pull/3149

Signed-off-by: yati1998 <ypadia@redhat.com>
2022-08-03 19:56:39 +05:30