Commit Graph
9118 Commits
Author SHA1 Message Date
Tarun Gupta Akirala b068cba3dd docs: fix indentation in CephCluster on PVC example yaml
Copy pasting current code block results in an YAML parsing error and
this change fixing that error by adding a space where its needed

Signed-off-by: Tarun Gupta Akirala <takirala@users.noreply.github.com>
2022-09-19 20:34:59 -07:00
Travis Nielsen cddcc0de78 Merge pull request #11016 from Sheetalpamecha/issue_10958
docs: clarify Object Pool CRD is same as Block Pool CRD
2022-09-19 22:12:32 -04:00
Travis Nielsen 54b6e5143a Merge pull request #11012 from jhoblitt/maint/too-much-hot-plug-to-handle
operator: silence 'cm is handled by another watcher' DEBUG messages
2022-09-19 15:38:36 -06:00
Sheetal Pamecha 4dd8ee9520 docs: clarify Object Pool CRD is same as Block Pool CRD
Signed-off-by: Sheetal Pamecha <spamecha@redhat.com>
2022-09-19 15:33:38 +05:30
Joshua Hoblitt 0763f91f93 operator: silence 'cm is handled by another watcher' DEBUG messages
I guesstimate that around 50% of the operator log volume when set to log
level `DEBUG` are messages about cm's which aren't relevant to rook.

E.g.:

```
2022-09-16 23:03:05.430839 D | ceph-cluster-controller: hot-plug cm watcher: only reconcile on hot plug cm changes, this "ingress-controller-leader" cm is handled by another watcher
2022-09-16 23:03:05.643255 D | ceph-cluster-controller: hot-plug cm watcher: only reconcile on hot plug cm changes, this "fleet-agent-lock" cm is handled by another watcher
2022-09-16 23:03:05.799526 D | ceph-cluster-controller: hot-plug cm watcher: only reconcile on hot plug cm changes, this "cattle-controllers" cm is handled by another watcher
```

Yes, it is `DEBUG` and noise is expected. However, there is no message
about checking the status of the cm's rook actually needs to watch and
these messages don't seem very useful. I have been resorting to piping
the operators logs through `| grep -v 'hot-plug cm watcher'` to cut down
the noise.

Signed-off-by: Joshua Hoblitt <josh@hoblitt.com>
2022-09-16 16:23:19 -07:00
Travis Nielsen 85b079105b Merge pull request #10942 from Madhu-1/fix-10932
csi: customize plugin volumes and volumemounts
2022-09-16 11:33:31 -06:00
Madhu Rajanna 80a96f8f32 csi: customize plugin volumes and volumemounts
This option open-up volumes and volumemounts
for user customization of the rbd,cephfs,nfs
plugin daemonset.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-09-16 09:57:37 +05:30
Travis Nielsen d0779b027e Merge pull request #10991 from travisn/gen-rbac-conflict
build: Fix intermittent gen-rbac failure
2022-09-15 10:13:48 -06:00
Travis Nielsen b4dcc9b633 Merge pull request #10990 from parth-gr/mon-ci-health
ci: add mon_data_avail_warn to canary ci test
2022-09-15 10:09:34 -06:00
Travis Nielsen 1102eeec87 Merge pull request #10934 from subhamkrai/assimilate-conf
core: use assimilate-conf command to run commands
2022-09-15 08:16:33 -06:00
Satoru Takeuchi 72c0683dc8 Merge pull request #10992 from cybozu-go/docs-add-lv-to-storage-options
docs: add logical volume to storage options
2022-09-15 21:33:26 +09:00
subhamkrai cfc5f19f92 core: use assimilate-conf command to run commands
this commit uses the ceph feature assimilate-conf to set
multiple configurations for ceph global/pods at one file and
use that in command to set the required configuration in one
line command.
for example:
`ceph config assimilate-conf -i <input file> -o <output file>`

Signed-off-by: subhamkrai <srai@redhat.com>
2022-09-15 17:53:58 +05:30
Satoru Takeuchi b52e6a0da8 docs: add logical volume to storage options
Rook supports osd on logical volume in host-based clusters. Let's add it
to the list of valid device types.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2022-09-15 11:31:20 +00:00
parth-gr df8493d77b ci: add mon_data_avail_warn to canary ci test
ceph cluster on ci mostly have health error
mon disk low on size,
so overriding the min aval capacity to 0 from 30% default so this
error can be removed

Closes: rook#10971

Signed-off-by: parth-gr <paarora@redhat.com>
2022-09-15 15:20:47 +05:30
Travis Nielsen 7863d3161c build: fix intermittent gen-rbac failure
The crds generation for the helm crds is intermittently hitting a build
error due to multiple builds generating the crds at the same time.
We avoid this race condition by first writing the crds to a temp file
then move the file to the helm crd resources file.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-09-14 16:10:51 -06:00
Travis Nielsen eaee34872b Merge pull request #10912 from parth-gr/restricted-upgrade
docs: add upgrade steps for multi-tenant custer
2022-09-14 07:44:07 -06:00
parth-gr 0ad1b52005 docs: add upgrade steps for multi-tenant custer
Currently for external clustr multitenancy is only applicable for new
deployments, but adding doc change so multi-tenancy can be achieved for
upgraded cluster also

Closes: https://github.com/rook/rook/issues/10678
Signed-off-by: parth-gr <paarora@redhat.com>
2022-09-14 12:48:18 +05:30
Travis Nielsen cb73f728cf Merge pull request #10925 from travisn/provider-owners
docs: Simplify code owners for ceph provider
2022-09-13 16:10:48 -06:00
Satoru Takeuchi eb4e3624e4 Merge pull request #10983 from travisn/daily-arm-host
ci: Update arm host to pick up correct self-hosted machine
2022-09-14 04:38:35 +09:00
Travis Nielsen 55c72a3674 ci: update arm host to pick up correct self-hosted machine
The self-hosted arm64 machine has a new label ubuntu-20.04-arm64 to
avoid the conflict with other ubuntu-20.04 labels from
general github actions. We only want the daily arm job
to use the self-hosted runner.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-09-13 13:30:45 -06:00
Satoru Takeuchi 9ad82eebbb Merge pull request #10968 from cybozu-go/osd-disallow-to-create-encrypted-osd-on-part
osd: disallow to create encrypted osd on partition
2022-09-14 04:26:15 +09:00
Travis Nielsen 8664d8680a Merge pull request #10975 from travisn/verbose-rbac
build: Stop printing verbose rbac generation details
2022-09-13 12:26:47 -06:00
Travis Nielsen f97e270870 Merge pull request #10969 from cybozu-go/ci-disallow-to-create-encrypted-osd-on-lv
ci:  disallow to create encrypted osd on lv and osd on lv with metadata device
2022-09-13 11:36:38 -06:00
Travis Nielsen d7ca581ef9 Merge pull request #10700 from jdloft/fix-growth-rule
monitoring: fix pool growth warning grouping
2022-09-13 11:31:47 -06:00
Travis Nielsen 839920ff80 build: stop printing verbose rbac generation details
The rbac generation prints a lot of info that is not necessary
unless troubleshooting the rbac build, so we can comment it
out by default.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-09-13 11:26:51 -06:00
Travis Nielsen 5fce56b596 Merge pull request #10965 from thotz/update-go-ceph-v17
build: update goceph module to v0.17
2022-09-13 10:56:20 -06:00
Blaine Gardner 697f34fcee Merge pull request #10950 from BlaineEXE/nfs-kerberos-implementation
nfs: add kerberos client security support
2022-09-13 10:05:14 -06:00
Blaine Gardner 2b0eaa974f Merge pull request #10909 from subhamkrai/remove-import-error
external: fix import errors for python2
2022-09-13 08:49:12 -06:00
Blaine Gardner 005000212c nfs: add kerberos client security support
Add support for enabling kerberos for client authentication.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2022-09-13 08:46:52 -06:00
Travis Nielsen c057c41aee Merge pull request #10963 from Rakshith-R/init-only-rbd-pool
pool: initialize only rbd application pools
2022-09-13 07:52:48 -06:00
Satoru Takeuchi 39cc6059f1 ci: disallow to create osd on lv with metadata by accident
OSD on LV with metadata device is not supported. So we once we made
a fix to disallow this configuration. However, it's insuffucient
because we forgot to reset `matched` flag.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2022-09-13 13:21:31 +00:00
Rakshith R c02f3194d1 pool: initialize only rbd application pools
`rbd pool init` cmd initializes pool for rbd images.
This commit makes modification to init only
rbd application pools, since it is not required
by other pools like ".nfs",".mgr" & "mgr_devicehealth".

Signed-off-by: Rakshith R <rar@redhat.com>
2022-09-13 18:18:26 +05:30
Satoru Takeuchi 7969450589 ci: disallow to create encrypted osd on lv
Rook doesn't support encrypted OSD on LV. Without disallowing
this configuration, ceph-volume results in failure.

Closes: https://github.com/rook/rook/issues/10782

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2022-09-13 12:44:53 +00:00
Satoru Takeuchi 591fc5f68b osd: disallow to create encrypted osd on partition
Rook doesn't support encrypted osd on partition. So we should
skip partitions as candidates of the new encrypted osds.

Closes: https://github.com/rook/rook/issues/10911

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2022-09-13 12:04:14 +00:00
Jiffin Tony Thottan d3d760e901 build: update goceph module to v0.17
Updating go-ceph module into latest version v0.17

Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2022-09-13 15:29:53 +05:30
subhamkrai 9a952df419 external: fix import errors for python2
remove duplicate import urllib.parse which is handled below
with try and except no need to import separately. Also, change
the way to get the python version.

Signed-off-by: subhamkrai <srai@redhat.com>
2022-09-13 10:59:18 +05:30
Travis Nielsen e5fe5e7081 Merge pull request #10948 from ideepika/wip-add-debug
ci: add debug flag to identify any failing yaml origin
2022-09-12 15:16:55 -06:00
Travis Nielsen 384fc4ab92 Merge pull request #10931 from parth-gr/rgw-fix-ceph-version
external: do not add info=read cap if ceph version doesn't support it
2022-09-12 15:15:47 -06:00
Travis Nielsen ef3f55460c Merge pull request #10728 from thotz/multisite-delete-zone-pools
rgw: delete zone/pools for multisite configuation
2022-09-12 13:42:42 -06:00
Travis Nielsen 671261d8ce Merge pull request #10943 from Rakshith-R/add-topo-prov-support
csi: add topology provisioning support
2022-09-12 11:19:48 -06:00
Jiffin Tony Thottan c98628eb0f rgw: delete zone/pools for multisite configuation
Allow option to delete the zone/pools created by ceph object zone CR.

Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2022-09-12 21:44:55 +05:30
Rakshith R 3c5a2f4142 csi: add topology provisioning support
This commit adds topology provisioning
support. This makes modification to rbac,
csi deployment and daemonset.

Signed-off-by: Rakshith R <rar@redhat.com>
2022-09-12 16:10:18 +05:30
Satoru Takeuchi 576900eeea Merge pull request #10951 from travisn/quickstart-prereq
docs: Clarify storage prereqs in quickstart guide
2022-09-12 08:07:43 +09:00
Travis Nielsen d5f100def1 docs: clarify storage prereqs in quickstart guide
The quickstart guide prerequisites have diverged from the storage
requirements on the prereqs doc page, now they are in sync again.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-09-09 15:23:58 -06:00
Travis Nielsen 91ede0279e Merge pull request #10889 from Rakshith-R/add-kmip-support
osd: add kmip encryption support
2022-09-09 14:23:19 -06:00
Deepika Upadhyay ccbff1be95 ci: add debug flag to identify any failing yaml origin
Signed-off-by: Deepika Upadhyay <deepika@koor.tech>
2022-09-09 23:30:51 +05:30
Blaine Gardner 8363e0dc6c Merge pull request #10892 from Rakshith-R/add-nfs-snap-resize
csi: add support for NFS snap, restore clone & resize
2022-09-09 09:43:30 -06:00
parth-gr 54425803b6 external: do not add info=read cap if ceph version doesn't support it
The rgw ip validation feature was needing to update the rgw user
cap to add info=read permission, but this permission is only backported
till ceph pacific, so we added a check that only add this cap
when ceph version support it,
But this cap was also adding with the other caps, so removed it from there
Now it will only add this cap if ceph version support it

Signed-off-by: parth-gr <paarora@redhat.com>
2022-09-09 15:46:18 +05:30
Rakshith R 0ba2ab1206 docs: add doc for kmip encryption support
Signed-off-by: Rakshith R <rar@redhat.com>
2022-09-09 11:39:33 +05:30
Rakshith R f21c12234d osd: add kmip encryption support
The cluster-wide encryption feature now
supports KMIP (Key Management Interoperability Protocol)
kms.
KMIP is an extensible communication protocol that defines
message formats for the manipulation of cryptographic keys
on a key management server.

For more information, refer:
https://en.wikipedia.org/wiki/Key_Management_Interoperability_Protocol

Signed-off-by: Rakshith R <rar@redhat.com>
2022-09-09 11:39:33 +05:30