Commit Graph
7961 Commits
Author SHA1 Message Date
Travis Nielsen ac6bbe5902 docs: remove obsolete doc for handling rebooting nodes
The approach to handle node restarts has been much improved since the
creation of this doc, with the new approach to drain nodes and
for the application to control the restarts with the pod disruption
budgets. We now remove this obsolete documentation and recommend
the PDBs to be configured.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-01-27 14:47:14 -07:00
Sébastien Han f841c1b211 Merge pull request #7071 from travisn/osd-args-ordering
ceph: Consistently order the osd args to avoid restarts
2021-01-27 16:47:36 +01:00
Travis Nielsen 475260de35 Merge pull request #6875 from Madhu-1/fix-6830
ceph: add option to set FSGroupPolicy for CSI PVC
2021-01-27 08:34:45 -07:00
ushen 9bd2150d5e ceph: fix mds liveness probe
Previous patchset does not work before, because
`ConfigureLivenessProbe` does not directly modifies
input variable.

Signed-off-by: ushen <yshxxsjt715@gmail.com>
2021-01-27 20:27:24 +08:00
Santosh Pillai 4237aa7ecc ceph: configure health check timeout for OSDs when upgrading
added waitTimeoutForHealthyOSD in the cluster crd that defines the time (in minutes) the operator would wait before an OSD can be stopped for
upgrade. This PR also removes the ok-to-continue logic for osds as its already handled by ok-to-stop. The default value is 10 minutes.

Signed-off-by: Santosh Pillai <sapillai@redhat.com>
2021-01-27 11:13:05 +05:30
Travis Nielsen 570cba9b4e ceph: consistently order the osd args to avoid restarts
The settings for tuneDeviceClass and tuneFastDeviceClass were
stored as a map[string]string. When iterating over the map to
append the args, the args were being appended in an unpredictable
order. The order could change every reconcile, resulting in an
unnecessary OSD restart potentially every reconcile. Now we iterate
over a slice that will be ordered predictably and ensure OSDs
will not be restarted when not needed.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-01-26 17:23:01 -07:00
Travis Nielsen 31bcb60302 Merge pull request #6982 from travisn/osd-pvc-allow-removal
ceph: Allow removal of arbitrary osds on pvcs and simplify pvc names
2021-01-26 15:00:24 -07:00
Travis Nielsen 4b43e7afa5 ceph: allow removal of arbitrary osds on pvcs and simplify pvc names
OSDs on PVCs previously were always replaced with PVCs of a given name.
For on-prem scenarios where the OSDs might need to be removed instead
of replaced, the operator now allows holes to exist in the PVC index
names as long as there are a sufficient number of PVCs to meet the
criteria for the deviceSet.count.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-01-26 14:38:12 -07:00
Travis Nielsen 3e32aaa693 docs: replace friends of rook with community
The friends of rook section in OWNERS.md has long been outdated.
With the growing community it is really impossible to keep an
active list of those who are contributing to the project.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-01-26 11:48:36 -07:00
Travis Nielsen 4b7cc5227a Merge pull request #7066 from travisn/remove-edgefs
build: Remove the EdgeFS operator from Rook
2021-01-26 11:30:07 -07:00
Sébastien Han e54fcc7c51 Merge pull request #7068 from travisn/stale-bot-gh-action
bot: Update stale bot to a github action
2021-01-26 17:59:30 +01:00
Travis Nielsen 050abd14b6 bot: update stale bot to a github action
The stale bot has stopped working. Now we use a github
action to mark and close the stale issues.
Issues will be marked as stale after 90 days
and closed after one week. PRs will be marked
as stale after 90 days and closed after two weeks.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-01-26 08:53:19 -07:00
Travis Nielsen d99092dcfc Merge pull request #7059 from ron1/fix-progressing-completed-ceph-cluster-status-condition
ceph: fix ProgressingCompleted CephCluster status condition type
2021-01-25 21:48:48 -07:00
Travis Nielsen 53ed11f15b build: remove the edgefs operator from rook
The EdgeFS operator has been deprecated for some time in Rook.
If the replacement is added back to Rook it can be completed
according to the new guidelines in the documentation.
https://rook.io/docs/rook/master/storage-providers.html

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-01-25 17:51:24 -07:00
Travis Nielsen 89a9a35e74 Merge pull request #6425 from thotz/bucket-notification-designdoc
ceph: bucket notifications CRD documentation
2021-01-25 12:18:27 -07:00
ron1 1e64b82b64 ceph: set ProgressingCompleted CephCluster status condition type
Set ProgressingCompleted CephCluster status condition to include type cephv1.ConditionProgressing

Closes: https://github.com/rook/rook/issues/7055
Signed-off-by: ron1 <ron18219@gmail.com>
2021-01-25 10:09:07 -05:00
Sébastien Han 720380e3d3 Merge pull request #7024 from travisn/remove-cockroachdb
build: Remove the CockroachDB operator from Rook
2021-01-25 10:04:44 +01:00
Sébastien Han 28c78b9204 Merge pull request #7044 from leseb/fix-7022
ceph: update rgw and mds deployment for logCollector
2021-01-25 09:29:40 +01:00
Sébastien Han ebbf332d8d ceph: update rgw and mds deployment for logCollector
If the CephCluster CR spec is updated to activate the logCollector, we
must reflect that change onto child CRDs, like the mds and rgw since
their configurationn would be impacted too.
Now we watch for the CephCluster object changes from the object/file
controllers and react upon the appropriate event.

Closes: https://github.com/rook/rook/issues/7022
Signed-off-by: Sébastien Han <seb@redhat.com>
2021-01-22 18:19:07 +01:00
Travis Nielsen fe7ed021c5 Merge pull request #7050 from subhamkrai/disable-admission-controller
ceph: disable admission controller for k8s older than v1.16.0
2021-01-22 09:15:36 -07:00
Sébastien Han c82ae69ad9 Merge pull request #6641 from thotz/vault-kms-integration
ceph: vault kms configuration for ceph object store
2021-01-22 14:21:34 +01:00
Jiffin Tony Thottan ee6a03dfb8 ceph: minor update init container script in generateVaultGetKEK
Replacing VAULT_KV_VERS with VAULT_BACKEND for specifing version of kv engine.

Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2021-01-22 16:04:35 +05:30
Jiffin Tony Thottan 01649a8cd2 docs: update vault kms with RGW details
The KMS encryption via HashiCorp Vault can be consumed for RGW, adding those details
in the doc.

Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2021-01-22 16:04:28 +05:30
Sébastien Han c84d42871b Merge pull request #7052 from leseb/fix-olm-dup
ceph: remove the append flag when overriding
2021-01-22 11:28:20 +01:00
Sébastien HanandUmanga Chapagain chapagainumanga@gmail.com 330d0e90a5 ceph: remove the append flag when overriding
It looks like combining --append with --overwrite will cause duplicate
entries of our CRDs in the CSV definition. Removing the flag fixes the
duplicates.

Diff before and after the fix:

```
1118c1118
<     createdAt: 2021-01-22T11-07-27Z
---
>     createdAt: 2021-01-22T11-06-24Z
1126a1127,1159
>       - kind: CephBlockPool
>         name: cephblockpools.ceph.rook.io
>         version: v1
>       - kind: CephClient
>         name: cephclients.ceph.rook.io
>         version: v1
>       - kind: CephCluster
>         name: cephclusters.ceph.rook.io
>         version: v1
>       - kind: CephFilesystem
>         name: cephfilesystems.ceph.rook.io
>         version: v1
>       - kind: CephNFS
>         name: cephnfses.ceph.rook.io
>         version: v1
>       - kind: CephObjectRealm
>         name: cephobjectrealms.ceph.rook.io
>         version: v1
>       - kind: CephObjectStore
>         name: cephobjectstores.ceph.rook.io
>         version: v1
>       - kind: CephObjectStoreUser
>         name: cephobjectstoreusers.ceph.rook.io
>         version: v1
>       - kind: CephObjectZoneGroup
>         name: cephobjectzonegroups.ceph.rook.io
>         version: v1
>       - kind: CephObjectZone
>         name: cephobjectzones.ceph.rook.io
>         version: v1
>       - kind: CephRBDMirror
>         name: cephrbdmirrors.ceph.rook.io
>         version: v1
```

Co-authored-by: Umanga Chapagain chapagainumanga@gmail.com
Signed-off-by: Sébastien Han <seb@redhat.com>
2021-01-22 11:12:36 +01:00
Madhu Rajanna e305810bf0 ceph: add option to set FSGroupPolicy for CSI PVC
in kubernetes 1.19 it added a support to set FSGroupPolicy
in the csidriver object, same supported is added to both
CephFS and RBD. where user will have an option to set
the FSGroupPolicy for CephFS and RBD separately.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2021-01-22 14:26:56 +05:30
subhamkrai f7d7c2979a ceph: disable admission controller for k8s older than v1.16.0
v1 version of admission controller require minimum v1.16.0
of k8s. So, this commits disable admission controller when
k8s version older than v1.16.0.

Signed-off-by: subhamkrai <srai@redhat.com>
2021-01-22 14:21:03 +05:30
Sébastien Han f167dbbb7b Merge pull request #6989 from travisn/storage-provider-docs
docs: Expectations for storage provider development
2021-01-22 09:14:14 +01:00
Jiffin Tony Thottan 968b002a6f test: validation test for RGW vault authentication
Extending existing deploy-validate-vault.sh to include RGW as well

Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2021-01-22 10:44:17 +05:30
Jiffin Tony Thottan da61c9a83e ceph: vault kms configuration for ceph object store
The first patch to configure vault for ceph object store. If the `security.kms` configured in
`clusterSpec` CRD, RGW will be configured with vault kms settings to handle SSE request from s3 clients.

Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2021-01-22 10:44:03 +05:30
Guillaume Moutier b28ce38ca9 ceph: bucket notifications CRD documentation
This documents the Ceph topics and buckets notification management by rook through CRs.

Signed-off-by: Guillaume Moutier <guillaume.moutier@gmail.com>
Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2021-01-22 10:08:38 +05:30
Travis Nielsen 81c05524c1 docs: expectations for storage provider development
The expectations for storage provider development are now
set forth for joining Rook and maintaining existing
storage providers. This will help ensure the longevity of
storage providers in the project and for the health of
the community.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-01-21 12:07:45 -07:00
Travis Nielsen 3a6deb8775 Merge pull request #7008 from TomHellier/master
#7007 Ability to configure ROOK_ALLOW_MULTIPLE_FILESYSTEMS environment to rook operator pod in helm chart
2021-01-21 11:15:34 -07:00
Travis Nielsen b9fc942d65 Merge pull request #7041 from leseb/notify-upgrade
ceph: update rbd-mirror when cluster is upgraded
2021-01-21 10:55:02 -07:00
Travis Nielsen d6307f07d8 Merge pull request #6940 from subhamkrai/admission-controller-v1
ceph: update admission controller to v1 from v1beta1
2021-01-21 10:53:06 -07:00
Sébastien Han 47a02145e7 ceph: update rbd-mirror when cluster is upgraded
The rbd-mirror was left being when the CephCluster was upgraded.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-01-21 18:23:20 +01:00
Sébastien Han dff0a46a35 ceph: fix incorrect camelcase
Golang use camel cases, so localcephNFS should be localCephNFS.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-01-21 18:22:27 +01:00
subhamkrai f17f908c31 ceph: disable admission controller for CephUpgradeSuite
disabling admission controller for the upgrade test.
Upgrade test was using older controller runtime version
and api v1 need latest version controller runtime(v0.7).

Signed-off-by: subhamkrai <srai@redhat.com>
2021-01-21 22:26:02 +05:30
subhamkrai 9898e00ac5 ceph: update admission controller to v1 from v1beta1
this commit update admission controller to v1 from
v1beta1. v1beta1 is deprecated in v1.16+ and unavailable
in v1.22+.

Signed-off-by: subhamkrai <srai@redhat.com>
2021-01-21 22:26:02 +05:30
Travis Nielsen 1802bc7b52 Merge pull request #7031 from Madhu-1/7015
ceph: add support to disable snapshotter sidecar
2021-01-21 09:18:10 -07:00
Madhu Rajanna 05c75b7084 ceph: add support to disable snapshotter sidecar
In some cases the user dont want to run snapshotter
container either for CephFS or RBD. In that case the
user wont install the required snapshot CRD's due
to that the snapshotter sidecar container produces
lot of noisy logs.
Snapshotter will be enabled by default for both
CephFS and RBD, but with this PR we are providing
an option to disable snapshotter sidecar deployment
either for CephFS or RBD.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2021-01-21 15:29:55 +05:30
Sébastien Han 9eabc639d8 Merge pull request #7030 from leseb/add-quincy
ceph: add quincy version
2021-01-21 09:29:28 +01:00
Sébastien Han db648bb6ee Merge pull request #7029 from cybozu-go/disable-livenessprobe-on-disaster-recovery
docs: stop livenessProbe
2021-01-21 09:28:07 +01:00
Sébastien Han 9f8404e330 ceph: add quincy version
Quincy just started https://github.com/ceph/ceph/pull/38996 so let's add
it to our version code.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-01-21 08:50:41 +01:00
Toshikuni Fukaya b02baa66fa docs: describe what commands do
Signed-off-by: Toshikuni Fukaya <toshikuni-fukaya@cybozu.co.jp>
2021-01-21 06:45:03 +00:00
Toshikuni Fukaya afab42228f docs: stop livenessProbe
Stop livenessProbe to prevent pod deletion while operation.

Signed-off-by: Toshikuni Fukaya <toshikuni-fukaya@cybozu.co.jp>
2021-01-21 05:46:30 +00:00
Tom Hellier 5d6f4ef4d4 ceph: allowMultipleFilesystems in helm-operator
This change allows the setting of the ROOK_ALLOW_MULTIPLE_FILESYSTEMS in the helm operator

Signed-off-by: Tom Hellier <me@tomhellier.com>
2021-01-21 01:17:49 +00:00
Travis Nielsen 2294851ca3 build: remove the cockroachdb operator from rook
The cockroachDB operator has not had community support in Rook.
Therefore, the time has come to deprecate and remove it.
If the sources are still needed, there is always git history.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-01-20 17:28:58 -07:00
Travis Nielsen 00c3b371ca Merge pull request #7019 from leseb/add-kubectl-check-ownerreferences
ceph: add kubectl-check-ownerreferences in ci
2021-01-20 12:12:38 -07:00
Travis Nielsen 34e28b9d36 Merge pull request #7021 from travisn/golang-1-5
ci: Build with golang 1.15.7
2021-01-20 11:30:08 -07:00