Commit Graph
6182 Commits
Author SHA1 Message Date
Jiffin Tony Thottan ee6a03dfb8 ceph: minor update init container script in generateVaultGetKEK
Replacing VAULT_KV_VERS with VAULT_BACKEND for specifing version of kv engine.

Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2021-01-22 16:04:35 +05:30
Jiffin Tony Thottan 01649a8cd2 docs: update vault kms with RGW details
The KMS encryption via HashiCorp Vault can be consumed for RGW, adding those details
in the doc.

Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2021-01-22 16:04:28 +05:30
Jiffin Tony Thottan 968b002a6f test: validation test for RGW vault authentication
Extending existing deploy-validate-vault.sh to include RGW as well

Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2021-01-22 10:44:17 +05:30
Jiffin Tony Thottan da61c9a83e ceph: vault kms configuration for ceph object store
The first patch to configure vault for ceph object store. If the `security.kms` configured in
`clusterSpec` CRD, RGW will be configured with vault kms settings to handle SSE request from s3 clients.

Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2021-01-22 10:44:03 +05:30
Travis Nielsen 3a6deb8775 Merge pull request #7008 from TomHellier/master
#7007 Ability to configure ROOK_ALLOW_MULTIPLE_FILESYSTEMS environment to rook operator pod in helm chart
2021-01-21 11:15:34 -07:00
Travis Nielsen b9fc942d65 Merge pull request #7041 from leseb/notify-upgrade
ceph: update rbd-mirror when cluster is upgraded
2021-01-21 10:55:02 -07:00
Travis Nielsen d6307f07d8 Merge pull request #6940 from subhamkrai/admission-controller-v1
ceph: update admission controller to v1 from v1beta1
2021-01-21 10:53:06 -07:00
Sébastien Han 47a02145e7 ceph: update rbd-mirror when cluster is upgraded
The rbd-mirror was left being when the CephCluster was upgraded.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-01-21 18:23:20 +01:00
Sébastien Han dff0a46a35 ceph: fix incorrect camelcase
Golang use camel cases, so localcephNFS should be localCephNFS.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-01-21 18:22:27 +01:00
subhamkrai f17f908c31 ceph: disable admission controller for CephUpgradeSuite
disabling admission controller for the upgrade test.
Upgrade test was using older controller runtime version
and api v1 need latest version controller runtime(v0.7).

Signed-off-by: subhamkrai <srai@redhat.com>
2021-01-21 22:26:02 +05:30
subhamkrai 9898e00ac5 ceph: update admission controller to v1 from v1beta1
this commit update admission controller to v1 from
v1beta1. v1beta1 is deprecated in v1.16+ and unavailable
in v1.22+.

Signed-off-by: subhamkrai <srai@redhat.com>
2021-01-21 22:26:02 +05:30
Travis Nielsen 1802bc7b52 Merge pull request #7031 from Madhu-1/7015
ceph: add support to disable snapshotter sidecar
2021-01-21 09:18:10 -07:00
Madhu Rajanna 05c75b7084 ceph: add support to disable snapshotter sidecar
In some cases the user dont want to run snapshotter
container either for CephFS or RBD. In that case the
user wont install the required snapshot CRD's due
to that the snapshotter sidecar container produces
lot of noisy logs.
Snapshotter will be enabled by default for both
CephFS and RBD, but with this PR we are providing
an option to disable snapshotter sidecar deployment
either for CephFS or RBD.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2021-01-21 15:29:55 +05:30
Sébastien Han 9eabc639d8 Merge pull request #7030 from leseb/add-quincy
ceph: add quincy version
2021-01-21 09:29:28 +01:00
Sébastien Han db648bb6ee Merge pull request #7029 from cybozu-go/disable-livenessprobe-on-disaster-recovery
docs: stop livenessProbe
2021-01-21 09:28:07 +01:00
Sébastien Han 9f8404e330 ceph: add quincy version
Quincy just started https://github.com/ceph/ceph/pull/38996 so let's add
it to our version code.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-01-21 08:50:41 +01:00
Toshikuni Fukaya b02baa66fa docs: describe what commands do
Signed-off-by: Toshikuni Fukaya <toshikuni-fukaya@cybozu.co.jp>
2021-01-21 06:45:03 +00:00
Toshikuni Fukaya afab42228f docs: stop livenessProbe
Stop livenessProbe to prevent pod deletion while operation.

Signed-off-by: Toshikuni Fukaya <toshikuni-fukaya@cybozu.co.jp>
2021-01-21 05:46:30 +00:00
Tom Hellier 5d6f4ef4d4 ceph: allowMultipleFilesystems in helm-operator
This change allows the setting of the ROOK_ALLOW_MULTIPLE_FILESYSTEMS in the helm operator

Signed-off-by: Tom Hellier <me@tomhellier.com>
2021-01-21 01:17:49 +00:00
Travis Nielsen 00c3b371ca Merge pull request #7019 from leseb/add-kubectl-check-ownerreferences
ceph: add kubectl-check-ownerreferences in ci
2021-01-20 12:12:38 -07:00
Travis Nielsen 34e28b9d36 Merge pull request #7021 from travisn/golang-1-5
ci: Build with golang 1.15.7
2021-01-20 11:30:08 -07:00
Travis Nielsen 31e2c4165c ci: build with golang 1.15.7
Update the cross build container to use golang 1.15.7 instead
of 1.13.8. The update to build with 1.15 had only been made in the
AMI, and is now updated in the container as well.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-01-20 10:31:35 -07:00
Sébastien Han 94d9c69361 ceph: add kubectl-check-ownerreferences in ci
After each non-pvc and pvc scenario we run the
kubectl-check-ownerreferences tool to analyze potential incorrect owner
references. We had issues in the past with incorrect owner ref so this
tool might help us ensure we are doing things right.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-01-20 10:51:11 +01:00
Sébastien Han 093ed7dd62 Merge pull request #6984 from leseb/core-dumps-dir
ceph: set process working dir to /var/log/ceph
2021-01-20 10:39:42 +01:00
Satoru Takeuchi 0512c7d33c Merge pull request #6793 from cybozu-go/ceph-fix-osd-corruption
ceph: avoid potential osd corruption due to wrong file-lock
2021-01-20 09:39:39 +09:00
Travis Nielsen e320c31cc9 Merge pull request #7010 from travisn/go-version
build: Enforce golang 1.15 in the build
2021-01-19 16:41:16 -07:00
Travis Nielsen 7f169a71a5 build: enforce golang 1.15 in the build
The build currently requires golang 1.15 and will fail if an
older version is used.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-01-19 11:20:18 -07:00
Travis Nielsen 9ba8c937dd build: print the golang version during the build
Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-01-19 11:19:53 -07:00
Travis Nielsen 4f841ea237 Merge pull request #6947 from kbristow/nfs-quickstart-documentation-fix
docs: updating nfs quickstart docs
2021-01-19 10:36:40 -07:00
Sébastien Han 62ac1cd001 Merge pull request #6985 from leseb/bump-controller-runtime-0.8
ceph: bump controller runtime and kube
2021-01-18 12:21:09 +01:00
Sébastien Han 2bb9444130 Merge pull request #6974 from cybozu-go/ceph-delete-discovery-daemon-after-disabling-it
ceph: delete discovery daemon if it is disabled
2021-01-18 11:36:21 +01:00
Sébastien Han 2c021fb357 ci: bump golang version to 1.15
The rest of the CI already uses 1.15 so let's homogenize that.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-01-18 08:47:31 +01:00
Satoru Takeuchi ae8dcf7cc3 ceph: fix osd corruption
Multiple OSD pods for the same OSD might run simultaneously becasue OSD pod
is managed by Deployment resource. However, OSD locking mechanism
doens't work because the lock file (fsid file) exist for each OSD pod.
It resutls in OSD corruption.

Closes: https://github.com/rook/rook/issues/6530

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2021-01-18 03:11:50 +00:00
Jared Watts dacf286867 Merge pull request #6993 from arturrez/reconfigure_build
build: switch to new aws buckets
2021-01-16 00:00:16 -08:00
Artur 0754695655 build: switch to new aws buckets
Signed-off-by: Artur <artur@upbound.io>
2021-01-15 23:58:23 -08:00
Travis Nielsen 7343aaddf9 Merge pull request #6988 from travisn/update-owners
docs: Remove inactive member from steering committee
2021-01-15 17:02:09 -07:00
Travis Nielsen 6810c6682e docs: remove inactive member from steering committee
Dmitry is no longer participating in Rook and has moved on
from the EdgeFS team. The position on the steering committee
is now open. Per the governance, we are looking for an owner
of a storage provider other than Ceph who has overall
perspective and interest in taking Rook forward.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-01-15 14:43:16 -07:00
Travis Nielsen f7013884b4 Merge pull request #6972 from jshen28/improve-cluster-upgrade-observibility
ceph: exposing which node/osd is processing
2021-01-15 14:32:53 -07:00
Satoru Takeuchi 1be47ea0b8 ceph: delete discovery daemon if it is disabled
discovery-daemon still exists even if it's disabled.

Closes: https://github.com/rook/rook/issues/6936

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2021-01-15 19:44:40 +00:00
Travis Nielsen a01e294aba Merge pull request #6978 from travisn/mon-health-doc
ceph: Add mon design to the official docs
2021-01-15 10:30:17 -07:00
Sébastien Han 448f6a89c6 Merge pull request #6958 from leseb/client-crd-controller-runtime
ceph: convert CephClient CRD to controller-runtime
2021-01-15 17:13:01 +01:00
Sébastien Han 3692d62998 ceph: bump controller runtime and kube
We now use k8s v0.20.1 and controller-runtime 0.8.0

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-01-15 16:45:08 +01:00
Sébastien Han 758226294b ceph: convert CephClient CRD to controller-runtime
This was the last remaining CRD to not use the controller-runtime
library.
Small additions were added with the transition:

* the Kubernetes Secret that contains the CephX key has now an owner
  reference to the CephClient object
* the secret name is present in the Status field of the CephClient:

```
status:
  info:
    secretName: rook-ceph-client-glance
  phase: Ready
```

The controller will reconcile on CR updates and also if the Kubernetes
Secret is deleted.

Closes: https://github.com/rook/rook/issues/4938
Signed-off-by: Sébastien Han <seb@redhat.com>
2021-01-15 16:17:38 +01:00
shenjiatong 0d80cc396d ceph: exposing which node/osd is processing
it would be more firendly to cloud operators to
know which node is being processed during
upgrade

Signed-off-by: shenjiatong <yshxxsjt715@gmail.com>
2021-01-15 23:12:26 +08:00
Sébastien Han cb7d600841 ceph: set process working dir to /var/log/ceph
By setting the working directory of a Ceph daemon to the log direcor
(which is bindmounted to the host), we can ensure that the coredumps
will be available.

On CentOS 7 **only**, the kernel is configured with:

```
cat /proc/sys/kernel/core_pattern
core
```

which means that the coredumps will end up in the process working
directory and will be named "core".

On CentOS 8, everything is different and this won't work but still
CentOS will be able to consume this and changing the working directory
is harmless.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-01-15 16:06:42 +01:00
Travis Nielsen b71c3ac293 ceph: add mon design to the official docs
The mon design and handling of failover is a topic that frequently
needs to be understood by rook users, thus moving this design doc
to the documentation and making some updates based on the latest
behavior.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-01-14 13:13:56 -07:00
Travis Nielsen 8fc110bf57 Merge pull request #6934 from cybozu-go/docs-describe-osd-purge-job-in-the-document
docs: describe osd purge job in the document of OSD management
2021-01-14 13:12:59 -07:00
Satoru Takeuchi 2d35703661 docs: describe osd purge job in the document of OSD management
Describe `rook-ceph-purge-osd` job in the document of OSD management
to ease day2 operations.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2021-01-14 19:46:42 +00:00
Travis Nielsen e1153b98fa Merge pull request #6968 from travisn/roadmap-1.6
docs: Update the roadmap for rook v1.6
2021-01-14 10:23:04 -07:00
Travis Nielsen 83fee8adfb Merge pull request #6966 from travisn/delete-object-store-test
ceph: During object store deletion return success if not found
2021-01-13 17:15:44 -07:00