Commit Graph
13292 Commits
Author SHA1 Message Date
Sébastien Han 1fef75bc6a ceph: create missing secret on external cluster
When Rook-Ceph is connected to an external cluster and the admin tries
to create resources such as CephFilesystem or CephObjectStore, we must
create the rook-ceph-config secret so that the daemons can get their mon
information.

Closes: https://github.com/rook/rook/issues/5439
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-05-11 18:51:44 +02:00
Travis Nielsen b95b89f838 Merge pull request #4913 from jmolmo/mgr_integration_tests
Ceph: manager integration tests
2020-05-11 09:19:29 -06:00
Arun Kumar Mohan 23d2191147 ceph: Python script to generate needed external cluster resources in JSON format
This script will generate JSON format of all the needed resources.
Script can also generate the output in Shell script format.

Signed-off-by: Arun Kumar Mohan <arun.iiird@gmail.com>
2020-05-11 20:39:10 +05:30
Sébastien Han da6de881c8 Merge pull request #5445 from binoue/update-upgrade-doc
Doc: update ceph-upgrade.md for handling a known issue
2020-05-11 12:10:33 +02:00
Sébastien Han 9141208068 Merge pull request #5408 from HaichaoLii/arm64
tests: Kubeadm add the makeTestImages tag of arm64
2020-05-11 11:51:15 +02:00
Sébastien Han 9f42e35331 Merge pull request #5429 from travisn/tini-update
Update tini version to v0.19.0
2020-05-11 11:26:45 +02:00
Sébastien Han 63eac54152 Merge pull request #5447 from leseb/import-script-csi
ceph: fix import script csi details
2020-05-11 11:04:50 +02:00
Sébastien Han 36985defd9 ceph: fix import script csi details
The cephfs csi driver expects both adminID and adminKey instead of
userID and userKey which are only specific to rbd.

Closes: https://github.com/rook/rook/issues/5432
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-05-11 10:57:04 +02:00
Sébastien Han 1a87d484de Merge pull request #5428 from travisn/test-pool-default-size
Set test default pool size to one
2020-05-11 09:47:25 +02:00
binoue ff2ba9c890 ceph: update ceph-upgrade.md for handling a known issue
Because of the ClusterRole api version change, #5341 may occur
when upgrading the rook chart to the latest version.
This pull request updates `ceph-upgrade.md` for handling the issue.

Signed-off-by: binoue <banji-inoue@cybozu.co.jp>
2020-05-11 03:22:55 +09:00
Travis Nielsen c7f06b4656 Merge pull request #5443 from Madhu-1/fix-prio
CSI: fix typo in operator.yaml and operator-openshift.yaml
2020-05-09 23:00:55 -06:00
Madhu Rajanna e8a999daea CSI: fix typo in operator.yaml and operator-openshift.yaml
there was a typo in operator.yaml and operator.openshift.yaml
file for priorityclass , This PR fixes the typo.

Resolves #5442

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-05-09 08:46:21 +05:30
Travis Nielsen 9ddd6aa5c6 Merge pull request #5438 from travisn/osd-lv-activate
Remove invalid verbose params from lv activate
2020-05-08 15:16:14 -06:00
Travis Nielsen af54349a5e ceph: remove invalid verbose params from lv activate
The activation of the lvs for OSDs had an invalid
argument to vgchange. The invalid argument is now reverted
to enable the OSDs in this scenario again.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-08 11:19:42 -06:00
Haichao Li 063558d2c3 tests: Kubeadm add the makeTestImages tag of arm64
Kubeadm add the makeTestImages tag of arm64

Signed-off-by: Haichao Li <haichao.li@arm.com>
2020-05-08 09:50:19 +08:00
Travis Nielsen 830a858049 build: update tini version to v0.19.0
The version of tini being used is getting rather stale,
time to update.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-07 16:46:59 -06:00
Travis Nielsen dc7802e369 ceph: set test default pool size to one
In test environments there may only be a single node, so we set
the default pool size in the test example to one.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-07 16:26:30 -06:00
Travis Nielsen 25fd0df893 Merge pull request #5420 from travisn/osd-node-name
OSD on PVC node assignment should be the node selector rather than nodeName
2020-05-07 12:25:04 -06:00
Travis Nielsen f1b084daa9 Merge pull request #5386 from travisn/multipath-support
Multipath support for OSD on PVC
2020-05-07 11:45:16 -06:00
Travis Nielsen 65377cbe63 ceph: osd on pvc node assignment is node selector
An OSD on a PVC when portable=false is assigned to a node
with a node selector. The same node assignment is expected
for the lifetime of the cluster. On subsequent reconciles,
the operator was looking up the node assignment from the
nodeName on the pod spec, which is not set if the pod is down.
The operator needs to retrieve the assignment from the
deployment spec node selector.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-07 10:51:46 -06:00
Sébastien Han 2e5d6c749e Merge pull request #5362 from thotz/ssl_regression_rgw
objectstore: Add ceph group to FsGroup
2020-05-07 17:18:49 +02:00
Jiffin Tony Thottan 68fc50686a objectstore: Add ceph group as FsGroup
ceph gid (167) provided as supplymentary group, so that all the mounts can
be accessed by the same. This is required for ssl certificate consumed by
the rgw server from ceph octopus onwards.

Closes: https://github.com/rook/rook/issues/5265
Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2020-05-07 18:37:36 +05:30
Sébastien Han 228041902b Merge pull request #5406 from cybozu-go/ceph-cleanup-osd-on-pvc
ceph: judge whether an OSD is on PVC or not by function
2020-05-07 09:13:39 +02:00
Travis Nielsen 1e50ca374b Merge pull request #5414 from travisn/force-osd-delete-if-not-out
Delete terminating osd pods even if not out
2020-05-06 17:53:45 -06:00
Travis Nielsen 5f57b6fd3a ceph: skip ceph-volume inventory for PVs
For multipath devices, ceph-volume inventory is failing
to detect that the device is available, complaining about
insufficient space. Instead of relying on c-v inventory
to determine if the device is available, just call
c-v raw list to determine if there is already an osd
configured on the pv. Otherwise, just attempt to configure
the OSD.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-06 17:12:25 -06:00
Travis Nielsen 32730123ea ceph: add support for multipath devices
Add mpath to the list of supported device types,
although it will only work for OSDs on PVCs.
OSDs on a raw device without PVCs have not
yet been tested.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-06 17:12:25 -06:00
Travis Nielsen 3f356d6a8c Merge pull request #5413 from travisn/operator-base-14.2.9
Set v14.2.9 as base image for the operator
2020-05-06 16:25:59 -06:00
Travis Nielsen 3c6bae56b7 ceph: delete terminating osd pods even if not out
When an OSD pod is stuck in terminating state, there is no need
to check if the OSD is marked as out before force deleting.
As long as the osd is down we will force delete the pod.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-06 15:43:04 -06:00
Travis Nielsen dda2e6e0ae Merge pull request #5412 from travisn/allow-unsupported-csi-version
Allow csi driver version to be undetected if unsupported flag is set
2020-05-06 15:27:54 -06:00
Travis Nielsen b5c9d4a02f ceph: set v14.2.9 as base image for the operator
The v14.2.9 release and updated base image have security fixes
that the operator needs to pick up.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-06 12:51:37 -06:00
Travis Nielsen b375e81c37 ceph: allow csi driver version to be undetected
If ROOK_CSI_ALLOW_UNSUPPORTED_VERSION=false and the csi canary image
is set to quay.io/cephcsi/cephcsi:canary, the csi driver fails
to load as expected since it is not supported. But if the
flag is set to true, it is expected to allow the canary image
which isn't versioned. The supported version check was requiring
that the version be detected in the image.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-06 12:36:10 -06:00
Satoru Takeuchi 417ea131bc ceph: judge whether an OSD is on PVC or not by function
There are many duplicated code to judge whether an OSD is on PVC
or not. Instead, let's introduce a function for this purpose.
It can also be applied to the logic of judging whether an OSD
on PVC has metadata device or not.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-05-07 00:49:17 +09:00
Travis Nielsen f82a07d441 Merge pull request #5394 from Madhu-1/csi-prio
CSI: Set PriorityClassName for CSI pods
2020-05-06 07:08:54 -06:00
Madhu Rajanna ec3ab55d94 CSI: Set PriorityClassName for CSI provisioner pods
provide an option to set PriorityclassName on the
CSI provisioner pods to avoid pod eviction, as the CSI provisioner
pods a critical in system for storage. the default value
for the CSI provisioner pods is set to system-cluster-critical.

provisioner pods are less priority than plugin pods.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-05-06 15:45:06 +05:30
Madhu Rajanna cc6ec58891 CSI: Set PriorityClassName for CSI plugin pods
provide an option to set Priorityclassname on the
CSI plugin pods to avoid pod eviction, as the CSI plugin pods are
critical in system for storage. the default value
for the CSI plugin pods is set to system-node-critical.
more info can be found at
https://kubernetes.io/docs/tasks/administer-cluster/guaranteed-scheduling-critical-addon-pods/

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-05-06 15:45:01 +05:30
Sébastien Han 7589573e0b Merge pull request #5405 from travisn/operator-setting-logging
Log the operator settings and their source
2020-05-06 11:27:04 +02:00
Sébastien Han cecbfcfba6 Merge pull request #5372 from leseb/obc-independent-mode
ceph: add support for OBC on external cluster
2020-05-06 10:30:15 +02:00
Sébastien Han 511f16ca70 Merge pull request #5401 from cybozu-go/cleanup-the-integration-test-and-remove-the-description-of-a-removed-feature
Cleanup the integration test and remove the description of a removed feature
2020-05-06 10:15:22 +02:00
RAJAT SINGH 9feb0287c5 Ceph: Newer mechanism to scale MDS for Nautilus+
ceph mds deactivate is not valid command for Nautilus, changing the mechnaism of upgrading so that it can be done in the way Nautilus does it.

Closes: https://github.com/rook/rook/issues/5278
Signed-off-by: RAJAT SINGH <rajasing@redhat.com>
2020-05-06 13:33:26 +05:30
Sébastien Han e342f7ea30 Merge pull request #5407 from chenxuc/patch-1
doc: correct the wordings
2020-05-06 09:30:23 +02:00
Chen, Xu Chun (Simon) a39d9a969e doc: correct wordings
correct wordings so that they pass grammar checkings and better understood by non-English native readers. Thanks!

Signed-off-by: XU CHUN CHEN <chenxuc@cn.ibm.com>
2020-05-06 11:21:21 +08:00
Travis Nielsen cd806c83ee ceph: log the operator settings and their source
The operator settings can come either from the configmap, an
env var, or a default value. Knowing where the setting is loaded
from is an important detail to see in the log.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-05 13:10:01 -06:00
Travis Nielsen 2d6fefbd5f Merge pull request #5395 from Madhu-1/csi-2.1.1
CSI: Update CSI version to v2.1.1
2020-05-05 11:25:49 -06:00
Sébastien Han bfb0501c14 Merge pull request #5403 from cybozu-go/ceph-fix-a-dead-link
ceph: fix dead links
2020-05-05 18:32:01 +02:00
Satoru Takeuchi aa7145e1ca ceph: fix dead links
Fix dead links in ceph document.

Closes: https://github.com/rook/rook/issues/5396

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-05-06 01:24:29 +09:00
Sébastien Han 775ed9532a Merge pull request #5398 from leseb/lvm-release
ceph: do not fail on deactivate
2020-05-05 18:09:24 +02:00
Satoru Takeuchi 22c5743656 cleanup: remove the descriptions of directory-based OSD
Directory-based OSD is not supported in v1.3.0 anymore. Let's remove
the descriptions of this feature. As an exception, it should still
be in the manifests of v1.2.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-05-06 00:44:31 +09:00
Satoru Takeuchi 5fc69b9e49 tests: add a note to the possibility of downgrading some deb packages
We should write down that kubeadm.sh may downgrade some deb packages.
Although it's clear that this script installs some K8s related packages,
downgrading packages are not so.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-05-05 23:17:43 +09:00
Satoru Takeuchi c0c0dc4ed9 tests: return bool if the functions are prefixed by "Is"
There are several functions that are prefixed by "Is" and return
just error. It's straightfoward to return bool to make the meaning
of these functions clearer.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-05-05 22:55:01 +09:00
Sébastien Han 65aae84bdd ceph: do not fail on deactivate
If we fail to release an LVM device, we should not fail the deployment.
We just print the error and let the backend handle the rest. Some
CSI backend will force detach the device anyway.
This prevents the deployment to get stuck in terminating.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-05-05 12:03:43 +02:00