Commit Graph
438 Commits
Author SHA1 Message Date
Alexander Trost 98217272be ceph: docs: unified formatting and style
This is the first phase Ceph part of three phases to improve and rework
the Rook documentation for better user accessibility to the Rook
projects and  with that the storage providers.
Phase two is about automatic generation of CRD documentation and phase
three is about reworking the docs themselves and, e.g., examples for
CRDs and certain use cases.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2019-11-01 18:10:32 +01:00
Travis Nielsen 831c15086a ceph: support all layers of CRUSH map with node labels
The node labels were already supported for zones and regions to add to
the CRUSH map. Now all layers of the CRUSH map will be supported
with the new labels such as topology.rook.io/rack.
The labels will be detected at the osd startup time
similar to the zone and region labels already being detected.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2019-10-31 14:47:18 -06:00
Dmitry Yusupov 2b80eaf052 Merge pull request #4190 from sabbot/sysrepcount-failuredomain-validation
FailureDomain/SysRepCount validation
2019-10-25 10:36:53 -07:00
Sebastian Wagner b2fe1b951d ceph: Add removeOSDsIfOutAndSafeToRemove to CRD
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-10-25 15:57:32 +02:00
Anton Skriptsov d75a281d6e edgefs: FailureDomain-SysRepCount validation
Additional failureDomain,sysRepCount validation

Signed-off-by: Anton Skriptsov <sabbotagge@gmail.com>
2019-10-25 06:27:35 -07:00
Sébastien Han 98bc8e4ca0 ceph: revert "CSI: Add support for CSIDriver object creation"
I merged https://github.com/rook/rook/pull/4169 too quickly and didn't
noticed we were supposed to wait for csi 1.2.2.

This reverts commit 520ad44d71.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-10-24 12:30:11 +02:00
Madhu Rajanna 520ad44d71 CSI: Add support for CSIDriver object creation
This will be helpful to list the CSI drivers deployed
in the kubernetes cluster. if we have N number of
CSI drivers deployed in the cluster, the user can
query kubectl get csidriver and get  the list of
registered CSI drivers and it requires kube 1.14+
and also the functionality is disabled by default

More info here: https://github.com/ceph/ceph-csi/pull/698

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-10-24 15:08:26 +05:30
rohan47 7f9611d489 Ceph: Added removeOSDsIfOutAndSafeToRemove to Cluster CR
OSDs can be removed automatically with the current mechanism if a new
setting removeOSDsIfOutAndSafeToRemove is set to true. The default for
all new or upgraded clusters should be false.

Signed-off-by: rohan47 <rohgupta@redhat.com>
2019-10-23 15:10:36 +05:30
Sébastien Han fcc2e21faf ceph: rework csi keys and secrets
We know create 4 secrets containing 4 ceph keys where each of them have
limited permissions to access the cluster.

Closes: https://github.com/rook/rook/issues/4074
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-10-22 15:14:28 +02:00
Sébastien Han 1765ad6508 ceph: expose prepare pod resource limits
The osd-prepare jobs should not inherit osd resources since this might
cause scheduling issues.
Instead, we can now use the new CRD property `prepareosd` in the resource section.

Refer to the documentation for more details.

Closes: https://github.com/rook/rook/issues/2502
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-10-18 16:48:03 +02:00
Travis Nielsen 000392533c Merge pull request #4022 from sebastian-philipp/validation-reservePoolsOnDelete
Ceph CRD Validation: Add reservePoolsOnDelete
2019-10-17 09:43:27 -06:00
awalker60 0345468b6b ceph: fix for csi-snapshotter always pulling
This switches csi-snapshotter to IfNotPresent which works better in production and offline environments.

Signed-off-by: awalker60 <awalker125@users.noreply.github.com>
2019-10-15 10:41:03 +01:00
Madhu Rajanna 0056e58ba6 csi: update cephfs registration directory name
when multiple CSI drivers are running in a cluster,
each should use unique socket for registration.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-10-10 10:52:27 +05:30
Sébastien Han 148f8da1fb ceph: relax pre-requisite for external cluster
We now differentiate the cases where:

* we only consume the external cluster
* we consume the external cluster as well as creating stateless
resources in Kubernetes (bootstrap mds,rgw, nfs)

This is mostly controlled via the image property spec. If not defined,
not extra CRs won't be able to be created.

Now the external cluster feature supports Ceph cluster as of Luminous 12.2.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-10-08 10:52:01 +02:00
Varsha Rao a83939319d ceph: Set ssl to true in cluster-test.yaml and cluster-on-pvc.yaml
Dashboard requires ssl to be turned on for running backend requests in rook.

Signed-off-by: Varsha Rao <varao@redhat.com>
2019-10-01 21:11:49 +05:30
Sebastian Wagner b4b1182d2e Ceph CRD Validation: Add reservePoolsOnDelete
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-10-01 16:10:51 +02:00
Sébastien Han 6f4a7cf6c8 Merge pull request #3974 from jmolmo/issue_2206
New setting to avoid delete pools on <filesystem>/<object store> deletion
2019-10-01 09:19:56 +02:00
Jeff Layton b5a5a65666 ceph: set ssl to true in cluster-minimal.yaml
The scripts for running backend dashboard requests in rook expect this
to be an SSL-enabled port. Ensure that it is.

https://tracker.ceph.com/issues/42089
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-09-30 10:58:38 -04:00
Juan Miguel Olmo Martínez 2de0787fc8 New setting to avoid delete pools on <fs>/<os> resources deletion
A new CRD property `PreservePoolsOnDelete` has been added to Filesystem(fs) and
Object Store(os) resources in order to increase protection against data loss.
If it is set to `true`, associated pools won't be deleted when the main
resource(fs/os) is deleted. Creating again the deleted fs/os with the same name
 will reuse the preserved pools.

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2019-09-30 08:13:39 +02:00
Madhu Rajanna f54099df0c CSI: Make metrics and liveness port configurable
provided ENV variables to configure the grpc
and liveness metrics port for both cephfs and
rbd CSI drivers.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-27 17:31:45 +05:30
Madhu Rajanna 9d298fe4f0 Add Toleration and NodeAffinity to CSI
Add support for setting Toleration and NodeAffinity
to CSI Provisioner deployment or statefulset and
plugin daemonset through ENV variables.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-27 10:23:12 +05:30
Dmitry Yusupov 37a9e6b0f0 Merge pull request #3995 from SergeyKaydalov/edgefs-kvssd
EdgeFS: support for rtkvs disk engine and Samsung KVSSD
2019-09-26 10:34:16 -07:00
Sergey Kaydalov 07ba73bb8f EdgeFS: support for rtkvs disk engine and Samsung KVSSD
Signed-off-by: Sergey Kaydalov <kayserg@gmail.com>
2019-09-26 18:02:32 +03:00
Travis Nielsen 7b5d855dfc Merge pull request #3614 from rajatsingh25aug/schema-validation-crds
Added validation for cephBlockPool,cephfs and cephnfs
2019-09-25 10:19:20 -06:00
Madhu Rajanna 0a516d5f32 use v1.2.1 cephcsi release
update CSI deployment templates and
doc to use new cephcsi v1.2.1 release

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-25 16:08:55 +05:30
RAJAT SINGH 4a02c568e7 Added validation for cephBlockPool,cephfs and cephnfs.Added changes in ceph_manifest.go and resources.yaml according to common.yaml.
Signed-off-by: RAJAT SINGH <rajasing@redhat.com>
2019-09-25 15:42:07 +05:30
Humble Chirammal 3da9514191 We were defaulting to ext4 at first and then moved to
`xfs`. However further testing shows that, ext4 should be
the default or preferred fs for RBD devices.

This patch bring that change

Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2019-09-24 14:28:16 +05:30
Alexander Trost ba196bdea5 Correct SYSTEM spelling (#3963)
Correct SYSTEM spelling
2019-09-24 10:00:56 +02:00
Travis Nielsen 4cbe8b5a3e Merge pull request #3931 from Madhu-1/fix-umount
Fix umount issue when rbd-nodeplugin restarts
2019-09-23 22:21:52 -06:00
Madhu Rajanna 09da4e3a3e Correct SYSTEM spelling
Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-24 09:32:36 +05:30
Travis Nielsen ba2b8724ce Merge pull request #3946 from sebastian-philipp/crd-validation-network-provider
CephCluster CRD: Added additional network attributes to validation
2019-09-23 10:22:41 -06:00
Travis Nielsen 1969a4f4fb Merge pull request #3944 from Madhu-1/correct-ns
correct namespace for csi resources  in upgrade doc
2019-09-23 10:22:00 -06:00
Travis Nielsen 1e695283c9 Merge pull request #3945 from Madhu-1/disable-flex
Disable Flexdriver in helm chart and operator-openshift
2019-09-23 09:52:10 -06:00
Madhu Rajanna d71d57f0e9 Add KUBELET_DIR_PATH to operator-openshift.yaml
Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-23 20:26:03 +05:30
Madhu Rajanna 7a407fb045 Disable flex driver in operator-openshift.yaml
Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-23 20:26:03 +05:30
Sébastien Han 2e482d15a3 ceph: common.yaml remove empty line
We don't need this empty line.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-09-23 12:10:38 +02:00
Sebastian Wagner 82329a0bc6 Ceph CRDs: sync between copies
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-09-23 09:57:49 +02:00
Sebastian Wagner 965dc93f11 CephCluster CRD: Added network.provider to validation
(and `network.selectors`)

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-09-23 09:57:05 +02:00
Madhu Rajanna 04a276abf1 correct namespace for csi resources
CSI pods should look for the resources
created in ROOK_SYSTEM_NAMESPACE instead
of ROOK_NAMESPACE

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-23 10:20:51 +05:30
Travis Nielsen f96960cfcc Merge pull request #3904 from sebastian-philipp/crd-validation-disruptionManagement
Fix CRD Validation: disruptionManagement and mgr modules
2019-09-20 17:06:45 -06:00
Madhu Rajanna 345f099bbc Make kubelet path configurable in operator
currently CSI templates have hardcoded kubelet
path which will  be used for  mounting PVC,this
will not work if kubelet is configured to use
different path, with this PR  kubelet path
can be configured for CSI.

Fixes: #3921

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-20 18:51:44 +05:30
Madhu Rajanna 915bed0c3c remove / host mount from pod template
set containerized flag as false

This is not required as we are setting
containerized=false and we have deprecated
this flag in ceph-csi.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-20 17:16:51 +05:30
Madhu Rajanna ac295a57a5 Remove containerized flag from provisioner
containerized is only useful in nodeplugin
not the provisioner pod

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-20 17:03:34 +05:30
Sebastian Wagner ec77c21f9b examples/ceph/cluster.yaml: comment out mgr.modules
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-09-20 09:55:46 +02:00
Sebastian Wagner 1987480dc5 Added missing properties
* volumeClaimTemplate
* storageClassDeviceSets
* external.enable

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-09-20 09:55:46 +02:00
Sebastian Wagner f66f6c1ce3 disruptionManagement: Added missing CRD validation
Also:
* `cluster.yaml`: spec.mgr.modules is not explicily nullable
* Removed `required: mon` in `ceph_manifests.go`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-09-20 09:55:46 +02:00
Blaine Gardner f97820a088 Merge pull request #3902 from Madhu-1/fix-3868
update cephcsi upgrade document
2019-09-19 12:14:37 -06:00
Sébastien Han 087d71106b ceph: add a new CR property to force upgrades
On rare occasion, the ceph checks might not be 100% correct and the user
might decide to force an upgrade anyway.
Correctly, if we are in an upgrade, we perform `ok-to-stop` check for
each daemon, if one of them fails, we retry and eventually fail.
They are corner-cases where users would like to force the upgrade anyway.

Enhance the new CR property: "skipUpgradeChecks: true".

Closes: https://github.com/rook/rook/issues/3872
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-09-19 10:55:56 +02:00
Madhu Rajanna 4a8b821c79 update csi upgrade document
updated required rules for upgrading CSI from
v1.0 to v1.1 and also updated the document with
required steps

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-19 12:00:22 +05:30
Sébastien Han 9c86f40a6e Merge pull request #3724 from leseb/disable-flex
operator: ceph disable flexdriver
2019-09-18 10:08:07 +02:00