Commit Graph
532 Commits
Author SHA1 Message Date
Alexander Trost 98217272be ceph: docs: unified formatting and style
This is the first phase Ceph part of three phases to improve and rework
the Rook documentation for better user accessibility to the Rook
projects and  with that the storage providers.
Phase two is about automatic generation of CRD documentation and phase
three is about reworking the docs themselves and, e.g., examples for
CRDs and certain use cases.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2019-11-01 18:10:32 +01:00
Travis Nielsen 831c15086a ceph: support all layers of CRUSH map with node labels
The node labels were already supported for zones and regions to add to
the CRUSH map. Now all layers of the CRUSH map will be supported
with the new labels such as topology.rook.io/rack.
The labels will be detected at the osd startup time
similar to the zone and region labels already being detected.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2019-10-31 14:47:18 -06:00
Juan Miguel Olmo Martínez 9c152e74af ceph: Included missing rolebindings for PodSecurityPolicies in Helm chart
**Description of your changes:**
Include missing rollebindings present in common.yaml file and not in the
rolebindings file for the Ceph Helm chart.

Resolves #

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2019-10-30 17:11:40 +01:00
Dmitry Yusupov 2b80eaf052 Merge pull request #4190 from sabbot/sysrepcount-failuredomain-validation
FailureDomain/SysRepCount validation
2019-10-25 10:36:53 -07:00
Sebastian Wagner b2fe1b951d ceph: Add removeOSDsIfOutAndSafeToRemove to CRD
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-10-25 15:57:32 +02:00
Anton Skriptsov d75a281d6e edgefs: FailureDomain-SysRepCount validation
Additional failureDomain,sysRepCount validation

Signed-off-by: Anton Skriptsov <sabbotagge@gmail.com>
2019-10-25 06:27:35 -07:00
Sébastien Han 6839b66b83 Merge pull request #4092 from S-Corkum/chart-image-update
update helm chart image
2019-10-25 10:17:33 +02:00
Travis NielsenandSean Corkum 8787a86b3c ceph: update the image in the helm chart
The image in the helm chart was broken. The url
needs to be updated to the new location for the rook
image.

Co-authored-by: Sean Corkum <seancorkum81@gmail.com>
Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2019-10-24 11:36:36 -06:00
Sébastien Han 98bc8e4ca0 ceph: revert "CSI: Add support for CSIDriver object creation"
I merged https://github.com/rook/rook/pull/4169 too quickly and didn't
noticed we were supposed to wait for csi 1.2.2.

This reverts commit 520ad44d71.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-10-24 12:30:11 +02:00
Madhu Rajanna 520ad44d71 CSI: Add support for CSIDriver object creation
This will be helpful to list the CSI drivers deployed
in the kubernetes cluster. if we have N number of
CSI drivers deployed in the cluster, the user can
query kubectl get csidriver and get  the list of
registered CSI drivers and it requires kube 1.14+
and also the functionality is disabled by default

More info here: https://github.com/ceph/ceph-csi/pull/698

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-10-24 15:08:26 +05:30
rohan47 7f9611d489 Ceph: Added removeOSDsIfOutAndSafeToRemove to Cluster CR
OSDs can be removed automatically with the current mechanism if a new
setting removeOSDsIfOutAndSafeToRemove is set to true. The default for
all new or upgraded clusters should be false.

Signed-off-by: rohan47 <rohgupta@redhat.com>
2019-10-23 15:10:36 +05:30
Sébastien Han fcc2e21faf ceph: rework csi keys and secrets
We know create 4 secrets containing 4 ceph keys where each of them have
limited permissions to access the cluster.

Closes: https://github.com/rook/rook/issues/4074
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-10-22 15:14:28 +02:00
Sébastien Han 1765ad6508 ceph: expose prepare pod resource limits
The osd-prepare jobs should not inherit osd resources since this might
cause scheduling issues.
Instead, we can now use the new CRD property `prepareosd` in the resource section.

Refer to the documentation for more details.

Closes: https://github.com/rook/rook/issues/2502
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-10-18 16:48:03 +02:00
Travis Nielsen 000392533c Merge pull request #4022 from sebastian-philipp/validation-reservePoolsOnDelete
Ceph CRD Validation: Add reservePoolsOnDelete
2019-10-17 09:43:27 -06:00
awalker60 0345468b6b ceph: fix for csi-snapshotter always pulling
This switches csi-snapshotter to IfNotPresent which works better in production and offline environments.

Signed-off-by: awalker60 <awalker125@users.noreply.github.com>
2019-10-15 10:41:03 +01:00
Madhu Rajanna 0056e58ba6 csi: update cephfs registration directory name
when multiple CSI drivers are running in a cluster,
each should use unique socket for registration.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-10-10 10:52:27 +05:30
Sébastien Han 148f8da1fb ceph: relax pre-requisite for external cluster
We now differentiate the cases where:

* we only consume the external cluster
* we consume the external cluster as well as creating stateless
resources in Kubernetes (bootstrap mds,rgw, nfs)

This is mostly controlled via the image property spec. If not defined,
not extra CRs won't be able to be created.

Now the external cluster feature supports Ceph cluster as of Luminous 12.2.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-10-08 10:52:01 +02:00
Travis Nielsen b40321fa1f Merge pull request #4032 from travisn/no-hyperkube-helm
Remove obsolete hyperkube settings from the helm chart
2019-10-02 09:16:37 -06:00
travisn 66e7562045 ceph: no hyperkube settings in the helm chart
In the original help chart hyperkube was used in the prototype.
The usage of hyperkube has long since been removed from the
chart. This is cleanup to remove the reference to hyperkube
in the chart settings.

Signed-off-by: travisn <tnielsen@redhat.com>
2019-10-01 17:45:57 -06:00
rohan47 47dc6c0347 Updated rook-ceph-osd clusterrole for helm chart
Signed-off-by: rohan47 <rohgupta@redhat.com>
2019-10-02 01:46:39 +05:30
Varsha Rao a83939319d ceph: Set ssl to true in cluster-test.yaml and cluster-on-pvc.yaml
Dashboard requires ssl to be turned on for running backend requests in rook.

Signed-off-by: Varsha Rao <varao@redhat.com>
2019-10-01 21:11:49 +05:30
Sebastian Wagner b4b1182d2e Ceph CRD Validation: Add reservePoolsOnDelete
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-10-01 16:10:51 +02:00
Sébastien Han 6f4a7cf6c8 Merge pull request #3974 from jmolmo/issue_2206
New setting to avoid delete pools on <filesystem>/<object store> deletion
2019-10-01 09:19:56 +02:00
Jeff Layton b5a5a65666 ceph: set ssl to true in cluster-minimal.yaml
The scripts for running backend dashboard requests in rook expect this
to be an SSL-enabled port. Ensure that it is.

https://tracker.ceph.com/issues/42089
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-09-30 10:58:38 -04:00
Juan Miguel Olmo Martínez 2de0787fc8 New setting to avoid delete pools on <fs>/<os> resources deletion
A new CRD property `PreservePoolsOnDelete` has been added to Filesystem(fs) and
Object Store(os) resources in order to increase protection against data loss.
If it is set to `true`, associated pools won't be deleted when the main
resource(fs/os) is deleted. Creating again the deleted fs/os with the same name
 will reuse the preserved pools.

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2019-09-30 08:13:39 +02:00
Madhu Rajanna f54099df0c CSI: Make metrics and liveness port configurable
provided ENV variables to configure the grpc
and liveness metrics port for both cephfs and
rbd CSI drivers.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-27 17:31:45 +05:30
Madhu Rajanna 9d298fe4f0 Add Toleration and NodeAffinity to CSI
Add support for setting Toleration and NodeAffinity
to CSI Provisioner deployment or statefulset and
plugin daemonset through ENV variables.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-27 10:23:12 +05:30
Dmitry Yusupov 37a9e6b0f0 Merge pull request #3995 from SergeyKaydalov/edgefs-kvssd
EdgeFS: support for rtkvs disk engine and Samsung KVSSD
2019-09-26 10:34:16 -07:00
Sergey Kaydalov 07ba73bb8f EdgeFS: support for rtkvs disk engine and Samsung KVSSD
Signed-off-by: Sergey Kaydalov <kayserg@gmail.com>
2019-09-26 18:02:32 +03:00
Travis Nielsen 7b5d855dfc Merge pull request #3614 from rajatsingh25aug/schema-validation-crds
Added validation for cephBlockPool,cephfs and cephnfs
2019-09-25 10:19:20 -06:00
Madhu Rajanna 0a516d5f32 use v1.2.1 cephcsi release
update CSI deployment templates and
doc to use new cephcsi v1.2.1 release

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-25 16:08:55 +05:30
RAJAT SINGH 4a02c568e7 Added validation for cephBlockPool,cephfs and cephnfs.Added changes in ceph_manifest.go and resources.yaml according to common.yaml.
Signed-off-by: RAJAT SINGH <rajasing@redhat.com>
2019-09-25 15:42:07 +05:30
Humble Chirammal 3da9514191 We were defaulting to ext4 at first and then moved to
`xfs`. However further testing shows that, ext4 should be
the default or preferred fs for RBD devices.

This patch bring that change

Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2019-09-24 14:28:16 +05:30
Alexander Trost ba196bdea5 Correct SYSTEM spelling (#3963)
Correct SYSTEM spelling
2019-09-24 10:00:56 +02:00
Travis Nielsen 4cbe8b5a3e Merge pull request #3931 from Madhu-1/fix-umount
Fix umount issue when rbd-nodeplugin restarts
2019-09-23 22:21:52 -06:00
Madhu Rajanna 09da4e3a3e Correct SYSTEM spelling
Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-24 09:32:36 +05:30
Travis Nielsen ba2b8724ce Merge pull request #3946 from sebastian-philipp/crd-validation-network-provider
CephCluster CRD: Added additional network attributes to validation
2019-09-23 10:22:41 -06:00
Travis Nielsen 1969a4f4fb Merge pull request #3944 from Madhu-1/correct-ns
correct namespace for csi resources  in upgrade doc
2019-09-23 10:22:00 -06:00
Travis Nielsen 1e695283c9 Merge pull request #3945 from Madhu-1/disable-flex
Disable Flexdriver in helm chart and operator-openshift
2019-09-23 09:52:10 -06:00
Madhu Rajanna d71d57f0e9 Add KUBELET_DIR_PATH to operator-openshift.yaml
Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-23 20:26:03 +05:30
Madhu Rajanna 7a407fb045 Disable flex driver in operator-openshift.yaml
Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-23 20:26:03 +05:30
Madhu Rajanna 15f36e9c63 Disable Flexdriver in helm chart
in commit https://github.com/rook/rook/commit/c7b861a21d729da0a4e5a86349efc8a290130bb8
flexdriver got enabled  by mistake, This will fix it

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-23 20:26:03 +05:30
Sébastien Han 2e482d15a3 ceph: common.yaml remove empty line
We don't need this empty line.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-09-23 12:10:38 +02:00
Sébastien Han 0b4129c856 rook-ceph olm: add missing nfs crd example
When displaying the CRDs OLM looks into the alm-examples field in the
CSV file, the NFS CRD example was missing so let's add it.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-09-23 12:08:15 +02:00
Sébastien Han cf091d3773 Merge pull request #3928 from rohantmp/csvBump
Generate OLM clusterserviceversion v1.1.1
2019-09-23 11:46:55 +02:00
Sebastian Wagner 82329a0bc6 Ceph CRDs: sync between copies
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-09-23 09:57:49 +02:00
Sebastian Wagner 965dc93f11 CephCluster CRD: Added network.provider to validation
(and `network.selectors`)

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-09-23 09:57:05 +02:00
Madhu Rajanna 04a276abf1 correct namespace for csi resources
CSI pods should look for the resources
created in ROOK_SYSTEM_NAMESPACE instead
of ROOK_NAMESPACE

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-23 10:20:51 +05:30
Travis Nielsen f96960cfcc Merge pull request #3904 from sebastian-philipp/crd-validation-disruptionManagement
Fix CRD Validation: disruptionManagement and mgr modules
2019-09-20 17:06:45 -06:00
Travis Nielsen 5f37de8abc Merge pull request #3927 from Madhu-1/fix-3921
Make kubelet path configurable in operator for csi
2019-09-20 10:45:27 -06:00