Commit Graph
257 Commits
Author SHA1 Message Date
Travis Nielsen 9250c072cc Merge pull request #3322 from umangachapagain/rook-ceph-monitoring
Integrate ceph-mixins with rook-ceph
2019-07-08 18:27:03 -06:00
Alexander Trost f0b0f0e4f3 ceph: wrong pool name for CephFS StorageClass (#3400)
ceph: wrong pool name for CephFS StorageClass
2019-07-08 09:56:02 +02:00
Umanga Chapagain 732f3030d0 integrate prometheus based monitoring with rook-ceph
> add new field to cluster spec
> deploy servicemonitor
> deploy prometheusRule

Signed-off-by: Umanga Chapagain <chapagainumanga@gmail.com>
2019-07-08 11:40:17 +05:30
Joel Huang c404a7e68b ceph: wrong pool name for CephFS StorageClass
* This error is found in creating CephFS StorageClass using document `Documentation/ceph-csi-drivers.md`: "expect a pool named `cephfs_data` in your Ceph cluster"
* **`kubectl apply -f pool.yaml` using metadata.name "cephfs_data" produce error:** The CephBlockPool "cephfs_data" is invalid: metadata.name: Invalid value: "cephfs_data": a DNS-1123 subdomain must consist of lower case alphanumeric characters, '-' or '.', and must start and end with an alphanumeric character (e.g. 'example.com', regex used for validation is '[a-z0-9]([-a-z0-9]*[a-z0-9])?(\.[a-z0-9]([-a-z0-9]*[a-z0-9])?)*')
* accoding to `Documentation/ceph-filesystem-crd.md` linked from `Documentation/ceph-csi-drivers.md` file and field test, it should be `myfs-data0`

Signed-off-by: Joel Huang <joelhy@gmail.com>
2019-07-06 00:21:34 +08:00
Travis Nielsen 0f699aa33c Merge pull request #3377 from poornimag/fork-ceph-image-latest
Change the ceph image to point to latest-nautilus-devel
2019-07-05 08:42:05 -06:00
Umanga Chapagain 25e4275082 Rook: Added NodeAffinity to agent and discovery daemon
Previously, Rook Agent and Discovery DaemonSet deployment didn't allow
adding nodeAffinity. This commit adds nodeAffinity spec to daemonSet
deployment, which can be configured through environment variables in
operator deployment yaml.

+ Support multiple LabelKey, each with multiple LabelValue
+ Support multiple LabelKey with no value

Signed-off-by: Umanga Chapagain <chapagainumanga@gmail.com>
2019-07-05 13:48:09 +05:30
Poornima G 4ddef3e823 Change the ceph image to latest-nautlius-devel
Currently in cluster deploy, ceph image points to ceph/ceph:v14.2.1-20190430.
Changing this to use ceph/daemon-base:latest-nautilus-devel as its the latest nautilus.

Ceph nautilus has some changes in cephsfs mgr module, which is required by ceph-csi
canary image, without which the create/purge of RWX PVCs will fail. These changes
are not yet part of any released ceph version, i.e v14.2.1-20190430. Even in the
short future, we expect some changes to land in Nautilus after 14.2.2, hence
waiting for 14.2.2 release and updating to it, will not solve the issue.
Therefore using latest-nautilus-devel, which will always have the changes
required by ceph-csi. This is only a temperory change in the master, until
14.2.3 is released.

Signed-off-by: Poornima G <pgurusid@redhat.com>
2019-07-05 06:50:30 +00:00
Madhu Rajanna de9f8c1b62 Update rbd and cephfs secret
cephcsi PR https://github.com/ceph/ceph-csi/pull/395
changed the way we are storing secrets. This PR will
bring same changes to the rook as well.

Fixes: #3357

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-07-04 12:17:26 +05:30
Travis Nielsen 72afc709aa Merge pull request #3353 from sabbot/handle-crd-update
EdgeFS Rolling Upgrade support
2019-07-02 10:43:24 -06:00
Anton Skriptsov 8d0866b20e upgrade service's crds
Signed-off-by: Anton Skriptsov <sabbotagge@gmail.com>
2019-07-01 13:19:03 -07:00
ShyamsundarR 1dbdd9bb12 Update Ceph-CSI manifests as per changes to ceph-csi repository
Ceph-CSI repository had a recent PR [1] merged that contains
changes to the pod manifests.

This PR to Rook updates the pod manifests to catchup with the
changes to Ceph-CSI master.

Once Ceph-CSI has a 1.1.0 release, future PRs to Rook on manifest
changes would track that branch (at least for Rook 1.1 release).

[1] PR in ceph-csi changing the manifest:
  https://github.com/ceph/ceph-csi/pull/443

Signed-off-by: ShyamsundarR <srangana@redhat.com>
2019-07-01 13:30:23 -04:00
Travis Nielsen e663624827 Merge pull request #3324 from Madhu-1/csiv1.1.0
update rook to use ceph-csi canary image
2019-06-25 08:24:21 -06:00
Madhu Rajanna 71f369303e update rook to use ceph-csi canary version
ceph-csi canary version is close to ceph-csi v1.1.0
release

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-06-25 17:15:46 +05:30
andrew webber (personal) 2eaaf26792 Container Linux - Daemonsets missing required field "selector"
Signed-off-by: andrew webber (personal) <andrewvwebber@googlemail.com>
2019-06-24 23:36:40 +02:00
Alexander Trost aa92e9a653 ceph: add psp.yaml example (#3317)
ceph: add psp.yaml example
2019-06-18 17:48:29 +02:00
Sébastien Han a74f806153 ceph: add psp.yaml example
The current doc was outdated and hardcoded, so removing the example from
the doc and add a proper psp.yaml file that people can use and
contribute too.

Closes: https://github.com/rook/rook/issues/3309
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-06-18 16:58:28 +02:00
ShyamsundarR 61b9f9a9f0 Update openshift with Ceph-CSI to image versions as in Kubernetes case
PR #3217 changed the pod manifest to drop some parameters to the
ceph-csi pods. This also resulted in a change to the operator with CSI
yaml for non-openshift case, but failed to update similar yaml's for
the openshift case.

This commit rectifies this problem.

Updates: #3312
Signed-off-by: ShyamsundarR <srangana@redhat.com>
2019-06-18 07:07:00 -04:00
Travis Nielsen 8da2221296 Merge pull request #3283 from leseb/rgw-refactor
ceph: refactor rgw bootstrap
2019-06-14 15:17:58 -06:00
Sébastien Han 93b2448619 ceph: refactor rgw bootstrap
This commit does multiple things:

* remove support for AllNodes where we would deploy one rgw per node on
all the nodes.
* a transition path is implemented in the code so that if someone has an
existing deployment, daemonsets will be removed and replaced by an
deployments.
* when using "instances", each rgw deployed has its own key which makes
Ceph reporting the exact number of rgw running, see:

```
[root@rook-ceph-operator-775cf575c5-bh4sr /]# ceph -s
  cluster:
    id:     611fcf39-0669-4864-9a12-debb35c0397a
    health: HEALTH_OK

  services:
    mon: 3 daemons, quorum a,b,c (age 12h)
    mgr: a(active, since 12h)
    osd: 3 osds: 3 up (since 12h), 3 in (since 12h)
    rgw: 3 daemons active (my.store.a, my.store.b, my.store.c)

  data:
    pools:   6 pools, 600 pgs
    objects: 235 objects, 3.8 KiB
    usage:   3.0 GiB used, 84 GiB / 87 GiB avail
    pgs:     600 active+clean
```

Closes: https://github.com/rook/rook/issues/2474, https://github.com/rook/rook/issues/2957 and https://github.com/rook/rook/issues/3245
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-06-14 17:55:15 +02:00
John Mulligan 8c5a1c502e ceph csi: update storage class example with clusterID field
New versions of ceph csi rbd expect a clusterID that will be used
to index into the config map and determine what mons to use.
Also, remove mons from config example.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2019-06-14 10:45:50 -04:00
John Mulligan 431f504cd4 ceph: create and maintain a config map for ceph csi to consume
Create and maintain a config map that meets the requirements of
the ceph csi such that Rook can maintain the contents of config
map with up-to-date mon information to be used later by csi.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2019-06-14 10:45:41 -04:00
John Mulligan d8ba51084b ceph csi: update config templates to match "canary" csi version
This is a temporary change that fixes the templates so that they match
the so-called "canary" tag in csi. This version of the csi rbd driver
supports a external mon configuration (in a config map).

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2019-06-14 10:43:53 -04:00
John Mulligan 700b42a475 ceph csi: update the operator-with-csi.yaml to use canary csi images
Temporary change to support the testing and development of new
integration between ceph csi and rook. This "canary" tag points
at new versions of csi that support taking mon config from a
config map.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2019-06-14 10:43:53 -04:00
Guy MargalitandTravis Nielsen fe5d94e370 Rook-NooBaa Design Doc
Signed-off-by: Guy Margalit <guymguym@gmail.com>
Co-Authored-By: Travis Nielsen <tnielsen@redhat.com>
2019-06-12 01:44:04 +03:00
Dmitry Yusupov 41d92cee3e enable proper values for metadataOnly property
Signed-off-by: Dmitry Yusupov <dmitry.yusupov@nexenta.com>
2019-06-06 21:12:04 -07:00
John Mulligan 642874fff0 ceph csi: whitespace cleanups in example file
Remove various excess white space from ceph csi storageclass example.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2019-06-06 13:17:10 -04:00
John Mulligan 0138cd23f8 ceph csi: whitespace cleanups in template files
Remove various excess white space from ceph csi template files.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2019-06-06 13:10:02 -04:00
Shubhendu 577728bb03 Added latest prometheus alerting rules for ceph
New rules added:
- CephMgrIsAbsent
- CephMgrIsMissingReplicas
- CephMdsMissingReplicas
- CephMonHighNumberOfLeaderChanges
- CephOSDVersionMismatch
- CephMonVersionMismatch

Signed-off-by: Shubhendu <shtripat@redhat.com>
2019-06-06 10:04:45 +05:30
Travis Nielsen c4b9acae8c Merge pull request #3251 from rhcs-dashboard/ceph-dashboard-load-balancer
ceph: update dashboard section
2019-06-01 09:29:15 -06:00
alfonsomthd 06f0602a29 ceph: update dashboard section
* Updated dashboard image: Nautilus.
* Added LoadBalancer method to access dashboard.
* Added LB example: dashboard-loadbalancer.yaml

Signed-off-by: alfonsomthd <almartin@redhat.com>
2019-05-31 17:29:54 +02:00
Mateusz Gozdek 04c70bfe3f ceph/operator.yaml: fix alignment and add newline
This commit fixes misaligned example values in operator.yaml and adds a
newline at the end of the file, which is considered a good practice.

Signed-off-by: Mateusz Gozdek <mgozdekof@gmail.com>
2019-05-31 11:02:48 +02:00
Travis Nielsen 30d7010f70 Merge pull request #3134 from Madhu-1/fix-2987
add attacher container to cephfs CSI provisioner
2019-05-28 17:25:36 -06:00
Travis Nielsen 34857f3e63 Merge pull request #3017 from leseb/olm-csv
deployment: OLM integration
2019-05-17 09:50:16 -06:00
Sébastien Han 0fc3775b99 deployment: OLM integration
Add necessary script to auto-generate a CSV file for OLM.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-05-16 22:53:30 +02:00
Anton Skriptsov a0edbf627f Edgefs:3181 prevents multiple targets deployment on the same node
Signed-off-by: Anton Skriptsov <sabbotagge@gmail.com>
2019-05-15 11:45:59 -07:00
Stephan Müller f1d7e3118e fix space
Signed-off-by: Stephan Müller <mail@stephanmueller.eu>
2019-05-12 16:55:48 +02:00
Madhu Rajanna 64f063fb69 update code for cephfs-csi
add test cases to test cephfs csi
update ceph-csi document

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-05-09 20:04:06 +05:30
Madhu Rajanna d9a5dc81e7 deploy attacher container for cephfs csi
Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-05-08 12:43:14 +05:30
Umanga Chapagain 32057646cc Added separator to enable creation of multiple SCC
Signed-off-by: Umanga Chapagain <chapagainumanga@gmail.com>
2019-05-03 11:38:17 +05:30
travisn 642a8c67a1 ceph: update tests and examples to nautilus 14.2.1
Signed-off-by: travisn <tnielsen@redhat.com>
2019-05-01 08:49:55 -06:00
Travis Nielsen 535952d3e2 Merge pull request #2777 from InfuseAI/feature/ceph-volume-metadatadevice
Support metadataDevice for ceph-volume based osd
2019-04-29 12:56:41 -06:00
Travis Nielsen 9cf586968a Merge pull request #2965 from SUSE/upgrade-docs-v1.0
Ceph docs: update for v1.0 release
2019-04-26 16:56:00 -06:00
Blaine Gardner 04924ce194 ceph upgrade doc: update for v1.0 release
Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2019-04-26 16:49:04 -06:00
Ashish Ranjan dac028ab24 enhance(nfs): remove one to one mapping for nfs provisioner
Signed-off-by: Ashish Ranjan <ashishranjan738@gmail.com>

This commit removes one to one mapping of NFS provisioner and adds a dedicated provisioner for nfs.
2019-04-26 20:52:30 +05:30
Ashish Ranjan edb2b5e76f refactor(nfs): updated nfs documentation with Dynamic provisioning method
Signed-off-by: Ashish Ranjan <ashishranjan738@gmail.com>
2019-04-26 04:25:49 +05:30
Ashish Ranjan 858c8eede7 refactor(operator): removed wild card from the operator
Signed-off-by: Ashish Ranjan <ashishranjan738@gmail.com>
2019-04-26 04:25:49 +05:30
Ashish Ranjan 9f3debc53f refactor(nfs,provisioning): move claimPath info from annotation to parameters
Signed-off-by: Ashish Ranjan <ashishranjan738@gmail.com>

This commit moves claimPath information from annotation to parameters and adds option to enable/disable storageclass creation.
2019-04-26 04:25:49 +05:30
Ashish Ranjan 23efbf658b enhance(NFS): adds dynamic provisoning for nfs
Signed-off-by: Ashish Ranjan <ashishranjan738@gmail.com>

This commit adds dynamic provisioning for nfs
2019-04-26 04:25:49 +05:30
Anton Skriptsov c659f2d6c7 Fix isgw formatting
Signed-off-by: Anton Skriptsov <sabbotagge@gmail.com>
2019-04-24 16:35:07 -07:00
Anton Skriptsov 21592776f0 Edgefs v1beta1 examples
Signed-off-by: Anton Skriptsov <sabbotagge@gmail.com>
2019-04-24 16:35:07 -07:00