Commit Graph
7961 Commits
Author SHA1 Message Date
Sébastien Han 87ca208640 Merge pull request #3596 from rohantmp/managedPDB
Managed PDBs
2019-08-30 14:34:31 +02:00
Sébastien Han 8abcf37269 Merge pull request #3716 from Madhu-1/metrics
Implement grpc metrics for cephcsi
2019-08-30 14:29:17 +02:00
Madhu Rajanna a8589af337 Implement grpc metrics for cephcsi
grpc metrics is made option in rook
this can be disabled/enabled with ROOK_CSI_ENABLE_GRPC_METRCS
variable in operator.yaml
this will help admin who want to check the grpc metrics
of the ceph-csi plugins

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-08-30 15:01:45 +05:30
Rohan CJ 4072d14557 Add tests for the clusterdisruption controller and update the docs and
pending releas notes for managed PDBs.

Signed-off-by: Rohan CJ <rohantmp@gmail.com>
2019-08-30 14:04:23 +05:30
Sébastien Han e2c8a9935c Merge pull request #3696 from mvollman/db-devices-n-size
ceph: add db-devices flag and fix DatabaseSizeMB
2019-08-30 09:49:42 +02:00
Madhu Rajanna 8d5d9b9117 Fix liveness service creation
Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-08-30 13:16:55 +05:30
Madhu Rajanna 11293393ca Fix logging in csi
Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-08-30 13:16:55 +05:30
Madhu Rajanna 3c0801dedb remove liveness tests from csi_template
The tempate defined is supposed to use of v1.0 manifests
so removing the liveness code from it.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-08-30 13:16:55 +05:30
Madhu Rajanna 5587169fe9 Fix namespace selector in csi-livenees-monitoring
csi services are created in rook-ceph namespace

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-08-30 13:16:55 +05:30
Madhu Rajanna 53e33d4e08 Fix invalid port name in service monitoring
http-metrics1 port was not the service port name
defined for liveness

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-08-30 13:16:55 +05:30
Madhu Rajanna fc713b61cf Fix markdown issues in ceph-csi doc
Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-08-30 13:16:55 +05:30
Madhu Rajanna 77715a1096 change liveness port of cephfs and rbd
earlier 8080 was used by rbd for liveness and 8081
was used by cephfs for liveness. in most of the system
8080 will be sued for some other service, this will
cause  the rbd service to fail,  choosing 9080 and 9081
as ports for rbd and cephfs to avoid this  kind of
suitation.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-08-30 13:16:55 +05:30
Sébastien Han 942a89d9cd Merge pull request #3661 from rohan47/osd-marked-out
OSD: Remove osd pods that are marked out and the pod is more than an hour old.
2019-08-30 09:45:45 +02:00
Sébastien Han 180f267b33 Merge pull request #3734 from travisn/osd-init-container-pvcs
Copy binaries init container for osds on pvcs provisioning
2019-08-30 09:41:03 +02:00
travisn 49115749ab ceph: copy binaries init container for osds on pvcs provisioning
The init container for copying binaries was being overwritten by the
init container for initializing pvcs. This change appends the init
containers so all expected init containers are preserved.

Signed-off-by: travisn <tnielsen@redhat.com>
2019-08-29 22:23:04 -06:00
Rohan CJ 60792ebe5c Add support for PDBs on Mons, RGW, and MDS
Signed-off-by: Rohan CJ <rohantmp@gmail.com>
2019-08-30 09:01:15 +05:30
Rohan CJ 5a248fbf59 Set a noout on failuredomains when in maintenance.
Maintenance is only defined when managedDisruptionBudgets are enabled.
Details can be found in the design doc for manged poddisriptionbudgets.

Signed-off-by: Rohan CJ <rohantmp@gmail.com>
2019-08-30 09:01:15 +05:30
Rohan CJ d6b23dd549 Add nodedrain controller for deploying canary deployments for every node.
Canary pods can be watched to determine when a node is draining.

Signed-off-by: Rohan CJ <rohantmp@gmail.com>
2019-08-30 09:01:11 +05:30
Rohan CJ 079c24883b Add a controller-runtime scaffolding
Signed-off-by: Rohan CJ <rohantmp@gmail.com>
2019-08-30 08:59:53 +05:30
Rohan CJ 6a94ff9b5b Bump kubernetes version to 1.14.1
Signed-off-by: Rohan CJ <rohantmp@gmail.com>
2019-08-30 08:59:53 +05:30
Travis Nielsen 5eab7ca658 Merge pull request #3573 from SUSE/mon-kv-store
Ceph: override configs in CRD
2019-08-29 19:04:16 -06:00
Michael Vollman ed9519953a ceph: add per OSD custom deviceClass support
Add deviceClass as a per OSD config option under
storage/nodes/devices/config for setting a custom crush device class
per OSD.

Signed-off-by: Michael Vollman <michael.b.vollman@gmail.com>
2019-08-29 20:39:41 -04:00
Michael Vollman 496c638306 ceph: add db-devices flag and fix DatabaseSizeMB
Adding support for the db-devices flag for ceph versions 14.2.1 and
newer.  This flag will allow for explictly setting the db device for
bluestore configurations to the device specified as metadataDevice.

Fixing the databaseSizeMB config parameter to ensure it is used to set
the size of the db-device partition when specified at either the global
or individual device level. (#3652)

Signed-off-by: Michael Vollman <michael.b.vollman@gmail.com>
2019-08-29 20:39:41 -04:00
Blaine Gardner a55468f5ab Ceph: remove legacy configs
Several legacy configs set by Rook are bad defaults that risk user data.
Remove them.

Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2019-08-29 15:38:29 -06:00
Blaine Gardner 1be43290be Ceph: override configs in CRD
Allow users to specify overrides in the CephCluster CRD. The override
ConfigMap still exists for emergency situations and is mounted into
daemon pods directly instead of being merged into a Rook-created config
file.

Rook Ceph no longer uses a config file for managing daemons with the
exception of the OSDs which still generate a config in an init
container.

Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2019-08-29 15:38:27 -06:00
Blaine Gardner 199f2b80ab Merge pull request #3568 from nabokihms/rook-add-image-pull-secrets
rook: Add image pull secrets option
2019-08-29 14:02:03 -06:00
Dmitry Yusupov b0dffa6f9b Merge pull request #3702 from sabbot/transition-to-v1
Declare EdgeFS CRDs as v1
2019-08-29 11:26:45 -07:00
Travis Nielsen a53503100a Merge pull request #3723 from Madhu-1/fix-pvc-res
update storageclass name in  pvc-restore
2019-08-29 11:36:27 -06:00
Travis Nielsen b13a70f6af Merge pull request #3730 from Madhu-1/pid-limit
Add pidlimit flag  for cephfs and rbd plugin
2019-08-29 11:33:43 -06:00
Travis Nielsen c5c16cbacb Merge pull request #3725 from kshlm/fix-rook-csi-rbd-rbac-in-csv
csv: Fix name SA name for CSI RBD provisioner
2019-08-29 10:55:15 -06:00
Travis Nielsen 6ccd243af1 Merge pull request #3729 from rohan47/node_selector_pvc
OSD: fixed label selector for osd prepare job pod
2019-08-29 10:55:04 -06:00
Madhu Rajanna ba66e53d10 Add pidlimit flag for cephfs and rbd plugin
pidlimit flag was  added only for cephfs
and rbd provisioner earlier, this PR adds
these flags to the rbd and cephfs plugin
to configure the pidlimit to max

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-08-29 22:01:12 +05:30
Sébastien Han 0d481d1bd1 Merge pull request #3712 from leseb/mon-down-upgrade
ceph: improve upgrade on image change
2019-08-29 17:43:00 +02:00
rohan47 a098cdd1a6 OSD: fixed label selector for osd prepare job pod
OSD prepare job pods don't require node selector when the OSDs are based
on PVC.
The bug was intruduced in https://github.com/rook/rook/pull/3707 which
added node selector to the prepare job pod when portable property of
storageClassDeviceSets is false.
Adding node selector set kubernetes.io/hostname=example-storagedeviceset-xxx, while there is no host example-storagedeviceset-xxx the prepare job failed.

Signed-off-by: rohan47 <rohgupta@redhat.com>
2019-08-29 19:30:02 +05:30
Sébastien Han 82702f5cc5 Merge pull request #3721 from travisn/default-ceph-osd-db-size
Ceph: Remove default database size for OSDs
2019-08-29 13:23:30 +02:00
Sébastien Han 8cf9d7e636 Merge pull request #3704 from mvollman/bugfix-osdsper
ceph: fix md and dev ordering for c-v batch
2019-08-29 12:24:26 +02:00
Kaushal M 77fc5e9c14 csv: Fix name SA name for CSI RBD provisioner
Signed-off-by: Kaushal M <kshlmster@gmail.com>
2019-08-29 14:24:45 +05:30
Sébastien Han bed14cfd71 ceph: improve upgrade on image change
From now on, Rook will only perform check before upgrades when there is
an actual upgrade. So if the Ceph image changed and a new version is
desired Rook will go through all the daemons and update them one by one
and perform checks in between.

Closes: https://github.com/rook/rook/issues/3583
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-08-29 10:18:19 +02:00
Madhu Rajanna b447e720f0 update storageclass name in pvc-restore
Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-08-29 12:02:14 +05:30
Travis Nielsen 484743075f Merge pull request #3711 from leseb/rm-mon-required
ceph: do not require mon in common.yaml
2019-08-28 18:57:30 -06:00
Travis Nielsen 0053d3d804 Merge pull request #3707 from rohan47/crushmap_base
OSD: CRUSH map can be based on node or PVC in case of PVC backed OSD
2019-08-28 18:21:31 -06:00
travisn b8e5e56dc1 ceph: remove default database size for OSDs
Since Rook is no longer creating partitions and leaving all that
work to ceph-volume, we should let ceph-volume choose the defaults
for the database size and use the max available. The default of 20GB
in fact doesn't even make sense since Ceph will only use the first 3GB
of that size and the other 17GB was wasted.

Signed-off-by: travisn <tnielsen@redhat.com>
2019-08-28 18:06:39 -06:00
rohan47 21deea9d64 OSD: CRUSH map can be based on node or PVC in case of PVC backed OSD
Signed-off-by: rohan47 <rohgupta@redhat.com>
2019-08-29 04:01:41 +05:30
Anton Skriptsov c0fe6af712 Initial v1
Signed-off-by: Anton Skriptsov <sabbotagge@gmail.com>
2019-08-28 15:18:38 -07:00
rohan47 9ebd151399 OSD: Remove osds that are marked out and the pod is more than an hour old
Signed-off-by: rohan47 <rohanrgupta1996@gmail.com>
Signed-off-by: rohan47 <rohgupta@redhat.com>
2019-08-29 03:32:25 +05:30
Travis Nielsen 663fed9c5e Merge pull request #3684 from travisn/pre-release-tag
Allow git tags to be added for alpha, beta, or rc releases
2019-08-28 14:09:28 -06:00
Maksim Nabokikh a63fa37d71 rook: Add image pull secrets option
Allow to specify imagePullSecrets to pull operator images from private registry

Signed-off-by: Maksim Nabokikh <maksim.nabokikh@flant.com>
2019-08-28 13:43:10 +04:00
Sébastien Han e0e769c30e ceph: do not require mon in common.yaml
For the external cluster setup, we don't have monitors to deploy because
we connect to external ones. So in the common.yaml we must not require a
mon section to be defined in the cluster CR.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-08-28 09:14:24 +02:00
Travis Nielsen 0aa1774ebe Merge pull request #3668 from noahdesu/canary-sched
ceph/mon: support monitor migration without rebuils
2019-08-27 22:50:43 -06:00
Noah Watkins e2fccdf03b ceph: remove the CRD option Mon.PreferredCount
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2019-08-27 17:43:35 -07:00