Commit Graph
13292 Commits
Author SHA1 Message Date
Travis Nielsen 102923cd18 Merge pull request #4030 from rohan47/ceph-helm
Updated rook-ceph-osd clusterrole for helm chart
2019-10-01 16:35:20 -06:00
rohan47 47dc6c0347 Updated rook-ceph-osd clusterrole for helm chart
Signed-off-by: rohan47 <rohgupta@redhat.com>
2019-10-02 01:46:39 +05:30
Sébastien Han b400a09317 Merge pull request #4026 from varshar16/wip-turn-on-ssl
ceph: set ssl to true in cluster-test.yaml
2019-10-01 17:52:02 +02:00
Varsha Rao a83939319d ceph: Set ssl to true in cluster-test.yaml and cluster-on-pvc.yaml
Dashboard requires ssl to be turned on for running backend requests in rook.

Signed-off-by: Varsha Rao <varao@redhat.com>
2019-10-01 21:11:49 +05:30
Sebastian Wagner b4b1182d2e Ceph CRD Validation: Add reservePoolsOnDelete
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-10-01 16:10:51 +02:00
Sébastien Han 418cbb9464 Merge pull request #4018 from SUSE/var-csi-images
ceph: set default Ceph CSI images as var not const
2019-10-01 09:39:06 +02:00
Sébastien Han 6f4a7cf6c8 Merge pull request #3974 from jmolmo/issue_2206
New setting to avoid delete pools on <filesystem>/<object store> deletion
2019-10-01 09:19:56 +02:00
Travis Nielsen 610de42cbb Merge pull request #4016 from jtlayton/wip-42089
ceph: set ssl to true in cluster-minimal.yaml
2019-09-30 14:56:32 -06:00
Blaine Gardner 24d2187f1a ceph: set default Ceph CSI images as var not const
Set the default Ceph CSI images as vars in the code instead of consts.
This allows these values to be overridden at build time with Go linker
-X flags. This allows users to build Rook in such a way that it will
automatically update the CSI images to a custom opinionated default
without having to manually manage the environment variable-based
overrides at upgrade time.

Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2019-09-30 12:15:32 -06:00
Jeff Layton b5a5a65666 ceph: set ssl to true in cluster-minimal.yaml
The scripts for running backend dashboard requests in rook expect this
to be an SSL-enabled port. Ensure that it is.

https://tracker.ceph.com/issues/42089
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-09-30 10:58:38 -04:00
Juan Miguel Olmo Martínez 2de0787fc8 New setting to avoid delete pools on <fs>/<os> resources deletion
A new CRD property `PreservePoolsOnDelete` has been added to Filesystem(fs) and
Object Store(os) resources in order to increase protection against data loss.
If it is set to `true`, associated pools won't be deleted when the main
resource(fs/os) is deleted. Creating again the deleted fs/os with the same name
 will reuse the preserved pools.

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2019-09-30 08:13:39 +02:00
Travis Nielsen 91b8a96fb6 Merge pull request #3994 from leseb/rm-osd-config
Ceph: fix rook-config-overrides for OSDs
2019-09-27 10:07:41 -06:00
Sébastien Han f1e57a5d3f Merge pull request #4005 from Madhu-1/fix-3987
CSI: Make metrics and liveness port configurable
2019-09-27 16:41:48 +02:00
Sébastien Han c8d8d30103 Merge pull request #3943 from galexrt/updated_disaster
docs: updated Ceph mon disaster recovery guide
2019-09-27 15:40:20 +02:00
Madhu Rajanna f54099df0c CSI: Make metrics and liveness port configurable
provided ENV variables to configure the grpc
and liveness metrics port for both cephfs and
rbd CSI drivers.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-27 17:31:45 +05:30
Sébastien Han 45e3ca2a23 Merge pull request #3957 from Madhu-1/tol-csi
Add Toleration and NodeAffinity to CSI provisioners
2019-09-27 11:52:40 +02:00
Madhu Rajanna 9d298fe4f0 Add Toleration and NodeAffinity to CSI
Add support for setting Toleration and NodeAffinity
to CSI Provisioner deployment or statefulset and
plugin daemonset through ENV variables.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-27 10:23:12 +05:30
Madhu Rajanna 55e9340737 rename kserrors to k8serrors
Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-27 10:05:45 +05:30
Madhu Rajanna 3af3cd63ab Rename AddNodeAffinity to GenerateNodeAffinity
function AddNodeAffinity was not adding any node
affinity instead it was forming the nodeaffinity
object. renamed it to GenerateNodeAffinity for more
meaningful

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-27 10:05:45 +05:30
Dmitry Yusupov 37a9e6b0f0 Merge pull request #3995 from SergeyKaydalov/edgefs-kvssd
EdgeFS: support for rtkvs disk engine and Samsung KVSSD
2019-09-26 10:34:16 -07:00
Travis Nielsen 4d221288ce Merge pull request #3967 from Madhu-1/fix-3913
Add check for csi volumes before cluster delete
2019-09-26 11:13:07 -06:00
Travis Nielsen 11348e8b67 Merge pull request #3972 from Madhu-1/pool-delete
Check Pools is in use before deleting it
2019-09-26 11:12:05 -06:00
Márton Elek d700b1a644 ozone: design doc for ozone operator
Signed-off-by: Márton Elek <elek@apache.org>
2019-09-26 18:32:34 +02:00
Sergey Kaydalov 07ba73bb8f EdgeFS: support for rtkvs disk engine and Samsung KVSSD
Signed-off-by: Sergey Kaydalov <kayserg@gmail.com>
2019-09-26 18:02:32 +03:00
Madhu Rajanna ec9784203e Add check for csi volumes before cluster delete
Add a finalizer to the CephCluster to check
the PV created by CSI so that we can block the
cluster deletion till the PVC are deleted.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-26 20:15:11 +05:30
Sébastien Han a5ab7ae960 ceph: osd add crush_location on startup flag
Since we remove the ceph.conf files from the OSD we lost the ability to
set the crush location of the OSD. So adding this capability back to the
CLI startup line.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-09-26 15:59:51 +02:00
Sébastien Han ae8e45585f ceph: osd add fsid to daemon flag
Now that the ceph.conf is gone, it's safer to run the OSD with the
cluster fsid flag.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-09-26 15:29:24 +02:00
Sébastien Han a4a180b8fb ceph: osd remove config file
We don't need to force any Ceph config file for ceph-volume based OSDs
since the 'ceph-volume activate' command mount everything at start time
in the right place.
So now, OSD will keep running normally and they will also read back
normally the default location of the ceph configuration:
/etc/ceph/ceph.conf which will allow OSDs to read any configuration
overrides.
We cannot remove the generation of that file in /var/lib/rook/osd* since
we cannot tell at the stage that triggers the generation if we run
ceph-volume or not. So let's keep it around for some time.
If you are wondering how the OSD connects to the mons this is done via
the CEPH_ARGS env variable which was introduced in
https://github.com/rook/rook/pull/3894.

Closes: https://github.com/rook/rook/issues/3926
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-09-26 15:07:53 +02:00
Madhu Rajanna 4efba0247d Check Pools is in use before deleting it
currently we are not checking the pool is empty or
not before deleting, This PR adds a check to check
if any images/snapshots using the pool, if yes it will
not delete the pool

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-26 11:41:47 +05:30
Travis Nielsen 25771cca50 Merge pull request #3983 from ashishranjan738/goupdate
enhance: Updates Makefile to allow compiling with go 1.13
2019-09-25 18:03:40 -06:00
Sébastien Han d9239bd45e Merge pull request #3977 from travisn/detect-version-placement
Allow setting affinity on the ceph version job
2019-09-25 19:02:56 +02:00
Alexander Trost 3a06804931 docs: updated Ceph mon disaster recovery guide
This updates the Ceph mon disaster recovery guide to use the correct
paths and commands for the current Rook Ceph release.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2019-09-25 18:26:04 +02:00
Travis Nielsen 75963b2859 Merge pull request #3973 from leseb/mergify-for-backports
add mergify engine for backport only
2019-09-25 10:23:31 -06:00
Travis Nielsen 7b5d855dfc Merge pull request #3614 from rajatsingh25aug/schema-validation-crds
Added validation for cephBlockPool,cephfs and cephnfs
2019-09-25 10:19:20 -06:00
travisn 0f5f2a81d7 ceph: allow setting affinity on the ceph version job
A job is started to detect the Ceph version. This job now allows setting
the node affinity and tolerations with the same setting that is
specified for the mon placement. No new placement spec is required, but
we will simply use the same spec that the mons use.

Signed-off-by: travisn <tnielsen@redhat.com>
2019-09-25 10:10:45 -06:00
Ashish Ranjan ec7bd4dda0 enhance: Updates Makefile to allow compiling with go 1.13
This commit updates Makefile to allow compiling with golang 1.13.

Signed-off-by: Ashish Ranjan <aranjan@redhat.com>
2019-09-25 21:22:12 +05:30
Travis Nielsen b99f6efb03 Merge pull request #3979 from Madhu-1/change-csi-tag
use new cephcsi release
2019-09-25 06:52:45 -06:00
Madhu Rajanna 0a516d5f32 use v1.2.1 cephcsi release
update CSI deployment templates and
doc to use new cephcsi v1.2.1 release

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-25 16:08:55 +05:30
RAJAT SINGH 4a02c568e7 Added validation for cephBlockPool,cephfs and cephnfs.Added changes in ceph_manifest.go and resources.yaml according to common.yaml.
Signed-off-by: RAJAT SINGH <rajasing@redhat.com>
2019-09-25 15:42:07 +05:30
Sébastien Han b6df9534d8 Merge pull request #3978 from travisn/configmap-clarify
Clarify docs around the custom ceph.conf settings configmap
2019-09-25 09:10:47 +02:00
Sébastien Han a42cc44d11 Merge pull request #3894 from mvollman/osd_ceph_conf
ceph: fix encrypted osd startup
2019-09-25 09:00:06 +02:00
Sébastien Han 24fc94cc57 Merge pull request #3955 from leseb/cv-debug-prepare
ceph: various osd fixes and improvements with lvm and ceph-volume
2019-09-25 08:46:34 +02:00
Sébastien Han 21e44c29e9 Merge pull request #3969 from leseb/osd-socket
ceph: osd reset 'run dir' to default location
2019-09-25 08:45:46 +02:00
Sébastien Han cfd2a7be0b add mergify engine for backport only
This is round 2 attempting to add the mergify engine in Rook. In this
case, we only use the backporting and automerge features.

* auto backport: set a label on your PR and a backport PR will be
automatically created under the right branch
* auto backport PR merge: if the backport PR passes CI, mergify will
merge it.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-09-25 08:41:41 +02:00
travisn 94c607b1d7 ceph: clarify docs around settings configmap
The configmap for advanced configuration can be created before the
cluster is created. In that case, the daemons will all pick up the
settings the first time they are started. Otherwise, the daemons
need to be restarted

Signed-off-by: travisn <tnielsen@redhat.com>
2019-09-24 17:49:33 -06:00
Sébastien Han 42cebf6311 ceph: osd run lvm config all the time
Previously, we were applying lvm config changes to OSD running on PV. So
now, we do this for any type of cluster deployment (bare metal or
Cloud).

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-09-24 22:49:39 +02:00
Sébastien Han 3404460d3c ceph: osd, fix lvm filter regexp
The lvm documentation uses commas to separate the regular expressions.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-09-24 17:17:29 +02:00
Sébastien Han 9b2afbca14 ceph: osd add debug logs for ceph-volume on prepare
Previously the debug flag was turned on for the 'activate' call only,
now 'prepare' will also take advantage of it.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-09-24 17:17:29 +02:00
Travis Nielsen 9affd75752 Merge pull request #3959 from Madhu-1/fix-svc-crt
Update service if already present
2019-09-24 08:44:14 -06:00
Sébastien Han 9bcdbeaf51 Merge pull request #3970 from humblec/ext4
Set default FS to "ext4" on RBD device
2019-09-24 11:11:46 +02:00