Commit Graph
7961 Commits
Author SHA1 Message Date
Sébastien Han d7956facdb Merge pull request #4075 from rohantmp/mdsFix
[Ceph] Fix: PDB for MDS not created when activeStandby:true and activeCount: 1
2019-10-11 11:02:12 +02:00
Travis Nielsen ec75db503f Merge pull request #4024 from thotz/brownfield
Fixing issues for object bucket claims for brownfield cases (delete policy)
2019-10-10 15:48:35 -06:00
Rohan CJ 0d9442982b ceph: Fix PDB for MDS is not created if minAvailable <= 1.
It should be minAvailable < 1.

Signed-off-by: Rohan CJ <rohantmp@gmail.com>
2019-10-10 21:34:20 +05:30
Rohan CJ 3c5856fc2a Ceph: Take activeStandby into account for CephFileSystem disruption budget.
When activeStandby is set on the CephFilesystem, the effective
activeCount will be incremented.

Signed-off-by: Rohan CJ <rohantmp@gmail.com>
2019-10-10 21:31:58 +05:30
Sébastien Han 776f3951dc Merge pull request #4072 from leseb/mergify-rebase
mergify: change config to allow auto-merging
2019-10-10 17:36:19 +02:00
Sébastien Han e17d22a363 mergify: change config to allow auto-merging
Let's not do a rebase, but only merge. Rook is configured to refuse the
rebase and mergify fails with the following Github error:

GitHub error message: Rebase merges are not allowed on this repository.

This commit fixes the error.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-10-10 17:29:43 +02:00
Jiffin Tony Thottan 3f3af19a13 objectstore: remove user unlink in Revoke()
The access of user will be revoked by Droppolicy(). And user unlink
need to perform only if it is the owner. For Delete() it makes sense
to call user unlink, but it is not required for Revoke()

Signed-off-by: Jiffin Tony Thottan <jthottan@redhat.com>
2019-10-10 19:21:45 +05:30
Jiffin Tony Thottan 69e4144b0f objectstore: modify existing bucket policy for brownfield cases
Following corrections are needed for bucket policy to work properly

* Change Principal:{"AWS":["<username>"]} to Principal:{"AWS":["arn:aws:iam:::user/<username>"]}
* Add missing "PutObject" policy in Action[]
* Add <bucket/*> to Resource[] for accessing contents inside the bucket

Signed-off-by: Jiffin Tony Thottan <jthottan@redhat.com>
2019-10-10 19:21:17 +05:30
Sébastien Han 28a898d9f3 Merge pull request #4046 from eknudtson/osd-memory-target-fix
remove decimal point for osdMemoryTargetValue
2019-10-10 09:27:50 +02:00
Madhu Rajanna 0056e58ba6 csi: update cephfs registration directory name
when multiple CSI drivers are running in a cluster,
each should use unique socket for registration.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-10-10 10:52:27 +05:30
Travis Nielsen 3c26fb1096 Merge pull request #4025 from leseb/external-more-flexible
ceph: relax pre-requisite for external cluster
2019-10-09 13:36:19 -06:00
Juan Miguel Olmo Martínez 6f439a7328 EdgeFS: Auto generated code missed
Auto generated code was missed in https://github.com/rook/rook/pull/3995.

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2019-10-08 14:32:51 +02:00
Sébastien Han 148f8da1fb ceph: relax pre-requisite for external cluster
We now differentiate the cases where:

* we only consume the external cluster
* we consume the external cluster as well as creating stateless
resources in Kubernetes (bootstrap mds,rgw, nfs)

This is mostly controlled via the image property spec. If not defined,
not extra CRs won't be able to be created.

Now the external cluster feature supports Ceph cluster as of Luminous 12.2.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-10-08 10:52:01 +02:00
Erik KnudtsonandSébastien Han ec4d0c8925 ceph: remove decimal places for osdMemoryTargetValue
Update pkg/operator/ceph/cluster/osd/spec.go

Rook v1.1.2 uses a different command to start an OSD, and seems to
have problems when --osd-memory-target contains a number with a
decimal point.

Co-Authored-By: Sébastien Han <seb@redhat.com>
Signed-off-by: Erik Knudtson <eknudtson@discogsinc.com>
2019-10-07 09:32:49 -07:00
Sébastien Han 233df963e7 ceph: fix various spelling issues
Correct spelling.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-10-03 11:42:40 +02:00
Sébastien Han 9b0c73ca6b Merge pull request #3817 from mantissahz/ceph_osd_nodes_timeout
Nodes always in OrchestrationStatusStarting
2019-10-03 11:07:19 +02:00
James Lu b8d7382b7a Ceph: nodes always in OrchestrationStatusStarting
When osd nodes do not finish the prepare jobs, the user remove the
nodes manully and it causes nodes always is
'OrchestrationStatusStarting' status.
Try to remove them after completeProvisionTimeout.

Signed-off-by: James Lu <jamesluhz@gmail.com>
2019-10-03 08:08:46 +08:00
Travis Nielsen b40321fa1f Merge pull request #4032 from travisn/no-hyperkube-helm
Remove obsolete hyperkube settings from the helm chart
2019-10-02 09:16:37 -06:00
travisn 66e7562045 ceph: no hyperkube settings in the helm chart
In the original help chart hyperkube was used in the prototype.
The usage of hyperkube has long since been removed from the
chart. This is cleanup to remove the reference to hyperkube
in the chart settings.

Signed-off-by: travisn <tnielsen@redhat.com>
2019-10-01 17:45:57 -06:00
Travis Nielsen 102923cd18 Merge pull request #4030 from rohan47/ceph-helm
Updated rook-ceph-osd clusterrole for helm chart
2019-10-01 16:35:20 -06:00
rohan47 47dc6c0347 Updated rook-ceph-osd clusterrole for helm chart
Signed-off-by: rohan47 <rohgupta@redhat.com>
2019-10-02 01:46:39 +05:30
Sébastien Han b400a09317 Merge pull request #4026 from varshar16/wip-turn-on-ssl
ceph: set ssl to true in cluster-test.yaml
2019-10-01 17:52:02 +02:00
Varsha Rao a83939319d ceph: Set ssl to true in cluster-test.yaml and cluster-on-pvc.yaml
Dashboard requires ssl to be turned on for running backend requests in rook.

Signed-off-by: Varsha Rao <varao@redhat.com>
2019-10-01 21:11:49 +05:30
Sebastian Wagner b4b1182d2e Ceph CRD Validation: Add reservePoolsOnDelete
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-10-01 16:10:51 +02:00
Sébastien Han 418cbb9464 Merge pull request #4018 from SUSE/var-csi-images
ceph: set default Ceph CSI images as var not const
2019-10-01 09:39:06 +02:00
Sébastien Han 6f4a7cf6c8 Merge pull request #3974 from jmolmo/issue_2206
New setting to avoid delete pools on <filesystem>/<object store> deletion
2019-10-01 09:19:56 +02:00
Travis Nielsen 610de42cbb Merge pull request #4016 from jtlayton/wip-42089
ceph: set ssl to true in cluster-minimal.yaml
2019-09-30 14:56:32 -06:00
Blaine Gardner 24d2187f1a ceph: set default Ceph CSI images as var not const
Set the default Ceph CSI images as vars in the code instead of consts.
This allows these values to be overridden at build time with Go linker
-X flags. This allows users to build Rook in such a way that it will
automatically update the CSI images to a custom opinionated default
without having to manually manage the environment variable-based
overrides at upgrade time.

Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2019-09-30 12:15:32 -06:00
Jeff Layton b5a5a65666 ceph: set ssl to true in cluster-minimal.yaml
The scripts for running backend dashboard requests in rook expect this
to be an SSL-enabled port. Ensure that it is.

https://tracker.ceph.com/issues/42089
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-09-30 10:58:38 -04:00
Juan Miguel Olmo Martínez 2de0787fc8 New setting to avoid delete pools on <fs>/<os> resources deletion
A new CRD property `PreservePoolsOnDelete` has been added to Filesystem(fs) and
Object Store(os) resources in order to increase protection against data loss.
If it is set to `true`, associated pools won't be deleted when the main
resource(fs/os) is deleted. Creating again the deleted fs/os with the same name
 will reuse the preserved pools.

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2019-09-30 08:13:39 +02:00
Travis Nielsen 91b8a96fb6 Merge pull request #3994 from leseb/rm-osd-config
Ceph: fix rook-config-overrides for OSDs
2019-09-27 10:07:41 -06:00
Sébastien Han f1e57a5d3f Merge pull request #4005 from Madhu-1/fix-3987
CSI: Make metrics and liveness port configurable
2019-09-27 16:41:48 +02:00
Sébastien Han c8d8d30103 Merge pull request #3943 from galexrt/updated_disaster
docs: updated Ceph mon disaster recovery guide
2019-09-27 15:40:20 +02:00
Madhu Rajanna f54099df0c CSI: Make metrics and liveness port configurable
provided ENV variables to configure the grpc
and liveness metrics port for both cephfs and
rbd CSI drivers.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-27 17:31:45 +05:30
Sébastien Han 45e3ca2a23 Merge pull request #3957 from Madhu-1/tol-csi
Add Toleration and NodeAffinity to CSI provisioners
2019-09-27 11:52:40 +02:00
Madhu Rajanna 9d298fe4f0 Add Toleration and NodeAffinity to CSI
Add support for setting Toleration and NodeAffinity
to CSI Provisioner deployment or statefulset and
plugin daemonset through ENV variables.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-27 10:23:12 +05:30
Madhu Rajanna 55e9340737 rename kserrors to k8serrors
Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-27 10:05:45 +05:30
Madhu Rajanna 3af3cd63ab Rename AddNodeAffinity to GenerateNodeAffinity
function AddNodeAffinity was not adding any node
affinity instead it was forming the nodeaffinity
object. renamed it to GenerateNodeAffinity for more
meaningful

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-27 10:05:45 +05:30
Dmitry Yusupov 37a9e6b0f0 Merge pull request #3995 from SergeyKaydalov/edgefs-kvssd
EdgeFS: support for rtkvs disk engine and Samsung KVSSD
2019-09-26 10:34:16 -07:00
Travis Nielsen 4d221288ce Merge pull request #3967 from Madhu-1/fix-3913
Add check for csi volumes before cluster delete
2019-09-26 11:13:07 -06:00
Travis Nielsen 11348e8b67 Merge pull request #3972 from Madhu-1/pool-delete
Check Pools is in use before deleting it
2019-09-26 11:12:05 -06:00
Márton Elek d700b1a644 ozone: design doc for ozone operator
Signed-off-by: Márton Elek <elek@apache.org>
2019-09-26 18:32:34 +02:00
Sergey Kaydalov 07ba73bb8f EdgeFS: support for rtkvs disk engine and Samsung KVSSD
Signed-off-by: Sergey Kaydalov <kayserg@gmail.com>
2019-09-26 18:02:32 +03:00
Madhu Rajanna ec9784203e Add check for csi volumes before cluster delete
Add a finalizer to the CephCluster to check
the PV created by CSI so that we can block the
cluster deletion till the PVC are deleted.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-26 20:15:11 +05:30
Sébastien Han a5ab7ae960 ceph: osd add crush_location on startup flag
Since we remove the ceph.conf files from the OSD we lost the ability to
set the crush location of the OSD. So adding this capability back to the
CLI startup line.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-09-26 15:59:51 +02:00
Sébastien Han ae8e45585f ceph: osd add fsid to daemon flag
Now that the ceph.conf is gone, it's safer to run the OSD with the
cluster fsid flag.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-09-26 15:29:24 +02:00
Sébastien Han a4a180b8fb ceph: osd remove config file
We don't need to force any Ceph config file for ceph-volume based OSDs
since the 'ceph-volume activate' command mount everything at start time
in the right place.
So now, OSD will keep running normally and they will also read back
normally the default location of the ceph configuration:
/etc/ceph/ceph.conf which will allow OSDs to read any configuration
overrides.
We cannot remove the generation of that file in /var/lib/rook/osd* since
we cannot tell at the stage that triggers the generation if we run
ceph-volume or not. So let's keep it around for some time.
If you are wondering how the OSD connects to the mons this is done via
the CEPH_ARGS env variable which was introduced in
https://github.com/rook/rook/pull/3894.

Closes: https://github.com/rook/rook/issues/3926
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-09-26 15:07:53 +02:00
Madhu Rajanna 4efba0247d Check Pools is in use before deleting it
currently we are not checking the pool is empty or
not before deleting, This PR adds a check to check
if any images/snapshots using the pool, if yes it will
not delete the pool

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-09-26 11:41:47 +05:30
Travis Nielsen 25771cca50 Merge pull request #3983 from ashishranjan738/goupdate
enhance: Updates Makefile to allow compiling with go 1.13
2019-09-25 18:03:40 -06:00
Sébastien Han d9239bd45e Merge pull request #3977 from travisn/detect-version-placement
Allow setting affinity on the ceph version job
2019-09-25 19:02:56 +02:00