Commit Graph
13292 Commits
Author SHA1 Message Date
Travis Nielsen 76e44f3584 Merge pull request #3458 from travisn/roadmap-1.1
Update the roadmap for the v1.1 release
2019-08-26 22:30:43 -06:00
Noah Watkins 88e28e7b3e ceph: fix spurious merge of dead code
for some reason 8c8c48e0ac introduced some
old scheduler code that had previously been removed.

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2019-08-26 18:51:11 -07:00
Travis Nielsen 769949bca9 Merge pull request #3694 from leseb/new-images
ceph: use latest ceph images
2019-08-26 18:40:49 -06:00
Michael Vollman 9eccffd794 ceph: fix md and dev ordering for c-v batch
Ensure that the metadata device and osd devices are passed as a space
separated list to ceph-volume.  Currently osds-per-device is placed
between the metadataDevice and the osd devices causing an error.

Signed-off-by: Michael Vollman <michael.b.vollman@gmail.com>
2019-08-26 19:17:52 -04:00
travisn ba99b4e9b9 Update the roadmap for the v1.1 release
Signed-off-by: travisn <tnielsen@redhat.com>
2019-08-26 16:42:06 -06:00
Dinar Valeev d52bd0278b helm: rename values.yaml.tmpl to values.yaml
version can be set over values.yaml directly, there is no reason
to copy over a file, while lack of values.yaml file makes git tree
helm incompatible.

This is low effort fix for https://github.com/rook/rook/issues/3217

Signed-off-by: Dinar Valeev <k0da@opensuse.org>
2019-08-27 00:06:48 +02:00
David Vossel 54f8eb7ee1 Fix rules to service account mapping in csv generation script
Signed-off-by: David Vossel <davidvossel@gmail.com>
2019-08-26 17:59:24 -04:00
Sébastien Han a42916eff0 ceph: use latest ceph images
The last image has disabled ephemeral repositories so it's now possible
for images older than 15 days to install packages without having an
  error from non-existing repositories.

Closes: https://github.com/rook/rook/issues/3662
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-08-26 23:50:55 +02:00
David Vossel cfa0ffba4d fix olm header formatting
Signed-off-by: David Vossel <davidvossel@gmail.com>
2019-08-26 17:42:36 -04:00
Sébastien Han 18db4d1f99 Merge pull request #3695 from leseb/fix-symlink
minikube: fix symlink
2019-08-26 23:16:29 +02:00
Sébastien Han 50e8fced8c Merge pull request #3698 from travisn/skip-start-discovery
Start the ceph device discovery only based on env var
2019-08-26 22:27:22 +02:00
travisn 0dd62eb56f build: do not add generic release docker tag
To support upgrades, the operator relies on a changing tag
between versions so that when a pod spec is updated, k8s will
restart the pod due to the new image name. If the image name
does not change, the operator cannot control the upgrade deployment.
Therefore, we do not support a generic docker tag such as
rook/ceph:release and we expect specific version tags to be
specified in the operator such as rook/ceph:v1.0.0.
The master build is tagged with a generic tag for convenience
of testing the latest builds, but it is important to note that
upgrades are not supported between master builds.

Signed-off-by: travisn <tnielsen@redhat.com>
2019-08-26 14:24:05 -06:00
Travis Nielsen 164491bff7 Merge pull request #3642 from Madhu-1/csi-leader-election
Use Deployment with leader election instead of StatefulSet
2019-08-26 13:00:46 -06:00
travisn f3e9a5adac ceph: starting the device discovery only based on env var
The decision to start the device discovery daemonset is made
by an env var on the operator pod since in some scenarios
the discovery needs to be started immediately with the operator
instead of being delayed to start with the cluster.

Signed-off-by: travisn <tnielsen@redhat.com>
2019-08-26 11:20:38 -06:00
Blaine Gardner 939a19a55e Ceph Helm charts: update pod security policy
Update the PSP in the Ceph Helm charts to match common.yaml

Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2019-08-26 09:16:00 -06:00
Sébastien Han 764f399630 minikube: fix symlink
Let's create the symlink one directory above dataDirHostPath so that
chown won't complain that this is a symlink.

Closes: https://github.com/rook/rook/issues/3529
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-08-26 16:11:47 +02:00
Madhu Rajanna 78fb35a93d Use Deployment with leader election instead of StatefulSet
Deployment behaves better when a node gets disconnected
from the rest of the cluster - new provisioner leader
is elected in ~15 seconds, while it may take up to
5 minutes for StatefulSet to start a new replica.

if kube version is 1.13.x deploy provisioner as statefulset.
if kube version is higher than 1.14+ deploy provisioner
as deployment.

Refer: kubernetes-csi/external-provisioner@52d1fbc
Refer: ceph/ceph-csi#497

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-08-26 19:29:37 +05:30
Sébastien Han 0bdc98f333 Merge pull request #3576 from giovanism/multus
Multi-homing networking
2019-08-26 15:17:24 +02:00
Madhu Rajanna fcf6250df9 remove unused files related to cephcsi
Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-08-26 15:45:23 +05:30
Madhu Rajanna 1abfdf9fb6 Fix incorrect service account used for rolebinding
Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-08-26 15:45:23 +05:30
Madhu Rajanna d4befa79db update plugin directory name in csi
This is required if you are running multiple
csi drivers, if multiple node plugins are
listening on the same socket they request
may go to any node plugin. to avoid this we
need to have a unique socket per csi driver.
It is recommended to have socket inside the
driver name folder.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-08-26 15:45:23 +05:30
giovanism 4974be4b20 rook: Move network util functions to k8sutil
rook: Remove NetworkSelector type alias

rook: Add error return value for multus funcs

Signed-off-by: giovanism <giovanism@outlook.co.id>
2019-08-26 16:17:04 +07:00
giovanism cc62702d39 ceph: Use rook's NetworkSpec with type embedding
ceph: Use the new NetworkSpec api

ceph: Change all tests to use the NetworkSpec

ceph: Remove TypeMeta field from NetworkSpec

ceph: Change IsHost network func signature

Signed-off-by: giovanism <giovanism@outlook.co.id>
2019-08-26 16:17:03 +07:00
giovanism ea14b555d9 edgefs: Replace NetworkSpec with rookv1alpha2 version
edgefs: Change IsHost and IsMultus network func signature

edgefs: Reorder mgr annotations declaration

edgefs: Update cluster CRD docs and example for NetworkSpec

Signed-off-by: giovanism <giovanism@outlook.co.id>
2019-08-26 16:17:03 +07:00
giovanism 95644b7067 rook: Replace NetworkSpec with the new Spec
Duplicate edgefs's NetworkSpec funcs to rook

rook: Add NetworkSpec related tests

Support multus's json syntax

Add ApplyMultus using json

Fix uncaught index error on parseMultusSelector

Fix parseMultusSelector short form

Fix invalid JSON literal on network_test.go

rook: Ignore selectors order in ApplyMultus tests

rook: Improve network docs and tests readability

rook: Change IsHost and IsMultus network func signature

Signed-off-by: giovanism <giovanism@outlook.co.id>
2019-08-26 16:17:03 +07:00
giovanism 6f48eb49e9 cockroachdb: Duplicate rook's NetworkSpec
cockroachdb: Remove TypeMeta and HostNetwork field from NetworkSpec

Signed-off-by: giovanism <giovanism@outlook.co.id>
2019-08-26 16:16:48 +07:00
Sébastien Han e029903a36 Merge pull request #3673 from davidvossel/csv-gen-template
Include csi cephfs and rbd in CSV template
2019-08-26 11:13:25 +02:00
giovanism 7d1c8f8848 ceph: Duplicate rook's NetworkSpec
Signed-off-by: giovanism <giovanism@outlook.co.id>
2019-08-26 14:45:39 +07:00
Dmitry Yusupov 8412bf6b3c edgefs: Initial prototype
fix ApplyMultus

apply multus to target template spec too

Modify NetworkSpec for new proposal

Prevent duplicated multus network annotations

Rename Network "Interfaces" with "Selectors"

Signed-off-by: giovanism <giovanism@outlook.co.id>
2019-08-26 14:45:16 +07:00
David Vossel 17c260db99 Add cluster/olm/ceph/templates to gitignore
Signed-off-by: David Vossel <davidvossel@gmail.com>
2019-08-23 17:28:59 -04:00
David Vossel 59ea31c7e0 Include csi cephfs and rbd in CSV template
Signed-off-by: David Vossel <davidvossel@gmail.com>
2019-08-23 10:22:53 -04:00
Travis Nielsen b298a02fce Merge pull request #3067 from yard-turkey/bucket-provisioner
Bucket provisioner
2019-08-23 00:06:58 -06:00
Travis Nielsen 3abadd0571 Merge pull request #3649 from rohantmp/fencing
Design: ceph-openshift-fencing-mitigation
2019-08-22 21:47:55 -06:00
Travis Nielsen a2b01a02c0 Merge pull request #3672 from rohan47/crushmap_base
Added portable and failure-domain label to the OSD deployment
2019-08-22 21:43:50 -06:00
jiffin abe3678990 adding smoke test for bucket store
Signed-off-by: jiffin <thottanjiffin@gmail.com>
Signed-off-by: Jon Cope <jcope@redhat.com>
Signed-off-by: jeffvance <jeff.h.vance@gmail.com>
2019-08-22 19:54:44 -06:00
jeffvance 5db55e1cfd bucket design doc
Signed-off-by: jeffvance <jeff.h.vance@gmail.com>
2019-08-22 19:54:43 -06:00
c852e86fe9 ceph-rook object bucket provisioner
Signed-off-by: travisn <tnielsen@redhat.com>
Signed-off-by: jeffvance <jeff.h.vance@gmail.com>
Signed-off-by: Jon Cope <jcope@redhat.com>

Co-authored-by: Jon Cope <copejon@users.noreply.github.com>
Co-authored-by: Jeff Vance <jeff.h.vance@gmail.com>
2019-08-22 19:54:43 -06:00
rohan47 7307575637 Added portable and failure-domain label to the OSD deployment
Signed-off-by: rohan47 <rohgupta@redhat.com>
2019-08-23 01:49:14 +05:30
Sébastien Han b3f58863e9 Merge pull request #3600 from mvollman/bugfix-osdsPerDevice
ceph: fix osdsPerDevice config
2019-08-22 20:24:01 +02:00
Sébastien Han 3eff79fd94 Merge pull request #3346 from leseb/external-ceph
External Ceph cluster
2019-08-22 20:22:40 +02:00
Sébastien Han caa8b9cb2f ceph: external refuse cluster older than Nautilus
The external cluster must run at least on Nautilus. The main reason
being the msgr2 knowledge by the Operator and the Ceph CLI.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-08-22 17:19:33 +02:00
Sébastien Han 83eca4b7ae ceph: fix various debug messages
Debug was used instead of Debugf so types were not interpreted
correctly.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-08-22 17:19:33 +02:00
Sébastien Han f25e4a6fbc ceph: re-adapt controller code
Re-adapt controller code with the latest changes. Split External and not
external more accuratly in initializeCluster.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-08-22 17:19:33 +02:00
Sébastien Han 300e9c35e6 ceph: remove redundant call
saveMonConfig already calls WriteConnectionConfig so there is no need to
call WriteConnectionConfig again after saveMonConfig is done.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-08-22 17:19:33 +02:00
Sébastien Han 0785962e09 ceph: update mon configmap for external cluster
With this change, the admin can specify a single mon and the operator
will add any other mons to both ClusterInfo and the configmap of mon
endpoints.

It will periodically check for changes too and update both ClusterInfo
and the configmap accordingly.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-08-22 17:19:33 +02:00
Sébastien Han 18bf541c00 ceph: remove redundant debug log
GetMonStatus is called by checkHealth in health.go and is already
printing GetMonStatus's response so there is no need to print it twice.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-08-22 17:19:33 +02:00
Sébastien Han 2d24065ddb ceph: add check for external cluster spec
Before attempting to do anything let's just make sure the spec is
correctly fulfilled.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-08-22 17:19:33 +02:00
Sébastien Han 1c50b30e0e ceph: fix condition
If the secret is not found, we create it, but once it was created we
were actually returning an error. The failure for getting the config
secret must be if the error is not that the secret is not found.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-08-22 17:19:33 +02:00
Sébastien Han 25158d3d2b ceph: purge external cluster metadata
Add code to remove configmap and secret injected and used by Rook to
connect to the external cluster.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-08-22 17:19:33 +02:00
Sébastien Han c7174b6b8e ceph: allow deployment of crds on external cluster
We can now deploy all the other Rook's CRDs. They will be deployed in
Kubernetes but will consume the external cluster storage.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-08-22 17:19:33 +02:00