Commit Graph
2672 Commits
Author SHA1 Message Date
Travis Nielsen b7622d0fe5 Merge pull request #2921 from leseb/log-to-file
Log to file
2019-04-16 06:56:44 -06:00
Travis Nielsen 6af3c4bd8c Merge pull request #2942 from karmab/ocp4
set correct flexvolume dir for openshift4
2019-04-15 21:28:50 -06:00
Sébastien Han 4438672e47 ceph: expose ceph version to osd pod
We must expose the ceph version to the osd pod so that we can generate
the proper ceph configuration file. If we don't do this all the version
check will assume they run the opposite of the desired version and the
formatting of the `ceph.conf` will be wrong.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-04-15 15:57:23 +02:00
Sébastien Han 6b84fee2ab ceph: add a CephVersionFormatted so we can consume it
Let's return the expected pattern so that can be consumed by
ExtractCephVersion later. We don't modify the built-in String() so we
can more easily remove that once we switch the osd to be configured from
the operator.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-04-15 10:52:06 +02:00
Sébastien Han b8874d7f3f ceph: allow logging control
We now run all the daemon with a new option from Nautilus 14.2.1 which
allows us to tell to a daemon to not log on file. However, we can decide
to activate logging by editing the configuration flag 'log_to_file' via
the centralized config store like this for a particular daemon:

ceph config set mon.a log_to_file true

This is useful when a daemon keeps crashing and we want to collect log
files on the system.

Fixes: https://github.com/rook/rook/issues/2881
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-04-15 10:52:03 +02:00
Sébastien Han d4c48bb293 ceph: expose /var/log/ceph to the host
It's quite convinient to expose /var/log/ceph so that we can decide to
activate logs locally on the machine and see what's going on.
This is only a placeholder when a daemon is stuck crashlooping and we
want to allow administrator to gather log files.
We still do not log on file but this can be activated via a config
option passed to the centralized config option store.

For some daemons, which typically do not store any data (rgw, rbd-mirror
and mds) we had to propagate dataDirHostPath from the cluster spec to
each creation call so that the bindmount can happen.

Fixes: https://github.com/rook/rook/issues/2881
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-04-15 10:47:09 +02:00
Sébastien Han 4627b66636 ceph: expose clusterInfo to the osd code
When instanciating an osd, we now pass clusterInfo which basically
represents a collection of information about a particular Ceph cluster. Rook uses information
// about the cluster to configure daemons to connect to the desired cluster.

From clusterInfo, we use the CephVersion which helps us putting
conditions for our code execution.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-04-15 10:47:09 +02:00
Alexander Trost 30589000e3 Merge pull request #2976 from galexrt/clustername_param
rookflex: Use `clusterName` if available for backwards compatibility
2019-04-13 17:56:05 +02:00
Travis Nielsen b1b77d84d6 Merge pull request #2971 from SUSE/ceph-pods-add-rook-version-label
ceph: add 'rook-version' label to controllers
2019-04-12 15:44:25 -06:00
Blaine Gardner 685a8df08d ceph: add 'rook-version' label to controllers
Add a `rook-version` label to all controller resources used by Ceph:
deployments, daemonsets, and jobs. Labels are added to controller
resources only and not to the pod templates within because changing pod
templates causes updates due to the label change. The controller
resources themselves are not updated with the label addition and
therefore don't cause an unnecessary upgrade.

Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2019-04-12 13:56:31 -06:00
Travis Nielsen c6b6c859e1 Merge pull request #2842 from ajarr/fix-2841
ceph filesytem: use `fs fail` to bring down filesystem
2019-04-12 13:48:39 -06:00
Alexander Trost 85fa159038 rookflex: Use clusterName if available for backwards compatibility
This fixes issues for users trying to delete volumes and failing because
they only have `clusterNames` set on them in Rook earlier v0.8.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2019-04-12 21:26:16 +02:00
Ramana Raja 7800d33171 ceph filesytem: use fs fail to bring down filesystem
A ceph filesystem was brought down by marking the filesystem
as down and individually failing the MDSes. From nautilus onwards,
this could be more simply and efficiently done by using
`fs fail` command. See,
https://github.com/ceph/ceph/commit/4c49f165ec1

Resolves: #2841

Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-04-12 20:42:48 +05:30
Ramana Raja bd77c609d7 ceph filesystem: correct log message
Downing filesystem is incorrectly logged as removing filesystem.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-04-12 20:42:48 +05:30
Alexander Trost 5007f9c6c7 Merge pull request #2814 from galexrt/fix_2731
Update all operators to use apps/v1
2019-04-12 15:02:58 +02:00
Alexander Trost 8bc26d9096 k8sclient: Update all operators to use apps/v1
All usages of k8s go client are now also using the versioned `AppsV1() `
call for the client.

Updated MySQL and Wordpress, and Kube Registy examples to use apps/v1
Deployments.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2019-04-12 09:25:42 +02:00
Travis Nielsen 65c0fd878f Merge pull request #2962 from noahdesu/ceph-crypto-link
ceph: add link to ceph docs on encryption details
2019-04-11 12:34:53 -06:00
Travis Nielsen 8f3d62e56b Merge pull request #2936 from SUSE/cautious-osd-node-removal
ceph: remove osd host nodes only when certain
2019-04-11 12:34:24 -06:00
Noah Watkins 21d6c90ed7 ceph: add link to ceph docs on encryption details
fixes: #2926

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2019-04-11 10:50:22 -07:00
Blaine Gardner a80082988d ceph: remove osds only when certain
Make the Ceph operator more cautious about when it decides to remove
nodes from the Rook-Ceph cluster which are acting as osd hosts.

When `useAllNodes` is set to `true` we assume that the user wants to
have the most hands-off experience. Node removals are allowed when a
node is delted from Kubernetes and when a node has its taints/affinities
modified by the user (but not by automatic k8s modification as much as
possible).

When `useAllnodes` is set to `false` the only time a node is removed is
if it is removed from the Ceph cluster definition.

Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2019-04-11 09:41:54 -06:00
Travis Nielsen d3e681bb63 Merge pull request #2864 from SUSE/SH_#2858
prevent multiple orchestrations at the same time
2019-04-11 09:24:54 -06:00
Travis Nielsen bdbf744f08 Merge pull request #2964 from Madhu-1/fix-csi-doc
remove manual namespace creation from doc
2019-04-11 09:09:32 -06:00
Madhu Rajanna 149ace57e6 remove manual namespace creation from doc
need to remove the manual namespace creation from
the doc because it will be created as part of
common.yaml deployment.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-04-11 14:32:07 +05:30
Stefan Haas badd3bc165 ceph: Prevent multiple orchestrations at the same time. Fixes #2858
Signed-off-by: Stefan Haas <shaas@suse.com>
2019-04-11 08:57:20 +02:00
Travis Nielsen f52df1aafd Merge pull request #2934 from Madhu-1/csi-doc-update
update ceph-csi rbd snapshot document
2019-04-10 17:28:15 -06:00
Travis Nielsen 38be11936c Merge pull request #2859 from phlogistonjohn/jjm-csi-simplify-1
Simplify Ceph CSI setup
2019-04-10 17:23:41 -06:00
Travis Nielsen 1113688aa8 Merge pull request #2952 from dyusupov/master
support for configurable trlog settings
2019-04-10 17:18:47 -06:00
Travis Nielsen 5a2bc901fe Merge pull request #2938 from travisn/save-cluster-health
Add ceph health info to the cephcluster custom resource
2019-04-10 17:18:19 -06:00
John Mulligan d46190357a doc: minor csi doc fix
When testing my changes I couldn't successfully deploy without also
creating the contents of common.yaml first.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2019-04-10 17:53:28 -04:00
John Mulligan c0f5557d47 docs: remove instructions for manual ceph csi config maps
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2019-04-10 17:53:28 -04:00
John Mulligan f6c15bfb5a ceph csi: include required templates in image
Include the mandatory template files in the rook ceph image
so that the user-driven configuration for CSI and flex do not
need to differ in this aspect.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2019-04-10 17:53:28 -04:00
John Mulligan 7ee207b0fb ceph csi: tweak options handling around enabling csi
Simplify one function and improve option wording.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2019-04-10 17:53:28 -04:00
travisn 5ebb651e37 ceph: update the cephcluster custom resource with ceph health
The CephCluster resource will now expose the health of the ceph cluster
so admins can query the status with k8s api or kubectl instead of
needing to run the rook toolbox. The operator will query the
ceph status periodically and update the status in the custom resource.

Signed-off-by: travisn <tnielsen@redhat.com>
2019-04-10 14:41:18 -06:00
Travis Nielsen 37c7aa35d3 Merge pull request #2961 from ktdreyer/ceph-image-comment
images: remove comment about ceph mimic image
2019-04-10 14:16:57 -06:00
Blaine Gardner 9c0369f264 k8sutil: extract granular node validity functions
Node validity is not always as simple as a true/false. Refactor each
validity test into its own function for operators that wish to check
validity more granularly. Ceph will use these changes.

Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2019-04-10 12:43:43 -06:00
Ken Dreyer a92714b348 images: remove comment about ceph mimic image
Commit 91cc62676d changed our base ceph
version from Mimic to Nautilus.

Update the comment in the Dockerfile to reflect this change.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2019-04-10 11:55:43 -06:00
Madhu Rajanna b5001ebfa7 update ceph-csi rbd snapshot document
The current document is too old and it has
a reference to the master branch(earlier
master branch referred to csi-v0.3.0).
This PR updated the snapshot document
wrt to the changes required for csi-v1.0.0

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-04-10 20:30:41 +05:30
Travis Nielsen e0d3ffdceb Merge pull request #2839 from Madhu-1/fix-drivername
Fix driver name in ceph csi driver
2019-04-10 08:51:06 -06:00
Madhu Rajanna d9dd81396c remove attacher statefulset for rbd csi driver
deploy attacher as a container inside  rbd provisioner
stateful set

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-04-10 18:27:08 +05:30
Travis Nielsen 2ca611a1bd Merge pull request #2940 from travisn/nautilus-support
Add nautilus to the list of supported Ceph versions
2019-04-09 21:53:14 -06:00
Dmitry Yusupov e1f61219b4 support for configurable trlog settings
Signed-off-by: Dmitry Yusupov <dmitry.yusupov@nexenta.com>
2019-04-09 15:20:18 -07:00
Blaine Gardner f126887b52 tests: add T/F/Unk. status to node ready condition
Rook previously relied on the presence of `Ready` to determine if a node
is ready, but `Ready` can have different statuses. Correct this.

https://kubernetes.io/docs/concepts/architecture/nodes/#condition

Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2019-04-09 15:40:37 -06:00
Jared Watts fa11c4b4d7 Merge pull request #2836 from SUSE/roadmap-update
Roadmap: update for recent v1.0 triage
2019-04-09 11:10:20 -07:00
Madhu Rajanna 38527239c4 simplify socker directory name inside container
socket directory name need not follow
the driver name format,renamed socket directory
to simple names.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-04-09 16:08:56 +05:30
Madhu Rajanna d99527382d replace fmt.Errorf with errors.New
if error formatting is not required
we can we errors.New()

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-04-09 15:48:16 +05:30
Madhu Rajanna 6461d4866f update driver name as per CSI spec
as per CSI spec,The driver name MUST follow
domain name notation format (https://tools.ietf.org/html/rfc1035#section-2.3.1).

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-04-09 15:48:16 +05:30
Travis Nielsen 1d98c47315 Merge pull request #2931 from sabbot/integration-test
Edgefs: Integration tests for EdgeFS
2019-04-08 20:01:40 -06:00
Travis Nielsen b15391819b Merge pull request #2910 from SUSE/mon-port-upgrade-fix-2854
ceph: fix for masked upgrade failures and getting integrations running again
2019-04-08 17:11:32 -06:00
Blaine Gardner e26c908f59 roadmap: update for latest 1.0 triage
Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2019-04-08 14:51:20 -06:00
karmab b6fd399f02 Set correct flexvolume dir for openshift4
We make sure to use the correct path for opc4 install

Signed-off-by: karmab <karimboumedhel@gmail.com>
2019-04-08 18:55:15 +02:00