Commit Graph
2918 Commits
Author SHA1 Message Date
Travis Nielsen f2c49ea034 Merge pull request #3165 from d-luu/resource_comparer
ceph: added comparer for resource quantity when checking cluster changes
2019-06-07 11:15:33 -07:00
Alexander Trost aff2874f17 Merge pull request #3276 from leseb/fix-doc
doc: fix patch command
2019-06-07 19:49:56 +02:00
Travis Nielsen 40ea3e65a2 Merge pull request #3274 from dyusupov/master
Enable proper usage of metadataOnly property
2019-06-07 10:45:03 -07:00
Travis Nielsen d73ff85b51 Merge pull request #3257 from leseb/retry-version-detect
ceph: retry on detecting ceph version
2019-06-07 09:44:26 -07:00
Sébastien Han e0584f344d doc: fix patch command
The command had the namespace twice, remove the typo and used a working
command.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-06-07 18:16:10 +02:00
Sébastien Han 6438d9907e ceph: retry on detecting ceph version
Sometime the kube engine needs a bit of time to return the logs of a
given job and fails to read the stream.
Retrying up to detect the Ceph version seems reasonnable to
overcome this issue.

Fixes: https://github.com/rook/rook/issues/3227
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-06-07 18:13:38 +02:00
Travis Nielsen 6d1ccadd4b Merge pull request #3256 from noahdesu/device-hotplug-update
discover: handle false-positives observed by users
2019-06-07 08:55:00 -07:00
Travis Nielsen c0276802f5 Merge pull request #2564 from travisn/toplevel-fsgroup
Set fsgroup on the top level of the mount
2019-06-07 08:53:59 -07:00
Noah Watkins 3966f163ed discover: handle false-positives observed by users
the only exception to a naive device list comparison had been to ignore
drive UUID information which was unreliable when a device wasn't
formatted / partitioned. however various users have reported different
type of false positives that resulted in orchestration being run
continuously due to the wrong observation that devices were changing.

this patch fixes the cases we have observed and attempts to be slightly
more conservative in the calculation.

1. the devlinks is ignored. when a device is setup for lvm, for example,
the devlinks will be updated with different paths that point to the
device in addition to its standard paths addressable by pci address.

2. in the lvm case, the "model" field and "filesystem" field may also
change.

3. we ignore devices with devlinks that contain "usb" to avoid issues
when using usb drives.

4. be smart about detecting device availability. if a device transitions
from a non-empty (or has-partitions) state to an empty (or unpartitioned)
state then orchestration is triggered. this like observing that a device
is now available (e.g. in the allDevices case). however, when a device
transistions from empty to non-empty, then this is ignored as while it
is a change, it's generally a change associated with the new consumption
of the device.

fixes: #3059
fixes: #3185
fixes: #3131

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2019-06-07 08:22:08 -07:00
Travis Nielsen 8cf5d540a4 Merge pull request #3258 from leseb/doc-resource-limit
Doc resource limit
2019-06-07 07:52:15 -07:00
Sébastien Han 62b69d08e5 ceph: add missing documentation for resource limits
This commit documents the minimum amount of memory accepted by Rook to
 run Ceph pods properly.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-06-07 15:06:16 +02:00
Sébastien Han d3c8d5612b ceph: add resource limit check for rbdmirror
The memory check was missing and will be trigger if resources limit are
configured for the rbdmirror pod.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-06-07 15:06:16 +02:00
Sébastien Han 24abbddf14 ceph: fix pod memory check
This commit fixes the second test case where limit and request are
either identical or different but still we use limit as a value.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-06-07 15:06:16 +02:00
Dmitry Yusupov 41d92cee3e enable proper values for metadataOnly property
Signed-off-by: Dmitry Yusupov <dmitry.yusupov@nexenta.com>
2019-06-06 21:12:04 -07:00
travisn fd341ae928 ceph: set the fsgroup only on the top level of the mount
If setting the fsgroup recursively on a shared filesystem mount is
not desirable, the fsgroup capability on the flex driver
should first be disabled in the operator env vars. Now the driver
will apply the fsgroup only at the top level instead of
recursively for the entire shared filesystem.

Signed-off-by: travisn <tnielsen@redhat.com>
2019-06-06 17:17:29 -07:00
DL186038 d22886da37 ceph: added resource quantity comparer when checking cluster changes
the resource struct has non-exportable fields which panics when
doing the diff comparison

Signed-off-by: d-luu <david@davidluu.info>
2019-06-06 15:39:50 -05:00
Travis Nielsen fb22976750 Merge pull request #3226 from rohan47/fix_dump_pgs_brief
fixed ceph pg dump pgs_brief json deserialization
2019-06-06 14:33:15 -06:00
Travis Nielsen 813188ba20 Merge pull request #3269 from phlogistonjohn/jjm-csi-remove-whitespace
Whitespace cleanups in ceph csi yaml files
2019-06-06 14:07:13 -06:00
John Mulligan 642874fff0 ceph csi: whitespace cleanups in example file
Remove various excess white space from ceph csi storageclass example.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2019-06-06 13:17:10 -04:00
John Mulligan 0138cd23f8 ceph csi: whitespace cleanups in template files
Remove various excess white space from ceph csi template files.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2019-06-06 13:10:02 -04:00
rohan47 a380ca7dc1 fixed ceph pg dump pgs_brief json deserialization
Signed-off-by: rohan47 <rohgupta@redhat.com>
2019-06-06 21:54:37 +05:30
Travis Nielsen a7df349f0c Merge pull request #3231 from shtripat/prom-rule-master
Added latest prometheus alerting rules for ceph
2019-06-06 10:05:54 -06:00
Travis Nielsen d5523086b6 Merge pull request #3265 from leseb/rgw-liveness
ceph: rgw add liveness probe check
2019-06-06 10:05:27 -06:00
Shubhendu 577728bb03 Added latest prometheus alerting rules for ceph
New rules added:
- CephMgrIsAbsent
- CephMgrIsMissingReplicas
- CephMdsMissingReplicas
- CephMonHighNumberOfLeaderChanges
- CephOSDVersionMismatch
- CephMonVersionMismatch

Signed-off-by: Shubhendu <shtripat@redhat.com>
2019-06-06 10:04:45 +05:30
Travis Nielsen 298dc100c7 Merge pull request #3262 from noahdesu/log-recovered-osd
ceph: log osd recovery at info level
2019-06-05 08:14:41 -06:00
Travis Nielsen 27556870a1 Merge pull request #3261 from sp98/multi-cluster-osd-failure
use ceph fsid to filter ceph volume OSDs
2019-06-05 08:14:16 -06:00
Sébastien Han 241296be8a ceph: rgw add liveness probe check
We now check if the pod responds on http port 80.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-06-05 14:35:15 +02:00
Santosh Pillai ec2e6ea888 use ceph fsid to filter ceph volume OSDs
- Updated getCephVolumeOSDs method to use fsid filter while retriving devices.
- This solves "failed to fetch mon config (--no-mon-config to skip)" error when multiple ceph clusters are running on same Node

Signed-off-by: Santosh Pillai <sapillai@redhat.com>
2019-06-05 12:05:56 +05:30
Noah Watkins 71c88ae9e9 ceph: log osd recovery at info level
for the osd recovery case (DOWN->UP) log at a matching log level as the
message indicating the OSD went down.

fixes: #2904

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2019-06-04 13:57:49 -07:00
Travis Nielsen cea5fd8676 Merge pull request #3240 from invidian/nit
Fix inconsistency regarding csv-ceph Makefile target
2019-06-03 07:42:22 -06:00
Travis Nielsen 37fecf5f62 Merge pull request #3241 from invidian/generate-rook-csv-fix
generate-rook-csv.sh: fix DEFAULT_CSV_FILE_NAME
2019-06-03 07:39:14 -06:00
Travis Nielsen c4b9acae8c Merge pull request #3251 from rhcs-dashboard/ceph-dashboard-load-balancer
ceph: update dashboard section
2019-06-01 09:29:15 -06:00
Travis Nielsen b7c29ed3ec Merge pull request #3244 from travisn/osd-creation-doc
Ceph Quickstart Doc to specify test configuration for OSDs
2019-06-01 00:19:44 -06:00
travisn 346f2c9fd4 ceph docs: quickstart uses the test configuration for a single osd
Since the default OSD is no longer created under dataDirHostPath,
the most common issue in the 1.0 release is that users don't have OSD
created in the cluster. Now the quickstart doc will guide users to
create a test cluster to get them going with a filestore OSD in
a directory, with clear guidance that this is not expected in production

Signed-off-by: travisn <tnielsen@redhat.com>
2019-06-01 00:06:42 -06:00
alfonsomthd 06f0602a29 ceph: update dashboard section
* Updated dashboard image: Nautilus.
* Added LoadBalancer method to access dashboard.
* Added LB example: dashboard-loadbalancer.yaml

Signed-off-by: alfonsomthd <almartin@redhat.com>
2019-05-31 17:29:54 +02:00
Travis Nielsen 5162088497 Merge pull request #3250 from invidian/nit2
ceph/operator.yaml: fix alignment and add newline
2019-05-31 08:26:58 -06:00
Mateusz Gozdek 0daca0e647 cluster/olm/ceph/README.md: fix inconsistent references to Makefile target
0fc3775b99 added csv-ceph target to Makefile,
but README.md refers to non-existent 'csv' target. This comment aligns
it.

Signed-off-by: Mateusz Gozdek <mgozdekof@gmail.com>
2019-05-31 11:13:50 +02:00
Mateusz Gozdek 81628fb0cf Makefile: fix targets list
0fc3775b99 added csv-ceph target to Makefile, but
'csv' target to the description.

Signed-off-by: Mateusz Gozdek <mgozdekof@gmail.com>
2019-05-31 11:09:23 +02:00
Mateusz Gozdek fcba12a402 generate-rook-csv.sh: fix printed examples
0fc3775b99 added new Makefile target
'csv-ceph', but printed examples refers to non-existing target 'csv'.

This commit fixes this inconsistency.

Signed-off-by: Mateusz Gozdek <mgozdekof@gmail.com>
2019-05-31 11:08:36 +02:00
Mateusz Gozdek 04c70bfe3f ceph/operator.yaml: fix alignment and add newline
This commit fixes misaligned example values in operator.yaml and adds a
newline at the end of the file, which is considered a good practice.

Signed-off-by: Mateusz Gozdek <mgozdekof@gmail.com>
2019-05-31 11:02:48 +02:00
Travis Nielsen a23f7ab9ff Merge pull request #3248 from laverya/fix-ceph-upgrade-0.9-docs-link
docs: fix ceph upgrade 0.8->0.9 docs link
2019-05-30 19:11:24 -06:00
Andrew Lavery b9e71351b9 docs: fix ceph upgrade 0.8->0.9 docs link
version 0.9 of the upgrade doc is located at ceph-upgrade.html not upgrade.html

Signed-off-by: Andrew Lavery <laverya@umich.edu>
2019-05-30 15:32:51 -07:00
Mateusz Gozdek d2c7acd0ff generate-rook-csv.sh: fix DEFAULT_CSV_FILE_NAME
With operator-sdk version 0.8.1, default csv file is created with following message:
'INFO[0000] Created deploy/olm-catalog/ceph/1.0.1/ceph.v1.0.1.clusterserviceversion.yaml'

Without this patch, `mv` in the script fails, as default file does not
exist.

Signed-off-by: Mateusz Gozdek <mgozdekof@gmail.com>
2019-05-30 19:12:12 +02:00
Travis Nielsen 1daa70f79c Merge pull request #3085 from christianhuening/feat-2271
added Liveness Probe to Ceph Mgr
2019-05-28 17:26:12 -06:00
Travis Nielsen 30d7010f70 Merge pull request #3134 from Madhu-1/fix-2987
add attacher container to cephfs CSI provisioner
2019-05-28 17:25:36 -06:00
Travis Nielsen 3d71237c56 Merge pull request #3209 from kshlm/fix-minikube-script
tests/scripts: Fix minikube script
2019-05-23 23:22:12 +02:00
Travis Nielsen 9fc6bc968a Merge pull request #3212 from kragniz/slack-readme-link
readme: fix slack link
2019-05-23 23:05:42 +02:00
Louis Taylor 9a19b2f00c readme: fix slack link
Signed-off-by: Louis Taylor <louis@kragniz.eu>
2019-05-22 13:51:44 +01:00
Kaushal M 16506e4f7a tests/scripts: Fix minikube script
Default to virtualbox driver. `minikube config get vm-driver` does not
work when default is used.

Fixes #3208.

Signed-off-by: Kaushal M <kshlmster@gmail.com>
2019-05-22 13:43:57 +05:30
Alexander Trost 88013858bd Merge pull request #3199 from galexrt/fix_k8s-multi-node-test-script
tests: fix git describe repo path in k8s-vagrant-multi-node script
2019-05-19 22:40:33 +02:00