Commit Graph
7961 Commits
Author SHA1 Message Date
Satoru Takeuchi 417ea131bc ceph: judge whether an OSD is on PVC or not by function
There are many duplicated code to judge whether an OSD is on PVC
or not. Instead, let's introduce a function for this purpose.
It can also be applied to the logic of judging whether an OSD
on PVC has metadata device or not.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-05-07 00:49:17 +09:00
Travis Nielsen f82a07d441 Merge pull request #5394 from Madhu-1/csi-prio
CSI: Set PriorityClassName for CSI pods
2020-05-06 07:08:54 -06:00
Madhu Rajanna ec3ab55d94 CSI: Set PriorityClassName for CSI provisioner pods
provide an option to set PriorityclassName on the
CSI provisioner pods to avoid pod eviction, as the CSI provisioner
pods a critical in system for storage. the default value
for the CSI provisioner pods is set to system-cluster-critical.

provisioner pods are less priority than plugin pods.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-05-06 15:45:06 +05:30
Madhu Rajanna cc6ec58891 CSI: Set PriorityClassName for CSI plugin pods
provide an option to set Priorityclassname on the
CSI plugin pods to avoid pod eviction, as the CSI plugin pods are
critical in system for storage. the default value
for the CSI plugin pods is set to system-node-critical.
more info can be found at
https://kubernetes.io/docs/tasks/administer-cluster/guaranteed-scheduling-critical-addon-pods/

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-05-06 15:45:01 +05:30
Sébastien Han 7589573e0b Merge pull request #5405 from travisn/operator-setting-logging
Log the operator settings and their source
2020-05-06 11:27:04 +02:00
Sébastien Han cecbfcfba6 Merge pull request #5372 from leseb/obc-independent-mode
ceph: add support for OBC on external cluster
2020-05-06 10:30:15 +02:00
Sébastien Han 511f16ca70 Merge pull request #5401 from cybozu-go/cleanup-the-integration-test-and-remove-the-description-of-a-removed-feature
Cleanup the integration test and remove the description of a removed feature
2020-05-06 10:15:22 +02:00
RAJAT SINGH 9feb0287c5 Ceph: Newer mechanism to scale MDS for Nautilus+
ceph mds deactivate is not valid command for Nautilus, changing the mechnaism of upgrading so that it can be done in the way Nautilus does it.

Closes: https://github.com/rook/rook/issues/5278
Signed-off-by: RAJAT SINGH <rajasing@redhat.com>
2020-05-06 13:33:26 +05:30
Sébastien Han e342f7ea30 Merge pull request #5407 from chenxuc/patch-1
doc: correct the wordings
2020-05-06 09:30:23 +02:00
Chen, Xu Chun (Simon) a39d9a969e doc: correct wordings
correct wordings so that they pass grammar checkings and better understood by non-English native readers. Thanks!

Signed-off-by: XU CHUN CHEN <chenxuc@cn.ibm.com>
2020-05-06 11:21:21 +08:00
Travis Nielsen cd806c83ee ceph: log the operator settings and their source
The operator settings can come either from the configmap, an
env var, or a default value. Knowing where the setting is loaded
from is an important detail to see in the log.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-05 13:10:01 -06:00
Travis Nielsen 2d6fefbd5f Merge pull request #5395 from Madhu-1/csi-2.1.1
CSI: Update CSI version to v2.1.1
2020-05-05 11:25:49 -06:00
Sébastien Han bfb0501c14 Merge pull request #5403 from cybozu-go/ceph-fix-a-dead-link
ceph: fix dead links
2020-05-05 18:32:01 +02:00
Satoru Takeuchi aa7145e1ca ceph: fix dead links
Fix dead links in ceph document.

Closes: https://github.com/rook/rook/issues/5396

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-05-06 01:24:29 +09:00
Sébastien Han 775ed9532a Merge pull request #5398 from leseb/lvm-release
ceph: do not fail on deactivate
2020-05-05 18:09:24 +02:00
Satoru Takeuchi 22c5743656 cleanup: remove the descriptions of directory-based OSD
Directory-based OSD is not supported in v1.3.0 anymore. Let's remove
the descriptions of this feature. As an exception, it should still
be in the manifests of v1.2.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-05-06 00:44:31 +09:00
Satoru Takeuchi 5fc69b9e49 tests: add a note to the possibility of downgrading some deb packages
We should write down that kubeadm.sh may downgrade some deb packages.
Although it's clear that this script installs some K8s related packages,
downgrading packages are not so.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-05-05 23:17:43 +09:00
Satoru Takeuchi c0c0dc4ed9 tests: return bool if the functions are prefixed by "Is"
There are several functions that are prefixed by "Is" and return
just error. It's straightfoward to return bool to make the meaning
of these functions clearer.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-05-05 22:55:01 +09:00
Sébastien Han 65aae84bdd ceph: do not fail on deactivate
If we fail to release an LVM device, we should not fail the deployment.
We just print the error and let the backend handle the rest. Some
CSI backend will force detach the device anyway.
This prevents the deployment to get stuck in terminating.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-05-05 12:03:43 +02:00
Madhu Rajanna 73c74d8a42 CSI: Update CSI version to v2.1.1
cephcsi v2.1.1 is released with fix for xfs formatting
issue. This PR updates the cephcsi image version to
v2.1.1

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-05-05 13:08:23 +05:30
Sébastien Han 350abe8603 Merge pull request #5336 from mykaul/master
Images: allow building images using Podman.
2020-05-05 09:15:25 +02:00
Sébastien Han b86bb9c528 ceph: add support for OBC on external cluster
We can now consume an external s3 endpoint which is not managed by Rook.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-05-04 18:14:26 +02:00
Sébastien Han c2079483a4 Merge pull request #5354 from HaichaoLii/mem
tests: Fix ProbeDevices function unit test failure
2020-05-04 15:58:56 +02:00
Sébastien Han 4017aa8de5 Merge pull request #5390 from leseb/rm-old-cr-rbd
ceph: remove leftover rbd mirror in cluster.yaml
2020-05-04 14:07:05 +02:00
Sébastien Han 656240831c ceph: remove leftover rbd mirror in cluster.yaml
Since the rbd mirror has been extracted to its own CR, it does not exist
in cluster.yaml anymore.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-05-04 13:55:58 +02:00
Juan Miguel Olmo Martínez 4b492e6f39 ceph: manager integration tests
Ceph orchestrator device ls
Ceph orchestrator status
Ceph orchestrator host ls
Ceph orchestrator create OSD
Ceph orchestrator ls

[test ceph]

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2020-05-04 11:32:56 +02:00
Travis Nielsen 8cdc3c103b Merge pull request #5376 from travisn/restart-osd-if-stuck
Restart portable osd pod if stuck
2020-05-01 08:39:03 -06:00
Travis Nielsen c713fd30f9 ceph: restart portable osd pod if stuck
If the OSD pod is portable and is on a failed node, the node
will be stuck indefinitely in the terminating state. The pod
can be force deleted in this scenario in order to allow the
underlying volume to be detached and then mounted on another
node.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-30 09:52:54 -06:00
Sébastien Han 1ea73ce123 Merge pull request #5364 from Madhu-1/err-cleaup
cleanup: use err.Wrap when the formatting is not required
2020-04-30 15:57:27 +02:00
Dmitry Yusupov 6e5a6c4542 Merge pull request #5370 from dyusupov/master
edgefs: raw disk empty check regression fix
2020-04-29 14:10:16 -07:00
Dmitry Yusupov e88704120b edgefs: raw disk empty check regression fix
Signed-off-by: Dmitry Yusupov <dmitry.yusupov@nexenta.com>
2020-04-29 11:48:09 -07:00
Dmitry Yusupov 9b6c1ede66 Merge pull request #5360 from dyusupov/master
edgefs: provide a way to configure ADS
2020-04-29 09:27:56 -07:00
Travis Nielsen f8e884d2ce Merge pull request #5287 from Madhu-1/resource-limit-csi
CSI: Add resource request and limit for CSI pods
2020-04-29 08:09:19 -06:00
Madhu Rajanna 81688398f2 cleanup: use err.Wrap when the formatting is not required
Replaced err.Wrapf with err.Wrap when the formatting
is not required.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-04-29 17:42:59 +05:30
Sébastien Han f90b14f9dc Merge pull request #5349 from jbw976/new-email-lists
docs: update rook mailing lists to new lists.cncf.io addresses
2020-04-29 08:54:11 +02:00
Madhu Rajanna 4065217913 CSI: use warning if the formatting is not required
If the formatting is not required use warning
instead of warningf

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-04-29 10:26:56 +05:30
Madhu Rajanna 4495d1fffd CSI: Add helm documentation for CSI resource
Updated helm documentation for CSI resources
which will be applied for CSI sidecar and plugin
containers.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-04-29 10:26:56 +05:30
Madhu Rajanna a3823c9467 CSI: Add helm template changes for CSI resource
Added template changes in helm chart for the
CSI resource. All resources limits will not
be applied default.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-04-29 10:26:56 +05:30
Madhu Rajanna 8bb7df8374 CSI: Update operator template for CSI resource
Updated operator and operator-openshift yaml files
for the CSI resouce requirements.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-04-29 10:26:56 +05:30
Madhu Rajanna a0270c57ea CSI: rename attacher sidecar name to follow other sidecar names
Renamed the csi attacher sidecar container name
to follow the nameing convention of other
sidecar containers of the CSI

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-04-29 10:26:56 +05:30
Madhu Rajanna 050fb2c616 CSI: code changes to apply resource to container
Update CSI spec code to fetch the resources from the
configmap or ENV and apply the specific resources
to the cephfs,rbd and kubernetes sidecar containers.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-04-29 10:26:51 +05:30
Dmitry Yusupov 2746b2edee edgefs: provide a way to configure ADS
Signed-off-by: Dmitry Yusupov <dmitry.yusupov@nexenta.com>
2020-04-28 14:58:40 -07:00
Sébastien Han bb3c6bdf47 Merge pull request #5343 from travisn/enable-pg-autoscaler
Enable pg_autoscaler module in default examples
2020-04-28 19:01:39 +02:00
Jared Watts 6e3921adfa docs: update rook mailing lists to new lists.cncf.io addresses
This commit updates the readme and docs with the new Rook mailing lists hosted
by the CNCF:

* cncf-rook-info@lists.cncf.io
* cncf-rook-security@lists.cncf.io
* cncf-rook-distributors-announce@lists.cncf.io

Signed-off-by: Jared Watts <jbw976@gmail.com>
2020-04-28 07:42:00 -07:00
Sébastien Han 95a705a64c Merge pull request #5319 from leseb/ceph-cluster-cr-controller-runtime
ceph: convert the CephCluster controller to the controller-runtime
2020-04-28 12:34:48 +02:00
Haichao Li c0a7297931 tests: Fix ProbeDevices function unit test failure
During the sgdisk command test, there was no output assignment,
causing uuid not found for device /dev/testa. Follow the log.

2020-04-27 18:24:21.921337 I | rook-discover: RUN Command lsblk
  [--all --noheadings --list --output KNAME]
2020-04-27 18:24:21.921491 I | rook-discover: RUN Command lsblk
[/dev/testa --bytes --nodeps --pairs --paths --output SIZE,ROTA,
RO,TYPE,PKNAME,NAME]
2020-04-27 18:24:21.921549 I | rook-discover: RUN Command sgdisk
[--print /dev/testa]
2020-04-27 18:24:21.921576 W | inventory: skipping device "testa"
because 'lsblk' failed. uuid not found for device /dev/testa. output=
2020-04-27 18:24:21.921592 I | rook-discover: localdevices: []
2020-04-27 18:24:21.921598 I | rook-discover: available devices: []
--- FAIL: TestProbeDevices (0.00s)
    discover_test.go:95:
                Error Trace:    discover_test.go:95
                Error:          Not equal:
                                expected: 1
                                actual  : 0
                Test:           TestProbeDevices
panic: runtime error: index out of range [0] with length 0 [recovered]
        panic: runtime error: index out of range [0] with length 0
FAIL    github.com/rook/rook/pkg/daemon/discover        0.050s

Signed-off-by: Haichao Li <haichao.li@arm.com>
2020-04-28 17:51:22 +08:00
Madhu Rajanna 1bb5e1bab2 k8sUtil: Add YamlToContainerResource to resource
YamlToContainerResource can be used to convert the raw
string data to the array of ContainerResource.
the ContainerResource can be applied to the
pod container resources request and limits.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-04-28 13:13:31 +05:30
Sébastien Han f27fd207ce ceph: convert the CephCluster controller to the controller-runtime
This is the final conversion to controller-runtime conversion. This time the
CephCluster CRD has been converted to use the controller-runtime
library.
The controller incorporates all the previous watchers too, so the Node
and hot-plug configmap are been watched too.
Only the operator setting configmap is not being watcher since it's not
related to the CephCluster CRD.
Not only the patch converts to controller-runtime but also tries to
re-organize the tree of the repo to actually make the code more
readable and have better functions/methods/tests separations.

Closes: https://github.com/rook/rook/issues/4939
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-04-28 09:40:35 +02:00
Yaniv Kaul 277f4d75b7 Images: allow building images using Podman.
Automatically detect Podman if Docker is not available.
This allows me to run make and complete it succesfully without Docker
and without the need to set the DOCKERCMD env. variable.

Closes: https://github.com/rook/rook/issues/5335
Signed-off-by: Yaniv Kaul <ykaul@redhat.com>
2020-04-28 09:39:39 +03:00
Travis Nielsen d9ee447549 ceph: enable pg_autoscaler module in default examples
The pg_autoscaler is enabled by default in octopus. In nautilus
it was a new feature and was not enabled by default for that reason.
Now that the pg_autoscaler is more stable and is essentially
the same as the autoscaler in octopus, we can enable it by default.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-27 16:17:30 -06:00