Commit Graph
7961 Commits
Author SHA1 Message Date
Satoru Takeuchi 206e45facd ceph: fix the wrong condition in the cluster health check
There are the following problems in the cluster health check.

- If the cluster is healthy: Unnecessary long time before exiting from
  the health check loop. The test succeeds thanks to the succeeding
  assertion by luck.
- If the cluster is unhealthy: Exit from the health check loop immediately.
  The test fails in the succeeding assertion by luck too.

It's a regression that is introduced in the following commit.
https://github.com/rook/rook/commit/c0c0dc4ed977a6b373b1884c5b76c9588f0be077

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-05-27 05:20:24 +09:00
Sébastien Han 1d61812f37 Merge pull request #5548 from leseb/crash-perm
ceph: add missing security context to crash collector
2020-05-26 18:45:07 +02:00
Adam Kraitman 1731f9cb25 build: Enabling buildDiscarder
Enabling buildDiscarder which keeps only the newest 200 builds

Signed-off-by: Adam Kraitman <akraitma@redhat.com>
2020-05-26 17:43:15 +03:00
Sébastien Han 0ed8e73942 ceph: add missing security context to crash collector
The crash collector was missing the security context to properly run on
OCP, thus crashing when trying to post a crash dump.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-05-26 16:35:11 +02:00
Ahmad Nurus S 714d654ec4 design: rename nfs object kind
This commit rename nfs object kind with actually implemented name `NFSServer`
instead of `NetworkFileSystem`. This commit also fix some bad url.

Signed-off-by: Ahmad Nurus S <prksu.sh@gmail.com>
2020-05-25 23:31:28 +07:00
Sébastien Han 3ffda5645a Merge pull request #5518 from aruniiird/fixGenCSVScript
Ceph: A minor fix to 'generate-rook-csv.sh' script
2020-05-25 10:24:19 +02:00
binoue a86b060849 ceph: update helm version
Currently, Helm v2.5.1 is used, but this version is released in 2017
and a little outdated.
To use the latest version of helm v2.x.x would be beneficial
as we can use more useful Helm commands like `helm template`.

This commit updates Helm version and stop using `helm lint`
with `--strict` option because Helm v2.16.7 does not allow
to use undefined values in values.yaml and
the Helm upstream is now stopping using the `--strict` option.

Signed-off-by: binoue <banji-inoue@cybozu.co.jp>
2020-05-24 16:48:05 +09:00
Arun Kumar Mohan bb770bb0d1 Ceph: A minor fix to 'generate-rook-csv.sh' script
A square bracket check on <shell_command> return status
will not work in an 'if' condition.

Signed-off-by: Arun Kumar Mohan <arun.iiird@gmail.com>
2020-05-23 23:36:37 +05:30
Ryan Thompson 36db509747 cassandra: Adds json struct tags to fix cassandra annotations
x ClusterSpec
x RackSpec

The lack of the json tag required manifests to use 'Annotations' rather than 'annotations' to propogate annotations to the stateful set pods. This change will allow the software to function as documented.

Closes: https://github.com/rook/rook/issues/5097
Signed-off-by: Ryan Thompson <ryan@zengyant.com>
2020-05-22 22:26:50 -07:00
Sébastien Han 643a2aff27 Merge pull request #5531 from leseb/mergify-highlight
mergify: ping user if PR has conflicts
2020-05-22 17:18:43 +02:00
Sébastien Han 67a8959e0a mergify: ping user if PR has conflicts
That rule posts a comment as soon as a pull request is in conflict, notifying the pull request author that they need to intervene!

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-05-22 16:49:08 +02:00
Sébastien Han 3dfe08cb9f Merge pull request #5529 from leseb/rm-osd-memory-target
ceph: do not enforce osd-memory-target
2020-05-22 12:38:04 +02:00
Sébastien Han 062e58e053 ceph: do not enforce osd-memory-target
As of Nautilus Ceph auto-tunes its osd_memory_target on the fly so we don't need to force it.
ROok does not support Mimic anymore so this can be removed.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-05-22 11:09:02 +02:00
Travis Nielsen f8256f8f01 Merge pull request #5524 from travisn/data-name-default
ceph: default the device set template name to data
2020-05-21 13:53:00 -06:00
Travis Nielsen 8bb4f603e6 ceph: default the device set template name to data
In 1.3 we added support for the metadata pvcs, thus requiring the name
to be set on the templates to differentiate between data and metadata.
For backward compatibility we need to assume the template is for data
if it is not set.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-21 11:33:16 -06:00
Sébastien Han 2576674648 Merge pull request #5515 from leseb/lvm-verbose
ceph: fix lvm arg
2020-05-20 17:13:47 +02:00
Sébastien Han 712c958202 ceph: fix lvm arg
Add the valid verbose flags back.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-05-20 13:03:51 +02:00
Sébastien Han 757e040e75 Merge pull request #5513 from travisn/delete-resized-pool
Pool resize test hangs during cleanup with latest v15.2.2
2020-05-20 08:54:19 +02:00
Travis Nielsen e1a9a9039b ceph: pool resize test hangs during cleanup
In Octopus 15.2.2 there is an rbd change that causes the rbd ls command
to hang if there are not sufficient OSDs to meet the replica requirement.
The smoke suite just started hanging today since the 15.2.2 image was
released with this change. Therefore, the test that resizes the pool
to replica 3 must resize back to 1 before cleaning up.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-19 22:02:37 -06:00
Travis Nielsen 5ac7b528c3 Merge pull request #5342 from rajatsingh25aug/ceph-mds-deactivate
Ceph: Newer mechanism to scale MDS for Nautilus+
2020-05-19 10:50:00 -06:00
Sébastien Han d28e2f605c Merge pull request #5490 from travisn/monitoring-goroutines
Only run the cluster monitoring goroutines once
2020-05-19 09:40:13 +02:00
Sébastien Han dce5846301 Merge pull request #5488 from travisn/host-cleanup-chan
Stop monitoring a cluster immediately when deleted
2020-05-19 08:50:15 +02:00
Sébastien Han 511772afb9 Merge pull request #5436 from sp98/obc-finalizer
finalizer for OBC cleanup
2020-05-19 08:44:38 +02:00
Sébastien Han 2c550dce83 Merge pull request #5486 from cybozu-go/ceph-stop-operator-if-critical-problems-happens
ceph: gave up to run the operator if the controller-runtime failed to start
2020-05-19 08:43:17 +02:00
Travis Nielsen 394b98cb0b ceph: cancel the host cleanup if pvc deletion pending
During cluster delection, the finalizer will not be removed until
all the PVCs are removed. Since this could wait for a long time,
as long as the deletion event is re-queued, we need to cancel
the goroutine that is watching for cluster deletion so it can
avoid running multiple goroutines as the event runs again
and again.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-18 13:07:35 -06:00
Travis Nielsen 4173bee7c1 ceph: stop monitoring a cluster when deleted
When a cluster is requested for deletion there is no longer
a reason to monitor the cluster health such as whether mons
are in quorum, osds are up and in, or monitor the ceph status.
The cluster will wait potentially for a long time if the
PVCs are not deleted by the admin, therefore we stop monitoring
the cluster even before the finalizer is removed.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-18 13:02:37 -06:00
Travis Nielsen 90fa3a6d22 ceph: set external creds if admin key is available
If the admin key is available, set the external creds struct
to use that admin username and key instead of requiring the
callers to check every time if they should use the admin
key or the external key.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-18 12:56:28 -06:00
Travis Nielsen 81dae96929 ceph: remove obsolete version from osd health check
The Ceph version information is not needed to be passed
to the osd health checker since mimic support was dropped.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-18 12:56:28 -06:00
Travis Nielsen 85b0be301e ceph: simplify ceph user for monitoring goroutines
The ceph username is all that needs to be passed to the goroutines
that are monitoring the health of Ceph. This simplifies the
initialization of the goroutines.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-18 12:56:27 -06:00
Travis Nielsen 52e15b6e36 ceph: only run the cluster monitoring goroutines once
The monitoring goroutines that check for mon and osd health,
the ceph cluster status, and the bucket provisioner should
only be started once for each cluster. Previous to this change
and since the controller runtime conversion the goroutines were
being started again every time a reconcile was run. This means
you could potentially have many goroutines monitoring the same
thing.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-18 12:55:58 -06:00
Travis Nielsen 73fa2d849a Merge pull request #5502 from mgfritch/nfs-mdcache
ceph: replace CACHEINODE with MDCACHE
2020-05-18 12:37:55 -06:00
Santosh PillaiandElise Gafford 5ef88f8f09 ceph: finalizer for OBC cleanup
This PR is for rebasing #4683 with master. With new controller runtime changes most the changes with #4683 got redundant.
Only valid change is waiting for all the object buckets to be cleaned up before removing the finalizer.

Co-authored-by: Elise Gafford <egafford@redhat.com>
Signed-off-by: Santosh Pillai <sapillai@redhat.com>
2020-05-18 23:54:59 +05:30
Satoru Takeuchi f6a3da2760 ceph: gave up to run the operator if the controller-runtime failed to start
The operator continues to run even though the controller-runtime
failed to start. Since the controller-runtime is essential, the operator
is non-functional after that. It makes troubleshooting more difficult.

Closes: https://github.com/rook/rook/issues/5434

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-05-18 17:38:35 +00:00
Michael Fritch 248178e0c3 ceph: replace CACHEINODE with MDCACHE
CACHEINODE has been deprecated in favor of MDCACHE

https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/454929
https://github.com/nfs-ganesha/nfs-ganesha/commit/4f4d624ceb361e2ac05e9e304583f35832921790

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-05-18 10:32:44 -06:00
Sébastien Han 9b4edc2036 Merge pull request #5497 from thotz/makehelp
makefile: complete the help menu
2020-05-18 17:57:49 +02:00
Jiffin Tony Thottan 391b0be44b makefile: complete the help menu
makefile items such as "check test", "mod.update", "mod.check" were
missing from help menu.

Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2020-05-18 15:12:55 +05:30
Sébastien Han 86c1580134 Merge pull request #5489 from travisn/pg-min-new-pools
Set pg_num_min on new rgw metadata pools
2020-05-18 08:49:43 +02:00
Travis Nielsen 6d130864f3 ceph: set pg_num_min on new rgw metadata pools
pg_num_min needs to be set on all new and existing rgw
metadata pools so the autoscaler won't immediately
increase the pg count. The pg_num_min was only being set
on existing pools and not on new pools.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-15 16:22:38 -06:00
Sébastien Han 35885a83d0 Merge pull request #5485 from travisn/wait-for-volume-cleanup
Wait for volume deletion before removing the cluster finalizer
2020-05-15 11:15:44 +02:00
Travis Nielsen d1da12c6ac ceph: wait indefinitely for cleanup before removing cluster finalizer
During cluster deletion, we currently only retry for a couple minutes
to wait for the pvcs to be deleted. After the timeout, we proceed
with the cluster deletion. To properly protect the pvcs for proper
cleanup, the finalizer should not be removed until the pvcs
are all confirmed to be deleted. In order to not block other cluster
events, we re-queue the deletion event to run again every 10s
until the pvcs are deleted or the finalizer is manually removed.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-14 16:52:24 -06:00
Travis Nielsen f47bb945c2 ceph: remove duplicate controller wait setting
The controller setting for requeuing an event moved to the
opcontroller package and was no longer needed in the main
controller package.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-14 16:52:24 -06:00
Travis Nielsen 4c384953d0 Merge pull request #5462 from Madhu-1/dep-anti-aff
CSI: set pod anti affinity to provisioner pod
2020-05-14 09:29:26 -06:00
Sébastien Han 64e0e5f589 Merge pull request #5467 from cybozu-go/ceph-prepare-pvc-just-before-osd-on-pvc-test
Ceph: prepare pvc just before osd on pvc test
2020-05-14 09:45:40 +02:00
Madhu Rajanna 747865283a CSI: set deployment strategy to Recreate
updated deployment strategy of provisioner
deployment to Recreate to avoid issue during
update, Recreate strategy will Kill all existing
pods before creating new ones.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-05-14 11:05:54 +05:30
Madhu Rajanna a16d3bd422 k8sutil: Make client as the first argument
To have parity with other functions and
also client should be the first argument to
the function.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-05-14 11:02:14 +05:30
Madhu Rajanna 4febbb09b8 CSI: set pod anti affinity to provisioner pod
sometimes the kube schedular will schedule the
provisioner pod on the same node. it doesnot make
sense to have both provisioner pod running on the same
node, we need to set the pod anti affinity to make
sure that no provisioner pods runnings on the same
node.

Fixes: #5271

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-05-14 11:01:11 +05:30
Travis Nielsen 0e328b5410 Merge pull request #5478 from leseb/rgw-cert-fix
ceph: change rgw certificate mode
2020-05-13 18:03:33 -06:00
Satoru Takeuchi e96009c26d ceph: prepare PVCs for OSD on PVC test inside the integration test
The PVCs for OSD on PVC test is prepared before running the integration test.
In addition, users are forced to run this script for this by themselves.
To avoid this problem, running this script inside the integration test.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-05-14 05:14:27 +09:00
Sébastien Han 5fffb76d24 op: add scc reminder
On Octopus cluster, we don't use the host PID anymore to run OSD so
adding a reminder to remove it later.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-05-13 18:14:14 +02:00
Sébastien Han bc581da75e ceph: change rgw certificate mode
Because the secret is mounted and owned by root and the rgw is running
under the 'ceph' user then it cannot access it. So moving from 0400 to
0444 fixes the issue.

Closes: https://github.com/rook/rook/issues/5265
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-05-13 18:07:53 +02:00