Commit Graph
4716 Commits
Author SHA1 Message Date
Travis Nielsen 1c1591c847 Merge pull request #5261 from cybozu-go/missing-requiresafereplicasize
Ceph: Add requireSafeReplicaSize in CephObjectStore CRD
2020-04-16 10:44:46 -06:00
Travis Nielsen 566530e90e Merge pull request #5263 from surajssd/surajssd/add-seccomp-annotation-to-psp
PSP: Add seccomp annotations
2020-04-16 08:48:23 -06:00
Sébastien Han a62c67a00c Merge pull request #5218 from travisn/codegen-pkg
Codegen needs to copy to pkg subfolder
2020-04-16 09:11:04 +02:00
Sébastien Han f824f4fc28 Merge pull request #5267 from cybozu-go/tests-fix-k8s-install-scripts
Tests: fix k8s install scripts
2020-04-16 08:59:25 +02:00
zoetrope babb55cc15 ceph: add requireSafeReplicaSize to CRD
add requireSafeReplicaSize field to CRD in upgrade-from-v1.2-crds.yaml and ceph_manifets.go

Signed-off-by: zoetrope <a.ikezoe@gmail.com>
2020-04-16 15:18:00 +09:00
Satoru Takeuchi 76a2b8c230 tests: prevent the installation failure due to downgrade packages
kubeadm installer tries to install the fixed versions of some packages.
So if the newer versions are already installed, this script fails.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-04-16 09:18:49 +09:00
Satoru Takeuchi ddf02d3032 tests: make swapon and swapoff reliable
After running `swapoff -a`, systemd re-enable swap soon.
We should stop the corresponding unit to avoid this problem.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-04-16 09:18:49 +09:00
Travis Nielsen c2878f693e build: codegen needs to copy to pkg subfolder
The codegen output is moving the apis and client folders to the root
folder instead of under pkg.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-15 16:21:50 -06:00
Travis Nielsen 753a5f56a6 Merge pull request #4904 from jmolmo/issue_4342_doc
Ceph:Update Helm Chart documentation
2020-04-15 15:42:46 -06:00
Suraj Deshmukh 2f6205b2f6 PSP: Add seccomp annotations
This commit adds seccomp annotations to the PSP shipped with Rook
Operator. In this way the operator when deployed will be more secure and
will only be allowed the syscalls defined the runtime's seccomp profile.

Signed-off-by: Suraj Deshmukh <surajd.service@gmail.com>
2020-04-15 20:10:30 +05:30
Sébastien Han 5adfc7b43d Merge pull request #5085 from leseb/rbd-mirror-crd
ceph: extract rbd-mirror to its own crd
2020-04-15 10:58:22 +02:00
Sébastien Han 2ad0d344b7 Merge pull request #5256 from travisn/review-cleanup
Reduce verbose logging for ok-to-stop failure
2020-04-15 10:30:08 +02:00
zoetrope f00092de73 ceph: Add requireSafeReplicaSize in CephObjectStore CRD
Add requireSafeReplicaSize field in CephObjectStore CRD.

Closes: https://github.com/rook/rook/issues/5260
Signed-off-by: zoetrope <a.ikezoe@gmail.com>
2020-04-15 17:01:16 +09:00
Sébastien Han 2d06e600c4 Merge pull request #5247 from cybozu-go/update-pg_num-related-documents
ceph: Update pg_num related documents
2020-04-15 09:39:06 +02:00
Sébastien Han 2bd017102b ci: add retry when deleting rbd image
Sometimes the image still has watchers so let's retry the deletion.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-04-15 09:12:57 +02:00
Sébastien Han d16cebea70 ci: modify upgrade to master
We now install 1.2 by default, then we upgrade from 1.2 to 1.3 and 1.3
to master.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-04-15 09:12:57 +02:00
Sébastien Han c1b8a7aa9e ceph: extract rbd-mirror to its own crd
Previously, the rbd-mirror daemon was integrated into the `CephCluster`
CRD. This wasn't really practical since we would have to wait for the
whole orchestration to be done to actually set it up. The same goes for
any CR update. Let's say you want to change the number of daemons, Rook
would go through mons, mgrs and osds until it get to rbd-mirror.
This triggers an undesired full orchestration.

With its own CRD this component just gains a lot more flexibility.

Closes: https://github.com/rook/rook/issues/5084
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-04-15 09:12:56 +02:00
Travis Nielsen 4060167852 ceph: document example for skipping osd creation
When an OSD has been previously configured with ceph-volume, the
OSD will be skipped on the next installation if the device is not
fully wiped. Added an example to the docs to detect this case.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-14 16:12:04 -06:00
Travis Nielsen 668bca27b1 ceph: reduce verbose logging for ok-to-stop failures
When a daemon is not safe-to-stop the operator will print the full
stack trace rather than a simple error message that the daemon
cannot be stopped.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-14 14:53:56 -06:00
Satoru Takeuchi 372e862478 ceph: add the description of too few PGs per OSD warning in the document
Since users often encounter "too few PGs per OSD" warning, it's worth treating
this as a common issue.

Closes: https://github.com/rook/rook/issues/1329
Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-04-14 18:47:02 +00:00
Satoru Takeuchi 6d0ca4892c ceph: remove the redundant description of pg_autoscaler
The description of pg_autoscaler is spread over the two documents.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-04-14 18:24:07 +00:00
Satoru Takeuchi da48fa517c ceph: add the description of Octopus and the existing pools in pg_autoscaler
pg_autoscaler is enabled by default in Octopus. In addition, enabling this
module don't enable the autoscaler of the existing pools.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-04-14 18:24:07 +00:00
Travis Nielsen 8c8b74afc3 Merge pull request #4740 from rajatsingh25aug/csiPV-provision
Ceph: PV provisioning fails upon upgrade
2020-04-14 10:35:06 -06:00
Travis Nielsen 0edaf70093 Merge pull request #5251 from travisn/test-env-vars
Convert integration test CLI params to env vars
2020-04-14 10:23:32 -06:00
Alexander Trost fad6560e81 Merge pull request #5253 from cloudical-io/fix_k8sprereqs_doc
doc: fix link in k8s-pre-reqs page
2020-04-14 17:59:03 +02:00
Alexander Trost edd272a7f1 doc: fix link in k8s-pre-reqs page
This fixes a markdwon link on the k8s-pre-reqs doc page.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2020-04-14 17:45:47 +02:00
Travis Nielsen 2eebfd5019 Merge pull request #5151 from vbnrh/rook-admission-controller-design-doc
Rook: Design document for admission controller support in rook
2020-04-14 09:14:24 -06:00
Travis Nielsen c4e712bbd2 tests: convert cli params to env vars
The command line flags parsing inside an init() method was causing
issues at runtime when trying to add certain new features, which
is a limitation of the flag parsing. We now move away from using
any command line flags in the tests and only use environment variables
to simplify adding new parameters to the tests.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-14 07:29:18 -06:00
vbnrh 9e7b5a64ae ceph: Adds design document for admission controller support in rook
Adding admission controllers to rook would help in performing custom CRD validations to rook resources. It ensures that the core specifications that reach rook remain valid despite any kind of changes. In case any invalid changes are found, The kubernetes api server would reject the request and  an error would be sent back to the user.

Signed-off-by: vbnrh <vbadrina@redhat.com>
2020-04-14 16:02:55 +05:30
Sébastien Han 8d4efc4d7f Merge pull request #5248 from cybozu-go/ceph-remove-unnecessary-lvremove-in-test
ceph: remove unnecessary lvremove in test
2020-04-14 10:36:32 +02:00
Juan Miguel Olmo Martínez 08821f1d61 Ceph: Update Helm Chart documentation
Add <unreachableNodeTolerationSeconds> parameter to Helm chart documentation

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2020-04-14 08:32:37 +02:00
RAJAT SINGH bb79f7bc2c Ceph: PV provisioning fails upon upgrade
CSI CephFS provisioner fails to provision a Persistent Volume after upgrading from Rook Ceph Operator 1.1.2 to 1.1.7.
This issue can be fixed by removing givePoolAppTag function whenever there is an appName cephFs.

Signed-off-by: RAJAT SINGH <rajasing@redhat.com>
2020-04-14 08:24:07 +05:30
Satoru Takeuchi 6a09cc0177 ceph: remove unnecessary lvremove in test
LVs in a VG are removed with vgremove. So lvremove before vgremove
is not necessary.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-04-13 14:49:05 +09:00
Sébastien Han 3d9babba6d Merge pull request #5237 from zerkms/issue-5236
ceph: helm add default value for the `nodeSelector`
2020-04-10 09:56:02 +02:00
Ivan Kurnosov b5e1e9f7e2 ceph: helm add default value for the nodeSelector
Without the default value helm does not have chance
to infer the field type and fails during type check
when custom `nodeSelector` value is specified;

Closes: https://github.com/rook/rook/issues/5236
Signed-off-by: Ivan Kurnosov <zerkms@zerkms.com>
2020-04-10 12:22:49 +12:00
Travis Nielsen 66f310c73b Merge pull request #5219 from travisn/status-reconcile-loop
Skip reconcile events where the spec is not updated
2020-04-09 16:53:40 -06:00
Travis Nielsen 8622583154 Merge pull request #5183 from umangachapagain/mgr-minimal-privilege
Ceph: revert mgr to minimal privilege
2020-04-09 16:53:32 -06:00
Travis Nielsen 8ba023764b Merge pull request #4433 from rajatsingh25aug/dataPool-Fix
Ceph: Filesystem Pool Size are ignored
2020-04-09 16:53:16 -06:00
Travis Nielsen 3298943b95 Merge pull request #5229 from travisn/upgrade-rgw-svc
Update the object store service port during upgrade
2020-04-09 14:16:41 -06:00
Travis Nielsen 24789f4c6a ceph: update the object store service port during upgrade
In the v1.3 release the target port for the rgw daemons changed to 8080.
The upgrade was skipping the service update anytime the service already existed.
Now the service will be updated with every reconcile to ensure the target port
is correct.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-09 12:42:20 -06:00
Travis Nielsen ff1ab64d8d ceph: skip reconcile events where the spec not updated
The controllers should ignore events for status updates. The reconcile
only needs to happen when the spec is updated or the resource is marked
for deletion. Otherwise, the controllers may stay in an update loop as
the reconcile events are triggered again every time there is a status
update during the reconcile.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-09 11:20:45 -06:00
Travis Nielsen 269cfe1199 ceph: update status on current version of resources
When updating the status on resources sometimes the update fails due to
the resource being an outdated version. This frequently occurs when
the same reconcile loop updates the status multiple times, or the finalizer
is added, or some other update to the resource. Upon the next reconcile
the error would generally go away since the status or finalizer didn't
need to be updated multiple times. But now the error is not expected
since the controller will retrieve the latest version of the resource
immediately before attempting to update it.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-09 11:20:45 -06:00
Sébastien Han 39aa5902b4 Merge pull request #5226 from leseb/reset-release-note
rook: reset PendingReleaseNotes
2020-04-09 17:32:13 +02:00
Sébastien Han dc364e17fa rook: reset PendingReleaseNotes
Since we ship 1.3, we need to reset this file.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-04-09 17:21:08 +02:00
Sébastien Han 85185f421a Merge pull request #5224 from leseb/helm-crds
ceph: helm add missing subresources to CRD
2020-04-09 16:38:09 +02:00
Sébastien Han 0e42222c50 ceph: helm add missing subresources to CRD
The subresources field was missing, this was missed in
https://github.com/rook/rook/pull/4964.

The .metadata.generation field is updated if and only if the value at the .spec subpath changes.
Additionally, if the spec does not change, .metadata.generation is not updated.
This is a must-have for the controller-runtime work, if we don't have
this, the generation field will always be incremented, resulting in a
endless reconcile loop.

Closes: https://github.com/rook/rook/issues/5173
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-04-09 11:30:33 +02:00
Sébastien Han c83ec7598b Merge pull request #5221 from travisn/pr-template
Clarify the CI flags in the PR template
2020-04-09 10:27:06 +02:00
Travis Nielsen c7310ec802 git: clarify CI flags in PR template
The commitlint bot is rarely understood and flags to skip the CI are
rarely used by new contributors. This update to the PR template
aims to make these options more discoverable to newer members of
the community

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-09 00:11:16 -06:00
Travis Nielsen a4e598b7c7 Merge pull request #5215 from joshuacox/fixdocpath-signed
ceph: Fixing path on ceph-quickstart to include rook
2020-04-08 11:57:58 -06:00
Josh Cox 263661adbe docs: Fixing path on ceph-quickstart to include rook
Signed-off-by: Josh Cox <josh@webhosting.coop>
2020-04-08 12:38:17 -05:00