Commit Graph
863 Commits
Author SHA1 Message Date
Travis Nielsen 0bddd562e0 ceph: document unique crush name requirement
CRUSH hierarchy requires unique names at each location.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-27 11:09:56 -06:00
Wang Zhen c37b5d5a70 docs: fix log collection script
[skip ci]

Signed-off-by: Wang Zhen <lazybetrayer@gmail.com>
2020-04-27 11:50:21 +08:00
Travis Nielsen 946673f3e1 Merge pull request #5305 from travisn/cluster-test-example
Restore the cluster-test.yaml example
2020-04-23 10:16:35 -06:00
Sébastien Han bb0a1565a4 Merge pull request #5290 from Obleskar/patch-2
Docs: Update link for Minikube PVs
2020-04-23 18:16:19 +02:00
Sébastien Han 75357b8516 Merge pull request #5288 from denysvitali/master
docs: improve ceph finalizer patching (#1488)
2020-04-23 18:15:00 +02:00
Travis Nielsen 5789c2b197 Merge pull request #5289 from Madhu-1/csi-v2.1.0
CSI: update cephcsi to v2.1.0
2020-04-23 07:49:23 -06:00
Obleskar 6a6be9d0c2 Docs: Update link for Minikube PVs
The hyperlink to the Minikube documentation on persistent volumes throws a 404. These docs have moved from https://github.com/kubernetes/minikube/blob/master/docs/persistent_volumes.md to https://github.com/kubernetes/minikube/blob/master/site/content/en/docs/handbook/persistent_volumes.md.

The anchor (#a-note-on-mounts-persistence-and-minikube-hosts) scrolls to the directory paths that Minikube preserves by default.

Alternatively, linking to the rendered site might be more stable.
https://minikube.sigs.k8s.io/docs/handbook/persistent_volumes/

Signed-off-by: Obleskar <benjamindeuson@gmail.com>
2020-04-22 16:47:58 -07:00
Denys Vitali 5693944737 docs: improve ceph finalizer patching (#1488)
- docs: improve ceph finalizer patching (#1488)
- docs: ceph-teardown: replace double grep w/ awk

Signed-off-by: Denys Vitali <denys.vitali@swisscom.com>
2020-04-22 16:47:14 +02:00
Travis Nielsen 36ebf9d890 Merge pull request #5286 from terorie/patch-1
doc: fix secret env keys on ObjectBucketClaim
2020-04-21 15:46:39 -06:00
Travis Nielsen 9d01f92d2c ceph: restore the cluster-test.yaml example
The cluster-test.yaml example is useful for small test clusters
where only one mon is required and certain settings can be disabled
when not running in production.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-21 15:41:39 -06:00
Travis Nielsen f8ffd2c2eb ceph: toolbox job for running a ceph script
As another option to run Ceph commands, a script can be executed
with Ceph commands as if running in the toolbox, but will instead
run in a job where the logs can be collected and analyzed
separately. This would be useful where automation is in place to collect
information about the cluster periodically or upon some failure
that is detected, without requiring an interactive shell.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-20 15:48:59 -06:00
Richard Patel 66feafa9a5 docs: fix secret env keys on ObjectBucketClaim
The documentation on the Ceph ObjectBucketClaim CRD
erroneously states that the generated Secret resource
contains keys `ACCESS_KEY_ID`, `SECRET_ACCESS_KEY`.

According to ceph-object.md, and when mounting the secret
into a container via secretRef, or inspecting it with kubectl,
the variables have an `AWS_` prefix.
Like so: `AWS_ACCESS_KEY_ID`, `AWS_SECRET_ACCESS_KEY`.

This commit adds the `AWS_` prefix to both keys.

Signed-off-by: Richard Patel <me@terorie.dev>
2020-04-20 23:37:44 +02:00
Madhu Rajanna 5684c4cc37 CSI: update cephcsi to v2.1.0
cephcsi v2.1.0 is released and doesnot need any deployment
template changes. This PR updates the cephcsi image
version to v2.1.0

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-04-20 14:58:25 +05:30
Sébastien Han 7c994441c3 ceph: make admin key optional for external cluster
Currently, we need to configure the Ceph external Admin keyi
in the Rook deployment to be able to connect to an external Ceph cluster.
If we wanted to run in a multi-tenant fashion
were several K8s/Rook clusters wanted to connect to the same external ceph cluster,
each K8s deployment would have the access to the External Ceph Admin key
and could potentially access or delete the Data
from pools that belong to other k8s/Rook Clusters.

Now the admin key is optional but the helper script create-external-cluster-resources.sh
will help create the necessary keys/users to connect to that cluster.

Closes: https://github.com/rook/rook/issues/4917 and https://github.com/rook/rook/pull/5227
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-04-20 09:59:04 +02:00
Travis Nielsen 348690ea64 ceph: update defaults to the ceph v14.2.9 release
With the release of ceph v14.2.9 we set the default examples to this version.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-17 12:54:06 -06:00
Travis Nielsen 753a5f56a6 Merge pull request #4904 from jmolmo/issue_4342_doc
Ceph:Update Helm Chart documentation
2020-04-15 15:42:46 -06:00
Sébastien Han 5adfc7b43d Merge pull request #5085 from leseb/rbd-mirror-crd
ceph: extract rbd-mirror to its own crd
2020-04-15 10:58:22 +02:00
Sébastien Han 2ad0d344b7 Merge pull request #5256 from travisn/review-cleanup
Reduce verbose logging for ok-to-stop failure
2020-04-15 10:30:08 +02:00
Sébastien Han c1b8a7aa9e ceph: extract rbd-mirror to its own crd
Previously, the rbd-mirror daemon was integrated into the `CephCluster`
CRD. This wasn't really practical since we would have to wait for the
whole orchestration to be done to actually set it up. The same goes for
any CR update. Let's say you want to change the number of daemons, Rook
would go through mons, mgrs and osds until it get to rbd-mirror.
This triggers an undesired full orchestration.

With its own CRD this component just gains a lot more flexibility.

Closes: https://github.com/rook/rook/issues/5084
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-04-15 09:12:56 +02:00
Travis Nielsen 4060167852 ceph: document example for skipping osd creation
When an OSD has been previously configured with ceph-volume, the
OSD will be skipped on the next installation if the device is not
fully wiped. Added an example to the docs to detect this case.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-14 16:12:04 -06:00
Satoru Takeuchi 372e862478 ceph: add the description of too few PGs per OSD warning in the document
Since users often encounter "too few PGs per OSD" warning, it's worth treating
this as a common issue.

Closes: https://github.com/rook/rook/issues/1329
Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-04-14 18:47:02 +00:00
Satoru Takeuchi 6d0ca4892c ceph: remove the redundant description of pg_autoscaler
The description of pg_autoscaler is spread over the two documents.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-04-14 18:24:07 +00:00
Satoru Takeuchi da48fa517c ceph: add the description of Octopus and the existing pools in pg_autoscaler
pg_autoscaler is enabled by default in Octopus. In addition, enabling this
module don't enable the autoscaler of the existing pools.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-04-14 18:24:07 +00:00
Alexander Trost fad6560e81 Merge pull request #5253 from cloudical-io/fix_k8sprereqs_doc
doc: fix link in k8s-pre-reqs page
2020-04-14 17:59:03 +02:00
Alexander Trost edd272a7f1 doc: fix link in k8s-pre-reqs page
This fixes a markdwon link on the k8s-pre-reqs doc page.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2020-04-14 17:45:47 +02:00
Juan Miguel Olmo Martínez 08821f1d61 Ceph: Update Helm Chart documentation
Add <unreachableNodeTolerationSeconds> parameter to Helm chart documentation

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2020-04-14 08:32:37 +02:00
Josh Cox 263661adbe docs: Fixing path on ceph-quickstart to include rook
Signed-off-by: Josh Cox <josh@webhosting.coop>
2020-04-08 12:38:17 -05:00
Travis Nielsen f4fad939e9 Merge pull request #5189 from asoltesz/patch-1
ceph: Add example for using a specific partition for storage
2020-04-08 09:25:22 -06:00
asoltesz a70cafdd9b ceph: Add example for using a specific partition for storage
The documentation has no example yet about how to use a specific partition

Signed-off-by: András Soltész <soltesz.andras@gmail.com>
2020-04-08 12:14:58 +02:00
Dmitry Yusupov b640f75c08 edgefs: fix SMB controller update path
Signed-off-by: Dmitry Yusupov <dmitry.yusupov@nexenta.com>
2020-04-06 18:32:23 -07:00
Dmitry Yusupov afd8398a6b Merge pull request #5165 from dyusupov/master
edgefs: support for SMB CRD
2020-04-03 14:18:14 -07:00
Dmitry Yusupov 4920202c10 edgefs: support for SMB CRD
Signed-off-by: Dmitry Yusupov <dmitry.yusupov@nexenta.com>
2020-04-03 13:15:14 -07:00
Travis Nielsen 948c0328bd Merge pull request #5162 from travisn/csi-v2.0.1
Enable the Ceph CSI v2.0.1 driver by default in Rook
2020-04-03 13:31:59 -06:00
Travis Nielsen b8e0d8902c Merge pull request #4077 from leseb/rook-multus
ceph: add multus support
2020-04-03 11:14:08 -06:00
Travis Nielsen b1825db09d ceph: install CSI driver v2.0.1 by default
With the release of the CSI v2.0.1 driver, this should now be the
default driver deployed by Rook. The minimum driver version
supported is still v2.0.0

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-03 11:08:19 -06:00
Chu Yong Mark Lee a018d89d9c csi: Update cephcsi driver to v2.0.1
Update cephcsi driver to v2.0.1 to allow nodes with
Ceph persistent volumes to shutdown cleanly. This requires
an additional bind mount (/run/mount) in cephfsplugin
and rbdplugin templates.

Signed-off-by: Chu Yong Mark Lee <markleechuyong@gmail.com>
2020-04-03 11:05:41 -06:00
Sébastien Han 20d1543507 ceph: add multus support
You can now use Rook along with Multus. Multus must be up and running
and the right ressources must exist such as NetworkAttachmentDefinition
CR.
The Cluster CR spec has new fields to work with multus:

network:
  provider: multus (or 'host' for hostNetworking)
  selectors:
    public: NetworkAttachmentDefinition name
    cluster: NetworkAttachmentDefinition name

If only a single NetworkAttachmentDefinition is provided Rook will use
both anyway for the Ceph traffic.

Please refer to the doc to learn more.

Closes: https://github.com/rook/rook/issues/4716
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-04-03 18:00:15 +02:00
Travis Nielsen cc59916c1a ceph: upgrade doc clarifications for v1.3
After testing the upgrade there are some updates to the upgrade guide.
Also added comments about the helm chart upgrades.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-03 09:13:29 -06:00
Travis Nielsen c79325f92c Merge pull request #5138 from cybozu-go/support-topology-spread-constraints
ceph: support topoplogySpreadConstraints
2020-04-02 12:00:45 -06:00
Satoru Takeuchi 06b10e248c ceph: support topoplogySpreadConstraints
Support topologySpreadConstraints to spread OSD pods among failure
domains as even as possible.

https://kubernetes.io/docs/concepts/workloads/pods/pod-topology-spread-constraints/

Without this feature, the number of OSD pods would be different
between the failure domains very much. At worst, there is
a possibility that a failure domain has many OSDs and other
failure domains have no OSDs. It can partly be mitigated
with podAntiAffinity. However, it only works if there are at most
one OSD per node. For more detail, please refer to the following
document.

https://github.com/rook/rook/blob/master/cluster/examples/kubernetes/ceph/cluster-on-pvc.yaml#L59

Closes: https://github.com/rook/rook/issues/4387
Signed-off-by: Hiroshi Muraoka <h.muraoka714@gmail.com>
Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-04-02 16:40:58 +00:00
Travis Nielsen f30c8066d1 docs: update docs for Rook v1.3 release
Various updates are needed for the v1.3 release.
- The pending release notes were missing some features
- Added a section to the upgrade guide for breaking changes to OSDs
- Clarifications around Ceph prereqs and min version
- Other misc clarifications

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-02 10:26:00 -06:00
Blaine Gardner 9d41b38095 Ceph: upgrade docs: update upgrade docs for v1.3
Update both documents and `upgrade-from-v1.2*.yaml` files for Rook v1.3
release.

Of note:
- note when the upgrade to CSI driver v2.0 should be updated
- note that CSI image envs can be removed to have Rook use defaults
- update Ceph version upgrade section
- update supported Ceph version info
- update CRDs before upgrade b/c new 'status' fields
- remove special CSI update info left from v1.2

Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
(cherry picked from commit 2ccff83d94)
2020-04-02 10:26:00 -06:00
ShyamsundarR de97b6a1d6 ceph: Add ability to specify compression mode for pools
This commit enables configuring a compression_mode for pools
that takes the values as specified for bluestore OSD
compression_mode values,
https://docs.ceph.com/docs/master/rados/configuration/bluestore-config-ref/#inline-compression

Signed-off-by: ShyamsundarR <srangana@redhat.com>
2020-04-01 14:24:30 -04:00
Santosh Pillai 2bfd7c42bc ceph: cleanup cluster.Spec.DataDirHostPath on cluster deletion
In order to ensure proper clean up of all the rook-ceph data when the cluster is deleted, we need to clean up the dataDirHostPath (var/lib/rook)

Signed-off-by: Santosh Pillai <sapillai@redhat.com>
2020-03-30 19:36:01 +05:30
Elise Gafford 2ca0d8f93d ceph: add cleanupPolicy to cephcluster spec
In order to perform full automation of cephcluster deletion safely
and protect against catastrophic data loss, the end user must be
able to signify that they intend to irrecoverably delete the data
in their cluster. The cleanupPolicy field of the cluster spec is
intended to communicate this. This patch does not implement
automated deletion, but only creates the spec field and the
safety feature of halting orchestration other than deletion on a
cluster with a set cleanup policy value.

Partially-fixes: #3222
Signed-off-by: Elise Gafford <egafford@redhat.com>
2020-03-30 19:11:54 +05:30
Satoru Takeuchi bb83122d18 ceph: fix a wrong comment
"comment" here should mean the comments of `pg_autoscaler`
in cluster/examples/kubernetes/ceph/cluster.yaml. However, it's
ambiguous. It's straightforward to use "add".

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-03-25 10:37:05 +00:00
Travis Nielsen da3bf49b61 Merge pull request #5043 from cybozu-go/remove-unnecessary-napespace-fields
remove unnecessary namespace fields
2020-03-20 17:18:21 -06:00
Paul Catinean 6cd49153ad ceph: mention helm upgrade path for csi driver
Update documentation to mention helm chart upgrade path for csi driver.

This prevents the user from manually applying the RBAC roles when the helm chart does it for him also notifies him where to set the images for CSI in the helm chart.

Signed-off-by: Paul <paulcatinean@gmail.com>
2020-03-19 18:07:33 +01:00
Sébastien Han 84dccb0d2c Merge pull request #5044 from travisn/monitoring-openshift-doc
Document monitoring namespace for OpenShift
2020-03-19 15:07:37 +01:00
Travis Nielsen a988dd23ae ceph: document monitoring namespace for OpenShift
OpenShift requires the monitoring to be bound to the openshift-monitoring
namespace instead of the rook default

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-03-18 11:55:07 -06:00