Commit Graph
2042 Commits
Author SHA1 Message Date
Sébastien Han 3d8fd2ca5a Merge pull request #5630 from cybozu-go/add-osdpodspec-schedulername
ceph: add schedulerName property to storageClassDeviceSet
2020-06-15 10:25:57 +02:00
UMEZAWA Takeshi 6085ff3223 ceph: add schedulerName property to storageClassDeviceSet
Support schdulerName to use another scheduler for OSD pod placement.

Closes: https://github.com/rook/rook/issues/5536
Signed-off-by: UMEZAWA Takeshi <takeshi-umezawa@cybozu.co.jp>
Signed-off-by: Masayuki Ishii <masa213f@gmail.com>
2020-06-12 11:53:28 +09:00
Travis Nielsen 899e8e547e docs: clean ssds with blkdiscard
blkdiscard is the better tool for cleaning SSDs instead
of dd.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-06-11 15:45:10 -06:00
Travis Nielsen 955dcb930e Merge pull request #5377 from alimaredia/wip-object-store-multisite
Foundation for Object Store Multisite CRs
2020-06-10 16:07:53 -06:00
Sébastien Han db17533435 docs: add design doc template
Rook already has a design process in place when introducing new
functionality. The only missing thing is a clear template to bring
consistency in our design documents.

This is inspired and shrunk version of
https://github.com/openshift/enhancements/tree/master/guidelines to add
some guidelines when it comes to writing a design document.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-10 19:05:14 +02:00
Ahmad Nurus S f5f6484869 docs: design nfs operator using controller-runtime
This commit is adding a design to implement controller-runtime in nfs operator

Signed-off-by: Ahmad Nurus S <prksu.sh@gmail.com>
2020-06-10 23:41:15 +07:00
Ali Maredia fc579f4520 ceph: initial commit for ceph rgw multisite resources
This commit contains CR implementations for:
CephObjectRealm
CephObjectZoneGroup
CephObjectZone

Also there are changes made to the objectstore
to add rgws in the object-store to zones and
zone groups in a multisite configuration and
the removal of the --default parameter for any
realms/zonegroups/zones that are created.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2020-06-09 16:28:53 -04:00
Madhu Rajanna 09ccf55453 ceph: update cephcsi to v2.1.2
Cephcsi v2.1.2 is released with bug fixes,
refer https://github.com/ceph/ceph-csi/releases/tag/v2.1.2
for release details.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-06-05 14:43:05 +05:30
Satoru Takeuchi 91e7912336 ceph: fix the document of OSD management
Removing a disk is not mandatory after the data in the corresponding
OSD is moved to other OSDs. It's better to just let users to know it's
safe to remove the disk.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-06-04 16:32:05 +00:00
Travis Nielsen c1ee1104c8 docs: fix indentation on the commit prefixes
The list of commit prefixes in the doc were rendering on
a single line instead of as a list.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-28 17:02:12 -06:00
Travis Nielsen 0d1c83c9c3 docs: update the obc provisioner name
The OBC provisioner name changed recently to include the namespace
as a prefix, but the docs were not updated.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-05-28 17:01:17 -06:00
Sébastien Han ff90fa7098 Merge pull request #5549 from leseb/semantic
add commitlint github action
2020-05-28 17:41:30 +02:00
Sébastien Han dea423fedd Merge pull request #5557 from cybozu-go/ceph-add-how-to-know-whether-filesystem-exist-on-top-of-device
ceph: add the description how to know whether there is a filesystem on top of a device
2020-05-28 17:38:11 +02:00
Sébastien Han db57455ba2 docs: update contribution guideline
Reflect the recent changes with the replacement of the commitlint bot
by the commitlint github action.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-05-28 17:36:08 +02:00
Satoru Takeuchi c3a2677883 ceph: add the description how to know whether there is a filesystem on top of a device
It's better to tell users to know whether their devices can be used as OSD
in the quick start guide.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-05-28 15:06:57 +00:00
Sébastien Han c799e11032 ceph: enhancement cleanup with disks
Now, we can not only cleanup monitor data, logs and crashes but the
disks too. As part of the cleanupPolicy CR spec, we have a new setting
called sanitizeDisks which holds more details:

* confirmation: the confirmation message to sanitize disks,
use "yes-really-sanitize-disks" to confirm

This will **only** wipe the metadata, so it's a fast cleanup allowing
you to re-install later but won't remove all the data from the drive.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-05-27 18:14:02 +02:00
Sébastien Han a760b6d5ae doc: ceph fix rgw links
links were pointing to dead pages.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-05-13 17:16:49 +02:00
Satoru Takeuchi 75f0b0f159 ceph: write down the multipath support in the documents
OSD on PVC supports multipath thanks to the following commit.

ceph: add support for multipath devices
32730123ea

However, it's not documented yet.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-05-12 17:11:02 +09:00
binoue ff2ba9c890 ceph: update ceph-upgrade.md for handling a known issue
Because of the ClusterRole api version change, #5341 may occur
when upgrading the rook chart to the latest version.
This pull request updates `ceph-upgrade.md` for handling the issue.

Signed-off-by: binoue <banji-inoue@cybozu.co.jp>
2020-05-11 03:22:55 +09:00
Travis Nielsen f82a07d441 Merge pull request #5394 from Madhu-1/csi-prio
CSI: Set PriorityClassName for CSI pods
2020-05-06 07:08:54 -06:00
Madhu Rajanna ec3ab55d94 CSI: Set PriorityClassName for CSI provisioner pods
provide an option to set PriorityclassName on the
CSI provisioner pods to avoid pod eviction, as the CSI provisioner
pods a critical in system for storage. the default value
for the CSI provisioner pods is set to system-cluster-critical.

provisioner pods are less priority than plugin pods.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-05-06 15:45:06 +05:30
Madhu Rajanna cc6ec58891 CSI: Set PriorityClassName for CSI plugin pods
provide an option to set Priorityclassname on the
CSI plugin pods to avoid pod eviction, as the CSI plugin pods are
critical in system for storage. the default value
for the CSI plugin pods is set to system-node-critical.
more info can be found at
https://kubernetes.io/docs/tasks/administer-cluster/guaranteed-scheduling-critical-addon-pods/

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-05-06 15:45:01 +05:30
Chen, Xu Chun (Simon) a39d9a969e doc: correct wordings
correct wordings so that they pass grammar checkings and better understood by non-English native readers. Thanks!

Signed-off-by: XU CHUN CHEN <chenxuc@cn.ibm.com>
2020-05-06 11:21:21 +08:00
Travis Nielsen 2d6fefbd5f Merge pull request #5395 from Madhu-1/csi-2.1.1
CSI: Update CSI version to v2.1.1
2020-05-05 11:25:49 -06:00
Satoru Takeuchi aa7145e1ca ceph: fix dead links
Fix dead links in ceph document.

Closes: https://github.com/rook/rook/issues/5396

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-05-06 01:24:29 +09:00
Madhu Rajanna 73c74d8a42 CSI: Update CSI version to v2.1.1
cephcsi v2.1.1 is released with fix for xfs formatting
issue. This PR updates the cephcsi image version to
v2.1.1

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-05-05 13:08:23 +05:30
Dmitry Yusupov 9b6c1ede66 Merge pull request #5360 from dyusupov/master
edgefs: provide a way to configure ADS
2020-04-29 09:27:56 -07:00
Madhu Rajanna 4495d1fffd CSI: Add helm documentation for CSI resource
Updated helm documentation for CSI resources
which will be applied for CSI sidecar and plugin
containers.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-04-29 10:26:56 +05:30
Dmitry Yusupov 2746b2edee edgefs: provide a way to configure ADS
Signed-off-by: Dmitry Yusupov <dmitry.yusupov@nexenta.com>
2020-04-28 14:58:40 -07:00
Travis Nielsen 0bddd562e0 ceph: document unique crush name requirement
CRUSH hierarchy requires unique names at each location.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-27 11:09:56 -06:00
Wang Zhen c37b5d5a70 docs: fix log collection script
[skip ci]

Signed-off-by: Wang Zhen <lazybetrayer@gmail.com>
2020-04-27 11:50:21 +08:00
Travis Nielsen 946673f3e1 Merge pull request #5305 from travisn/cluster-test-example
Restore the cluster-test.yaml example
2020-04-23 10:16:35 -06:00
Sébastien Han bb0a1565a4 Merge pull request #5290 from Obleskar/patch-2
Docs: Update link for Minikube PVs
2020-04-23 18:16:19 +02:00
Sébastien Han 75357b8516 Merge pull request #5288 from denysvitali/master
docs: improve ceph finalizer patching (#1488)
2020-04-23 18:15:00 +02:00
Travis Nielsen 5789c2b197 Merge pull request #5289 from Madhu-1/csi-v2.1.0
CSI: update cephcsi to v2.1.0
2020-04-23 07:49:23 -06:00
Obleskar 6a6be9d0c2 Docs: Update link for Minikube PVs
The hyperlink to the Minikube documentation on persistent volumes throws a 404. These docs have moved from https://github.com/kubernetes/minikube/blob/master/docs/persistent_volumes.md to https://github.com/kubernetes/minikube/blob/master/site/content/en/docs/handbook/persistent_volumes.md.

The anchor (#a-note-on-mounts-persistence-and-minikube-hosts) scrolls to the directory paths that Minikube preserves by default.

Alternatively, linking to the rendered site might be more stable.
https://minikube.sigs.k8s.io/docs/handbook/persistent_volumes/

Signed-off-by: Obleskar <benjamindeuson@gmail.com>
2020-04-22 16:47:58 -07:00
Denys Vitali 5693944737 docs: improve ceph finalizer patching (#1488)
- docs: improve ceph finalizer patching (#1488)
- docs: ceph-teardown: replace double grep w/ awk

Signed-off-by: Denys Vitali <denys.vitali@swisscom.com>
2020-04-22 16:47:14 +02:00
Travis Nielsen 36ebf9d890 Merge pull request #5286 from terorie/patch-1
doc: fix secret env keys on ObjectBucketClaim
2020-04-21 15:46:39 -06:00
Travis Nielsen 9d01f92d2c ceph: restore the cluster-test.yaml example
The cluster-test.yaml example is useful for small test clusters
where only one mon is required and certain settings can be disabled
when not running in production.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-21 15:41:39 -06:00
Travis Nielsen f8ffd2c2eb ceph: toolbox job for running a ceph script
As another option to run Ceph commands, a script can be executed
with Ceph commands as if running in the toolbox, but will instead
run in a job where the logs can be collected and analyzed
separately. This would be useful where automation is in place to collect
information about the cluster periodically or upon some failure
that is detected, without requiring an interactive shell.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-20 15:48:59 -06:00
Richard Patel 66feafa9a5 docs: fix secret env keys on ObjectBucketClaim
The documentation on the Ceph ObjectBucketClaim CRD
erroneously states that the generated Secret resource
contains keys `ACCESS_KEY_ID`, `SECRET_ACCESS_KEY`.

According to ceph-object.md, and when mounting the secret
into a container via secretRef, or inspecting it with kubectl,
the variables have an `AWS_` prefix.
Like so: `AWS_ACCESS_KEY_ID`, `AWS_SECRET_ACCESS_KEY`.

This commit adds the `AWS_` prefix to both keys.

Signed-off-by: Richard Patel <me@terorie.dev>
2020-04-20 23:37:44 +02:00
Madhu Rajanna 5684c4cc37 CSI: update cephcsi to v2.1.0
cephcsi v2.1.0 is released and doesnot need any deployment
template changes. This PR updates the cephcsi image
version to v2.1.0

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-04-20 14:58:25 +05:30
Sébastien Han 7c994441c3 ceph: make admin key optional for external cluster
Currently, we need to configure the Ceph external Admin keyi
in the Rook deployment to be able to connect to an external Ceph cluster.
If we wanted to run in a multi-tenant fashion
were several K8s/Rook clusters wanted to connect to the same external ceph cluster,
each K8s deployment would have the access to the External Ceph Admin key
and could potentially access or delete the Data
from pools that belong to other k8s/Rook Clusters.

Now the admin key is optional but the helper script create-external-cluster-resources.sh
will help create the necessary keys/users to connect to that cluster.

Closes: https://github.com/rook/rook/issues/4917 and https://github.com/rook/rook/pull/5227
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-04-20 09:59:04 +02:00
Travis Nielsen 348690ea64 ceph: update defaults to the ceph v14.2.9 release
With the release of ceph v14.2.9 we set the default examples to this version.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-17 12:54:06 -06:00
Travis Nielsen 753a5f56a6 Merge pull request #4904 from jmolmo/issue_4342_doc
Ceph:Update Helm Chart documentation
2020-04-15 15:42:46 -06:00
Sébastien Han 5adfc7b43d Merge pull request #5085 from leseb/rbd-mirror-crd
ceph: extract rbd-mirror to its own crd
2020-04-15 10:58:22 +02:00
Sébastien Han 2ad0d344b7 Merge pull request #5256 from travisn/review-cleanup
Reduce verbose logging for ok-to-stop failure
2020-04-15 10:30:08 +02:00
Sébastien Han c1b8a7aa9e ceph: extract rbd-mirror to its own crd
Previously, the rbd-mirror daemon was integrated into the `CephCluster`
CRD. This wasn't really practical since we would have to wait for the
whole orchestration to be done to actually set it up. The same goes for
any CR update. Let's say you want to change the number of daemons, Rook
would go through mons, mgrs and osds until it get to rbd-mirror.
This triggers an undesired full orchestration.

With its own CRD this component just gains a lot more flexibility.

Closes: https://github.com/rook/rook/issues/5084
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-04-15 09:12:56 +02:00
Travis Nielsen 4060167852 ceph: document example for skipping osd creation
When an OSD has been previously configured with ceph-volume, the
OSD will be skipped on the next installation if the device is not
fully wiped. Added an example to the docs to detect this case.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-14 16:12:04 -06:00
Satoru Takeuchi 372e862478 ceph: add the description of too few PGs per OSD warning in the document
Since users often encounter "too few PGs per OSD" warning, it's worth treating
this as a common issue.

Closes: https://github.com/rook/rook/issues/1329
Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-04-14 18:47:02 +00:00