Commit Graph
769 Commits
Author SHA1 Message Date
Sébastien Han 227d2d527a ceph: osd store refactor
Multiple things:

1. We removed all the function/methods/tests that were used to
create and manage rook legacy OSDS as well as bringing support to
Bluestore OSD only.
It also fixes various go-lint issues in the respectives files.

2. use c-v inventory to detect available devices:
Now we rely on the 'ceph-volume inventory' command to tell us if a
device is available or not.

3. implement raw mode for osd on pvc
When an OSD will be bootstrap on a PVC, the new c-v raw mode will be
used. It consists of putting block, db and wal under the same device.
Here LVM is out of the picture and the raw device is used as is. The
implementation is backward compatible so existing OSD on PVC will LVM
will continue to operate.

Closes: https://github.com/rook/rook/issues/4363
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-01-23 19:13:09 +01:00
Sébastien Han 245516e607 Merge pull request #4737 from cybozu-go/ceph-add-a-note-of-osd-in-placement
ceph: add a note of osd in placement
2020-01-23 09:24:40 +01:00
Satoru Takeuchi 24e62faa2d ceph: add a note of osd in placement
Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-01-23 01:09:16 +00:00
Travis Nielsen 8f6f9a444a Merge pull request #4682 from leseb/enable-partition-support
ceph: add partition support
2020-01-16 11:14:06 -07:00
Travis Nielsen 6ad62bebf4 Merge pull request #4688 from leseb/external-cluster-crash
ceph: ability to disable crash controller
2020-01-16 11:13:48 -07:00
Umanga Chapagain 55e45862ae Ceph: updates CephCluster CRD doc to include monitoring options
adds documentation on spec to enable/disable monitoring of Ceph
clusters using prometheus. prometheus still needs to be deployed
separately.

Signed-off-by: Umanga Chapagain <chapagainumanga@gmail.com>
2020-01-16 21:33:19 +05:30
Sébastien Han bb214b2f27 ceph: ability to disable crash controller
A new CR setting has been introduced to disable the crash controller.
To disable it, add `disable: true` on the crashCollector section.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-01-16 16:05:22 +01:00
Sébastien Han dd659de46f ceph: add partition support
We now support partitions via 2 ways:

* if `useAllDevice: true`: partitions will be taken into account and
presented as OSD candidate
* if specified in the cluster CR: it'll picked up as well

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-01-16 09:34:46 +01:00
Sébastien Han 81dd279062 Merge pull request #4653 from leseb/pick-14.2.6
ceph: bump to 14.2.6
2020-01-15 17:44:52 +01:00
Sébastien Han dec0c7d4b0 ceph: bump to 14.2.6
14.2.6 is released, let's use it!

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-01-15 11:02:44 +01:00
Travis Nielsen f5edde3b80 Merge pull request #4503 from travisn/test-k8s-1.17
Run integration tests on K8s 1.17
2020-01-09 18:08:26 -08:00
Travis Nielsen 9a078bf9e6 minio: remove from rook
The minio operator has not had community support nor
any updates since being added to Rook. Support is being
removed from Rook due to this lack of community interest.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-01-08 15:45:21 -08:00
Travis Nielsen a02c2c3089 tests: run integration tests on k8s 1.17 and remove 1.12
With the release of K8s 1.17 Rook needs to test on this new version.
The integration tests will now run the tests across K8s 1.13-1.17.
The pattern has been to run the tests across the most recent five
versions.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-01-08 07:18:53 -08:00
Sébastien Han 05aa639317 ceph: add option to continue on unclean PGs
A new CRD option `continueUpgradeAfterChecksEvenIfNotHealthy` is added.
When upgrading, Rook goes OSD by OSD and then waits for PGs to be clean
before proceeding to the next OSD. Currently, Rook waits for 5 hours but
there might be circumstances where PGs need more time to settle.
Thus setting `continueUpgradeAfterChecksEvenIfNotHealthy` to true will
pursue the upgrade process, even if PGs are not 100% active+clean.

Closes: https://bugzilla.redhat.com/show_bug.cgi?id=1786029
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-01-07 12:18:54 -07:00
Rik Harris 410b5263ed doc: ceph DR updates based on real-world mistake
After a failure in a live ceph cluster, I discovered some minor glitches
when executing the instructions in ceph-disaster-recovry.md. Hopefully
this should help others.

Signed-off-by: Rik Harris <git@kawaja.net>
2020-01-04 18:04:16 +11:00
Sébastien Han 360ff98923 documentation: improve commit structure
This commits adds more documentation on how to contribute better commit
messages.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-01-03 10:14:41 +01:00
Jeff Billimek 127e9d289a ceph: bumping ceph-operator memory limit to 256Mi
* bumping ceph-operator memory limit from 128Mi to 256Mi in order to
avoid OOMkills of the rook-ceph-operator pod
* updating documentation example for operator to denote a limit of 256Mi
instead of 128Mi

When upgrading from rook v1.1.7 to v1.2.0, the rook-ceph-operator pod
continued to get OOMKilled by the kubernetes scheduler.  Manually
bumping this limit to something higher than 128Mi (I tried 256Mi and it
was good) prevented the OOMKills.

Signed-off-by: Jeff Billimek <jeff@billimek.com>
2019-12-20 11:41:40 -05:00
Dmitry Yusupov fce90f8f6a Merge pull request #4540 from dyusupov/master
EdgeFS: last minute doc changes for 1.2
2019-12-18 11:22:08 -08:00
Dmitry Yusupov 6ebcc52565 EdgeFS: last minute doc changes for 1.2
Signed-off-by: Dmitry Yusupov <dmitry@nexenta.com>
2019-12-18 11:19:39 -08:00
Travis Nielsen 36894b1791 ceph: increase size of headers for upgrade
To simplify the readability of the important sections for the upgrade
we will increase the header size.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2019-12-18 12:00:51 -07:00
Blaine Gardner 56569ffc23 Merge pull request #4532 from SUSE/rename-disaster-recovery-md
docs: append `ceph-` to `disaster-recovery.md` doc
2019-12-18 11:37:47 -07:00
Blaine Gardner 326b2b6a32 docs: append ceph- to disaster-recovery.md doc
Add the `ceph-` prefix to the `disaster-recovery.md` document since it
is Ceph-specific and should be logically grouped with the rest of the
`ceph-` docs.

Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2019-12-18 11:31:49 -07:00
Alexander Trost 78cce642a4 docs: added toc to Ceph advanced configuration page
Added table of contents to the Ceph advanced configuration page to make
it easier to find the right section till the theme / layout of the
homepage can autogenerate a toc if enabled.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2019-12-18 19:25:20 +01:00
Travis Nielsen f7b6984b6e Merge pull request #4420 from galexrt/fix_cephfs_docs
docs: fix storageclass name used
2019-12-17 15:22:22 -07:00
Travis Nielsen 92e7f12451 cephcsi: add upgrade documentation for csi driver
If using ceph-fuse or rbd-nbd the application pods will need
to be restarted during upgrade. This adds a description of
the steps necessary to ensure the applications remain healthy
during upgrade.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2019-12-16 23:16:05 -07:00
Madhu Rajanna 8be3cdd10e CSI: cephfs and rbd daemonset upgrade strategy
CSI nodeplugins, specifically when using cephfs FUSE or
rbd-nbd as the mounters, when upgraded, will
cause existing mounts to become stale/not-rechable
(usually connection timeout errors).

This is due to losing the mount processes running within the
CSI nodeplugin pods.

This PR add updated the Daemonset update strategy
based on the ENV variable to take care of above issue
with some manual steps

Moreinfo: https://github.com/ceph/ceph-csi/issues/703

Resolves: https://github.com/rook/rook/issues/4248

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-12-16 23:15:56 -07:00
Travis Nielsen 804e41132d ceph: force enable the cephfs kernel driver by default
There are two issues at odds with the cephfs driver. The
first is that older kernels less than 4.17 do not support
quotas so PVC sizes will not be enforced with the kernel
driver in that case. If the FUSE client is used instead, there
are issues during upgrade because the client mount will be
disrupted and the client pods will have to restart.

To prevent client pods from breaking during upgrade, we enable
the kernel driver by default. If the quotas are critical,
the admin will need to take steps during upgrade to prevent
breaking the applications.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2019-12-16 13:04:16 -07:00
Madhu Rajanna 85d622dc2f CSI: Add ENV variable to use ceph kernel client
In ceph-csi v1.2.2 we have add a flag `forcecephkernelclient`
to force use Ceph Kernel clients on kernel < 4.17 which
support quotas for Cephfs

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-12-16 12:36:31 -07:00
Travis Nielsen 32a69b8afc ceph: clarifications to v1.2 upgrade guide
Removed some obsolete instructions from the 1.1 upgrade
and made a few minor fixes to make the upgrade to 1.2 smoother.
With the addition of the CephClient CRD, the CRD needs to be
created before the upgrade or else the operator log will be
filled with errors until it is created. The CSI driver also
had an error when registering after the upgrade due to an RBAC
change.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2019-12-16 11:31:52 -07:00
Sébastien Han 0a1d700927 ceph: osd tune startup flags when running on GP2
gp2 devices present themselves as SSDs,
but have much more variable performance.
Ceph attempts to adjust some settings based on the drive type,
HDD/SSD
In this case client I/O can be impacted too much by assuming gp2 devices are like other SSDs
(an example is https://bugzilla.redhat.com/show_bug.cgi?id=1765923#c6)

In order to prevent this, rook can set the following for OSDs
if the new CR setting `tuneSlowDeviceClass` is set to `true`:

```
osd_recovery_sleep = 0.1
osd_snap_trim_sleep = 2
osd_delete_sleep = 2
```

Closes: https://github.com/rook/rook/issues/4298 and https://bugzilla.redhat.com/show_bug.cgi?id=1771047
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-12-16 16:37:02 +01:00
Dmitry Yusupov 1fd1938234 Merge pull request #4505 from dyusupov/master
EdgeFS documentation corrections and 1.2 release notes
2019-12-13 17:22:48 -08:00
Dmitry Yusupov ad93098a33 EdgeFS documentation corrections and 1.2 release notes
Signed-off-by: Dmitry Yusupov <dmitry@nexenta.com>
2019-12-13 15:35:30 -08:00
Travis Nielsen ef4d5aea88 ceph: document manual deletion of osds
Removal of OSDs is a sensitive area. If you get it wrong you could have data
loss. Now a help topic is provided for manual steps to remove OSDs when
absolutely necessary.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2019-12-13 09:09:07 -07:00
Blaine Gardner 2a250314be Ceph: update upgrade docs for v1.1 -> v1.2
Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2019-12-12 13:58:25 -07:00
Sébastien Han 695412acd8 Merge pull request #4477 from shellwedance/ceph_document_typo
docs: fix typo on ceph cluster crd description
2019-12-12 08:59:32 +01:00
taeuk_kim 3aedc8c80d docs: fix typo on ceph cluster crd description
Signed-off-by: taeuk_kim <taeuk_kim@tmax.co.kr>
2019-12-12 15:38:58 +09:00
Travis Nielsen 009af3dab0 Merge pull request #3621 from alexcpn/patch-1
add 'git clone' step to quickstart guides
2019-12-10 11:10:15 -07:00
Travis Nielsen 3294384da7 Merge pull request #4415 from leseb/use-minor-version
rook-ceph: stop using ceph version with timestamp and bump to 14.2.5
2019-12-10 08:14:51 -07:00
Alex Punnen 2d3ddc6a8d docs: add 'git clone' step to quickstart guides
Add documentation to clone the correct release branch of the repo
   to reduce confusion from pulling the wrong branch.
   removed spaces

Signed-off-by: Alex Punnen <alexcpn@gmail.com>
2019-12-10 20:22:56 +05:30
Sébastien Han 68fd4f4df9 rook: stop using ceph version with timestamp
With https://github.com/ceph/ceph-container/pull/1529, we now build
vX.X.X version so we don't need to have the timestamp. Also we will
automatically get the last changes from the OS/packages too more
frequently.

Closes: https://github.com/rook/rook/issues/4414
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-12-10 11:39:35 +01:00
Dmitry Yusupov f842c60116 Merge pull request #4432 from SergeyKaydalov/edgefs-s3-payload
EdgeFS: support for payload on external S3 server
2019-12-09 20:01:37 -08:00
Mateusz Los 50f3d29cf4 ceph: client controller tests and docs
ceph client CRD refactoring
Add info about client crd to documentation
Add tests for client controller CRD

Signed-off-by: Mateusz Los <los.mateusz@gmail.com>
2019-12-09 12:48:44 +01:00
Alex Punnen ae633f4828 docs: add 'git clone' step to quickstart guides
Add documentation to clone the correct release branch of the repo
        to reduce confusion from pulling the wrong branch.

Signed-off-by: Alex Punnen <alexcpn@gmail.com>
2019-12-07 11:19:29 +05:30
Cody Belcher 47a706288d Docs: edgefs-quickstart
removed dead link to edgefs-helm-operator.md from edgefs-quickstart.md

Signed-off-by: Cody Belcher <cody.t.belcher@gmail.com>
2019-12-06 22:10:14 -06:00
Sergey Kaydalov b6b95d44ed edgefs: payloads on an S3 service
Added support for data chunk forwarding to an external S3 service

Signed-off-by: Sergey Kaydalov <kayserg@gmail.com>
2019-12-06 19:16:43 +02:00
Otto Yiu 239028c010 docs: fix typo on ceph bucket claim description
Signed-off-by: Otto Yiu <otto@live.ca>
2019-12-05 22:57:14 -08:00
dulltzandSatoru Takeuchi dfe45ac6b0 ceph: support OSD on PVC backed by LV
"OSD on PVC" doesn't work for PV backed by LV. Fixing this problem
by the following changes.

- Rook accepts LVM disk type.
- If a LV-backed device is passed, Rook/Ceph invokes
  "ceph-volume lvm prepare" with "--data vg/lv"
  instead of "--data /path/to/device".
- If a LV-backed device is passed, Rook/Ceph suppresses
  activation/deactivation of VG that owns this LV.

Fixes: https://github.com/rook/rook/issues/4185
Signed-off-by: dulltz <isrgnoe@gmail.com>
Co-authored-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2019-12-05 17:26:27 +00:00
Travis Nielsen 0a352f64d9 Merge pull request #4285 from cybozu-go/use-mapper-name
ceph: support device selection for OSDs by device path name patterns
2019-12-05 07:54:07 -07:00
Kazuhito MATSUDA 40d868ebd7 ceph: support device selection for OSDs by device path name patterns
Add devicePathFilter to Storage Selection Settings which enables
device selection with a regular expression for device path names.

Fixes: https://github.com/rook/rook/issues/4275
Signed-off-by: Kazuhito MATSUDA <kazuto.jinnai@gmail.com>
2019-12-05 07:02:44 +00:00
RAJAT SINGH 519b36286c File: Added file direct-mount.yaml
Changed all the occurances of toolbox.yaml to direct-mount.yaml in file direct-tools.md

Signed-off-by: RAJAT SINGH <rajasing@redhat.com>
2019-12-05 01:57:40 +05:30