Commit Graph
114 Commits
Author SHA1 Message Date
Travis Nielsen acad369b94 Merge pull request #4520 from alimaredia/wip-object-store-realm
object-store-realm: Initial design doc
2020-02-25 16:06:42 -07:00
Ali Maredia 429a4c336e ceph: initial design documents for ceph multisite
The implementation of this initial design will
allow object-stores to sync data across Rook Ceph
Clusters via a Day 1 setup of Ceph RGW Multisite

This design splits the realm, zonegroup, and zone
objects of Ceph RGW Multisite into seperate
resources.

This commit also moves all ceph object designs
into the design/ceph/object dir.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2020-02-25 17:10:08 -05:00
Blaine Gardner 178187d035 design: ceph orchestrator module add/remove OSDs
Add a design document to plan how Rook will allow Ceph's Rook
Orchestrator Mgr Module to add and remove OSDs to/from a Rook-Ceph
cluster including changes needed in both the Orchestrator Module and in
Rook.

Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2020-02-24 11:06:46 -07:00
Maksim Nabokikh 7dc9ec1191 cassandra: JMX prometheus exporter
Export prometheus metrics for cassandra in sidecar container

Signed-off-by: Maksim Nabokikh <maksim.nabokikh@flant.com>
2020-02-03 11:40:38 +04:00
Sébastien Han 289503a6ec ceph: remove last bits of osd min_size
As agreed in https://github.com/rook/rook/issues/2543, Rook must not set
min_size for a pool and should let Ceph handle that calculation.

Also, stop setting this property to EC pools.

Closes: https://github.com/rook/rook/issues/2543
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-01-10 17:24:52 +01:00
Travis Nielsen 9a078bf9e6 minio: remove from rook
The minio operator has not had community support nor
any updates since being added to Rook. Support is being
removed from Rook due to this lack of community interest.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-01-08 15:45:21 -08:00
Travis Nielsen 6c543788ba Merge pull request #4219 from cybozu-go/support-lv-backed-pv
ceph: support OSD on PVC backed by LV
2019-12-05 14:26:23 -07:00
dulltzandSatoru Takeuchi dfe45ac6b0 ceph: support OSD on PVC backed by LV
"OSD on PVC" doesn't work for PV backed by LV. Fixing this problem
by the following changes.

- Rook accepts LVM disk type.
- If a LV-backed device is passed, Rook/Ceph invokes
  "ceph-volume lvm prepare" with "--data vg/lv"
  instead of "--data /path/to/device".
- If a LV-backed device is passed, Rook/Ceph suppresses
  activation/deactivation of VG that owns this LV.

Fixes: https://github.com/rook/rook/issues/4185
Signed-off-by: dulltz <isrgnoe@gmail.com>
Co-authored-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2019-12-05 17:26:27 +00:00
Sébastien Han 3ebae50f84 design: add multus for ceph
Add the design doc for integrating multus with the ceph backend.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-12-05 18:16:37 +01:00
Travis Nielsen 0a352f64d9 Merge pull request #4285 from cybozu-go/use-mapper-name
ceph: support device selection for OSDs by device path name patterns
2019-12-05 07:54:07 -07:00
Kazuhito MATSUDA 40d868ebd7 ceph: support device selection for OSDs by device path name patterns
Add devicePathFilter to Storage Selection Settings which enables
device selection with a regular expression for device path names.

Fixes: https://github.com/rook/rook/issues/4275
Signed-off-by: Kazuhito MATSUDA <kazuto.jinnai@gmail.com>
2019-12-05 07:02:44 +00:00
Travis Nielsen 2c6a6a87d6 Merge pull request #3282 from elek/ozone-design
ozone: design doc for ozone operator
2019-12-04 15:36:28 -07:00
d-luu 9c755fac66 ceph: added priority classes to components
Adds priority class support to Ceph components
  to influence scheduler's pod preemption

Signed-off-by: d-luu <david@davidluu.info>
2019-11-15 16:28:41 -06:00
Sébastien Han 91b76cc24c doc: update design links
Since we re-organized the design directory we need to update the links
in various files.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-11-15 11:29:46 +01:00
Sébastien Han 3c28d3368d design: add backends to their respective directories
Add missing directories and re-organize the folder.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-11-14 12:48:04 +01:00
Nizamudeen 9a0a3d4070 ceph: Design document which explains the use of Conditions
Signed-off-by: Nizamudeen <nia@redhat.com>
2019-10-24 11:04:18 +05:30
Owen Tuz 15e3ecad54 ceph: add 'rgw.buckets.non-ec' to list of RGW metadataPools
This is used for S3 multipart uploads and should be configured in the same way as other metadata pools.

Signed-off-by: Owen Tuz <owen@segfault.re>
2019-10-17 18:44:59 +01:00
binoue 170f45cd42 doc: update wrong/outdated links
this fix not working links

Signed-off-by: binoue <banji-inoue@cybozu.co.jp>
2019-10-11 18:11:49 +09:00
Márton Elek d700b1a644 ozone: design doc for ozone operator
Signed-off-by: Márton Elek <elek@apache.org>
2019-09-26 18:32:34 +02:00
Noah Watkins e2fccdf03b ceph: remove the CRD option Mon.PreferredCount
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2019-08-27 17:43:35 -07:00
Noah Watkins 94bd70a14c ceph/mon: support monitor migration without rebuils
this patch adds two new related features. first, it removes the
requirement that all monitor deployments be pinned to nodes using node
selector. this is allowed when not using host networking and when PVC
storage is used. the second feature introduced in this patch is the
elimination of the Rook scheduler for placing monitors that continue to
use the node selector by using canary pods to that are scheduled by k8s,
after which Rook uses the scheduling results to pin the monitors to
nodes.

fixes: #3667

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2019-08-27 17:43:35 -07:00
Travis Nielsen b298a02fce Merge pull request #3067 from yard-turkey/bucket-provisioner
Bucket provisioner
2019-08-23 00:06:58 -06:00
Travis Nielsen 3abadd0571 Merge pull request #3649 from rohantmp/fencing
Design: ceph-openshift-fencing-mitigation
2019-08-22 21:47:55 -06:00
jeffvance 5db55e1cfd bucket design doc
Signed-off-by: jeffvance <jeff.h.vance@gmail.com>
2019-08-22 19:54:43 -06:00
Sébastien Han ddfb403a3f Merge pull request #3338 from giovanism/multi-homed-network-design
Design: Multi-homed Cluster Network Spec
2019-08-22 16:43:38 +02:00
Rohan CJ bfb20f84b0 Add design: ceph-openshift-fencing-mitigation
Signed-off-by: Rohan CJ <rohantmp@gmail.com>
2019-08-22 11:36:20 +05:30
Sakura ef70304ed2 fix typo in ceph-managed-disruptionbudgets.md
Signed-off-by: Sakura <longfei.shang@daocloud.io>
2019-08-22 00:04:40 +08:00
Vishal Biyani e02eaef39f Added a draft design doc for YugaByte Rook operator
Signed-off-by: Vishal Biyani <vishal@infracloud.io>
2019-08-21 12:56:59 +05:30
giovanism c2550ac8c4 design: Multi-homed Cluster Network
Signed-off-by: giovanism <giovanism@outlook.co.id>
2019-08-21 07:00:10 +07:00
Travis Nielsen ec3102a6e7 Merge pull request #3475 from noahdesu/ceph-mon-pv-design
design: ceph mon pv design
2019-08-02 22:07:52 -06:00
Noah Watkins fc1b494be8 design: ceph mon pv design
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2019-08-02 13:15:02 -07:00
Rohan CJ 733b76a523 Ceph: Add design for managed poddisrupionbudgets.
This design proposes that rook creates and manages PDBs for all ceph
daemons. OSDs need special treatment and a new heuristic, but simple
PDBs will suffice for other daemon types.

Signed-off-by: Rohan CJ <rohantmp@gmail.com>
2019-08-02 08:47:18 +05:30
Travis Nielsen 3ec7a5f480 Merge pull request #3306 from jarrpa/ceph-device-set-design
Rook StorageClassDeviceSet design doc
2019-07-02 16:31:32 -06:00
Jose A. Rivera 371a659491 Rook StorageClassDeviceSet design doc
Signed-off-by: Jose A. Rivera <jarrpa@redhat.com>
2019-07-02 17:13:46 -05:00
Alexander Trost a0df634dad remove unused md file (#3301)
remove unused md file
2019-06-18 17:59:22 +02:00
Sébastien Han 93b2448619 ceph: refactor rgw bootstrap
This commit does multiple things:

* remove support for AllNodes where we would deploy one rgw per node on
all the nodes.
* a transition path is implemented in the code so that if someone has an
existing deployment, daemonsets will be removed and replaced by an
deployments.
* when using "instances", each rgw deployed has its own key which makes
Ceph reporting the exact number of rgw running, see:

```
[root@rook-ceph-operator-775cf575c5-bh4sr /]# ceph -s
  cluster:
    id:     611fcf39-0669-4864-9a12-debb35c0397a
    health: HEALTH_OK

  services:
    mon: 3 daemons, quorum a,b,c (age 12h)
    mgr: a(active, since 12h)
    osd: 3 osds: 3 up (since 12h), 3 in (since 12h)
    rgw: 3 daemons active (my.store.a, my.store.b, my.store.c)

  data:
    pools:   6 pools, 600 pgs
    objects: 235 objects, 3.8 KiB
    usage:   3.0 GiB used, 84 GiB / 87 GiB avail
    pgs:     600 active+clean
```

Closes: https://github.com/rook/rook/issues/2474, https://github.com/rook/rook/issues/2957 and https://github.com/rook/rook/issues/3245
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-06-14 17:55:15 +02:00
xiaorui.zou c4aef1a073 remove unused md file
Signed-off-by: xiaorui.zou <xiaorui.zou@gmail.com>
2019-06-14 13:42:47 +08:00
Guy MargalitandTravis Nielsen fe5d94e370 Rook-NooBaa Design Doc
Signed-off-by: Guy Margalit <guymguym@gmail.com>
Co-Authored-By: Travis Nielsen <tnielsen@redhat.com>
2019-06-12 01:44:04 +03:00
Louis 355b652ed4 update ROOK_MON_HEALTHCHECK_INTERVAL
Signed-off-by: Louis <gofaceme@gmail.com>
2019-04-23 11:25:55 +08:00
Louis f88beafc56 update ROOK_MON_OUT_TIMEOUT to 600s
Signed-off-by: Louis <gofaceme@gmail.com>
2019-04-23 11:19:23 +08:00
Alexander Trost 8bc26d9096 k8sclient: Update all operators to use apps/v1
All usages of k8s go client are now also using the versioned `AppsV1() `
call for the client.

Updated MySQL and Wordpress, and Kube Registy examples to use apps/v1
Deployments.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2019-04-12 09:25:42 +02:00
Madhu Rajanna d9dd81396c remove attacher statefulset for rbd csi driver
deploy attacher as a container inside  rbd provisioner
stateful set

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-04-10 18:27:08 +05:30
Travis Nielsen 7bac02b06a Merge pull request #2857 from phlogistonjohn/csi-one-oh
Ceph-CSI 1.0 support and integration doc update
2019-04-05 10:24:49 -06:00
Ker Liu 4ca24f46d1 doc: Fix typo in doc
Signed-off-by: Ker Liu <kerliu818@gmail.com>
2019-03-29 18:38:41 +08:00
John Mulligan 3c22d31e17 design: future directions for rook + ceph-csi
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2019-03-27 12:55:18 -04:00
John Mulligan 5875069994 design: rewrite the rook/ceph-csi itegration section
Re-write the Rook/ceph-csi (short term) integration section
to conform to my goals and understanding of the integration
needs.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2019-03-19 13:05:54 -04:00
John Mulligan 2b97bdfc16 design: simplify "Coexist with flex driver" section
The "Coexist with flex driver" section was overly technical about
details in the implementation of CSI vs. flex. Remove the detail
and replace it with more goal oriented paragraphs.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2019-03-19 13:05:54 -04:00
John Mulligan 855e18fe40 design: Improve and update intro paragraphs
* Minor grammar and working improvements
* Update to current state of CSI in k8s, ceph-csi

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2019-03-19 13:05:22 -04:00
travisn a207fa4bcc design doc for managing an external ceph cluster
The user may want to connect to storage that is in a Ceph cluster,
independent from the local Kubernetes cluster. This design doc
describes the changes needed to enable the scenario.

Signed-off-by: travisn <tnielsen@redhat.com>
2019-03-18 10:43:17 -06:00
Noah Watkins 6597531ed0 ceph: share host ipc namespace with provision pod
this is needed as cryptsetup in the pod and udev on the host coordinate
via a semaphore that must be visible in both contexts.

note that additionally the host needs to have dmcrypt compiled with udev
synchronization, which at least one minikube version does not have.

fixes: #923

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2019-03-01 10:50:19 -08:00