Commit Graph
561 Commits
Author SHA1 Message Date
Travis Nielsen 9250c072cc Merge pull request #3322 from umangachapagain/rook-ceph-monitoring
Integrate ceph-mixins with rook-ceph
2019-07-08 18:27:03 -06:00
Alexander Trost f0b0f0e4f3 ceph: wrong pool name for CephFS StorageClass (#3400)
ceph: wrong pool name for CephFS StorageClass
2019-07-08 09:56:02 +02:00
Umanga Chapagain 732f3030d0 integrate prometheus based monitoring with rook-ceph
> add new field to cluster spec
> deploy servicemonitor
> deploy prometheusRule

Signed-off-by: Umanga Chapagain <chapagainumanga@gmail.com>
2019-07-08 11:40:17 +05:30
Joel Huang c404a7e68b ceph: wrong pool name for CephFS StorageClass
* This error is found in creating CephFS StorageClass using document `Documentation/ceph-csi-drivers.md`: "expect a pool named `cephfs_data` in your Ceph cluster"
* **`kubectl apply -f pool.yaml` using metadata.name "cephfs_data" produce error:** The CephBlockPool "cephfs_data" is invalid: metadata.name: Invalid value: "cephfs_data": a DNS-1123 subdomain must consist of lower case alphanumeric characters, '-' or '.', and must start and end with an alphanumeric character (e.g. 'example.com', regex used for validation is '[a-z0-9]([-a-z0-9]*[a-z0-9])?(\.[a-z0-9]([-a-z0-9]*[a-z0-9])?)*')
* accoding to `Documentation/ceph-filesystem-crd.md` linked from `Documentation/ceph-csi-drivers.md` file and field test, it should be `myfs-data0`

Signed-off-by: Joel Huang <joelhy@gmail.com>
2019-07-06 00:21:34 +08:00
Dmitry Yusupov 1f1f58ac1e Merge pull request #3375 from dyusupov/master
support for rook Device.FullPath
2019-07-05 07:40:47 -07:00
Joel Huang d4945d6533 ceph: fix typo error storegeclass
The word "storegeclass" should be "storageclass"

Signed-off-by: Joel Huang <joelhy@gmail.com>
2019-07-05 21:28:36 +08:00
Madhu Rajanna de9f8c1b62 Update rbd and cephfs secret
cephcsi PR https://github.com/ceph/ceph-csi/pull/395
changed the way we are storing secrets. This PR will
bring same changes to the rook as well.

Fixes: #3357

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-07-04 12:17:26 +05:30
Dmitry Yusupov 5ffe2f037c support for rook Device.FullPath
Signed-off-by: Dmitry Yusupov <dmitry.yusupov@nexenta.com>
2019-07-03 23:06:58 -07:00
Anton Skriptsov 8d0866b20e upgrade service's crds
Signed-off-by: Anton Skriptsov <sabbotagge@gmail.com>
2019-07-01 13:19:03 -07:00
Sébastien Han e6093d2c83 Merge pull request #3196 from travisn/upgrade-1.0
Ceph: upgrade test from 1.0 to master instead of 0.9 to master
2019-06-25 17:48:31 +02:00
Travis Nielsen e663624827 Merge pull request #3324 from Madhu-1/csiv1.1.0
update rook to use ceph-csi canary image
2019-06-25 08:24:21 -06:00
Madhu Rajanna 71f369303e update rook to use ceph-csi canary version
ceph-csi canary version is close to ceph-csi v1.1.0
release

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-06-25 17:15:46 +05:30
travisn 37efe00cc6 ceph: clarify that upgrade guide in master does not support upgrades
Signed-off-by: travisn <tnielsen@redhat.com>
2019-06-24 15:15:55 -06:00
Guy Margalit 2ce2382676 Refactor operator context init and allow to run local
Signed-off-by: Guy Margalit <guymguym@gmail.com>
Co-Authored-By: Sébastien Han <seb@redhat.com>
Co-Authored-By: Travis Nielsen <tnielsen@redhat.com>

This change is meant to allow running operators locally on a developer machine.
The idea is to allow faster development cycles by reducing the time and complexity of building -> deploying -> debugging on cluster.

For operators that rely only on kubernetes API this works easily - see cockroachdb and minio examples in development-flow doc.

The change includes:

- rook.NewContext() - Refactored to remove repeating initialization code that was copy-pasted in most of the operators in order to create the clusterd.Context and the Clientsets. Also it detects the mode of working in-cluster vs external and sets up the external mode with standard user config (~/.kube/config) and a job executor.
- rook.GetOperatorImage() - Refactor this repeating code in many operators to detect the operator pod image. Also added a global flag --operator-image that developers can use to override this when running locally.
- rook.TerminateOnError() - Added a convenient function.
2019-06-19 20:47:55 +03:00
Sébastien Han a74f806153 ceph: add psp.yaml example
The current doc was outdated and hardcoded, so removing the example from
the doc and add a proper psp.yaml file that people can use and
contribute too.

Closes: https://github.com/rook/rook/issues/3309
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-06-18 16:58:28 +02:00
Travis Nielsen 8da2221296 Merge pull request #3283 from leseb/rgw-refactor
ceph: refactor rgw bootstrap
2019-06-14 15:17:58 -06:00
Sébastien Han 93b2448619 ceph: refactor rgw bootstrap
This commit does multiple things:

* remove support for AllNodes where we would deploy one rgw per node on
all the nodes.
* a transition path is implemented in the code so that if someone has an
existing deployment, daemonsets will be removed and replaced by an
deployments.
* when using "instances", each rgw deployed has its own key which makes
Ceph reporting the exact number of rgw running, see:

```
[root@rook-ceph-operator-775cf575c5-bh4sr /]# ceph -s
  cluster:
    id:     611fcf39-0669-4864-9a12-debb35c0397a
    health: HEALTH_OK

  services:
    mon: 3 daemons, quorum a,b,c (age 12h)
    mgr: a(active, since 12h)
    osd: 3 osds: 3 up (since 12h), 3 in (since 12h)
    rgw: 3 daemons active (my.store.a, my.store.b, my.store.c)

  data:
    pools:   6 pools, 600 pgs
    objects: 235 objects, 3.8 KiB
    usage:   3.0 GiB used, 84 GiB / 87 GiB avail
    pgs:     600 active+clean
```

Closes: https://github.com/rook/rook/issues/2474, https://github.com/rook/rook/issues/2957 and https://github.com/rook/rook/issues/3245
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-06-14 17:55:15 +02:00
John Mulligan 214d08718e doc: Update csi document to match new storageclass field
Update the csi document to assist the user in updating the new
`clusterID` field that is used to map to mons in the configmap
rook maintains.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2019-06-14 10:45:50 -04:00
Travis Nielsen 0f1c919b83 Merge pull request #3255 from rhcs-dashboard/ceph-dashboard-enable-object-gateway
ceph: updated doc. for enabling dashboard object gateway mgmt.
2019-06-12 15:45:02 -06:00
Travis Nielsen 14e68dd5ce Merge pull request #3275 from iMartyn/patch-1
[skip-ci] Include AKS in the oddity list
2019-06-10 10:10:54 -07:00
Alexander Trost aff2874f17 Merge pull request #3276 from leseb/fix-doc
doc: fix patch command
2019-06-07 19:49:56 +02:00
Travis Nielsen 40ea3e65a2 Merge pull request #3274 from dyusupov/master
Enable proper usage of metadataOnly property
2019-06-07 10:45:03 -07:00
Sébastien Han e0584f344d doc: fix patch command
The command had the namespace twice, remove the typo and used a working
command.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-06-07 18:16:10 +02:00
Martyn Ranyard 397904ee14 [patch-1] Include AKS in the oddity list
Signed-off-by: Martyn Ranyard <m@rtyn.berlin>
2019-06-07 15:56:38 +02:00
Sébastien Han 62b69d08e5 ceph: add missing documentation for resource limits
This commit documents the minimum amount of memory accepted by Rook to
 run Ceph pods properly.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-06-07 15:06:16 +02:00
Dmitry Yusupov 41d92cee3e enable proper values for metadataOnly property
Signed-off-by: Dmitry Yusupov <dmitry.yusupov@nexenta.com>
2019-06-06 21:12:04 -07:00
alfonsomthd 856c626e2f ceph: enable dashboard object gateway mgmt.
* Provided steps to enable Object Gateway mgmt. from toolbox CLI.

Signed-off-by: alfonsomthd <almartin@redhat.com>
2019-06-03 14:12:18 +02:00
Travis Nielsen c4b9acae8c Merge pull request #3251 from rhcs-dashboard/ceph-dashboard-load-balancer
ceph: update dashboard section
2019-06-01 09:29:15 -06:00
travisn 346f2c9fd4 ceph docs: quickstart uses the test configuration for a single osd
Since the default OSD is no longer created under dataDirHostPath,
the most common issue in the 1.0 release is that users don't have OSD
created in the cluster. Now the quickstart doc will guide users to
create a test cluster to get them going with a filestore OSD in
a directory, with clear guidance that this is not expected in production

Signed-off-by: travisn <tnielsen@redhat.com>
2019-06-01 00:06:42 -06:00
alfonsomthd 06f0602a29 ceph: update dashboard section
* Updated dashboard image: Nautilus.
* Added LoadBalancer method to access dashboard.
* Added LB example: dashboard-loadbalancer.yaml

Signed-off-by: alfonsomthd <almartin@redhat.com>
2019-05-31 17:29:54 +02:00
Andrew Lavery b9e71351b9 docs: fix ceph upgrade 0.8->0.9 docs link
version 0.9 of the upgrade doc is located at ceph-upgrade.html not upgrade.html

Signed-off-by: Andrew Lavery <laverya@umich.edu>
2019-05-30 15:32:51 -07:00
Travis Nielsen 30d7010f70 Merge pull request #3134 from Madhu-1/fix-2987
add attacher container to cephfs CSI provisioner
2019-05-28 17:25:36 -06:00
Alexander Trost 097f5f15a2 doc: add link to vagrant+libvirt setup (#2880)
doc: add link to vagrant+libvirt setup
2019-05-19 14:03:39 +02:00
Travis Nielsen 0c23e1cd4b Merge pull request #3182 from sabbot/Edgefs-bugfix-3181
Edgefs: Prevents multiple targets deployment on the same node
2019-05-15 14:31:55 -06:00
Anton Skriptsov a0edbf627f Edgefs:3181 prevents multiple targets deployment on the same node
Signed-off-by: Anton Skriptsov <sabbotagge@gmail.com>
2019-05-15 11:45:59 -07:00
Santosh Pillai 7d5afa29b8 added device class pool property
- Updated code to use deviceClass property when a pool is created for both "replicated" and "erasure code".
- Updated "ceph crush rule create-..." command to use "create-replicated" instead of "create-simple"
- Updated unit tests
- Updated (ceph-pool-crd.md) documentation to reflect the changes.
- Updated pending release notes.

Signed-off-by: Santosh Pillai <sapillai@redhat.com>
2019-05-15 16:45:39 +05:30
Travis Nielsen 0dacfd4a0c Merge pull request #3093 from jarrpa/node-labels
Read node labels for provider topology
2019-05-14 14:07:17 -06:00
Travis Nielsen d798a03f81 Merge pull request #3171 from sabbot/s3x-proxy-container
Edgefs: Add s3 proxy container to S3X pod
2019-05-14 13:03:17 -06:00
Jose A. Rivera f3a1512983 Read node labels for provider topology
Signed-off-by: Jose A. Rivera <jarrpa@redhat.com>
2019-05-14 13:18:00 -05:00
Anton Skriptsov 57d4bb28b4 Edgefs: Add s3 proxy container to S3X pod
Signed-off-by: Anton Skriptsov <sabbotagge@gmail.com>
2019-05-14 09:25:57 -07:00
Alexander Trost 76708d1d52 docs: added missing delete for new manifest structure
This corrects the cleanup instructions to delete operator.yaml but also
common.yaml to remove the reamining objects in one go.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2019-05-14 18:14:39 +02:00
travisn b09ca55f3c ceph: upgrade guide describes failing over mons for new port
The default mon port has changed from 6790 to 6789. With the msgr2 work in nautilus,
the mons need to be listening on the default ports. These instructions will
direct the users to failover the mons to the new default port.

Signed-off-by: travisn <tnielsen@redhat.com>
2019-05-13 11:56:06 -06:00
ejez b21b5b3748 Correct typo in the doc related to ceph shared file system
Signed-off-by: Ejez <ejez@protonmail.ch>
2019-05-10 14:38:44 +03:00
Madhu Rajanna 64f063fb69 update code for cephfs-csi
add test cases to test cephfs csi
update ceph-csi document

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2019-05-09 20:04:06 +05:30
travisn 5098fc71ad docs: update for consistency after reviewing for release
Signed-off-by: travisn <tnielsen@redhat.com>
2019-05-02 13:28:11 -06:00
Alexander Trost 5aea23aea5 Add optional containers count for restore/zap option (#3088)
Add optional containers count for restore/zap option
2019-05-01 23:40:00 +02:00
Anton Skriptsov 1db2da74a7 Add container count for restore option
Signed-off-by: Anton Skriptsov <sabbotagge@gmail.com>
2019-05-01 13:14:56 -07:00
Travis Nielsen 9f4ee800c1 Merge pull request #3091 from travisn/nautilus-14.2.1
Ceph: Update tests and examples to Nautilus 14.2.1
2019-05-01 12:44:22 -06:00
Travis Nielsen 3f5b4a7bcc Merge pull request #3075 from bigbitbus/bugfix/issue-2591
Add lvm2 package to pre-reqs in docs
2019-05-01 10:21:53 -06:00
travisn 642a8c67a1 ceph: update tests and examples to nautilus 14.2.1
Signed-off-by: travisn <tnielsen@redhat.com>
2019-05-01 08:49:55 -06:00