Commit Graph
7961 Commits
Author SHA1 Message Date
Travis Nielsen 3767d6e14b tests: initialize the cluster-specific rbac properly
The integration tests were creating several namespace-specific resources
in the system namespace instead of the namespace with the cluster. This
was only affecting the rook-ceph-osd and rook-ceph-mgr service accounts,
which hadn't been exercised until the nodes were queried by osds for
topology awareness.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2019-11-04 23:07:13 -07:00
Travis Nielsen 51cc8a752f ceph: restructure the object store guide for OBCs
The guide for configuring object stores has a new flow for creating
buckets in the object store. This requires a new approach instead of
asking the user to create user creds and a bucket with other commands
such as s3cmd.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2019-11-05 10:04:03 +05:30
d-luu 014431ee0d ceph: fix set mgr annotations
Mgr annotation was previously not being set.

Signed-off-by: d-luu <david@davidluu.info>
2019-11-04 15:22:24 -06:00
Jiffin Tony Thottan 5a72f9a299 doc: Add OBC details to admin guide
This patch adds required documentation to consume OBC for a user

Signed-off-by: Jiffin Tony Thottan <jthottan@redhat.com>
2019-11-04 23:14:07 +05:30
Sébastien Han ef6815ebfa ceph: remove topologyAware CRD option
We removed the topologyAware CRD option since it was redundant with the
use of an OSD being backed by a PVC.
So now, if an OSD is backed by a PVC we assume the topology aware
decision and will discover zone and region labels on that host.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-11-04 09:53:14 -07:00
Sébastien Han 1f788cf637 Merge pull request #4202 from galexrt/fix_helm_chart_csi_port
ceph: helm: fix operator chart rbdGrpcMetricsPort
2019-11-04 09:16:34 +01:00
Alexander Trost 020626a432 docs: added missing Rook Ceph operator helm values
Added missing csi values of the Rook Ceph operator helm chart to the
documentation.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2019-11-03 13:06:38 +01:00
Alexander Trost 9fe5e2ad3e ceph: helm: fix operator chart rbdGrpcMetricsPort
This fixes the conditional for the `rbdGrpcMetricsPort` option.
Previously the `rbdGrpcMetricsPort` was useless as it was not used,
instead the Helm chart looked for `cephfsrbdGrpcMetricsPort` option.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2019-11-03 13:06:38 +01:00
Travis Nielsen 77a583dac9 Merge pull request #4240 from travisn/yq-install
Build Fix: Update the path to pull the yq tool
2019-11-03 01:42:38 -06:00
Travis Nielsen d79c8a61a3 build: update the path to pull the yq tool
The yq tool changed and requires a new path from which to build.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2019-11-03 01:16:20 -06:00
Alexander Trost 77814b022d docs: rework and improve documentation (#4166)
docs: rework and improve documentation
2019-11-01 18:15:41 +01:00
Alexander Trost c7afa0eb43 misc: docs: unified formatting and style
This is the first phase  miscellaneous part of three phases to improve and
rework the Rook documentation for better user accessibility to the Rook
projects and  with that the storage providers.
Phase two is about automatic generation of CRD documentation and phase
three is about reworking the docs themselves and, e.g., examples for
CRDs and certain use cases.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2019-11-01 18:13:27 +01:00
Alexander Trost eb74512021 yugabyte: docs: unified formatting and style
This is the first phase YugabyteDB part of three phases to improve and
rework the Rook documentation for better user accessibility to the Rook
projects and  with that the storage providers.
Phase two is about automatic generation of CRD documentation and phase
three is about reworking the docs themselves and, e.g., examples for
CRDs and certain use cases.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2019-11-01 18:11:19 +01:00
Alexander Trost a91d83d833 edgefs: docs: unified formatting and style
This is the first phase EdgeFS part of three phases to improve and
rework the Rook documentation for better user accessibility to the Rook
projects and  with that the storage providers.
Phase two is about automatic generation of CRD documentation and phase
three is about reworking the docs themselves and, e.g., examples for
CRDs and certain use cases.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2019-11-01 18:11:00 +01:00
Alexander Trost eb0d8699d1 cockroachdb: docs: unified formatting and style
This is the first phase CockroachDB part of three phases to improve and
rework the Rook documentation for better user accessibility to the Rook
projects and  with that the storage providers.
Phase two is about automatic generation of CRD documentation and phase
three is about reworking the docs themselves and, e.g., examples for
CRDs and certain use cases.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2019-11-01 18:10:51 +01:00
Alexander Trost 64afb24596 cassandra: docs: unified formatting and style
This is the first phase Ceph part of three phases to improve and rework
the Rook documentation for better user accessibility to the Rook
projects and  with that the storage providers.
Phase two is about automatic generation of CRD documentation and phase
three is about reworking the docs themselves and, e.g., examples for
CRDs and certain use cases.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2019-11-01 18:10:36 +01:00
Alexander Trost 98217272be ceph: docs: unified formatting and style
This is the first phase Ceph part of three phases to improve and rework
the Rook documentation for better user accessibility to the Rook
projects and  with that the storage providers.
Phase two is about automatic generation of CRD documentation and phase
three is about reworking the docs themselves and, e.g., examples for
CRDs and certain use cases.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2019-11-01 18:10:32 +01:00
Travis Nielsen 038667cfb7 Merge pull request #4236 from travisn/topology-aware-rack
Support all layers of CRUSH map with node labels
2019-10-31 14:49:27 -06:00
Travis Nielsen 831c15086a ceph: support all layers of CRUSH map with node labels
The node labels were already supported for zones and regions to add to
the CRUSH map. Now all layers of the CRUSH map will be supported
with the new labels such as topology.rook.io/rack.
The labels will be detected at the osd startup time
similar to the zone and region labels already being detected.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2019-10-31 14:47:18 -06:00
Sébastien Han 382524a408 Merge pull request #4217 from travisn/block-test-stabilize
Clean up block integration tests more reliably
2019-10-31 09:13:07 +01:00
Travis Nielsen 1593e52933 Merge pull request #4138 from ashleyw/master
edgefs: Add NET_ADMIN to corosync container capabilities
2019-10-30 16:44:48 -06:00
Travis Nielsen e32729269f ceph: clean up block integration tests more reliably
The block integration tests are a source of intermittent failures
in the CI. The PVCs were not being confirmed as removed before the
pools were deleted. Then the pool would not be removed since there
might still be a block image from the PVC that wasn't deleted yet.
Now the tests will ensure the PVCs and their block images are
removed before the pool is deleted.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2019-10-30 15:37:35 -06:00
Travis Nielsen b13c173148 Merge pull request #4197 from travisn/stale-pull-requests
Close stale pull requests if no activity
2019-10-30 13:40:17 -06:00
Travis Nielsen fb51b5abd8 Merge pull request #4224 from jmolmo/issue_3851
ceph: Included missing rolebindings for PSP in Helm chart
2019-10-30 13:13:38 -06:00
Travis Nielsen b31b570c1f Merge pull request #4220 from rohantmp/uniqueToleration
Ceph: fix the deduplication of tolerations collected for the drain-canary
2019-10-30 13:12:26 -06:00
Travis Nielsen b04567c0bd Merge pull request #4222 from sp98/fix-orchestration-restart
stop orchestration restart on device config map update for osd on pvc
2019-10-30 13:11:27 -06:00
Rohan CJ b16d55f4a0 Ceph: fix the deduplication of tolerations collected for the drain-canary
- Implement exportable TolerationSet with the following differences:
  - Change map key to a string to ensure it is deterministic.
    The old key was a struct that included a pointer.
  - Sort the outputted list by this key to ensure the order is deterministic.
  - Get the tolerations from the deployment instead of the pod as pod tolerations
    are sometimes modified by the system. We only want user provided tolerations
    in our deployment.
- Modify tests to try duplicate keys from different structs. The old way tested duplicate
  keys using the same structs.

Signed-off-by: Rohan CJ <rohantmp@gmail.com>
2019-10-30 22:42:01 +05:30
Juan Miguel Olmo Martínez 9c152e74af ceph: Included missing rolebindings for PodSecurityPolicies in Helm chart
**Description of your changes:**
Include missing rollebindings present in common.yaml file and not in the
rolebindings file for the Ceph Helm chart.

Resolves #

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2019-10-30 17:11:40 +01:00
Travis Nielsen 642f592079 Merge pull request #4216 from travisn/continue-mon-on-failure
Continue with orchestration if a single mon pod fails to start
2019-10-30 09:24:05 -06:00
Santosh Pillai d1c82015f9 ceph: stop orchestration restart on device config map update for osd on pvc
when running OSD on PVC, orchestration should not be started again if there is any change in the device config
map. Added a check to skip orchestration on device CM update when StorageClassDeviceSets are available,
that is, when running osd on pvc.

Signed-off-by: Santosh Pillai <sapillai@redhat.com>
2019-10-30 20:00:27 +05:30
Travis Nielsen 95171c682b ceph: continue with orchestration if a single mon pod fails to start
If the cluster has previously been initialized and the operator
is restarted, the operator needs to perform the first orchestration
to confirm basic cluster health, then start watching for CR events.
If there was a single mon pod in a failed or pending pod state, the
orchestration was blocked even if just one mon was in this state.

The scenario is when a node is lost and a mon and the operator happen
to be running on that node. The operator will restart, but the mon
will not restart because it is tied to the node that died (unless running
on a PVC). The mon would remain in a pending state while attempting
to schedule on the node that is down indefinitely and the operator would
be blocked indefinitely. Now we will just log the error and attempt
to continue.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2019-10-30 08:24:18 -06:00
Sébastien Han 09e29d01b1 Merge pull request #4214 from leseb/skip-restorecon
ceph: osd hide 'restorecon' when necessary
2019-10-30 14:44:30 +01:00
Sébastien Han 69a3a52f37 Merge pull request #4213 from rohantmp/canaryImage
Ceph: use the rook image for drain-canaries.
2019-10-30 11:57:36 +01:00
Sébastien Han d224fbdef1 ceph: osd hide 'restorecon' when necessary
Some testing on OpenShift has shown that enabling Hostnetworking causes
issues with ceph-volume creating OSD.
This is a pure Red Hat OpenShift downstream issue.

This is meant to be temporary while we are waiting for the Selinux team
to get back to us.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-10-30 11:32:15 +01:00
Rohan CJ 17f6a25b2b Ceph: use the rook image for drain-canaries.
Change the canaries to use the rook image instead of the busybox image to
run `sleep infinity`. This removes our dependency on an external image that
we do not control.

Signed-off-by: Rohan CJ <rohantmp@gmail.com>
2019-10-30 12:47:14 +05:30
Travis Nielsen 1bab64687b Merge pull request #4198 from egafford/generate-keyrings-before-OSD-deployment
ceph: Generate keyrings before OSD deployment
2019-10-29 16:51:36 -06:00
egafford 51689b6d3f ceph: Generate keyrings before OSD deployment
Generating keyrings after deployments created a race condition
resulting in intermittent OSD pod failure on the first attempt.
This change creates keyrings prior to creation of OSD deployments
and updates the owner after the creation of a deployment.

Partially fixes: rook#4089
Signed-off-by: egafford <egafford@redhat.com>
2019-10-29 16:01:50 -04:00
Sébastien Han 6dff2afe8b ceph: osd update error message
Add a more meaninful message.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-10-29 16:58:16 +01:00
Travis Nielsen 3d5addc282 Merge pull request #4123 from thotz/obc
objectstore: set quota for max_bucket into -1 in Grant()
2019-10-28 13:40:39 -06:00
Travis Nielsen edbbf6b2ca project: close stale pull requests if no activity
Issues are already being closed if there is no activity for 90 days.
Pull requests have not been closed automatically. This change will cause
pull requests to be closed after six months of inactivity. If there is
no further activity, the PR will be closed after one more month.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2019-10-26 01:03:11 -06:00
Travis Nielsen 45b3f53710 Merge pull request #2437 from mykaul/mykaul-patch-1
Remove comments on merged issues
2019-10-26 00:48:00 -06:00
Travis NielsenandYaniv Kaul 42cccf3210 docs: remove comments on merged issues in dev guide
Both issues were already merged in Kubespray, so hopefully irrelevant anymore.

Co-authored-by: Yaniv Kaul <ykaul@redhat.com>
Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2019-10-26 00:40:55 -06:00
Travis Nielsen 734467aa33 Merge pull request #4194 from krig/doc-runtime
Tests: Document the DOCKERCMD environment variable
2019-10-25 16:23:06 -06:00
Dmitry Yusupov 2b80eaf052 Merge pull request #4190 from sabbot/sysrepcount-failuredomain-validation
FailureDomain/SysRepCount validation
2019-10-25 10:36:53 -07:00
Travis Nielsen d6888b5aa2 Merge pull request #4191 from sebastian-philipp/removeOSDsIfOutAndSafeToRemove
ceph: Add removeOSDsIfOutAndSafeToRemove to CRD
2019-10-25 11:00:04 -06:00
Kristoffer Grönlund 601bef2280 Tests: Document the DOCKERCMD environment variable
PR #3611 added the possibility of using something other
than docker as the container CLI, but the readme wasn't
updated.

[skip ci]

Signed-off-by: Kristoffer Grönlund <kgronlund@suse.com>
2019-10-25 17:42:19 +02:00
Ashley Williams 05aba33636 fix: add NET_ADMIN to corosync container capabilities
Resolves https://github.com/Nexenta/edgefs/issues/393

Signed-off-by: Ashley Williams <hi@ashleyw.co.uk>
2019-10-25 16:37:34 +01:00
Sébastien Han 10eff06430 Merge pull request #4189 from leseb/prepare-osd-fix
ceph: fix set osd prepare resources
2019-10-25 16:57:14 +02:00
Sebastian Wagner b2fe1b951d ceph: Add removeOSDsIfOutAndSafeToRemove to CRD
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-10-25 15:57:32 +02:00
Anton Skriptsov d75a281d6e edgefs: FailureDomain-SysRepCount validation
Additional failureDomain,sysRepCount validation

Signed-off-by: Anton Skriptsov <sabbotagge@gmail.com>
2019-10-25 06:27:35 -07:00