Commit Graph
7961 Commits
Author SHA1 Message Date
Alexander Trost f819404113 Merge pull request #6099 from cloudical-io/fix_13_upgrade_apply_file
ceph: fix v1.3 to v1.4 upgrade apply file syntax
2020-08-17 22:51:43 +02:00
Alexander Trost d16a778cc5 ceph: fix v1.3 to v1.4 upgrade apply file syntax
There is a missing YAML document / object separator in the apply file.
This PR adds it so it can be applied without errors.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2020-08-17 22:46:05 +02:00
Alexander Trost 435b99f7ee Merge pull request #6086 from cloudical-io/fix_5491 2020-08-17 22:15:24 +02:00
Travis Nielsen 98db380237 Merge pull request #6062 from leseb/wal-encryption
ceph: add support for wal encrypted device on pvc
2020-08-17 14:07:40 -06:00
Alexander Trost 2288ec90ed docs: fix helm command usage
This fixes the helm commands to be compatible with Helm v3.x and adds an
example / notes for Helm v2.x users.

Resolves #5491

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2020-08-17 22:04:26 +02:00
Alexander Trost 788709f67a Merge pull request #6082 from cloudical-io/additional_user_labels
core: added labels to rook v1
2020-08-17 18:18:42 +02:00
Sébastien Han 45b8a0c88c Merge pull request #6035 from guni1192/ci-fix-remove-cluster-role-bindings
ci: skip the creation of already existing clusterrolebinding
2020-08-17 17:52:38 +02:00
Sébastien Han b4208f4a55 Merge pull request #6090 from leseb/fix-rgw-healthcheck
ceph: fix object store healthcheck yaml
2020-08-17 17:32:15 +02:00
Sébastien Han a5982b749f ceph: fix object store yaml example
The healthcheck for the bucket is called `bucket`.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-17 17:24:26 +02:00
Sébastien Han 80ff2bb0be Merge pull request #6048 from aruniiird/external-script-optional-json-output
Making RBD provisioner, Ceph provisioner and Ceph node optional
2020-08-17 17:19:11 +02:00
Arun Kumar Mohan a5b4020d80 ceph: making rbd / cephs provisioner and nodes optional
Some more optional items in json output.
RBD Provisioner, CSI CephFS node and provisioner are now optional and
will only be populated if they are available.

Signed-off-by: Arun Kumar Mohan <amohan@redhat.com>
2020-08-17 19:32:26 +05:30
Arun Kumar Mohan 940118af82 ceph: a minor refactoring of external cluster resources script
Signed-off-by: Arun Kumar Mohan <amohan@redhat.com>
2020-08-17 18:57:00 +05:30
Sébastien Han dbac1c11d0 ceph: improve callCephVolume() for list and prepare
callCephVolume() was using our exec interface with CombinedOutput which
means return both stdout and stderr. This is fine when preparing OSDs
since we read back the stdout and also want any errors if any (stderr).
However when listing OSD we only want the output since ceph-volume tends
to mix stdout and stderr in the output and does not always silence the
warning types/harmless errors. If the listing has a problem we report it
by printing the ceph-volume log file.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-17 12:43:43 +02:00
Sébastien Han f59aecb36b Merge pull request #6083 from cloudical-io/rbdmirror_doc
docs: added rbd mirror crd documentation
2020-08-17 12:12:38 +02:00
Alexander Trost e990841206 docs: added rbd mirror crd documentation
This adds some basic RBDMirror CRD documentation and fixes the types.go
comments accordingly.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2020-08-17 11:55:42 +02:00
Alexander Trost 5225a59278 core: added labels to rook v1
This adds Labels and LabelsSpec to the rook.io/v1 apis pkg.

Related to #6050

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2020-08-17 10:57:48 +02:00
Sébastien Han 7859bf5c4b ceph: fix object store healthcheck yaml
Reverting some of
https://github.com/rook/rook/commit/23f0ac7f9c7157383bc860b259c1964df46454c1
to re-use `bucket` for the healthcheck configuration.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-17 10:25:49 +02:00
Satoru Takeuchi 1a3c175e63 ceph: add a note of OSD on PVC-backed PVC's known problem
There is a critical flaw in OSD on LV-backed PVC. So it's necessary
to let users to know what they should do.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-08-14 00:10:47 +00:00
Travis Nielsen 7481993959 Merge pull request #6017 from humblec/ceph-csi-snapshotter
Add/update ceph csi snapshotter rbac and sidecar deployments
2020-08-13 12:32:35 -06:00
Humble Chirammal 97a3283099 ceph: add snapshot create/delete and restore doc for cephfs
Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2020-08-13 22:17:01 +05:30
Sébastien Han efa7ba9d84 Merge pull request #5986 from subhamkrai/secureport
ceph: disable object store port when secureport specified
2020-08-13 17:25:57 +02:00
Sébastien Han 1390335f98 Merge pull request #6063 from leseb/fix-crash-collector
ceph: check for gone node on crash collector
2020-08-13 17:02:30 +02:00
Sébastien Han 77a615cc4d Merge pull request #6065 from leseb/mergify-auto-label
bot: add mergify rule for ceph label and reviewer
2020-08-13 16:48:01 +02:00
Sébastien Han e6e025f911 bot: add mergify rule for ceph label and reviewer
If a PR has a title that starts with "ceph", the ceph label will be
added as well the reviewers.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-13 16:42:54 +02:00
Sébastien Han b3e7971953 Merge pull request #6060 from leseb/fix-6057
ceph: use different command for lvm2 presence
2020-08-13 16:30:30 +02:00
Travis Nielsen 1624c58fea Merge pull request #6056 from travisn/annotations-append
cassandra: Initialize merged annotations when empty
2020-08-13 07:53:05 -06:00
Travis Nielsen 306c5425de Merge pull request #6033 from Madhu-1/check-channel
ceph: check channel is open before closing
2020-08-13 07:49:20 -06:00
Sébastien Han 4f9435d226 ceph: add support for wal encrypted device on pvc
Similar to https://github.com/rook/rook/pull/5977 but for wal devices.
So if a cluster is deployed on PVC and wal devices, those will be
encrypted as well.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-13 15:42:40 +02:00
Sébastien Han acc5ba1a6b ceph: check for gone node on crash collector
If a node is gone, we try to remove crash collector deployments so they
don't stay stale or pending. We must ensure the node is gone and not
just return an error even if we successfully deployment the orphan
deployment.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-13 14:16:31 +02:00
Madhu Rajanna 52c2ac3620 ceph: check channel is open before closing
to avoid operator panic we should check the channel
is open before closing as a safety measure.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-08-13 16:59:28 +05:30
Sébastien Han db71d38a5e ceph: use different command for lvm2 presence
Older versions of lvm do not implement "--help" but "help" only where
new versions support both so let's use "help" so the check works for all
the versions.

Closes: https://github.com/rook/rook/issues/6057
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-13 10:03:49 +02:00
Takashi IIGUNI 39fae17fb1 ci: cleanup clusterrolebindings
`anon-user-access` clusterrolebinding is created when installing rook operator.
However each test suite does not delete the clusterrolebinding,
and cause errors.
This PR skip creating the clusterrolebinding in each suite if it already exists.

Signed-off-by: Takashi IIGUNI <iiguni.tks@gmail.com>
2020-08-13 03:02:14 +00:00
Travis Nielsen 52a60716f7 Merge pull request #5977 from leseb/encryption-metadata-pvc
ceph: add support for encrypted metadata pvc
2020-08-12 16:01:36 -06:00
Sébastien Han dd2166b105 ceph: return cv debug logs
So that the operator can print it.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-12 22:24:14 +02:00
Sébastien Han f75a6e9d93 ceph: do not list on empty device
If the device is empty let's not use an empty space as an argument for
the c-v call.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-12 22:24:14 +02:00
Sébastien Han 9738c2ba21 ceph: use callCephVolume() to list osds
Small refactor to use the common function helper callCephVolume() to
build ceph-volume arguments.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-12 22:24:14 +02:00
Sébastien Han a91c96cb47 ceph: add support for encrypted metadata pvc
Now the metadata pvc will also be encrypted if the storageClassDeviceSet
has the "encrypted" flag turned on.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-12 22:24:11 +02:00
Travis Nielsen 820852268d core: move annotations helper into test code
The helper to convert annotations to a string map is not needed in the
production code, so it is moved to the unit tests.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-08-12 14:00:29 -06:00
Travis Nielsen b3355454dc core: initialize merged annotations when empty
Applying annotations was crashing when there were no annotations in the
original map. Now the map is initialized when no annotations are set
in the original map.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-08-12 13:58:25 -06:00
Humble Chirammal 903fcdb778 ceph: update csi image version to 3.1.0 in spec.go
Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2020-08-12 22:39:48 +05:30
subhamkrai e21854145a ceph: disable object store port when secureport specified
currently, the object store schema requires the
port to be non-zero. This does not allow http
access to the object store to be disabled.
so setting the port minimum to 0 to from 1 in the cr.

Signed-off-by: subhamkrai <subhamkumarrai03@gmail.com>
2020-08-12 21:57:01 +05:30
Sébastien Han 7d6974b9b7 ceph: add octopus validation for pvc encryption
The c-v encryption is part of 15.2.5 on Octopus.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-12 12:06:35 +02:00
Sébastien Han ec0a0af76f Merge pull request #5975 from tenzen-y/remove-unnecessary-rm-command
ci: remove unnecessary "rm" command
2020-08-12 11:32:29 +02:00
Travis Nielsen 9c23522f2b Merge pull request #6029 from travisn/mon-failover-antiaffinity
ceph: Mon failover should first scale down the failed mon before starting the new mon
2020-08-11 13:24:00 -06:00
Travis Nielsen c7575b4457 Merge pull request #6046 from leseb/fix-csv
ceph: re-add missing RBAC to CSV
2020-08-11 11:19:46 -06:00
Sébastien Han 65fb4819bc ceph: replace service account names properly in the CSV
The CSV generation needs to be patched with the correct service account names
for the correct RBAC to be generated.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-11 11:13:44 -06:00
Travis Nielsen d7a83107b6 ceph: mon failover should scale down failed mon first
When a mon is failed over, the new mon is started before the old mon
is removed from quorum and purged from the cluster. If the mon has
anti-affinity, in small clusters or specific toplogies where sufficient
nodes are not available, the new mon may be prevented from starting simply
because the dead mon pod still exists. To ensure a clean failover, the
dead mon pod must first be stopped before the new mon is started.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-08-11 10:30:28 -06:00
Sébastien Han cc691cfa57 Merge pull request #6039 from leseb/fix-1867998
ceph: do not validate default.rgw.buckets.index
2020-08-11 16:14:39 +02:00
Sébastien Han 15f138b090 Merge pull request #6040 from leseb/csv-crd
ceph: add missing crds in csv
2020-08-11 15:50:04 +02:00
Sébastien Han ec58092778 ceph: add missing crds in csv
The newly object store CRDs were missing from the CSV.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-11 15:00:49 +02:00