Commit Graph
8616 Commits
Author SHA1 Message Date
Travis Nielsen afbb97dbea Merge pull request #10269 from humblec/rbac-cleanup
remove `watch` verb from csi-snapshottter sidecar RBAC
2022-05-16 08:13:01 -06:00
Humble Chirammal 0812d08a75 csi: remove watch verb from csi-snapshottter sidecar RBAC
The `watch` verb is not required for the csi-snapshotter sidecar
to function, removing it from the deployment

Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2022-05-16 13:21:42 +05:30
Sébastien Han 9b6143baa7 Merge pull request #10006 from parth-gr/rgw-external
rgw: validate rgw endpoint ip
2022-05-13 14:28:10 +02:00
Travis Nielsen 5e0d896a69 Merge pull request #10232 from parth-gr/external-fqdn
rgw: support FQDN for RGW endpoint
2022-05-12 11:52:24 -06:00
Travis Nielsen c75e834da0 Merge pull request #10246 from leseb/blk-mapper-message
osd: exit immediately if pvc block has not changed
2022-05-12 11:51:35 -06:00
Travis Nielsen 929bc9720f Merge pull request #10161 from BlaineEXE/identify-rook-clusters-via-mon-kv-field
operator: set 'rook-version' in mon k/v store
2022-05-12 10:48:48 -06:00
Travis Nielsen 9b5191b3db Merge pull request #10242 from ttyS0/master
docs: update tolerations name from controlplane to control-plane
2022-05-12 10:30:55 -06:00
Travis Nielsen 4c34878a4d Merge pull request #10250 from travisn/osd-startup-probe
osd: Allow the osd to take a long time to start
2022-05-12 10:25:15 -06:00
Travis Nielsen c240a3ad19 Merge pull request #10253 from yuvalman/hostNetwork
csi: add the option to disable hostNetwork
2022-05-12 10:24:13 -06:00
Blaine Gardner 94b622c302 operator: set 'rook-version' in mon k/v store
Ceph upstream telemetry (which Rook users could optionally enable via
Ceph CLI or Dashboard) does not easily identify if a cluster is managed
by Rook. Identifying Rook clusters is possible only if users also enable
the rook mgr module, which is optional and not often used.

To get better upstream insights into Ceph clusters managed by Rook, set
a new 'rook-version' field in Ceph's generic k/v store. This field can
be used to determine if a cluster is managed by Rook by its presence.
It additionally provides information about the Rook version used to
manage the cluster, which is another piece of potentially useful
information.

Regarding Ceph cluster identification via telemetry:
Ceph telemetry is anonymous and uses a different ID from the Ceph
cluster ID. Identifying the Rook version in telemetry does not add
directly identifying information. Therefore, there should be little
risk that adding the Rook version field will decrease anonymity of Ceph
clusters via telemetry.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2022-05-12 09:31:13 -06:00
Sean Johnson 30667157ab docs: update tolerations name from controlplane to control-plane
Signed-off-by: ttyS0 <sean@skj.dev>
2022-05-12 10:04:55 -05:00
Yuval Manor 504e78a5ba csi: add the option to disable hostNetwork
currently, it is not possible to disable hostNetwork. This pr fix this issue.

Signed-off-by: Yuval Manor <yuvalman958@gmail.com>
2022-05-12 17:58:54 +03:00
parth-gr 624400ff93 rgw: support FQDN for RGW endpoint
Now rgw can be pass by FQDN too,
to avoid problems where it is required
The format should be similar to
Ip(<IP>:<PORT> format), <FQDN>:<PORT> format

Signed-off-by: parth-gr <paarora@redhat.com>
2022-05-12 18:31:35 +05:30
Travis Nielsen 28e721d877 osd: allow the osd to take a long time to start
The startup probe for the OSD has been too aggressive to kill the OSD
in case the OSD is taking some time to start. The OSD may be self-optimizing,
scrubbing, or some other internal operation before it is ready to start.
Rather than disable the startup probe completely, the default is now
to retry for two hours in case the OSD is performing those operations.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-05-11 14:29:25 -06:00
Travis Nielsen bb5812316d Merge pull request #10244 from y1r/add-psp
build: add psp for missing roles
2022-05-11 11:55:45 -06:00
Travis Nielsen 718512997b Merge pull request #10033 from Madhu-1/fix-4841
csi: remove unwanted RBAC of csi driver
2022-05-11 08:41:43 -06:00
parth-gr b97bc74f45 csi: update the upgrade flag description
Currently it was mention we are updating the csi-user
But more precisely we go and update the keyrings
which auto update users so replacing it

Signed-off-by: parth-gr <paarora@redhat.com>
2022-05-11 19:52:38 +05:30
parth-gr cf29043f4d rgw: donot validate prefix rgw pools when prefix is default
Signed-off-by: parth-gr <paarora@redhat.com>
2022-05-11 19:52:38 +05:30
parth-gr 09d52511ad rgw: validate rgw endpoint ip
The ceph-external-cluster-details-exporter.py
generates the json output even with
rgw-endpoint IP from different cluster
Added a check validate_rgw_endpoint which will validate
the above rgw_endpoint Ip by matching the cluster fsid

Signed-off-by: parth-gr <paarora@redhat.com>
2022-05-11 19:52:30 +05:30
Sébastien Han 4234216db8 osd: exit immediately if pvc block has not changed
We don't need to run any `cp` command since a destination path already
exists. Using `--no-clobber` is not needed and it results in a noop
anyways.
Instead, let's print the reason why we exit the container.

Signed-off-by: Sébastien Han <seb@redhat.com>
2022-05-11 15:02:18 +02:00
Yuichiro Ueno 1ccc185a79 build: add psp for missing roles
This commit adds psp RoleBindings to rook-ceph-rgw role and
rook-ceph-purge-osd role. Without this commit, I cannot perform
rook-ceph-purge-osd job on PSP-enabled cluster.

Signed-off-by: Yuichiro Ueno <ueno@preferred.jp>
2022-05-11 13:50:37 +09:00
Madhu Rajanna 19f77c6174 csi: remove unwanted RBAC of csi driver
Removed unwanted RBAC from the
previous versions of driver.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-05-11 10:16:37 +05:30
Travis Nielsen c1ab415c40 Merge pull request #10226 from subhamkrai/update-validate-cluster
webhook: update the check-in cluster spec validation
2022-05-10 08:13:22 -06:00
Travis Nielsen 8a8d7e20d3 Merge pull request #10233 from parth-gr/external-radosnamespace
namespace: adding radosnamespace in canary CI
2022-05-10 07:50:27 -06:00
parth-gr 17918c0b9e namespace: adding radosnamespace in canary CI
THe radosnamespace CRD is already added by
https://github.com/rook/rook/pull/9733,
Checking the external script with the namespace created by
the CRD

Signed-off-by: parth-gr <paarora@redhat.com>
2022-05-10 12:52:36 +05:30
subhamkrai 0c593d5420 webhook: update the check-in cluster spec validation
we should iterate older clusters spec instead of
new cluster spec since in case of new storageClassdeviceset
added in spec. The total count of the new clusters and older
spec cluster is will not be the same and we'll get panic.

Closes: https://github.com/rook/rook/issues/10222
Signed-off-by: subhamkrai <srai@redhat.com>
2022-05-10 09:32:44 +05:30
Satoru Takeuchi e66b35aa55 Merge pull request #10230 from leseb/fix-9470
core: append filesystem property on disk
2022-05-10 09:07:09 +09:00
Sébastien Han 8328ec6d31 core: add mountpoint detection to the prepare pod
Amount various filters let's add a mountpoint property and skip the
device if its filesystem is mounted.

Signed-off-by: Sébastien Han <seb@redhat.com>
2022-05-09 15:26:50 +02:00
Sébastien Han 77b2e10c14 core: add more debug info to the prepare pod
When running the device property commands, let's also log their results
for better debugging/visibility.

Signed-off-by: Sébastien Han <seb@redhat.com>
2022-05-09 15:26:50 +02:00
Sébastien Han 8c1bf0f3f0 core: append filesystem property on disk
When detecting the device property the filesystem was not passed but
used later to validate if the device should be taken or not. Now we read
the filesystem info from "lsblk" and populate it in the device type.

Closes: https://github.com/rook/rook/issues/9470
Signed-off-by: Sébastien Han <seb@redhat.com>
2022-05-09 15:26:48 +02:00
Satoru Takeuchi 286e8248aa Merge pull request #10212 from cybozu-go/osd-fix-disk-uuid-management
osd: fix disk uuid management
2022-05-09 19:04:59 +09:00
Satoru Takeuchi 4c46dd1abd osd: fix disk uuid management
- disk UUID should only be got for "disk" type device.
- It's not necessary to fail prepare job when failing to get disk UUID
- We should consider that `sgdisk` reports UUID even if there is no GPT.

Closes: https://github.com/rook/rook/issues/9948

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2022-05-09 18:25:09 +09:00
subhamkrai 99420ad779 ci: add webhook to commitlint title
Signed-off-by: subhamkrai <srai@redhat.com>
2022-05-09 11:29:24 +05:30
Travis Nielsen 85a4c867cd Merge pull request #10216 from travisn/reef-version
core: Add reef version info
2022-05-06 09:03:37 -06:00
Travis Nielsen a3306a7911 core: add reef version info
Since Quincy is released, Ceph master builds will soon
be tagged with the reef v18 version. This adds the capability
for rook to check for the reef version of Ceph.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-05-06 07:35:08 -06:00
Travis Nielsen 300a87db54 Merge pull request #10217 from travisn/prometheus-doc
docs: Add prometheus doc link to pick up rook service monitor
2022-05-06 07:33:49 -06:00
Satoru Takeuchi a9465efa07 Merge pull request #9931 from cybozu-go/test-add-canary-integration-tests-for-osd-on-device
test: add canary integration tests for osd on device
2022-05-06 05:25:57 +09:00
Travis Nielsen 91a8011a61 docs: add prometheus doc link to pick up rook service monitor
If prometheus is already installed in a cluster, it may not be configured
to watch for third-party service monitors such as for Rook.
To help with this configuration, a link is added to the doc for
enabling the third-party service monitors.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-05-05 13:05:32 -06:00
Satoru Takeuchi 805163e2e2 test: add canary integration tests for osd on device
OSD on PVC is tested in many patterns but OSD on device is not.
It's preferable to add the following patterns for OSD on device.

- An OSD on a raw disk
- Two OSDs on a device

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2022-05-05 13:15:18 +00:00
Satoru Takeuchi ab38c10c2d test: avoid to create a corrupted GPT headers
The following steps in CI scripts create corrupted GPT headers.

```console
$ sudo sgdisk --zap-all --clear --mbrtogpt -g -- "$DISK"
$ sudo dd if=/dev/zero of="$DISK" bs=1M count=10
```

It results in the failure of the succeeding `sgdisk --print "$DISK".

Here is an example.

```console
$ sudo parted /dev/sdb mklabel msdos
...
$ sudo sgdisk --zap-all --clear --mbrtogpt -g -- /dev/sdb
...
$ sudo dd if=/dev/zero of=/dev/sdb bs=1M count=10
...
$ sudo sgdisk --print /dev/sdb
Caution: invalid main GPT header, but valid backup; regenerating main header
from backup!

Warning: Invalid CRC on main header data; loaded backup partition table.
Warning! One or more CRCs don't match. You should repair the disk!
Main header: ERROR
Backup header: OK
Main partition table: OK
Backup partition table: OK

Invalid partition data!
$ echo $?
2
```

We can safely use the simple `sgdisk --zap-all "$DEVICE"` here.
It's not necessary to convert "mbr" to "gpt" because we'll make new GPT
labels just after this command.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2022-05-05 13:11:21 +00:00
Alexander Trost ea94e49187 Merge pull request #10187 from koor-tech/fixing_nits 2022-05-04 18:46:58 +02:00
Travis Nielsen fe3c024e8d Merge pull request #10172 from fengjiankui121/mon_health_improve
mon: quorumStatus.MonMap.Mons changed to quorumStatus.Quorum
2022-05-04 09:26:04 -06:00
Alexander Trost e418f91ed8 ci: fix indentation in .commitlintrc.json
Fixes the tab/space indentation in .commitlintrc.json to be the same on
all lines.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2022-05-04 13:05:48 +02:00
Alexander Trost 10f6d8449d helm: update rook-ceph-cluster dashboard values comments
Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2022-05-04 13:05:48 +02:00
Travis Nielsen 9be4ec9ee9 Merge pull request #10199 from travisn/op-memory
operator: Increase memory limit of operator
2022-05-03 09:58:28 -06:00
Sébastien Han 83a0dd32c8 Merge pull request #10191 from leseb/fix-10181
osd: close the encrypted disk after cleanup is done
2022-05-03 17:28:36 +02:00
Sébastien Han 6ef491d9fc osd: close the encrypted disk after cleanup is done
Once we are done cleaning up the content of the encrypted osd, let's
close the main LUKS device.
This avoids having dm devices on the system after the cleanup.

Closes: https://github.com/rook/rook/issues/10181
Signed-off-by: Sébastien Han <seb@redhat.com>
2022-05-03 16:47:59 +02:00
Travis Nielsen 60b72b6d48 operator: increase memory limit of operator
The operator is very bursty and when starting up may need more memory
to reconcile all the CRs initially before it calms down.
The default of 256Mi was not sufficient for many clusters, so now
we bump up the limit to 512Mi.

This is a follow-up from the same change to the helm chart in
https://github.com/rook/rook/pull/10195.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-05-03 07:54:53 -06:00
Travis Nielsen 5a4c77efa5 Merge pull request #10195 from travisn/operator-mem
helm: Increase memory limit of operator
2022-05-02 12:40:33 -06:00
Travis Nielsen 8571db0c7f helm: increase memory limit of operator
The operator is very bursty and when starting up may need more memory
to reconcile all the CRs initially before it calms down.
The default of 256Mi was not sufficient for many clusters, so now
we bump up the limit to 512Mi.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-05-02 11:26:48 -06:00