Commit Graph
13292 Commits
Author SHA1 Message Date
subhamkrai 0c593d5420 webhook: update the check-in cluster spec validation
we should iterate older clusters spec instead of
new cluster spec since in case of new storageClassdeviceset
added in spec. The total count of the new clusters and older
spec cluster is will not be the same and we'll get panic.

Closes: https://github.com/rook/rook/issues/10222
Signed-off-by: subhamkrai <srai@redhat.com>
2022-05-10 09:32:44 +05:30
Satoru Takeuchi e66b35aa55 Merge pull request #10230 from leseb/fix-9470
core: append filesystem property on disk
2022-05-10 09:07:09 +09:00
Sébastien Han 8328ec6d31 core: add mountpoint detection to the prepare pod
Amount various filters let's add a mountpoint property and skip the
device if its filesystem is mounted.

Signed-off-by: Sébastien Han <seb@redhat.com>
2022-05-09 15:26:50 +02:00
Sébastien Han 77b2e10c14 core: add more debug info to the prepare pod
When running the device property commands, let's also log their results
for better debugging/visibility.

Signed-off-by: Sébastien Han <seb@redhat.com>
2022-05-09 15:26:50 +02:00
Sébastien Han 8c1bf0f3f0 core: append filesystem property on disk
When detecting the device property the filesystem was not passed but
used later to validate if the device should be taken or not. Now we read
the filesystem info from "lsblk" and populate it in the device type.

Closes: https://github.com/rook/rook/issues/9470
Signed-off-by: Sébastien Han <seb@redhat.com>
2022-05-09 15:26:48 +02:00
Satoru Takeuchi 286e8248aa Merge pull request #10212 from cybozu-go/osd-fix-disk-uuid-management
osd: fix disk uuid management
2022-05-09 19:04:59 +09:00
Satoru Takeuchi 4c46dd1abd osd: fix disk uuid management
- disk UUID should only be got for "disk" type device.
- It's not necessary to fail prepare job when failing to get disk UUID
- We should consider that `sgdisk` reports UUID even if there is no GPT.

Closes: https://github.com/rook/rook/issues/9948

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2022-05-09 18:25:09 +09:00
subhamkrai 99420ad779 ci: add webhook to commitlint title
Signed-off-by: subhamkrai <srai@redhat.com>
2022-05-09 11:29:24 +05:30
Travis Nielsen 85a4c867cd Merge pull request #10216 from travisn/reef-version
core: Add reef version info
2022-05-06 09:03:37 -06:00
Travis Nielsen a3306a7911 core: add reef version info
Since Quincy is released, Ceph master builds will soon
be tagged with the reef v18 version. This adds the capability
for rook to check for the reef version of Ceph.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-05-06 07:35:08 -06:00
Travis Nielsen 300a87db54 Merge pull request #10217 from travisn/prometheus-doc
docs: Add prometheus doc link to pick up rook service monitor
2022-05-06 07:33:49 -06:00
Satoru Takeuchi a9465efa07 Merge pull request #9931 from cybozu-go/test-add-canary-integration-tests-for-osd-on-device
test: add canary integration tests for osd on device
2022-05-06 05:25:57 +09:00
Travis Nielsen 91a8011a61 docs: add prometheus doc link to pick up rook service monitor
If prometheus is already installed in a cluster, it may not be configured
to watch for third-party service monitors such as for Rook.
To help with this configuration, a link is added to the doc for
enabling the third-party service monitors.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-05-05 13:05:32 -06:00
Satoru Takeuchi 805163e2e2 test: add canary integration tests for osd on device
OSD on PVC is tested in many patterns but OSD on device is not.
It's preferable to add the following patterns for OSD on device.

- An OSD on a raw disk
- Two OSDs on a device

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2022-05-05 13:15:18 +00:00
Satoru Takeuchi ab38c10c2d test: avoid to create a corrupted GPT headers
The following steps in CI scripts create corrupted GPT headers.

```console
$ sudo sgdisk --zap-all --clear --mbrtogpt -g -- "$DISK"
$ sudo dd if=/dev/zero of="$DISK" bs=1M count=10
```

It results in the failure of the succeeding `sgdisk --print "$DISK".

Here is an example.

```console
$ sudo parted /dev/sdb mklabel msdos
...
$ sudo sgdisk --zap-all --clear --mbrtogpt -g -- /dev/sdb
...
$ sudo dd if=/dev/zero of=/dev/sdb bs=1M count=10
...
$ sudo sgdisk --print /dev/sdb
Caution: invalid main GPT header, but valid backup; regenerating main header
from backup!

Warning: Invalid CRC on main header data; loaded backup partition table.
Warning! One or more CRCs don't match. You should repair the disk!
Main header: ERROR
Backup header: OK
Main partition table: OK
Backup partition table: OK

Invalid partition data!
$ echo $?
2
```

We can safely use the simple `sgdisk --zap-all "$DEVICE"` here.
It's not necessary to convert "mbr" to "gpt" because we'll make new GPT
labels just after this command.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2022-05-05 13:11:21 +00:00
Alexander Trost ea94e49187 Merge pull request #10187 from koor-tech/fixing_nits 2022-05-04 18:46:58 +02:00
Travis Nielsen fe3c024e8d Merge pull request #10172 from fengjiankui121/mon_health_improve
mon: quorumStatus.MonMap.Mons changed to quorumStatus.Quorum
2022-05-04 09:26:04 -06:00
Alexander Trost e418f91ed8 ci: fix indentation in .commitlintrc.json
Fixes the tab/space indentation in .commitlintrc.json to be the same on
all lines.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2022-05-04 13:05:48 +02:00
Alexander Trost 10f6d8449d helm: update rook-ceph-cluster dashboard values comments
Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2022-05-04 13:05:48 +02:00
Travis Nielsen 9be4ec9ee9 Merge pull request #10199 from travisn/op-memory
operator: Increase memory limit of operator
2022-05-03 09:58:28 -06:00
Sébastien Han 83a0dd32c8 Merge pull request #10191 from leseb/fix-10181
osd: close the encrypted disk after cleanup is done
2022-05-03 17:28:36 +02:00
Sébastien Han 6ef491d9fc osd: close the encrypted disk after cleanup is done
Once we are done cleaning up the content of the encrypted osd, let's
close the main LUKS device.
This avoids having dm devices on the system after the cleanup.

Closes: https://github.com/rook/rook/issues/10181
Signed-off-by: Sébastien Han <seb@redhat.com>
2022-05-03 16:47:59 +02:00
Travis Nielsen 60b72b6d48 operator: increase memory limit of operator
The operator is very bursty and when starting up may need more memory
to reconcile all the CRs initially before it calms down.
The default of 256Mi was not sufficient for many clusters, so now
we bump up the limit to 512Mi.

This is a follow-up from the same change to the helm chart in
https://github.com/rook/rook/pull/10195.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-05-03 07:54:53 -06:00
Travis Nielsen 5a4c77efa5 Merge pull request #10195 from travisn/operator-mem
helm: Increase memory limit of operator
2022-05-02 12:40:33 -06:00
Travis Nielsen 8571db0c7f helm: increase memory limit of operator
The operator is very bursty and when starting up may need more memory
to reconcile all the CRs initially before it calms down.
The default of 256Mi was not sufficient for many clusters, so now
we bump up the limit to 512Mi.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-05-02 11:26:48 -06:00
Sébastien Han 051125ff3f core: tidy up go deps
Tidy our dependencies.

Signed-off-by: Sébastien Han <seb@redhat.com>
2022-05-02 09:34:06 +02:00
FengJiankui bfcce7d484 mds: pool changed to cephpool
The path resolved the problem that the variable pool is the same as the package name. (bug #9275)

Signed-off-by: FengJiankui <fengjiankui@inspur.com>
2022-04-29 11:15:09 +08:00
FengJiankui d335dc59eb mon: quorumStatus.MonMap.Mons changed to quorumStatus.Quorum
The path use quorum instead of monMap to determine if there is enough mon. (bug #10165).

Signed-off-by: FengJiankui <fengjiankui@inspur.com>
2022-04-29 09:46:21 +08:00
Travis Nielsen 2e89bb14de Merge pull request #9936 from slavonicsniper/ingress-annotation-for-ssl
helm: add ingress annotations for ssl
2022-04-28 09:19:30 -06:00
Travis Nielsen 85c9f6fcf4 Merge pull request #10183 from Rakshith-R/fix-csi-nfs-csv-gen
build: fix csi nfs rbac csv generation
2022-04-28 08:52:51 -06:00
Rakshith R d0b67af23b build: fix csi nfs rbac csv generation
Added hack in generate-rook-csv for proper
generation of csi nfs rbac in csv.
Added placeholder clusterrole and binding for
nfs nodeplugin sa, since operator-sdk
does not include sa without rules.

Signed-off-by: Rakshith R <rar@redhat.com>
2022-04-28 19:42:24 +05:30
Erik Galajda c422d40247 helm: add ingress annotations for ssl
Currently annotations are not set on the ingress resource

Signed-off-by: Erik Galajda <erik.galajda.sk@gmail.com>
2022-04-28 14:45:56 +02:00
Alexander Trost 3005a6fc68 Merge pull request #10137 from koor-tech/fix_9099
rgw: fix dashboard admin creation for multiple object stores
2022-04-27 16:13:38 +00:00
Alexander Trost 5d03061d47 rgw: fix dashboard admin creation for multiple object stores
Check the radosgw-admin realm user list per object store instead of relying
on the ceph dashboard get-rgw-api- command.

Resolves #9099

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2022-04-27 14:57:17 +02:00
Sébastien Han 4ea8cc6224 Merge pull request #10173 from subhamkrai/fix-deploy-vault
ci: wait for cert while deploying vault
2022-04-27 11:51:02 +02:00
Sébastien Han ed3121defd Merge pull request #9925 from leseb/multus-plugin-restart-fix
core: fix csi-cephfsplugin pod restart on non-hostnetworking env
2022-04-27 11:41:59 +02:00
subhamkrai 86b3d466f6 ci: wait for cert while deploying vault
sometimes, it take few seconds to fill certificate
after certificate approval. So, let's wait for few seconds.

Closes: https://github.com/rook/rook/issues/10158
Signed-off-by: subhamkrai <srai@redhat.com>
2022-04-27 14:44:24 +05:30
Travis Nielsen d5070dc418 Merge pull request #10125 from subhamkrai/update-go-ceph
build: update go-ceph version and remove ceph_preview
2022-04-26 16:05:49 -06:00
Travis Nielsen 8b334685a9 Merge pull request #10123 from travisn/min-version-1.17
build: Update min version to k8s 1.17
2022-04-26 12:24:04 -06:00
Travis Nielsen d5c46677bf Merge pull request #10163 from travisn/clear-notes
docs: reset the release notes for 1.10
2022-04-26 11:22:49 -06:00
Travis Nielsen 518901305a docs: reset the release notes for 1.10
With the 1.9 release out we go ahead and clear the
release notes for 1.10 feature work.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-04-26 11:18:35 -06:00
Sébastien Han 73b1347675 core: fix csi-cephfsplugin pod restart on non-hostnetworking env
Implementation of the design proposed in
https://github.com/rook/rook/pull/9903.

Signed-off-by: Sébastien Han <seb@redhat.com>
2022-04-26 17:53:01 +02:00
Sébastien Han 79dbb35302 ci: collect secrets and cms in the logs
The CI runs will now collect all the secrets and configmaps available.

Signed-off-by: Sébastien Han <seb@redhat.com>
2022-04-26 11:05:02 +02:00
Sébastien Han 583791c45c core: move clusterInfo code to the controller package
The CSI package needs to load clusterInfo, today this code is in the mon
package which makes the call of LoadClusterInfo impossible without
having a circular import.

Signed-off-by: Sébastien Han <seb@redhat.com>
2022-04-26 11:05:02 +02:00
Sébastien Han df435d555a Merge pull request #10162 from travisn/dead-test-code
test: Remove dead test helper code
2022-04-26 09:13:17 +02:00
Travis Nielsen d26b6cf403 build: update min version to k8s 1.17
Support is removed for k8s for various limitations such as
priority classes not working and csi driver feature
incompleteness and missing snapshots. Documentation is updated
with the new min version of k8s 1.17 and also the tests are
updated to run on the min version of 1.17.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-04-25 15:32:09 -06:00
Travis Nielsen 2db3910052 test: remove dead test helper code
The K8sHelper has a number of methods that are no longer
in use that we can remove.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-04-25 15:28:29 -06:00
Sébastien Han 1a7e983ad2 Merge pull request #10156 from rook/fix-ibm-key-test
ci: use stringData instead of data for secret
2022-04-25 18:16:51 +02:00
Alexander Trost f381f0a94a Merge pull request #10147 from koor-tech/linter 2022-04-25 17:38:07 +02:00
Sébastien Han edfd120d6a ci: use stringData instead of data for secret
The "data" field only accepts base64 strings and our env var is not. So
let's use stringData to prevent an error from the API server:

```
"v1" cannot be handled as a Secret: illegal base64 data at input byte 29
```

Signed-off-by: Sébastien Han <seb@redhat.com>
2022-04-25 16:41:27 +02:00