Commit Graph
8415 Commits
Author SHA1 Message Date
Sébastien Han 87c431936f Merge pull request #9967 from nazarewk/patch-1
osd: add NixOS specific PATHs
2022-04-04 10:17:25 +02:00
Travis Nielsen d847fc86b1 Merge pull request #9969 from travisn/mergify-1.9
build: Add mergify rules for release-1.9
2022-04-01 11:09:20 -06:00
Travis Nielsen bc5013e487 build: remove auto merge rules for master branch
The rules for auto merging PRs from master have not been used.
Instead we follow a pattern of a maintainer deciding when is
the best time to merge the PR in case it is not ready even after
being approved.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-04-01 10:48:34 -06:00
Travis Nielsen 74cfe4549a build: add new ci checks to auto v1.9 merge rules
Several new CI checks have been added recently, so we add
them as auto-merge rules for mergify.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-04-01 10:46:51 -06:00
Travis Nielsen 42c7b7f6b3 build: add mergify rules for release-1.9
With the creation of the release-1.9 branch, the mergify
rules are updated for the new branch.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-04-01 09:10:07 -06:00
Krzysztof Nazarewski 352df4e62f osd: add NixOS specific PATHs
This commits makes Rook usable on NixOS.

NixOS system holds "installed" binaries in `/run/current-system/sw/{bin,sbin}`.
The only binaries residing outside those paths are `/usr/bin/env` and `/bin/sh`.

I got a suggestion on Slack to simply add those NixOS specific paths

Signed-off-by: Krzysztof Nazarewski <3494992+nazarewk@users.noreply.github.com>
2022-04-01 16:37:23 +02:00
Sébastien Han 55a8fb9b8e Merge pull request #9962 from leseb/fix-9911
core: reload go routine after CR is edited
v1.9.0-alpha.0
2022-03-31 15:51:43 +02:00
Sébastien Han 05506e7a68 core: reload go routine after CR is edited
Previously, the struct maintaining the list of cluster was still
initialized with a cluster item. Then the monitoring check will see that
the cluster is part of the struct already and thus won't run the
monitoring go routine again.
Now each time we cancel the context, we also remove the cluster item
from the map so that when the controller runs again, the monitoring
struct is re-populated and the go routine runs and statuses are updated.

Closes: https://github.com/rook/rook/issues/9911
Signed-off-by: Sébastien Han <seb@redhat.com>
2022-03-31 08:49:42 +02:00
Travis Nielsen 6c50530737 Merge pull request #9685 from weirdwiz/context-remove
Remove context.TODO and add context parameter
2022-03-30 12:20:30 -05:00
Blaine Gardner 5a82a1cbd7 Merge pull request #9941 from Rakshith-R/csi/add-oidc-token
csi: mount serviceaccount oidc-token into csi-driver
2022-03-29 11:41:07 -06:00
Blaine Gardner b098e7ca72 Merge pull request #9951 from parth-gr/secret-external-cluster
csi: rbd node secret was misspelled
2022-03-29 10:00:21 -06:00
parth-gr 79db113aab csi: rbd node secret was misspelled
Corrected CSI_RBD_NODE_SECRET name so it should be
output correctely when called script with
bash format output

Signed-off-by: parth-gr <paarora@redhat.com>
2022-03-29 16:56:42 +05:30
Rakshith R ec6f2e31b1 csi: mount serviceaccount oidc-token into csi-driver
This oidc-token is used to authenticate with OpenID Connect (OIDC)
Provider. Currently, Ceph-CSI uses it to assume role with amazon STS
to get access to aws kms for encryption.

Signed-off-by: Rakshith R <rar@redhat.com>
2022-03-29 14:04:28 +05:30
Sébastien Han 1569f39186 Merge pull request #9956 from parth-gr/externalcluster-pylint
ci: fixed pylint failure
2022-03-29 09:35:41 +02:00
parth-gr 339855f172 ci: fixed pylint failure
pylint was failing with used-before-assignment error
fixed it by making the variables assignmet before it was used
Also backward compatibility is removed from the ModuleNotFoundError import,
as we auto installed python3 version on ceph standalone

Signed-off-by: parth-gr <paarora@redhat.com>
2022-03-29 12:09:32 +05:30
Blaine Gardner ba3cf9cea6 Merge pull request #9898 from yuvalman/logcollector
core: fix GetLogCollectorResources to get the right resources
2022-03-28 12:27:33 -06:00
Blaine Gardner 4beb5da44b Merge pull request #9906 from thotz/use-region-us-east-1
object: remove region option from OBC StorageClass
2022-03-28 11:38:36 -06:00
Satoru Takeuchi 656e9466d4 Merge pull request #9946 from superbrothers/fix-invalid-nodeaffinity
helm: fix the invalid nodeAffinity configuration in the comment
2022-03-28 14:25:49 +09:00
Kazuki Suda bb98cf373a helm: fix the invalid nodeAffinity configuration in the comment
This commit fixes the missing indentation for nodeAffinity configuration
example in the comment. If users try to use the example configuration by
copy and paste, an error will occur.

Signed-off-by: Kazuki Suda <kazuki.suda@gmail.com>
2022-03-26 22:55:35 +09:00
Jiffin Tony Thottan fc2b8012c6 object: use us-east-1 for aws go lang sdk
The aws go lang sdk needs value for region, it is set differently in
various part of current code. With PR the value is always `us-east-1` so
that it will work RGW server without any issues.

This reverts commit 280c29f330.

Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2022-03-24 14:37:39 +05:30
Divyansh Kamboj 9008409f87 core: add context parameter to functions
This commit adds context parameter to various functions, and remove the
usage of context.TODO.

Closes: https://github.com/rook/rook/issues/8701
Signed-off-by: Divyansh Kamboj <dkamboj@redhat.com>
2022-03-22 08:19:07 +05:30
Travis Nielsen 8e3350a625 Merge pull request #9837 from travisn/helm-prometheus-rules
monitoring: Create prometheus rules with helm chart
2022-03-21 16:59:00 -06:00
Travis Nielsen 8dd4b77d8a monitoring: update to the latest ceph prometheus rules
Pick up the latest ceph prometheus rules from the ceph repo
found at https://github.com/ceph/ceph/blob/master/monitoring/ceph-mixin/prometheus_alerts.yml.
The updates include many new rules for monitoring of ceph.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-03-21 14:47:56 -06:00
Travis Nielsen 4edcff04f7 monitoring: create prometheus rules with helm chart
The prometheus rules had been previously created if the cephcluster CR
setting monitoring.enabled was set to true. The rules were not customizable
and therefore not flexible enough. Now the rules are installed by the helm
chart. To customize the rules, a post-processor can be applied to the helm
chart.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-03-21 14:47:52 -06:00
Travis Nielsen 4f9a72c1db Merge pull request #9894 from yuvalman/resources
helm: enable resource defaults on rook components
2022-03-21 13:58:17 -06:00
Yuval Manor ff7a5c2d2d helm: enable resource defaults on rook components
This PR assign default values to the resources of all Rook and Ceph components

Closes: https://github.com/rook/rook/issues/9858
Signed-off-by: Yuval Manor <yuvalman958@gmail.com>
2022-03-21 21:23:35 +02:00
Yuval Manor d222ad65e3 core: fix GetLogCollectorResources to get the right resources
Fix GetLogCollectorResources to use the logcollector instead of the crashcollector key

Closes: https://github.com/rook/rook/issues/9897
Signed-off-by: Yuval Manor <yuvalman958@gmail.com>
2022-03-21 17:55:03 +02:00
Travis Nielsen 833c458f60 Merge pull request #9910 from subhamkrai/all-crs-printColumn
core: add `Phase` in `additionalPrinterColumns` for all CRs
2022-03-21 07:15:07 -06:00
subhamkrai dc488591e2 core: add Phase in additionalPrinterColumns for all CRs
this commit adding `Phase` in `additionalPrinterColumns` for
all the CRs.

this is how it looks now, example:

```
$ kc get cephfilesystem
NAME   ACTIVEMDS   AGE     PHASE
myfs   1           4m57s   Ready
srai@ ~
$ kc get cephblockpool
NAME                    PHASE
device-health-metrics   Ready
replicapool             Progressing
srai@ ~
$ kc get cephclient
NAME     PHASE
cinder   Ready
glance   Ready
```

Closes: https://github.com/rook/rook/issues/9883
Signed-off-by: subhamkrai <srai@redhat.com>
2022-03-21 09:13:26 +05:30
Travis Nielsen 2b2469cf1c Merge pull request #9926 from travisn/default-msgr1-port
mon: Set the msgr1 port by default for csi driver
2022-03-18 07:55:43 -06:00
Satoru Takeuchi eb88d01924 Merge pull request #9930 from cybozu-go/test-avoid-potential-data-inconsistency-on-zapping-disk
test: avoid potential data inconsistency on zapping disk
2022-03-18 22:34:04 +09:00
Satoru Takeuchi 3bbffd1e4d test: avoid potential data inconsistency on zapping disk
Data inconsistency might happen if the disk is accessed just after disk
zapping because direct I/O is not synchronous by itself.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2022-03-18 11:50:04 +00:00
Travis Nielsen 86eebc7486 mon: set the msgr1 port by default for csi driver
Older kernels still fail to connect for rbd/cephfs with
the msgr2 port due to a difference in http protocol expected.
For now, we keep the default port as msgr1 for the csi driver
and other client connections, unless msgr2 is strictly required
for encryption or compression.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-03-17 16:34:13 -06:00
Sébastien Han 18b19de639 Merge pull request #9687 from parth-gr/observedGeneration
core: add observedGeneration to CR status
2022-03-17 10:36:11 +01:00
Travis Nielsen b4a0ae39b0 Merge pull request #9890 from travisn/support-quincy-1.9
test: Support Ceph Quincy v17 and Rook v1.9 with updated integration tests
2022-03-16 15:20:01 -06:00
Travis Nielsen 48be000b4f core: add quincy to the supported versions
Ceph Quincy is now supported as of Rook v1.9.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-03-16 14:26:20 -06:00
Travis Nielsen ee1e17518d test: upgrade from 1.8 to master
The upgrade integration test had been testing from v1.7
to master. Now with the v1.8 release coming up we upgrade
from v1.8 to master.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-03-16 14:19:08 -06:00
Travis Nielsen 8ed9c5d480 test: add quincy to the integration test matrix
With Ceph Quincy v17 support added in Rook v1.9, Quincy
is now added as a target ceph version to test in the integration
tests. The smoke suite will test against Quincy, the upgrade
suite will upgrade from pacific to quincy, while other test
suites will run against octopus or pacific. The daily tests
will test other combinations as well.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-03-16 14:19:08 -06:00
Travis Nielsen ad99f9e205 pool: update the quincy default pool to .mgr
In Quincy, the device_health_metrics pool is renamed to .mgr.
In the example cluster-test.yaml, we therefore update the
example to create the pool with the new name.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-03-16 14:18:49 -06:00
parth-gr 2dfd64a97c core: add observedGeneration to CR status
adding observedGeneration field in the cephcluster cr
status for having better control on reconciling,
as observedGeneration field will be updated by the controller

Closes: https://github.com/rook/rook/issues/9673

Signed-off-by: parth-gr <paarora@redhat.com>
2022-03-16 19:58:35 +05:30
Blaine Gardner 1bbe39a81b Merge pull request #9710 from rexagod/9025
rgw: add unit tests for the external ceph object store reconciler
2022-03-15 16:23:49 -06:00
Travis Nielsen 016ad25537 Merge pull request #9913 from travisn/restart-osds-doc
docs: Add annotations to restart ceph daemons
2022-03-15 13:43:56 -06:00
Travis Nielsen 027477a890 docs: add annotations to restart ceph daemons
If the ceph daemons need to be restarted after applying the custom
ceph.conf, adding annotations or labels to the cluster CR is
perhaps the simplest way to automate the rolling update.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-03-15 11:52:16 -06:00
Blaine Gardner 1d0c79f8f0 Merge pull request #9908 from BlaineEXE/dependents-cephfilesystem
file: add events to filesystem reconcile
2022-03-15 09:12:30 -06:00
Pranshu Srivastava 5e414666cc rgw: add unit tests for the external ceph object store reconciler
Added few test cases to check for the following:
* creation of an external object store
* deletion of an external object store
* creation of an external object store with a missing secret
* creation of an external object store with ExternalRGWEndpoints set to
  nil.

Signed-off-by: Pranshu Srivastava <rexagod@gmail.com>
2022-03-15 18:08:54 +05:30
Blaine Gardner 177ba1103d file: add events to filesystem reconcile
Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2022-03-14 10:29:25 -06:00
Sébastien Han 00a4dc19f7 Merge pull request #9879 from subhamkrai/ci-pylint
ci: add pylint in ci
2022-03-14 17:22:27 +01:00
Blaine Gardner 992c1e620a Merge pull request #9800 from subhamkrai/events
core: add k8s events in blockpool reconciler
2022-03-14 09:51:46 -06:00
subhamkrai fd475575ff ci: add pylint in ci
adding pylint in ci.

Closes: https://github.com/rook/rook/issues/9866
Signed-off-by: subhamkrai <srai@redhat.com>
2022-03-14 18:58:20 +05:30
subhamkrai 6a9ff434d2 core: add k8s events in controller reconciler
adding k8s event in controller reconciler when
1. when reconciler starts
2. when deletion reconcile triggered.

Closes: https://github.com/rook/rook/issues/9462
Signed-off-by: subhamkrai <srai@redhat.com>
2022-03-14 18:55:26 +05:30