Commit Graph
7961 Commits
Author SHA1 Message Date
Sébastien Han 723f144452 core: remove unused clientset
Removing ancient clientset which was not used anywhere any more.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-10-06 11:34:06 +02:00
Blaine Gardner 507dfe11f6 helm: remove chart content not in common.yaml
Assume common.yaml is the right source of truth, and remove major
content from helm charts that does not exist in common.yaml.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-10-06 09:18:02 +00:00
Travis Nielsen 00cef458af Merge pull request #8917 from subhamkrai/close-stdout
core:  close stdoutPipe for the discovery daemon
2021-10-05 12:36:42 -06:00
subhamkrai 6387c7d063 core: close stdoutPipe for the discovery daemon
Closing stdoutPipe for the discovery daemon that
could possibly leaks memory due to unclosed resources.

Closes: https://github.com/rook/rook/issues/8914
Signed-off-by: subhamkrai <srai@redhat.com>
2021-10-05 18:10:59 +00:00
Travis Nielsen 086649c7f8 Merge pull request #8742 from subhamkrai/cant-mount-volume-nodelost
docs: add doc to recover from pod from lost node
2021-10-05 12:09:50 -06:00
subhamkrai 7587704743 docs: add doc to recover from pod from lost node
This commit adds the doc which has the manual
steps to recover from the specific scenario
like
`on the node lost, the new pod can't mount the
same volume`.

Closes: https://github.com/rook/rook/issues/1507
Signed-off-by: subhamkrai <srai@redhat.com>
2021-10-05 21:13:13 +05:30
Joseph Sawaya ee791b09fd ceph: update CephNFS to use ".nfs" pool in newer ceph versions
This commit updates the CephNFS CR to make the RADOS settings optional
for Ceph versions above 16.2.7 due to the NFS module changes in Ceph.
The changes in Ceph make it so the RADOS pool is always ".nfs" and the
RADOS namespace is always the name of the NFS cluster.

This commit also handles the changes in Ceph Pacific versions before 16.2.7
where the default pool name is "nfs-ganesha" instead of ".nfs".

Closes: https://github.com/rook/rook/issues/8450
Signed-off-by: Joseph Sawaya <jsawaya@redhat.com>
2021-10-04 17:39:47 +00:00
Travis Nielsen 078f648644 Merge pull request #8909 from aruniiird/revert-one-alert-interval-change
ceph: reverting the time delay of 'CephMonHighNumberOfLeaderChanges'
2021-10-04 08:58:54 -06:00
Arun Kumar Mohan 4d845425e6 ceph: reverting the time delay of 'CephMonHighNumberOfLeaderChanges'
As 'CephMonHighNumberOfLeaderChanges' means there is a
multiple monitor election and indicate some communication
issue between the monitors. Increasing interval timing for
this alert is not considered as safe. So reverting this
change back to 5m

Signed-off-by: Arun Kumar Mohan <amohan@redhat.com>
2021-10-04 10:37:34 +05:30
Blaine Gardner 7586cea049 core: create TRACE_INSECURE log level
Create a new log level for Rook that is hidden from users. This is the
most verbose log level, and it is the level developers would like to use
to get debug logs that are important for debugging but that could leak
senstivie information like credentials in production use.

If a user sets their debug level to "TRACE", they will merely get
"DEBUG" level logs. Only if they set "TRACE_INSECURE" will they get
trace logs, and those are likely to include insecure information. Rook
tries very hard not to leak sensitive information in logs even with
verbose "DEBUG" logs.

Resolves #8778

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-10-01 12:09:19 -06:00
Blaine Gardner 08cb6785a4 Merge pull request #8804 from jmolmo/fix_timeout
ceph: retry <ceph orch> commands when they fail
2021-10-01 10:55:32 -06:00
Sébastien Han 5f0cfb6829 Merge pull request #8896 from aruniiird/alert-interval-changes
ceph: increasing the auto-resolvable alerts' delay to 15m
2021-10-01 14:57:49 +02:00
Arun Kumar Mohan a7f16c912a ceph: increasing the auto-resolvable alerts' delay to 15m
The following alerts,

CephMonHighNumberOfLeaderChanges
CephOSDDiskNotResponding
CephClusterWarningState

, which are resolved automatically, in most cases,
are causing unnecessary admin events. So we are increasing the
alert delay time to '15m'.

Signed-off-by: Arun Kumar Mohan <amohan@redhat.com>
2021-10-01 11:44:43 +00:00
Sébastien Han 3c93eb3ab8 Merge pull request #8901 from aruniiird/add-namespace-to-ceph-queries
ceph: adding 'namespace' field to the needed ceph queries
2021-10-01 13:42:29 +02:00
Arun Kumar Mohan 8950e78a4f ceph: adding 'namespace' field to the needed ceph queries
Signed-off-by: Arun Kumar Mohan <amohan@redhat.com>
2021-10-01 16:05:54 +05:30
Sébastien Han 8468b6f777 Merge pull request #8897 from travisn/test-local-build
build: Run canary tests against the local-build tag
2021-10-01 09:44:20 +02:00
Blaine Gardner c084ee715f Merge pull request #8898 from BlaineEXE/fix-double-makelib-helm-mk-include
build: fix double include of build/makelib/helm.mk
2021-09-30 16:21:42 -06:00
Travis Nielsen af29d1d801 build: run canary tests against the local-build tag
The canary tests were still picking up the tag from operator.yaml
and toolbox.yaml instead of the new test local-build tag.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
(cherry picked from commit 6f48dce3f5)
2021-09-30 15:33:48 -06:00
Travis Nielsen aa085c93b9 Merge pull request #8895 from leseb/mgr-weekly
ci: run the orch ceph manager test daily
2021-09-30 15:31:24 -06:00
Blaine Gardner 74d3492ee5 build: fix double include of build/makelib/helm.mk
Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-09-30 15:29:54 -06:00
Blaine Gardner 7aa4bbfff7 Merge pull request #8878 from BlaineEXE/initial-generate-rbac-from-helm
build: start tracking rbac generated from helm chart
2021-09-30 13:49:21 -06:00
Blaine Gardner e2ba16f710 build: start tracking rbac generated from helm chart
This is a starting step to be able to generate common.yaml from Helm
charts. For right now, we merely want to be able to determine when the
rendered output of the Helm chart changes.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-09-30 12:20:24 -06:00
Sébastien Han 04e1589a33 ci: run the orch ceph manager test daily
Let's run the test every day at midnight since the code is moving
fast and tends to fail. This gives us some time to fix the issues.
It can be triggered on PR too if the "run-mgr-suite" label is set.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-09-30 18:54:09 +02:00
Blaine Gardner da52226280 Merge pull request #8885 from BlaineEXE/use-intermediate-tmp-for-offline-image-install-list
build: use intermediate tmp for offline image gen
2021-09-30 08:18:58 -06:00
Sébastien Han 1f49b6f766 Merge pull request #8882 from aruniiird/change-CephMgrIsAbsent-alert
ceph: change CephAbsentMgr to use 'up' query
2021-09-30 09:05:49 +02:00
Satoru Takeuchi a0d0d7ef86 Merge pull request #8881 from BlaineEXE/period-log
rgw: add period does not exist debug message
2021-09-30 16:02:41 +09:00
Blaine Gardner 24bf99f31c build: use intermediate tmp for offline image gen
Reading from a file, processing the file in a pipe, and outputting the
piped content to the same file can have undefined results, often leading
to an empty file. Use an intermediate temp file for generating the
offline image list.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-09-29 17:31:02 -06:00
Blaine Gardner c6edc1b7d0 Merge pull request #8781 from BlaineEXE/limit-wildcard-in-rbac-verb-resource
rgw: reduce RBAC for lib-bucket-provisioner
2021-09-29 14:40:54 -06:00
aruniiird 854eb0113f ceph: change CephAbsentMgr to use 'up' query
Instead of using 'absent' query, we are trying to use 'up' which should
provide us with the needed 'namespace' field in the resultant metrics

Signed-off-by: aruniiird <amohan@redhat.com>
2021-09-30 01:12:46 +05:30
Blaine Gardner e10fb751e5 rgw: add period does not exist debug message
Log as a debug message when the RGW period will be updated because it
does not exist.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-09-29 13:14:52 -06:00
Blaine Gardner 2826bc99df Merge pull request #8828 from BlaineEXE/rgw-period-command-should-be-run-on-every-reconcile
rgw: update period if period does not exist
2021-09-29 13:08:27 -06:00
Sébastien Han 85612b1f3c Merge pull request #8868 from leseb/fix-crash-kms-deletion
ceph: do not fail on keys deletion
2021-09-29 16:44:26 +02:00
Sébastien Han 804500fc11 Merge pull request #8869 from leseb/image-pull-erorr
ci: retry on image pull error
2021-09-29 16:43:44 +02:00
Sébastien Han 33f0577dcb Merge pull request #8866 from leseb/fix-8865
bot: change mergify config for k8s versions
2021-09-29 16:34:44 +02:00
Sébastien Han 7a9a6a65fc Merge pull request #8863 from subhamkrai/update-image-list
build: update command to generate image list
2021-09-29 16:06:18 +02:00
Sébastien Han e3f7d2f046 ci: retry on image pull error
Try to avoid the following:

```
error pulling image configuration: received unexpected HTTP status: 500 Internal Server Error
```

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-09-29 16:03:38 +02:00
Sébastien Han 2e73baf4f5 ceph: do not fail on keys deletion
Prior, we were returning a nil map and thus the assignment for forced
deletion was not working since we were trying to assign on a nil map.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-09-29 15:59:18 +02:00
subhamkrai 2d7755ca15 build: update command to generate image list
While build.all we have race condition where images.txt
file was update with duplicate entries. So, removing `-a`
from 1st tee and also add `sort -h`and `uniq` command to
confirm no duplicate entry is in the file.

Signed-off-by: subhamkrai <srai@redhat.com>
2021-09-29 15:00:05 +05:30
Sébastien Han cc66fdb5d7 bot: fix mergify merge rules for kubernetes version
CI's running versions were incorrect.

Closes: https://github.com/rook/rook/issues/8865
Signed-off-by: Sébastien Han <seb@redhat.com>
2021-09-29 10:17:29 +02:00
Sébastien Han 8902d7095e bot: remove old branch config from mergify
We don't backport to 1.4 or 1.5 anymore so let's clean up the file.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-09-29 10:08:11 +02:00
Sébastien Han 0ba6243baa Merge pull request #8860 from leseb/exec-mgr
multus: do not build all the args to remote exec cmd
2021-09-29 08:53:55 +02:00
Blaine Gardner 7b9293624a rgw: update period if period does not exist
Rook should update the RGW object store's period if the period doesn't
yet exist. This protects us from the case where the
'radosgw-admin period update --commit` command fails and the
CephObjectStore controller reconciles again.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-09-28 14:17:04 -06:00
Sébastien Han 17999bcb3d ceph: do not build all the args to remote exec cmd
When proxying commands to the cmd-proxy container we don't need to build
the command line with the same flags as the operator. The cmd-proxy
container does not use any ceph config file and just relies on the
CEPH_ARGS environment variable in the container. So passing the same
args as the operator causes to fail since we don't have a ceph config
file in `/var/lib/rook/openshift-storage/openshift-storage.config` thus
the remote exec fails with:

```
global_init: unable to open config file from search list ...
```

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-09-28 19:00:32 +02:00
Sébastien Han 62d66b0f45 Merge pull request #8807 from leseb/fix-bz-2007130
ceph: fix external script when passing monitoring list
2021-09-28 16:01:28 +02:00
Sébastien Han 428942ac59 Merge pull request #8854 from leseb/wait-longer
ci: wait longer for pod label to be deleted
2021-09-28 15:54:41 +02:00
Travis Nielsen 2bedb53fbe Merge pull request #8712 from leseb/fix-8663
rgw: use insecure TLS for bucket health check
2021-09-28 07:53:18 -06:00
Sébastien Han f47b870718 ceph: fix external script when passing monitoring list
If we call the script with --monitoring-endpoint
10.1.8.29,10.1.8.36,10.1.8.25, we need to parse each comma-separated
address and not the entire block.
Now each address is tested properly.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-09-28 15:30:38 +02:00
Sébastien Han b4a36e9967 ci: wait longer for pod label to be deleted
I've seen cases were the CI needs a few more seconds to delete and
object store. When logging in the runner, the object store is gone and
the timing matches too with the runner's logs (comparing with the
operator's logs).

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-09-28 15:24:39 +02:00
Sébastien Han cda5dad291 rgw: use insecure TLS for bucket health check
We have seen cases where the signed certificate used for the RGW does not
contain the internal DNS endpoint, resulting in the health check to fail
since the certificate is not valid for this domain.
People consuming the gateways by external clients and for specific
domains do not necessarily have the internal DNS configured in the
certificate.
So let's be a bit more flexible and simply ensure a connectivity check
and bypass the certificate validation.

Also, this is fixing the tls code in newS3Agent and adds unit tests.

Closes: #8663
Signed-off-by: Sébastien Han <seb@redhat.com>
2021-09-28 14:48:07 +02:00
Sébastien Han dcb88a71d1 Merge pull request #8848 from leseb/fix-8843
ci: fix the test name for upgrade suite
2021-09-28 11:30:39 +02:00