Commit Graph
13292 Commits
Author SHA1 Message Date
dependabot[bot] 4011ec696f build(deps): bump golang.org/x/net from 0.5.0 to 0.7.0
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.5.0 to 0.7.0.
- [Release notes](https://github.com/golang/net/releases)
- [Commits](https://github.com/golang/net/compare/v0.5.0...v0.7.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-02-17 16:25:40 +00:00
Travis Nielsen a4791c13d8 Merge pull request #11692 from parth-gr/go1.19
build: update golang version to v1.19
2023-02-17 09:23:28 -07:00
subhamkrai 972202db0d ci: install kubectl binary in mac for csv gen
installing kubectl in mac build for csv generation
as without that it is failing with
```
./../build/csv/csv-gen.sh: line 26: kubectl: command not found
```

Signed-off-by: subhamkrai <srai@redhat.com>
2023-02-17 20:58:09 +05:30
parth-gr a84daf9bf0 core: change io/ioutil package to use io and os package
few functions got change as they were deprecated
for ex: ioutil.Readfile change to os.Readfile
ioutil.TempFile change to os.CreateTemp
And fixed golang-ci-lint-issues

Signed-off-by: parth-gr <paarora@redhat.com>
2023-02-17 20:38:29 +05:30
parth-gr b81ee215a7 build: update golang version to v1.19
Updated the go mod and ci to use gov1.19 as
minimum and removed support for go1.18

Closes: https://github.com/rook/rook/issues/11681
Signed-off-by: parth-gr <paarora@redhat.com>
2023-02-17 18:39:05 +05:30
Madhu Rajanna 1cfa7eefae csi: add missing node access to cephfs driver
Node access is only needed when we are using
volumeBindingMode: WaitForFirstConsumer in
the storageclass its not required for Immediate
BindingMode.

fixes: #11694

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2023-02-17 07:50:53 +01:00
Travis Nielsen 0a80789367 Merge pull request #11690 from rkachach/fix_issue_11685
ci: fix MultiClusterDeploySuite CI
2023-02-16 11:19:04 -07:00
Redouane Kachach b464428978 ci: fix MultiClusterDeploySuite CI
This fixes the the MultiClusterDeploySuite CI failure. The operator
is timing out waiting for the mgr deployments to be
ready, according to the WaitForDeploymentToStart() method. After
the reconcile times out after about five minutes, the next
reconcile succeeds since the wait is only done for new mgr
deployments.

Closes: https://github.com/rook/rook/issues/11685

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2023-02-16 18:43:38 +01:00
Travis Nielsen fb63b88a33 Merge pull request #11631 from Rakshith-R/enable-read-affinity
csi: add support for enabling read affinity for rbd volumes.
2023-02-16 08:00:17 -07:00
Rakshith R cec987821e helm: add option for rbd read affinity
This commit documents and adds helm options
to enable read affinity for rbd volumes.

Signed-off-by: Rakshith R <rar@redhat.com>
2023-02-16 19:10:12 +05:30
Rakshith R f8c7a62c3b docs: add documentation about rbd read affinity
This commit documents steps to enable read affinity
for rbd volumes.

Signed-off-by: Rakshith R <rar@redhat.com>
2023-02-16 19:10:10 +05:30
Rakshith R 8b9ded1f77 csi: add option to enable read affinity for rbd volumes
This commit adds code to supply variables required
to enable read affinity for rbd volumes.
It leverages `read_from_replica=localize,crush_locations=key:value`
krbd map option from ceph to serve reads from the most local OSD.
refer:
https://docs.ceph.com/en/latest/man/8/rbd/#kernel-rbd-krbd-options

Signed-off-by: Rakshith R <rar@redhat.com>
2023-02-16 19:09:39 +05:30
Travis Nielsen d045cd5822 Merge pull request #11687 from travisn/mergify-1.11
ci: Update mergify for the 1.11 branch
2023-02-15 15:28:24 -07:00
Travis Nielsen 395a6750c0 ci: update mergify for the new 1.11 branch
Add the mergify settings so backports can be automated
to the release-1.11 branch and automatically merged
after the CI is green.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2023-02-15 15:23:18 -07:00
Travis Nielsen 06eb431525 Merge pull request #11674 from travisn/osd-version-label
osd: Ensure rook version label is not set on pod
v1.11.0-alpha.0
2023-02-15 12:21:09 -07:00
Travis Nielsen ace2e152e8 Merge pull request #11673 from travisn/rgw-pool-pgs
object: RGW metadata pg count reduction on 16.2.11
2023-02-15 12:20:23 -07:00
Travis Nielsen 3dabc6dcb6 Merge pull request #11317 from avanthakkar/introduce-ceph-exporter
core: introduce ceph-exporter
2023-02-15 11:59:05 -07:00
Travis Nielsen b9be333651 Merge pull request #11678 from Madhu-1/fix-v2-map
core: set rbd default map options
2023-02-15 11:49:04 -07:00
Travis Nielsen b008c5753f Merge pull request #11643 from rkachach/fix_issue_11640
mgr: use k8s readiness probe to implement mgr HA
2023-02-15 09:51:48 -07:00
Blaine Gardner 2733375ca4 object: make OBC genUserID unique across clusters
Rook's implementation of OBC's GenerateUserID could generate colliding
user IDs for multisite clusters where each site is configured with the
same namespace/name of CephObjectStore. Add the Ceph cluster FSID to the
generated name to ensure the names won't conflict for multiple sites.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2023-02-15 09:08:52 -07:00
Madhu Rajanna 0ab6c34bf2 core: set rbd default map options
Set the rbd map default option to ms_mode=prefer_crc
when v2 ports are used and encryption is disabled.
If we dont pass/set the ms_mode in the map options
the kernel client will assume its using v1 ports
and map operation will fail.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2023-02-15 12:46:40 +01:00
Avan Thakkar 460900756c core: add service monitor for ceph-exporter service
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2023-02-15 15:44:56 +05:30
Redouane Kachach dc76f81fea mgr: use k8s readiness probe to implement mgr HA
The idea behind this change is to use the readiness probe to implement
the mgr HA mechanism. In the current ceph mgr implementation only the
active instance offers the command 'mgr_status' through the admin
socket. We use this command combined with a Readiness Exec Probe to
detect which manager is active. Kubernetes will automatically mark
it as ready and redirect any service traffic to the active instance.

Closes: https://github.com/rook/rook/issues/11640
Closes: https://github.com/rook/rook/issues/11638
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2023-02-15 10:12:16 +01:00
Travis Nielsen 11e80b7047 Merge pull request #11436 from subhamkrai/bump-ci-k8s-version
ci: Update min K8s support to 1.21 and add 1.26 support
2023-02-14 20:26:56 -07:00
Travis Nielsen 6035c09c5b Merge pull request #11675 from travisn/upgrade-test-msgr2
test: Fix upgrade test for msgr2 setting
2023-02-14 20:25:43 -07:00
subhamkrai 1effb11a0a ci: bump min and max k8s support
this commit bump minmum k8s version to 1.21.14 and
max k8s version to latest 1.26.0. Keeping support for
most recent 6 versions.

Signed-off-by: subhamkrai <srai@redhat.com>
2023-02-15 07:08:02 +05:30
Travis Nielsen 88f66ff1f2 test: fix upgrade test for msgr2 setting
The requireMsgr2 setting is not available in 1.10, therefore
the setting must be removed from the cephcluster CR
when the 1.10 cluster is created before the upgrade.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2023-02-14 17:23:38 -07:00
Travis Nielsen 107d947f97 object: rgw metadata pg count reduction on latest pacific
The removal of the rgw_rados_pool_pg_num_min property
was completed in v16.2.11 for Pacific. The previous
fix in PR 11024 only assumed the fix was in Quincy v17.2.2
or newer. Now we account for v16.2.11 as well.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2023-02-14 16:25:31 -07:00
Travis Nielsen 1ba93b4047 osd: ensure rook version label is not set on pod
The rook-version tag must not be set on the pod spec labels
since it will result in the ceph daemons being restarted every
time there is a rook version update, even if the ceph version
or pod spec was not otherwise updated.

The rook-version tag was being added to the OSD pod spec
due to a shared pointer to the labels. The code intended
to only add the version label to the deployment labels,
but since the pod labels shared the map variable, the
pod unintentionally also had the version label added.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2023-02-14 16:10:53 -07:00
Travis Nielsen 47d7c06bdc core: remove dead code for rook version labels
The RookVersionLabelMatchesCurrent() method is no longer
used, so remove it.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2023-02-14 15:56:40 -07:00
Travis Nielsen 240bd564f2 Merge pull request #11663 from travisn/remove-psp-doc
docs: Remove mention of PSPs from documentation
2023-02-14 15:01:40 -07:00
Travis Nielsen 2e89649b3a Merge pull request #11594 from subhamkrai/update-rbd-mirror-log-size
rbdmirror: set log rotation from 7 to 4x i.e 28
2023-02-14 07:51:05 -07:00
Travis Nielsen cc8e69fb7f Merge pull request #11662 from mnlipp/improved-fs-example
Add comment regarding placement restrictions.
2023-02-13 14:56:15 -07:00
Michael N. Lipp f466789ad5 docs: add comment regarding placement restrictions
The sample files placement rules are too restrictive for small clusters.
The comment provides a hint how to fix this.

Closes: https://github.com/rook/rook/issues/11658

Signed-off-by: Michael Lipp <mnl@mnl.de>
2023-02-13 22:53:09 +01:00
Travis Nielsen eb4a727658 docs: remove mention of psps from documentation
The PSPs have long since been deprected. In K8s 1.21 the PSPs
were first deprecated, and support was completely removed
for them in 1.25. With Rook v1.11, the min supported version of
K8s is now 1.21. To reduce confusion in the documentation,
mention of the PSPs is now removed from the 1.11 docs.
For the corner case that users still require the PSPs,
the helm chart still contains the option for creating PSPs
or other users can still create the psp.yaml.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2023-02-13 13:30:32 -07:00
Blaine Gardner 76528305f0 Merge pull request #11281 from subhamkrai/update-operator-sdk
core: upgrade to latest operator-sdk v1.25.0
2023-02-13 09:33:32 -07:00
subhamkrai 036715c3b2 rbdmirror: set log rotation from 7 to 4x i.e 28
increasing the rotation from default 7 to 28 as
in case of rbdmirror logs seems not enough in some cases
with maxLogSize 500 so it's better to increase the rotation
for rbdmirror specific.

Signed-off-by: subhamkrai <srai@redhat.com>
2023-02-13 21:37:57 +05:30
subhamkrai 45a10dcb85 core: upgrade to latest operator-sdk v1.25.0
upgrading to latest operator-sdk later version
and changing the way of csv generation.

Signed-off-by: subhamkrai <srai@redhat.com>
2023-02-13 17:08:09 +05:30
Travis Nielsen 5e0cf95228 Merge pull request #11627 from travisn/require-msgrv2
core: Option to require msgrv2 even without encryption
2023-02-10 10:58:22 -07:00
Travis Nielsen 3ea8f15912 Merge pull request #11630 from microyahoo/fix_11629
rgw: handle insecure flag skip for object bucket notification in the tls config
2023-02-10 09:57:09 -07:00
Travis Nielsen a4f71baf8a core: option to require msgrv2 even without encryption
Enabling msgr v2 and disabling msgr v1 currently requires enabling
either encryption on the wire or compression on the wire.
As more clients are running on the latest kernel, allow
the clients to run on v2 even when encryption and compression
are not enabled. Clusters that are fully running on v2
will more easily be able to change configuration between
enabling or disabling msgr v2 features.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2023-02-10 09:45:57 -07:00
Travis Nielsen e7320ad63b mon: allow mons on msgr1 even if v2 settings required
Mons that are configured on msgr1 will be using the v1 port
in the csi driver since only one port is allowed in the configmap.
To allow mons to be started on v2 while keeping quorum with the
v1 mons, the v1 mons must continue running on the v1 port.
So even if msgr2 is required, allow existing v1 mons to continue
running on that port.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2023-02-10 09:38:09 -07:00
Travis Nielsen d53b7fcbbd Merge pull request #11616 from travisn/override-cm-labels
helm: Add labels and annotations to config overrides configmap
2023-02-10 08:11:41 -07:00
Travis Nielsen de77746494 Merge pull request #11625 from Madhu-1/fix-11624
csi: provide way to set cephfs kernel mount options
2023-02-10 07:36:54 -07:00
Travis Nielsen ab3209c140 helm: add labels and annotations to config overrides configmap
The default configmap does not have any labels or annotations
applied. If the helm chart is later updated to configure the
ceph config overrides, the configmap will fail to be created
by the chart since it doesn't have the needed label and helm
annotations so helm will know it can take over the resource
management.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2023-02-10 07:33:35 -07:00
subhamkrai d84d139e4c ci: bump min and max k8s support
this commit bump minmum k8s version to 1.21.14 and
max k8s version to latest 1.26.0. Keeping support for
most recent 6 versions.

Signed-off-by: subhamkrai <srai@redhat.com>
2023-02-10 13:02:31 +05:30
Madhu Rajanna d7dc12d834 csi: provide way to set cephfs kernel mount options
Exposing CSI configuration for the user to
set the cephfs kernel mount options.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2023-02-10 08:26:41 +01:00
Satoru Takeuchi 50dbc6e1ab Merge pull request #11646 from cybozu-go/test-change-ceph-version-of-canary-tests-for-osd-on-pvc
test: change ceph version of osd on pvc canary test to avoid failures
2023-02-10 15:02:54 +09:00
Satoru Takeuchi f19c77a6fb test: change ceph version of osd on pvc canary test to avoid failures
This is to fix the following CI failure.

ci: Canary tests on PVCs are failing when creating OSDs #11600
https://github.com/rook/rook/pull/11600

We set the version of Ceph used for OSD on PVC to v16. It's the moving
target and was recently changed the target version. The new version
has a regression which results in the failure
of `ceph-volume raw prepare`. Although this will be fixed in Ceph
by the following PR, it's not backported to Quincy yet.

ceph-volume: fix a bug in lsblk_all() #49171
https://github.com/ceph/ceph/pull/49171

Let's change the version to v17.2.3, which is the latest version
without the above-mentioned regression of Ceph.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2023-02-10 04:21:57 +00:00
Travis Nielsen d0cc3d3d9b Merge pull request #11525 from rook/add-glossary
docs: add glossary page
2023-02-08 09:40:12 -07:00