Commit Graph
2115 Commits
Author SHA1 Message Date
mergify[bot] 470fb35253 Merge pull request #14927 from rook/mergify/bp/release-1.15/pr-14588
Rgw pool placement (backport #14588)
2024-10-29 15:26:22 +00:00
Artem Torubarov 3712566c9b rgw: pool placement
Signed-off-by: Artem Torubarov <torubarov.a.a@gmail.com>
(cherry picked from commit 59175f0b40)
2024-10-29 08:37:58 -06:00
parth-gr 695324fa7a docs: fix external doc broken links
some of the links have the full path
which is not working in the doc server,
but works locally

Signed-off-by: parth-gr <partharora1010@gmail.com>
(cherry picked from commit d061382661)
2024-10-29 13:42:01 +00:00
Travis Nielsen d117b52783 Merge pull request #14905 from rook/mergify/bp/release-1.15/pr-14818
kms: key rotation support for vault kms (backport #14818)
2024-10-25 14:45:50 -06:00
Blaine Gardner c781db7c03 object: also use system certs for validating RGW cert
When generating the HTTP client used for RGW admin ops, use both system
certs as well as the user-given cert.

As a real world example, admins may use ACME to rotate Letsencrypt certs
every 2 months. For an external CephObjectStore, the cert used by Rook
and RGW may not be rotated at the same time. This can cause the Rook
operator to fail CephObjectStore reconciliation until both certs agree.

When Rook also relies on system certs in the container, Rook's
reconciliation will not have reconciliation failures because
Letsencrypt's well-known and trusted root certificates can be loaded
from the system to validate the RGW's newly-rotated cert.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
(cherry picked from commit 7bb72a0171)
2024-10-25 17:59:00 +00:00
Praveen M ca9e893bcb docs: update docs for vault KMS key rotation support
Signed-off-by: Praveen M <m.praveen@ibm.com>
(cherry picked from commit 01ccb5e20a)
2024-10-24 17:39:18 +00:00
Madhu Rajanna 7cabfd056f core: cleanup blockpool with annotation
This is similar to #14052 we did for radosnamespace
and this is an extension to support cleanup
at the blockpool level to cleanup the images
and the snapshots in a pool.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
(cherry picked from commit 4e29717317)
2024-10-24 16:29:20 +00:00
Niraj Yadav bef1e160e3 Revert "docs: add documentation for rbd volumegroupsnapshot"
This reverts commit 524b6071d2.

Signed-off-by: Niraj Yadav <niryadav@redhat.com>
(cherry picked from commit b040a02336)
2024-10-23 07:52:25 +00:00
Travis Nielsen e0edea90a1 build: set the release version to v1.15.4
For the patch release update the docs and examples
to v1.15.4

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2024-10-17 14:14:49 -06:00
Niraj Yadav 0e720ff47a docs: add documentation for rbd volumegroupsnapshot
This PR adds the sample YAMLs and documentation
for the RBD VolumeGroupSnapshot.

Signed-off-by: Niraj Yadav <niryadav@redhat.com>
(cherry picked from commit 524b6071d2)
2024-10-15 13:50:54 +00:00
Madhu Rajanna 34f81ec820 csi: disable fencing in Rook
Disabling the RBD and CephFS fencing
in Rook for now as its having bugs where
Rook is blocklisting wrong IP address
due to timing issues.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
(cherry picked from commit 1d1ed5e962)
2024-10-11 16:27:09 +00:00
Travis Nielsen 050a5dbfda build: set the release version to v1.15.3
For the patch release update the docs and manifests
to v1.15.3

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2024-10-03 14:34:04 -06:00
Joshua Hoblitt 8ed15f773c rgw: change CephObjectZone.spec.{dataPool,metadataPool} to optional
These fields must be optional in order to allow usage of pre-existing
pools managed by CephBlockPool CR(s).

Signed-off-by: Joshua Hoblitt <josh@hoblitt.com>
(cherry picked from commit 76fa776795)
2024-10-03 19:50:06 +00:00
Travis Nielsen 38d3d28dd9 helm: add enforce host network setting
The ROOK_ENFORCE_HOST_NETWORK option was implemented recently
and now we add the helm setting to expose this new setting
in the rook chart.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
(cherry picked from commit 810de394e7)
2024-10-02 22:04:58 +00:00
Michael Adam 1cb843acab helm: add revisionHistoryLimit setting
Co-authored-by: Travis Nielsen <tnielsen@redhat.com>
Signed-off-by: Michael Adam <obnox@samba.org>
(cherry picked from commit 20f0031280)
2024-10-02 20:11:54 +00:00
Travis Nielsen a33f180b56 docs: declare cephconfig settings stable
The cephConfig settings in the CephCluster CR have been
stable and there are no planned changes, so remove the
experimental documentation indicator. Also, clarify
the usage and the precedence of the ceph config
options.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
(cherry picked from commit 1c9727c271)
2024-09-30 20:26:58 +00:00
parth-gr 7f3cd3d884 docs: update external docs with a better structure
step1 to improve the external docs
and make it more clear to end user

Signed-off-by: parth-gr <partharora1010@gmail.com>
(cherry picked from commit 467578d368)
2024-09-20 14:30:45 +00:00
Travis Nielsen d8f8ec9d43 build: update the release version to v1.15.2
For the patch release update the docs and examples
to v1.15.2

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2024-09-19 13:06:50 -06:00
Travis Nielsen 3eb17e28f2 Merge pull request #14712 from rook/mergify/bp/release-1.15/pr-14702
doc: add the pv encryption key rotation job (backport #14702)
2024-09-19 13:01:18 -06:00
Artem Torubarov 362cf539eb exporter: move config to cluster CRD
allows to set prio-limit and stats-period options to ceph exporter

Signed-off-by: Artem Torubarov <artem.torubarov@clyso.com>
(cherry picked from commit b2c39ace25)
2024-09-18 20:16:36 +00:00
Niraj Yadav e622c52f3f docs: add documentation for volumegroupsnapshot
This PR adds the sample YAMLs and documentation
for the VolumeGroupSnapshot feature.

Signed-off-by: Niraj Yadav <niryadav@redhat.com>
(cherry picked from commit 1e3d08f114)
2024-09-18 19:47:24 +00:00
Alexander Trost 7ac0716fe6 docs: add grafana dashboards files to docs
Co-authored-by: Travis Nielsen <tnielsen@redhat.com>
Signed-off-by: Alexander Trost <galexrt@googlemail.com>
(cherry picked from commit 36f6807fbe)
2024-09-12 16:44:34 +00:00
parth-gr adb0a66c4d doc: add the pv encryption key rotation job
Add missing csi addon's feature in the Rook document

Signed-off-by: parth-gr <partharora1010@gmail.com>
(cherry picked from commit 4af5b6a331)
2024-09-10 14:13:37 +00:00
Madhu Rajanna 5f2be2e52c csi: update to new cephcsi release
we have 3.12.2 as the new cephcsi release
updating the rook to use the same.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
(cherry picked from commit d041be4bcf)
2024-09-06 14:52:00 +00:00
Travis Nielsen 2a1c5e0d2c build: update release version to v1.15.1
For the patch release update the docs and manifests
to v1.15.1

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2024-09-04 13:57:32 -06:00
Madhu Rajanna 21daa24046 csi: update csi-addons to v0.9.1
updating csi-addons to latest
v0.9.1 release.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
(cherry picked from commit 05d579b607)
2024-09-03 18:15:40 +00:00
Tarun Gupta Akirala 3cfa3eee7e docs: exhaustively list all priority class options
List all possible config values for listing
PriorityClasses in CephCluster CRD.

Signed-off-by: Tarun Gupta Akirala <tarun.akirala@nutanix.com>
(cherry picked from commit 48ab3d774f)
2024-08-29 18:56:35 +00:00
Blaine Gardner ad5b332e77 rgw: allow users to add custom volume mounts
Allow RGW users to mount arbitrary volumes to RGW pods. This follows the
pattern that was established for NFS to support SSSD and LDAP, and
reuses much of the same code.

This opens the door wider for advanced users to take advantage of some
Ceph RGW features that Rook doesn't have first class support for.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
(cherry picked from commit eea43b7b79)
2024-08-28 22:51:16 +00:00
Vamsi Krishna Sethu c4accdadf7 docs: fix ceph object multisite and update source code layout
Signed-off-by: Vamsi Krishna Sethu <sethuvamsikrishna@gmail.com>
(cherry picked from commit a26565d922)
2024-08-27 17:29:22 +00:00
chanyoung 7c8de4e637 docs: fix typo
Corrects a typo in 'CRDs/Cluster/host-cluster.md'.

Signed-off-by: chanyoung <park910113@gmail.com>
(cherry picked from commit d1b014090d)
2024-08-27 15:25:34 +00:00
Travis Nielsen 4c2a3411f5 build: update the release version to v1.15.0
For the minor release update the documentation and manifests
to v1.15.0

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2024-08-20 13:58:58 -06:00
Travis Nielsen ed90a3ef0b Merge pull request #14613 from rook/mergify/bp/release-1.15/pr-14612
docs: missing slack link (backport #14612)
2024-08-20 13:13:09 -06:00
Travis Nielsen 60faae1e73 Merge pull request #14608 from rook/mergify/bp/release-1.15/pr-14550
manifest: add registry name to docker images (backport #14550)
2024-08-20 12:53:28 -06:00
Zuhair AlSader ee43ca07bc docs: missing slack link
Signed-off-by: Zuhair AlSader <zuhair@devzero.io>
(cherry picked from commit b6087c46bb)
2024-08-20 18:50:30 +00:00
Zuhair AlSader e76d60dd25 manifest: add registry name to docker images
Signed-off-by: Zuhair AlSader <zuhair@devzero.io>
(cherry picked from commit 6714b86d3b)
2024-08-20 12:20:05 -06:00
parth-gr dd1e1a6120 osd: reweight osd while resizing
osd got resized by cryptsetup bluestore cmd
but it should also be reweight to balance the pgs properly

closes: https://github.com/rook/rook/issues/14430

Signed-off-by: parth-gr <partharora1010@gmail.com>
(cherry picked from commit 17cfda5bd6)
2024-08-20 18:15:26 +00:00
Travis Nielsen 1283f1d132 Merge pull request #14605 from rook/mergify/bp/release-1.15/pr-14357
csi: update csi sidecars' image version (backport #14357)
2024-08-20 12:11:53 -06:00
mergify[bot] 8ca25e9c74 Merge pull request #14606 from rook/mergify/bp/release-1.15/pr-14599
csi: update csi-operator to use latest tag v0.1 (backport #14599)
2024-08-20 17:57:29 +00:00
subhamkrai 4f96664ba0 build: changes forced by latest controller-runtime
this commit contains changes that are forced by latest
controller-runtime version v0.19.0.

Signed-off-by: subhamkrai <srai@redhat.com>
(cherry picked from commit 2556e14780)
2024-08-20 17:28:15 +00:00
Praveen M cf42f35f12 csi: update csi sidecars' image version
Below csi sidecars are updated with latest available versions

csi-resizer: v1.11.1
csi-provisioner: v5.0.1
csi-attacher: v4.6.1
csi-snapshotter: v8.0.1
csi-node-driver-registrar: v2.11.1

Signed-off-by: Praveen M <m.praveen@ibm.com>
(cherry picked from commit a1ddf4535d)

# Conflicts:
#	deploy/examples/images.txt
2024-08-20 17:22:10 +00:00
ShravaniVangur b8db2e6e81 csi: storageclass update to gp2-csi
Updating storageClassName for cluster-on-pvc.yaml file from gp2 to gp2-csi.

Signed-off-by: ShravaniVangur <shravanivangur@gmail.com>
(cherry picked from commit 9656d1963a)
2024-08-20 13:34:16 +00:00
Travis Nielsen 6d4837c4cb core: add annotations and labels to detect version jobs
The jobs to detect the ceph and csi versions now can have
custom annotationso and labels added to them. They are
very short-lived jobs, but they may need custom annotations
in some environments to run.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
(cherry picked from commit 5014d5bcf2)
2024-08-16 16:04:59 +00:00
Madhu Rajanna 9e64a840aa csi: update cephcsi to 3.12.0
updating cephcsi image to 3.12.0
release.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
(cherry picked from commit 7c7e8a2b32)
2024-08-16 08:43:34 -06:00
Madhu Rajanna 9e98ae6512 csi: update csi-addons to v0.9.0
As we have new csi-addons v0.9.0
updating the same here as well.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
(cherry picked from commit 123025f22c)

# Conflicts:
#	go.sum
2024-08-16 14:36:41 +00:00
Travis Nielsen 955876cc44 core: support k8s versions 1.26 through 1.31
With the release of K8s v1.31.0, we update the minimum
supported version to v1.26, and add v1.31 to the CI
so we can test the most recent six versions of K8s.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
(cherry picked from commit e157bb5a56)
2024-08-13 17:58:03 -06:00
Blaine Gardner 007b13a941 docs: update upgrade docs for v1.15
Update Rook and Ceph upgrade docs for upcoming v1.15 release.
Tidy up pending release notes in the working text as well as official
doc texts.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
(cherry picked from commit 6026fb1c36)
2024-08-13 17:16:09 +00:00
Zuhair AlSader d80986919c docs: fix affinity docs in operator chart
Signed-off-by: Zuhair AlSader <zuhair@devzero.io>
(cherry picked from commit c146b59d6f)
2024-08-09 14:32:35 +00:00
Sebastian Riese 85949049a3 rgw: add support for keystone auth + swift/s3
For the specification see:
<https://github.com/rook/rook/blob/master/design/ceph/object/swift-and-keystone-integration.md>

* extend the API object specs for swift and keystone integration

* adapt rgw to the new go-ceph version

  - The parameter lists of the API call have changes, as parameters
    ignored by the RGW Admin Ops API are no longer serialized, therefore
    the mock has to be adapted.

  - There is now validation for the user keys that are passed to the
    User get API, therefore things failed when we had empty keys in our
    User proxy object.

* expand the reconcile loop for the swift and keystone integration

* fix minor mistakes in design document

* add env var to pass extra args to minikube

  Minikube decides CPU cores and memory automatically based on the
  available resources on the machine which may be insufficient to
  run rook. This commit adds an environment variable to add arbitrary
  arguments to the minikube command, so both can be specified if
  desired.

* integration tests for swift and keystone

  The new integration of swift or s3 and keystone support by rook
  does not have any integration tests yet.

  This commit introduces integration tests for swift and keystone. The
  tests are done against a minimal keystone setup (keystone container
  image from Yaook-project (https://yaook.cloud), sqlite as database
  backend, cert-manager and trust-manager for test certificate setup).

  To prevent hardcoded credentials, passwords are generated
  by the tests. The integration tests use the openstack client
  (keystone- and swift-functionality) (https://docs.openstack.org/
  python-openstackclient/ latest/). This was a concious design decision
  to use client tooling as close as possible to the end user instead of
  using other go-libraries (such as gophercloud).

* add documentation on swift and keystone

  Currently there is no documentation on the use of Swift to access
  an object store as well as the use of OpenStack keystone for
  authentication.

  This commit adds documentation on the use of Swift and OpenStack
  keystone, as well as CRD-related documentation and an example setup.

* add integration tests for S3 via keystone

  This commit introduces integration tests for s3 and keystone. The
  tests are run against the same minimal keystone setup that the tests
  for swift and keystone use.

  The integration tests use the aws s3 client to use client tooling as
  close as possible to the end user instead of using other go-libraries.

Co-authored-by: Jan Klippel <jan.klippel@uhurutec.com>
Co-authored-by: Silvio Ankermann <silvio.ankermann@cloudandheat.com>
Signed-off-by: Sebastian Riese <sebastian.riese@cloudandheat.com>
Signed-off-by: Jan Klippel <jan.klippel@uhurutec.com>
Signed-off-by: Silvio Ankermann <silvio.ankermann@cloudandheat.com>
(cherry picked from commit ee8bcad49d)
2024-08-08 15:56:28 +00:00
Blaine Gardner ebba8bc4a2 object: use advertise endpoint for admin ops
RGW can only serve a single certificate. This limitation means that the
prior behavior of using the default service for admin ops when TLS is
enabled may mean it requires additional complex certificate management
to make sure the object store uses a certificate valid for Rook internal
admin ops and user connections.

This is needlessly complex for users. Instead, change Rook's behavior
and documentation to clarify that it will use the same endpoint intended
for S3 client applications. This means that users have a more
straightforward path to enabling both Rook and consuming applications.

More info: https://github.com/rook/rook/issues/14530

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
(cherry picked from commit b4a2285aa6)
2024-08-05 21:46:48 +00:00
Blaine Gardner ae00f2f811 object: add hosting.advertiseEndpoint config
Add CephObjectStore spec.hosting.advertiseEndpoint configuration. This
provides a clear documented default for which endpoint Rook "advertises"
to dependent resources like CephObjectStores, OBCs, and COSI
Buckets/Accesses and allows users to override the default behavior if
desired.

The current default is to round-robin an endpoint from
spec.hosting.dnsNames, which has proven to be troublesome for some
users' object store configurations. This change provides much-needed
disambiguation for users.

This may be a breaking change for some existing spec.hosting.dnsNames
users. This is unexpected but is documented.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
(cherry picked from commit a2b0b6449c)
2024-07-31 22:18:07 +00:00