Commit Graph
11794 Commits
Author SHA1 Message Date
subham rai fb5ab477a2 Merge pull request #15198 from rook/mergify/bp/release-1.16/pr-15191
docs: Remove obsolete min csi version (backport #15191)
2024-12-18 15:15:41 +05:30
Travis Nielsen 8375a55f1a docs: remove obsolete min csi version
The csi version is no longer checked by Rook. If the user
changes the default csi version, it's their responsibility
to ensure it is updated according to the upgrade guide,
we just don't officially have a min version anymore.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
(cherry picked from commit 26ff895f0a)
2024-12-18 06:42:39 +00:00
Travis Nielsen 1c9c9f36ec Merge pull request #15190 from travisn/release-1.16.0
build: Update release version to v1.16.0
v1.16.0
2024-12-17 13:27:30 -07:00
Blaine Gardner ec68ccca86 Merge pull request #15192 from rook/mergify/bp/release-1.16/pr-15189
test: ignore rgw cli flag order in unit test (backport #15189)
2024-12-17 13:05:36 -07:00
Blaine Gardner fba91ba6f5 test: ignore rgw cli flag order in unit test
In the unit test that ensures `rgwCommandFlags` works properly, ignore
the ordering of the flags. Golang maps are used underneath, which
results in random flag ordering. This is fine as long as the
`rgwCommandFlags` are still guaranteed to be appended to the args Rook
normally applies.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
(cherry picked from commit 37c3cc9fba)
2024-12-17 19:42:37 +00:00
Travis Nielsen b29d17eb7b build: update release version to v1.16.0
For the minor release update the docs and examples
to v1.16.0.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2024-12-17 12:32:03 -07:00
Travis Nielsen 0a27580eb0 Merge pull request #15188 from rook/mergify/bp/release-1.16/pr-15176
doc: add object advanced config and vol mount example (backport #15176)
2024-12-17 11:33:51 -07:00
Travis Nielsen d61c516005 Merge pull request #15186 from rook/mergify/bp/release-1.16/pr-14646
add rgw ops sidecar for op logs (backport #14646)
2024-12-17 11:30:21 -07:00
Travis Nielsen 71dcc6fe00 Merge pull request #15187 from rook/mergify/bp/release-1.16/pr-15185
test: fix flaky object config unit test (backport #15185)
2024-12-17 11:29:29 -07:00
Blaine Gardner 80d11e66d4 doc: add object advanced config and vol mount example
Add a sample to the CephObjectStore Advanced configuration section which
shows how the new `rgwConfig` option can be used with the
`additionalVolumeMounts` setting.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
(cherry picked from commit c845d36b20)
2024-12-17 18:29:22 +00:00
Blaine Gardner 68eff7b591 test: fix flaky object config unit test
Use testify/assert.Equal() to compare maps. Comparing string
representations of maps is supposed to be stable but is flaking in GH
actions CI.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
(cherry picked from commit 92c95fcc16)
2024-12-17 17:36:37 +00:00
Deepika Upadhyay b8f4c920e4 object: add rgw ops sidecar for op logs
the rgw operations for s3 can now be accessible using sidecar
rgw-ops-log availabe in json form that can be further filtered logging
for observability, this will set the rgw_enable_ops_log setting

Signed-off-by: Deepika Upadhyay <deepika.upadhyay@clyso.com>
(cherry picked from commit c5d27467d6)
2024-12-17 17:36:14 +00:00
Travis Nielsen eeb3aa1228 Merge pull request #15182 from rook/mergify/bp/release-1.16/pr-15178
ceph: Update s5cmd to resolve vulnerabilities (backport #15178)
2024-12-17 10:26:26 -07:00
Blaine Gardner 7911c48c88 Merge pull request #15179 from rook/mergify/bp/release-1.16/pr-15153
rgw: bulk data pool by default (backport #15153)
2024-12-17 09:52:12 -07:00
TomHellier 5bd2c7b931 build: update s5cmd to resolve vulnerabilities
The docker.io/rook/ceph image contains vulnerabilities in the s5cmd binary.
A new version of s5cmd was released on 16th December which resolves these issues.

Signed-off-by: TomHellier <me@tomhellier.com>
(cherry picked from commit a87843de62)
2024-12-17 15:20:25 +00:00
Artem Torubarov 6008733b55 rgw: bulk data pool by default
update CephObjecStore examples to set bulk=true for data pools by default

Signed-off-by: Artem Torubarov <artem.torubarov@clyso.com>
(cherry picked from commit e3c3aafe09)
2024-12-17 14:17:20 +00:00
Blaine Gardner 19f7145323 Merge pull request #15175 from rook/mergify/bp/release-1.16/pr-15160
object: allow overriding rgw configs and flags (backport #15160)
2024-12-16 16:11:55 -07:00
Blaine Gardner 95764f590b object: allow overriding rgw configs and flags
Implement #15119

Allow users to override RGW configurations by specifying Ceph config
options in the CephObjectStore. For configurations that require RGW to
be restarted when the config is applied, allow configs to be specified
as CLI arguments to the RGW as well.

This is an advanced option and is documented as such. Users should be
careful to understand the values they are setting, as there is no
validation to prevent the object store from breaking when these configs
are used.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
(cherry picked from commit aaa16488de)
2024-12-16 22:30:48 +00:00
Blaine Gardner 07bf3d06c6 Merge pull request #15174 from rook/mergify/bp/release-1.16/pr-15115
build: Update api gomod dependencies (backport #15115)
2024-12-16 15:13:51 -07:00
Travis Nielsen a277f52233 test: add new default fields to csi unit test
With the updated dependencies, the csi unit tests
require new default fields in the comparison of the
json test blob.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
(cherry picked from commit 2fdf173ddf)
2024-12-16 14:47:43 -07:00
Michael Adam cab7723632 build: update api go module dependencies
Signed-off-by: Michael Adam <obnox@samba.org>
(cherry picked from commit c8a1bb21f6)
2024-12-16 14:47:36 -07:00
Travis Nielsen cef7f2c868 Merge pull request #15173 from rook/mergify/bp/release-1.16/pr-14456
external: fix exporter secret isn't created with external cluster (backport #14456)
2024-12-16 11:49:52 -07:00
Travis Nielsen 0ba187c3ae Merge pull request #15159 from rook/mergify/bp/release-1.16/pr-15138
object: add bucketPolicy to obc (backport #15138)
2024-12-16 11:29:38 -07:00
Travis Nielsen 4637143c02 Merge pull request #15172 from rook/mergify/bp/release-1.16/pr-15158
docs: Fix misleading example for urlPrefix (backport #15158)
2024-12-16 11:27:10 -07:00
Travis Nielsen 7fc5bb88d8 Merge pull request #15170 from rook/mergify/bp/release-1.16/pr-15132
ci: update golangci-lint to the latest version (v1.62) (backport #15132)
2024-12-16 11:26:47 -07:00
Yaguang Tang d85e6c7a6b external: fix exporter secret isn't created with external cluster
Fix the issue when using with external ceph cluster, ceph exporter
secret isn't created which cause ceph-exporter fail to run. By
default this option is false means ceph-exporter will run for
external cluster.

monitoring
  metricsDisabled: false

This patch also adds metricsDisabled option to helm values.yaml.

fixes #14275

Signed-off-by: Yaguang Tang <heut20008@gmail.com>
(cherry picked from commit 1563d32fbb)
2024-12-16 17:59:45 +00:00
Silvio Ankermann bd3970b3b2 docs: fix misleading example for urlPrefix
The default value for protocols.swift.urlPrefix is "swift", which makes
the Swift API available at http://host:port/swift/v1. However, in the
documentation our example says "/swift", which resulted in the
unexpected endpoint http://host:port//swift/v1.

Apparently, Ceph distinguishes between both values even though their
docs[1] seem to suggest that using leading slashes is fine.

This commit fixes the examples in the documentation to use the default
value "swift".

[1]
https://docs.ceph.com/en/reef/radosgw/config-ref/#confval-rgw_swift_url_prefix

Fixes #15065

Signed-off-by: Silvio Ankermann <silvio.ankermann@cloudandheat.com>
(cherry picked from commit fcce3ca520)
2024-12-16 16:31:41 +00:00
Michael Adam ec968c2085 core: add function roundupSizeMiB
This change  refactors inline roundup code to a function
roundup_size_MiB that takes a size(in bytes) as argument and returns
the smallest number of Mibibytes larger than or equal to the given size.

Signed-off-by: Michael Adam <obnox@samba.org>
(cherry picked from commit 26b4fb06d5)
2024-12-16 16:12:24 +00:00
Michael Adam 3bb6380947 ci: update golangci-lint to the latest version (v1.62)
The ci was using a pretty old version og golangci-lint.
This updates to the latest version.

Additionally, it  silences some
gosec integer conversion overflow false positves
and fixes some real errors of this category
 and string format errors found by golangci-lint, while at it.

Co-authored-by: Blaine Gardner <b.blaine.gardner@gmail.com>
Co-authored-by: Travis Nielsen <tnielsen@redhat.com>
Signed-off-by: Michael Adam <obnox@samba.org>
(cherry picked from commit df511fb58f)
2024-12-16 16:12:24 +00:00
Joshua Hoblitt 04624782ea test: add obc bucketPolicy integration test
Signed-off-by: Joshua Hoblitt <josh@hoblitt.com>
(cherry picked from commit 8fd34e88bb)
2024-12-13 10:46:26 -07:00
Joshua Hoblitt fa9da8f12a object: add obc bucketPolicy
Signed-off-by: Joshua Hoblitt <josh@hoblitt.com>
(cherry picked from commit 97b904c717)
2024-12-12 21:37:30 +00:00
Joshua Hoblitt 40e5026b26 object: add httpClient param to object.NewS3Agent()
To allow the caller to pass in their own transport when testing.

Signed-off-by: Joshua Hoblitt <josh@hoblitt.com>
(cherry picked from commit 57b7eeec80)
2024-12-12 21:37:28 +00:00
Joshua Hoblitt 7ac36bcef6 object: factor out bucket.setS3Agent()
Add a s3Agent field to bucket.Provisioner struct as a step towards
allowing the s3Agent / s3 client to be mocked in unit tests.

Signed-off-by: Joshua Hoblitt <josh@hoblitt.com>
(cherry picked from commit e5f79dba7f)
2024-12-12 21:37:26 +00:00
mergify[bot] 1fdf737b4c Merge pull request #15156 from rook/mergify/bp/release-1.16/pr-15155
build: Add support for K8s 1.32 (backport #15155)
2024-12-12 19:00:36 +00:00
Travis Nielsen 26689e9a5b build: add support for k8s 1.32
With the release of K8s 1.32, we update the CI and docs
to support this new release, to maintain the most recent
six releases of K8s.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
(cherry picked from commit 7c2f41e72e)
2024-12-12 11:35:35 -07:00
mergify[bot] be9b70b437 Merge pull request #15149 from rook/mergify/bp/release-1.16/pr-15131
manifest: Update default ceph version to v19 (backport #15131)
2024-12-11 23:11:17 +00:00
Travis Nielsen c0dfa9caf6 Merge pull request #15147 from rook/mergify/bp/release-1.16/pr-15134
csi: update cephcsi to latest release (backport #15134)
2024-12-11 15:56:55 -07:00
Travis Nielsen 3043b6758c manifest: update default ceph version to v19
With the v19.2.0 release being out for some time now,
update the default version to be deployed with Rook
as v19.2.0.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
(cherry picked from commit 07d8012d36)
2024-12-11 15:45:25 -07:00
Travis Nielsen 1784980555 Merge pull request #15151 from rook/mergify/bp/release-1.16/pr-15145
ci: Use correct ceph-ci repo (backport #15145)
2024-12-11 15:41:37 -07:00
Blaine Gardner f958646d31 Merge pull request #15143 from BlaineEXE/bp-116-cosi-user-revert
Revert "object: create cosi user for each object store"
2024-12-11 15:37:14 -07:00
Travis Nielsen 89ff4e4098 ci: use correct ceph-ci repo
The repo should be quay.ceph.io, instead of quay.io

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
(cherry picked from commit 6db75b76b8)
2024-12-11 15:29:10 -07:00
Blaine Gardner c232c85cce Merge pull request #15146 from BlaineEXE/bp-116-upugrade-docs
docs: update guides and examples for v1.16 release (backport #15105)
2024-12-11 15:21:45 -07:00
Madhu Rajanna 22dc0ff13f csi: update cephcsi to latest release
cephcsi 3.13.0 is released today and
update the Rook to use the latest image

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
(cherry picked from commit 07f5700a87)
2024-12-11 15:20:51 -07:00
Blaine Gardner bd07cebb79 docs: remove deprecated toplogyKey beta labels
Remove long-deprecated topologyKey beta label from examples:
failure-domain.beta.kubernetes.io/zone

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
(cherry picked from commit 79e767e0e7)
2024-12-11 15:11:12 -07:00
Blaine Gardner 50450a2832 docs: update guides and examples for v1.16 release
Update upgrade guides, docs, and exmaple manifests for the Rook v1.16
release.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
(cherry picked from commit 9bf562c253)
2024-12-11 15:11:03 -07:00
Travis Nielsen 441437a3ce Merge pull request #15142 from rook/mergify/bp/release-1.16/pr-15139
ci: Use images from ceph-ci instead of daemon-base (backport #15139)
2024-12-11 15:08:41 -07:00
Blaine Gardner 8d53a3f2ac Revert "object: create cosi user for each object store"
This reverts commit a941b3c33f.

Stop creating the 'cosi' user in the CephObjectStore reconcile. This
step often fails for some amount of time during initial object store
creation, causing frequent user concern. It has also been the source of
some reported failures that would otherwise be non-breaking for certain
users.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
(cherry picked from commit fc08e87d44)
2024-12-11 15:01:02 -07:00
Travis Nielsen 620eef21c4 ci: use ceph-ci instead of daemon-base images
Ceph has changed the image build process to only require a
dockerfile and stop using the ceph-container repo. The
daily images are pushed to the quay.io/ceph-ci/ceph repo,
so the Rook CI will now start using those images.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
(cherry picked from commit 85375bf073)
2024-12-11 14:55:20 -07:00
mergify[bot] 6cafece47c Merge pull request #15140 from rook/mergify/bp/release-1.16/pr-15137
ci: Suppress the error from creating the dashboard admin user (backport #15137)
2024-12-11 21:34:20 +00:00
Travis Nielsen 7ac1701318 ci: suppress the error from creating the dashboard admin user
The dashboard admin rgw user has timing isssues in the CI.
For now, just suppress the CI failure and log the error
until we can spend more time to get a reliable wait for the
user creation.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
(cherry picked from commit 23f3db1261)
2024-12-11 14:08:53 -07:00