Commit Graph
9411 Commits
Author SHA1 Message Date
Travis Nielsen 4e4084a9cc Merge pull request #11467 from Madhu-1/fix-11463
doc: update csi registry in custom-images
2022-12-21 07:41:41 -07:00
Madhu Rajanna 2d544d59f1 docs: update csi registry in custom-images
updated the outdated registry URL
for the CSI sidecar images in the custom-images

fixes: #11463

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-12-21 08:52:54 +01:00
Blaine Gardner 50c1eeaeb0 Merge pull request #11374 from BlaineEXE/rgw-probe-update
object: update startup, liveness, readiness probes
2022-12-20 16:15:53 -07:00
Blaine Gardner 17c5cf7384 object: update startup, liveness, readiness probes
Based on the latest info from the Ceph RGW team, update all probes. Get
rid of the liveness probe entirely. Update startup and readiness probes
to support return codes for misconfiguration (500) and for server-side
throttling (498 or 503).

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2022-12-20 15:23:22 -07:00
Satoru Takeuchi 49e7e37341 Merge pull request #11461 from travisn/multicluster-timeout
ci: Multi cluster test failing consistently in master
2022-12-20 20:22:20 +09:00
Travis Nielsen 2a8bb75eb6 ci: multi cluster test improvement for pools
Waiting for pools to be configured in the multi cluster test is taking
too long and timing out. Increase the timeout of the wait so the
pool creation can succeed.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-12-19 15:48:13 -07:00
Travis Nielsen ec9f520860 Merge pull request #11377 from steache/new/allow-to-specify-allowed-topologies
helm: allow to specify allowed topologies for storage class
2022-12-19 11:36:55 -07:00
Travis Nielsen c068ae439e Merge pull request #11456 from travisn/mirroring-link
docs: Add link to failover and failback topic
2022-12-19 10:58:00 -07:00
Travis Nielsen 5f059ad1f6 Merge pull request #11427 from Rajpratik71/bump-go-1-19
build: move to Go 1.19 as default version for building services
2022-12-19 10:53:38 -07:00
Travis Nielsen 2991ee1e61 docs: add link to failover and failback topic
A note in the rbd mirroring topic was missing a link
to the failover and failback doc.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-12-19 10:51:00 -07:00
Pratik Raj cc921a53f0 build: move to Go 1.19 as default version for building services
Go 1.18.5 and other Go 1.18 version patches provided many vulnerability fixes
but as go.mod doesn't support minor version i.e why moving to next go release

Signed-off-by: Pratik Raj <rajpratik71@gmail.com>
2022-12-19 15:07:02 +05:30
Tomáš Sýkora 57babee11f helm: allow to specify allowed topologies for storage class
Signed-off-by: Tomáš Sýkora <tomas@reservio.com>
2022-12-17 11:52:59 +01:00
Travis Nielsen f908bcdba2 Merge pull request #11450 from travisn/remove-machine-budgets
core: Remove support for machine disruption budgets
2022-12-16 14:57:45 -07:00
Travis Nielsen 25ac236b5c core: remove support for machine disruption budgets
The machine disruption budgets for handling openshift
machines and machinesets are now removed since they
have been unused and unmaintained since implemented.
This feature is expected to be handled with the more
common Pod Disruption Budgets. A workaround is for the
cluster admin to set up their machine sets so they
match the zone topology. See the original design
doc from the feature here:
https://github.com/rook/rook/blob/master/design/ceph/ceph-openshift-fencing-mitigation.md

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-12-16 11:15:12 -07:00
Satoru Takeuchi 3a525f772e Merge pull request #11448 from subhamkrai/fix-log
operator: adding logs for debugging
2022-12-16 14:19:15 +09:00
subhamkrai de604d3689 operator: adding logs for debugging
Signed-off-by: subhamkrai <srai@redhat.com>
2022-12-16 08:46:44 +05:30
Travis Nielsen 3a8c7d2422 Merge pull request #11434 from travisn/secret-as-file
core: Read mon secret from file instead of env var
2022-12-15 10:19:09 -07:00
Travis Nielsen 03bfd5e7cd Merge pull request #11301 from ausias-armesto/fix/11297-create-volumes-with-mapper-alias
OSD prepare job cannot create vols with /dev/mapper alias on PVCs
2022-12-15 10:05:42 -07:00
Travis Nielsen fa35c069da Merge pull request #11432 from subhamkrai/disable-webhook-openshift
operator: disable webhook by default
2022-12-15 09:25:46 -07:00
Travis Nielsen 70591f43ab Merge pull request #11391 from parth-gr/ci-pod-retest
ci: watch for pods that restart unexpectedly
2022-12-15 08:46:09 -07:00
subhamkrai 159fe3ae6f operator: disable webhook by default
disable webhook in downstream cluster.

Signed-off-by: subhamkrai <srai@redhat.com>
2022-12-15 21:08:42 +05:30
Travis Nielsen 7c57a3ba81 Merge pull request #11405 from parth-gr/external-k8s-cluster
docs: import external K8s cluster on existing cluster
2022-12-15 08:10:24 -07:00
ausias-armesto f55c4573cf osd: cannot create volumes on pvc based osd with alias dev mapper
It removes the condition that select the devices name prefixed with /dev/mapper as it is causing the ceph-volume command to fail.

Closes: #11301
Signed-off-by: ausias-armesto <ausiasarmesto@gmail.com>
2022-12-15 16:04:29 +01:00
parth-gr 8d6be0bcf3 docs: import external K8s cluster on existing cluster
If there is a external k8s cluster which need to use rook-ceph as
a storageclass backend then user can do the following steps import
it to the running rook-ceph cluster

Closes:https://github.com/rook/rook/issues/11404
Signed-off-by: parth-gr <paarora@redhat.com>
2022-12-15 20:11:18 +05:30
Travis Nielsen 4f77664862 manifest: toolbox and jobs mount secret volume
The toolbox, toolbox job, and osd prepare jobs need to mount the
ceph admin keyring as a file instead of using an env var.
The toolbox script will still allow setting of the env var
for backward compatibility, though all the examples are now
updated to use the keyring as a file.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-12-14 21:44:59 -07:00
Travis Nielsen 403335177a core: read mon secret from file instead of env var
Environment variables are not recommended for secrets in pods since
they can be easily leaked if the environemnt variables are logged.
By mounting the mon secret as a file, the mgr and osd prepare pods
can read the mon secret from a file for better security.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-12-14 16:24:44 -07:00
parth-gr 9319eaa86d ci: watch for pods that restart unexpectedly
will check if the podrestartcount is greater than 1,
If it is we will alert it and fail the CI
It is important to understand intermittent failures
to avoid too many false positives

Closes: https://github.com/rook/rook/issues/11380
Signed-off-by: parth-gr <paarora@redhat.com>
2022-12-14 21:50:15 +05:30
Travis Nielsen d330c6bfd4 Merge pull request #11439 from subhamkrai/update-minikube-action
ci: upgrade minikube action to latest version
2022-12-14 08:53:34 -07:00
subhamkrai a877771748 ci: upgrade minikube action to latest version
upgrading minikube action to latest version which has
the fix of crictl, currently CI is failing due to this.

Signed-off-by: subhamkrai <srai@redhat.com>
2022-12-14 20:47:59 +05:30
Travis Nielsen e90f7ce022 Merge pull request #11414 from travisn/sanitize-deviceset-name
osd: Replace dot with dash in storageClassDeviceSet names since used as volume names
2022-12-12 09:57:14 -07:00
Travis Nielsen d532e27c6c Merge pull request #11399 from travisn/osd-purge-config
core: Allow ceph.conf to be updated if already exists
2022-12-12 07:53:22 -07:00
Travis Nielsen 1f472c7ea7 Merge pull request #11424 from rook/dependabot/go_modules/github.com/aws/aws-sdk-go-1.44.157
build(deps): bump github.com/aws/aws-sdk-go from 1.44.152 to 1.44.157
2022-12-12 07:26:59 -07:00
dependabot[bot] f210dd41ac build(deps): bump github.com/aws/aws-sdk-go from 1.44.152 to 1.44.157
Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go) from 1.44.152 to 1.44.157.
- [Release notes](https://github.com/aws/aws-sdk-go/releases)
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.44.152...v1.44.157)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-12-12 12:04:49 +00:00
Satoru Takeuchi 399b369c97 Merge pull request #11413 from travisn/mpath_filesystem
osd: Allow mpath_member filesystem for mpath disks
2022-12-12 18:13:22 +09:00
Travis Nielsen 0886eb6d78 Merge pull request #11400 from travisn/crash-collector-refactor
core: Refactor crash collector for more node daemons
2022-12-09 17:33:01 -07:00
Travis Nielsen b693a5cca5 core: refactor crash collector for more node daemons
The crash collector controller is designed for watching nodes where
ceph daemons are running, and ensuring a special daemon is running
on that node to provide additional support for ceph on that node.
The crash collector is the first example of a daemon that should be
running on all the ceph daemon nodes. The next example of such a
node daemon will be the ceph exporter that will listen for the
ceph metrics as described in the design doc.
https://github.com/rook/rook/blob/master/design/ceph/ceph-exporter.md

Now the crash collector controller is renamed to the node daemon controller
so the ceph exporter daemon can also be managed by the same controller.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-12-09 16:57:05 -07:00
Travis Nielsen 4a70d3489d osd: replace dot with dash in pvc names
The volume names of a pod must follow the standard naming convention
which does not allow periods in the name. Since the device set name
is used as the pvc name and then the volume name to attach to the osd
prepare job, we must sanitize the name for the invalid character
and replace it.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-12-09 12:43:17 -07:00
Travis Nielsen 8a94bb20ae osd: allow mpath_member filesystem for mpath disks
Multipath devices may have an FSTYPE=mpath_member even though
a valid device for creating an OSD. The device will be allowed
in this case when creating the OSD on a PV since it is a device
specifically provisioned for the OSD.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-12-09 09:42:27 -07:00
Travis Nielsen fc5f9e583e Merge pull request #11403 from thenamehasbeentake/dev
docs: Fix notes in CephBucketTopic docs
2022-12-09 07:29:52 -07:00
xiaobaowen 8f23c1ba9e docs: fix notes in CephBucketTopic docs
Signed-off-by: xiaobaowen <xiaobaowen@deeproute.ai>
2022-12-09 10:41:14 +08:00
Travis Nielsen edfccf34df Merge pull request #11387 from Rakshith-R/enc-osd-prepare/handle-stale-dm-dev
osd: remove stale dm device during osd-prepare-job
2022-12-08 11:26:09 -07:00
Rakshith R 24fa9ed935 osd: remove stale dm device during osd-prepare-job
During osd-prepare-job,

The encrypted device is found to be closed in some cases when
the OSD deployment has been removed manually accompanied
by any of following cases:
- node reboot
- csi managed PVC being unmounted etc

while re-opening the block to re-hydrate the OSDInfo,
the dm device `<pvc-name>-block-dmcrypt` clashes with
the one used by OSD pod which is stale by now.
This commit adds cmd to remove this stale dm device.
Error with output "No such device" is ignored.

Signed-off-by: Rakshith R <rar@redhat.com>
2022-12-08 15:57:56 +05:30
Travis Nielsen 4208587b24 Merge pull request #11395 from rook/dependabot/go_modules/github.com/IBM/keyprotect-go-client-0.9.1
build(deps): bump github.com/IBM/keyprotect-go-client from 0.9.0 to 0.9.1
2022-12-07 16:27:16 -07:00
Travis Nielsen 2a16cd857c osd: improve error message for osd purge
The OSD purge was printing an incorrect sentence, so this now
fixes the grammar.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-12-07 14:34:01 -07:00
Travis Nielsen 9975e09406 core: allow ceph.conf to be updated if already exist
The ceph.conf was being written with 0x444 permissions, which means
the file could not be updated if it already exists. Specifically, when
an osd is purged, if the operation is retried multiple times, only
the first operation was succeeding. The subsequent requests to purge
an osd were failing due to the config already existing. If we make
the config writeable with 0x644 then the operator can always write the file.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-12-07 14:33:36 -07:00
dependabot[bot] 1ae785fb69 build(deps): bump github.com/IBM/keyprotect-go-client
Bumps [github.com/IBM/keyprotect-go-client](https://github.com/IBM/keyprotect-go-client) from 0.9.0 to 0.9.1.
- [Release notes](https://github.com/IBM/keyprotect-go-client/releases)
- [Changelog](https://github.com/IBM/keyprotect-go-client/blob/master/CHANGELOG.md)
- [Commits](https://github.com/IBM/keyprotect-go-client/compare/v0.9.0...v0.9.1)

---
updated-dependencies:
- dependency-name: github.com/IBM/keyprotect-go-client
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-12-06 20:09:11 +00:00
Travis Nielsen 74df713bfb Merge pull request #11383 from rook/dependabot/go_modules/github.com/hashicorp/vault-1.12.2
build(deps): bump github.com/hashicorp/vault from 1.12.1 to 1.12.2
2022-12-06 13:06:34 -07:00
Travis Nielsen bcd46dd21a Merge pull request #11384 from rook/dependabot/go_modules/github.com/aws/aws-sdk-go-1.44.152
build(deps): bump github.com/aws/aws-sdk-go from 1.44.146 to 1.44.152
2022-12-06 13:06:11 -07:00
Travis Nielsen ca7b148ccc Merge pull request #11024 from thotz/remove-rgw_rados_pool_pg_num_min-quincy
rgw: remove rgw_rados_pool_pg_num_min for metadata pool creation
2022-12-06 07:37:13 -07:00
Jiffin Tony Thottan 5f1b443662 rgw: remove rgw_rados_pool_pg_num_min for metadata pool creation
rgw_rados_pool_pg_num_min is deprecated and no longer valid in qunicy
with https://github.com/ceph/ceph/pull/46234, remove that option from
cephobject-controller as well

Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2022-12-06 15:35:24 +05:30