Commit Graph
9392 Commits
Author SHA1 Message Date
Travis Nielsen 03bfd5e7cd Merge pull request #11301 from ausias-armesto/fix/11297-create-volumes-with-mapper-alias
OSD prepare job cannot create vols with /dev/mapper alias on PVCs
2022-12-15 10:05:42 -07:00
Travis Nielsen fa35c069da Merge pull request #11432 from subhamkrai/disable-webhook-openshift
operator: disable webhook by default
2022-12-15 09:25:46 -07:00
Travis Nielsen 70591f43ab Merge pull request #11391 from parth-gr/ci-pod-retest
ci: watch for pods that restart unexpectedly
2022-12-15 08:46:09 -07:00
subhamkrai 159fe3ae6f operator: disable webhook by default
disable webhook in downstream cluster.

Signed-off-by: subhamkrai <srai@redhat.com>
2022-12-15 21:08:42 +05:30
Travis Nielsen 7c57a3ba81 Merge pull request #11405 from parth-gr/external-k8s-cluster
docs: import external K8s cluster on existing cluster
2022-12-15 08:10:24 -07:00
ausias-armesto f55c4573cf osd: cannot create volumes on pvc based osd with alias dev mapper
It removes the condition that select the devices name prefixed with /dev/mapper as it is causing the ceph-volume command to fail.

Closes: #11301
Signed-off-by: ausias-armesto <ausiasarmesto@gmail.com>
2022-12-15 16:04:29 +01:00
parth-gr 8d6be0bcf3 docs: import external K8s cluster on existing cluster
If there is a external k8s cluster which need to use rook-ceph as
a storageclass backend then user can do the following steps import
it to the running rook-ceph cluster

Closes:https://github.com/rook/rook/issues/11404
Signed-off-by: parth-gr <paarora@redhat.com>
2022-12-15 20:11:18 +05:30
parth-gr 9319eaa86d ci: watch for pods that restart unexpectedly
will check if the podrestartcount is greater than 1,
If it is we will alert it and fail the CI
It is important to understand intermittent failures
to avoid too many false positives

Closes: https://github.com/rook/rook/issues/11380
Signed-off-by: parth-gr <paarora@redhat.com>
2022-12-14 21:50:15 +05:30
Travis Nielsen d330c6bfd4 Merge pull request #11439 from subhamkrai/update-minikube-action
ci: upgrade minikube action to latest version
2022-12-14 08:53:34 -07:00
subhamkrai a877771748 ci: upgrade minikube action to latest version
upgrading minikube action to latest version which has
the fix of crictl, currently CI is failing due to this.

Signed-off-by: subhamkrai <srai@redhat.com>
2022-12-14 20:47:59 +05:30
Travis Nielsen e90f7ce022 Merge pull request #11414 from travisn/sanitize-deviceset-name
osd: Replace dot with dash in storageClassDeviceSet names since used as volume names
2022-12-12 09:57:14 -07:00
Travis Nielsen d532e27c6c Merge pull request #11399 from travisn/osd-purge-config
core: Allow ceph.conf to be updated if already exists
2022-12-12 07:53:22 -07:00
Travis Nielsen 1f472c7ea7 Merge pull request #11424 from rook/dependabot/go_modules/github.com/aws/aws-sdk-go-1.44.157
build(deps): bump github.com/aws/aws-sdk-go from 1.44.152 to 1.44.157
2022-12-12 07:26:59 -07:00
dependabot[bot] f210dd41ac build(deps): bump github.com/aws/aws-sdk-go from 1.44.152 to 1.44.157
Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go) from 1.44.152 to 1.44.157.
- [Release notes](https://github.com/aws/aws-sdk-go/releases)
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.44.152...v1.44.157)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-12-12 12:04:49 +00:00
Satoru Takeuchi 399b369c97 Merge pull request #11413 from travisn/mpath_filesystem
osd: Allow mpath_member filesystem for mpath disks
2022-12-12 18:13:22 +09:00
Travis Nielsen 0886eb6d78 Merge pull request #11400 from travisn/crash-collector-refactor
core: Refactor crash collector for more node daemons
2022-12-09 17:33:01 -07:00
Travis Nielsen b693a5cca5 core: refactor crash collector for more node daemons
The crash collector controller is designed for watching nodes where
ceph daemons are running, and ensuring a special daemon is running
on that node to provide additional support for ceph on that node.
The crash collector is the first example of a daemon that should be
running on all the ceph daemon nodes. The next example of such a
node daemon will be the ceph exporter that will listen for the
ceph metrics as described in the design doc.
https://github.com/rook/rook/blob/master/design/ceph/ceph-exporter.md

Now the crash collector controller is renamed to the node daemon controller
so the ceph exporter daemon can also be managed by the same controller.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-12-09 16:57:05 -07:00
Travis Nielsen 4a70d3489d osd: replace dot with dash in pvc names
The volume names of a pod must follow the standard naming convention
which does not allow periods in the name. Since the device set name
is used as the pvc name and then the volume name to attach to the osd
prepare job, we must sanitize the name for the invalid character
and replace it.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-12-09 12:43:17 -07:00
Travis Nielsen 8a94bb20ae osd: allow mpath_member filesystem for mpath disks
Multipath devices may have an FSTYPE=mpath_member even though
a valid device for creating an OSD. The device will be allowed
in this case when creating the OSD on a PV since it is a device
specifically provisioned for the OSD.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-12-09 09:42:27 -07:00
Travis Nielsen fc5f9e583e Merge pull request #11403 from thenamehasbeentake/dev
docs: Fix notes in CephBucketTopic docs
2022-12-09 07:29:52 -07:00
xiaobaowen 8f23c1ba9e docs: fix notes in CephBucketTopic docs
Signed-off-by: xiaobaowen <xiaobaowen@deeproute.ai>
2022-12-09 10:41:14 +08:00
Travis Nielsen edfccf34df Merge pull request #11387 from Rakshith-R/enc-osd-prepare/handle-stale-dm-dev
osd: remove stale dm device during osd-prepare-job
2022-12-08 11:26:09 -07:00
Rakshith R 24fa9ed935 osd: remove stale dm device during osd-prepare-job
During osd-prepare-job,

The encrypted device is found to be closed in some cases when
the OSD deployment has been removed manually accompanied
by any of following cases:
- node reboot
- csi managed PVC being unmounted etc

while re-opening the block to re-hydrate the OSDInfo,
the dm device `<pvc-name>-block-dmcrypt` clashes with
the one used by OSD pod which is stale by now.
This commit adds cmd to remove this stale dm device.
Error with output "No such device" is ignored.

Signed-off-by: Rakshith R <rar@redhat.com>
2022-12-08 15:57:56 +05:30
Travis Nielsen 4208587b24 Merge pull request #11395 from rook/dependabot/go_modules/github.com/IBM/keyprotect-go-client-0.9.1
build(deps): bump github.com/IBM/keyprotect-go-client from 0.9.0 to 0.9.1
2022-12-07 16:27:16 -07:00
Travis Nielsen 2a16cd857c osd: improve error message for osd purge
The OSD purge was printing an incorrect sentence, so this now
fixes the grammar.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-12-07 14:34:01 -07:00
Travis Nielsen 9975e09406 core: allow ceph.conf to be updated if already exist
The ceph.conf was being written with 0x444 permissions, which means
the file could not be updated if it already exists. Specifically, when
an osd is purged, if the operation is retried multiple times, only
the first operation was succeeding. The subsequent requests to purge
an osd were failing due to the config already existing. If we make
the config writeable with 0x644 then the operator can always write the file.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-12-07 14:33:36 -07:00
dependabot[bot] 1ae785fb69 build(deps): bump github.com/IBM/keyprotect-go-client
Bumps [github.com/IBM/keyprotect-go-client](https://github.com/IBM/keyprotect-go-client) from 0.9.0 to 0.9.1.
- [Release notes](https://github.com/IBM/keyprotect-go-client/releases)
- [Changelog](https://github.com/IBM/keyprotect-go-client/blob/master/CHANGELOG.md)
- [Commits](https://github.com/IBM/keyprotect-go-client/compare/v0.9.0...v0.9.1)

---
updated-dependencies:
- dependency-name: github.com/IBM/keyprotect-go-client
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-12-06 20:09:11 +00:00
Travis Nielsen 74df713bfb Merge pull request #11383 from rook/dependabot/go_modules/github.com/hashicorp/vault-1.12.2
build(deps): bump github.com/hashicorp/vault from 1.12.1 to 1.12.2
2022-12-06 13:06:34 -07:00
Travis Nielsen bcd46dd21a Merge pull request #11384 from rook/dependabot/go_modules/github.com/aws/aws-sdk-go-1.44.152
build(deps): bump github.com/aws/aws-sdk-go from 1.44.146 to 1.44.152
2022-12-06 13:06:11 -07:00
Travis Nielsen ca7b148ccc Merge pull request #11024 from thotz/remove-rgw_rados_pool_pg_num_min-quincy
rgw: remove rgw_rados_pool_pg_num_min for metadata pool creation
2022-12-06 07:37:13 -07:00
Jiffin Tony Thottan 5f1b443662 rgw: remove rgw_rados_pool_pg_num_min for metadata pool creation
rgw_rados_pool_pg_num_min is deprecated and no longer valid in qunicy
with https://github.com/ceph/ceph/pull/46234, remove that option from
cephobject-controller as well

Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2022-12-06 15:35:24 +05:30
Satoru Takeuchi 0e10d97431 Merge pull request #11331 from travisn/remove-env-vars
core: Remove unnecessary env vars from pod specs
2022-12-06 08:28:06 +09:00
Travis Nielsen 5065526ed7 Merge pull request #11360 from avanthakkar/design-doc-ceph-exporter
docs: add ceph-exporter design doc
2022-12-05 11:06:21 -07:00
Travis Nielsen 43b4da23bb Merge pull request #11346 from zalsader/add-helm-docs
docs: auto generate helm docs
2022-12-05 10:50:21 -07:00
dependabot[bot] b037fd43f6 build(deps): bump github.com/aws/aws-sdk-go from 1.44.146 to 1.44.152
Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go) from 1.44.146 to 1.44.152.
- [Release notes](https://github.com/aws/aws-sdk-go/releases)
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.44.146...v1.44.152)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-12-05 12:05:14 +00:00
dependabot[bot] a060efcd61 build(deps): bump github.com/hashicorp/vault from 1.12.1 to 1.12.2
Bumps [github.com/hashicorp/vault](https://github.com/hashicorp/vault) from 1.12.1 to 1.12.2.
- [Release notes](https://github.com/hashicorp/vault/releases)
- [Changelog](https://github.com/hashicorp/vault/blob/main/CHANGELOG.md)
- [Commits](https://github.com/hashicorp/vault/compare/v1.12.1...v1.12.2)

---
updated-dependencies:
- dependency-name: github.com/hashicorp/vault
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-12-05 12:04:43 +00:00
Avan Thakkar fbee491fe1 docs: add ceph-exporter design doc
Add a design doc for introducing ceph-exporter daemon in Rook.

Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2022-12-05 12:50:04 +05:30
Zuhair 792a261ca9 docs: auto generate helm chart docs using helm-docs
Signed-off-by: Zuhair AlSader <zuhair@koor.tech>
2022-12-02 17:08:50 -05:00
Satoru Takeuchi fe1ef6c222 Merge pull request #11373 from travisn/msgr-nonce
core: Set env var for ceph msgr to always use random nonce
2022-12-02 13:10:39 +09:00
Travis Nielsen 31a8fb1e6a core: set env var for ceph msgr to use random nonce
Ceph will use a random nonce for the msgr daemons as long as
they are running as PID 1 or have the environment variable
CEPH_USE_RANDOM_NONCE set to indicate running in a containerized
environment. While the Ceph daemons in Rook are expected to
run in PID 1, there are some environments where the container
runtime may choose to run something else such as
/usr/bin/pod as PID 1. The side effect then is that ceph uses
the pid as the nonce and causes problems when the daemons
restart with the same PID.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2022-12-01 16:49:32 -07:00
Blaine Gardner 4883a6e29e Merge pull request #11338 from Rakshith-R/fix-enc-osd-prepare-job
osd: re-open encrypted disk during osd-prepare-job if closed
2022-12-01 09:07:51 -07:00
Rakshith R bde286ef49 osd: re-open encrypted disk during osd-prepare-job if closed
This commit implements this corner case during osd-prepare job.
```
The encrypted block is not opened, this is an extreme corner case
The OSD deployment has been removed manually AND the node rebooted
So we need to re-open the block to re-hydrate the OSDInfo.

Handling this case would mean, writing the encryption key on a
temporary file, then call luksOpen to open the encrypted block and
then call ceph-volume to list against the opened encrypted block.
We don't implement this, yet and return an error.
```
When underlying PVC for osd are CSI provisioned, the encrypted device
is closed when PVC is unmounted due to osd pod being deleted.
Therefore, this may occur more frequently and needs to be handled.
This commit implements the fix for the same.

Signed-off-by: Rakshith R <rar@redhat.com>
2022-11-30 18:54:23 +05:30
Satoru Takeuchi 7278fb9e56 Merge pull request #11361 from cybozu-go/improve-log-on-specifying-filter-for-lv-loop
osd: improve log on specifying lv and loop device as osd
2022-11-29 11:18:58 +09:00
Satoru Takeuchi 36f8074938 osd: improve log on specifying lv and loop device as osd
We can use LVM logical volumes and loop devices as OSD iff we specify
them in the `devices` field. If we use filters like `deviceFilter`,
these devices are not picked with a log message which let users
to specify the exact device name. It's better to mention which field
users should use in this case.

Closes: https://github.com/rook/rook/issues/11353

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2022-11-28 23:18:54 +00:00
Travis Nielsen 32436af133 Merge pull request #11356 from rook/dependabot/go_modules/github.com/aws/aws-sdk-go-1.44.146
build(deps): bump github.com/aws/aws-sdk-go from 1.44.136 to 1.44.146
2022-11-28 12:24:30 -07:00
Travis Nielsen 2742f74eaf Merge pull request #11357 from rook/dependabot/go_modules/github.com/prometheus-operator/prometheus-operator/pkg/client-0.61.1
build(deps): bump github.com/prometheus-operator/prometheus-operator/pkg/client from 0.60.1 to 0.61.1
2022-11-28 12:24:06 -07:00
Travis Nielsen bbb4658b54 Merge pull request #11358 from rook/dependabot/github_actions/wagoid/commitlint-github-action-5.3.0
build(deps): bump wagoid/commitlint-github-action from 5.2.2 to 5.3.0
2022-11-28 12:23:12 -07:00
Blaine Gardner b5aa9a76b2 Merge pull request #11337 from sp98/parse-debug-logs
core: parse peer pool output with --out-file flag
2022-11-28 09:01:04 -07:00
dependabot[bot] cf5b783ce4 build(deps): bump wagoid/commitlint-github-action from 5.2.2 to 5.3.0
Bumps [wagoid/commitlint-github-action](https://github.com/wagoid/commitlint-github-action) from 5.2.2 to 5.3.0.
- [Release notes](https://github.com/wagoid/commitlint-github-action/releases)
- [Changelog](https://github.com/wagoid/commitlint-github-action/blob/master/CHANGELOG.md)
- [Commits](https://github.com/wagoid/commitlint-github-action/compare/v5.2.2...v5.3.0)

---
updated-dependencies:
- dependency-name: wagoid/commitlint-github-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-11-28 12:11:28 +00:00
dependabot[bot] 38f1404ab6 build(deps): bump github.com/prometheus-operator/prometheus-operator/pkg/client
Bumps [github.com/prometheus-operator/prometheus-operator/pkg/client](https://github.com/prometheus-operator/prometheus-operator) from 0.60.1 to 0.61.1.
- [Release notes](https://github.com/prometheus-operator/prometheus-operator/releases)
- [Changelog](https://github.com/prometheus-operator/prometheus-operator/blob/main/CHANGELOG.md)
- [Commits](https://github.com/prometheus-operator/prometheus-operator/compare/v0.60.1...v0.61.1)

---
updated-dependencies:
- dependency-name: github.com/prometheus-operator/prometheus-operator/pkg/client
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-11-28 12:04:49 +00:00