Commit Graph
7961 Commits
Author SHA1 Message Date
Blaine Gardner 2f850b6ae6 Merge pull request #8613 from subhamkrai/remove-nautilus
ceph: remove ceph nautilus, ceph octopus to default
2021-10-25 09:09:18 -06:00
Yug Gupta 0f62a7c03d ceph: add volume replication cr yaml
Add a new yaml for creating volume replicationclass
and volume replication cr.

Signed-off-by: Yug Gupta <yuggupta27@gmail.com>
2021-10-25 19:37:08 +05:30
Yug Gupta 41ef8561d0 ceph: add mirrored pool yaml
Add a new yaml for creating pools that
have mirroring enabled.

Signed-off-by: Yug Gupta <yuggupta27@gmail.com>
2021-10-25 19:36:52 +05:30
Sébastien Han fc9c4b6fc9 Merge pull request #9010 from thotz/rgw-external-endpoint
ceph: update endpoint with IP for external RGW server
2021-10-25 15:49:08 +02:00
Sébastien Han cfe59ecc2a Merge pull request #8920 from subhamkrai/add-synk-licence
ci: add action for snyk as rook licence
2021-10-25 14:42:03 +02:00
Sébastien Han a0cef3bc0b Merge pull request #9023 from y1r/add-context-opscontroller
core: add context parameter to opcontroller
2021-10-25 14:17:13 +02:00
Yuichiro Ueno 3fd86f83ae core: add context parameter to opcontroller
This commit adds context parameter to utilities in opcontroller to
remove context.TODO use in opcontroller. By this, we can handle
cancellation of reconcilers in a fine-grained way.

Signed-off-by: Yuichiro Ueno <y1r.ueno@gmail.com>
2021-10-25 20:45:06 +09:00
subhamkrai faefd097b0 ci: add action for synk as rook licence
Adding github action for synk as licence for rook.
This will replace FOSSA licence in future.

Links to read about synk
1. https://snyk.io/
2. https://github.com/snyk/snyk

Signed-off-by: subhamkrai <srai@redhat.com>
2021-10-25 13:33:09 +05:30
subhamkrai 132c2607a3 core: update controller runtime to v0.10.2
Updating controller runtime to v0.10.2

Closes: https://github.com/rook/rook/issues/8648
Signed-off-by: subhamkrai <srai@redhat.com>
2021-10-25 12:19:15 +05:30
Jiffin Tony Thottan d4562f6b83 ceph: update endpoint with IP for external RGW server
For external RGW server use the IP mentioned in Gateway for admin Ops
operattions.

Fixes: #8916
Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2021-10-21 19:13:10 +05:30
Sébastien Han 18a4047679 osd: add support for k8s with vault kms
Rook cluster-wide encryption can now use the native Kubernetes
authentication to interact with vault KMS instead of using the token
method.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-10-21 13:59:28 +02:00
Sébastien Han 1a6827bea5 Merge pull request #9012 from leseb/mirror-secret-ownerref
ci: fix mirror scenario by removing ownerref
2021-10-21 13:58:54 +02:00
Sébastien Han 8d54fdc35f Merge pull request #8979 from aruniiird/add-CephMonQuorumLost-alert
ceph: adding CephMonQuorumLost critical alert
2021-10-21 12:20:45 +02:00
Sébastien Han 07f006ac43 ci: fix mirror scenario by removing ownerref
When we copy the peer token secret from a namespace to another we also
copy the ownerref, however the creation succeeds but the controller
removes the secret since the uid of the owner do not exist in that
namespace.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-10-21 12:11:10 +02:00
Arun Kumar Mohan 5c34393eca ceph: adding CephMonQuorumLost critical alert
Signed-off-by: Arun Kumar Mohan <amohan@redhat.com>
2021-10-21 12:01:17 +05:30
Yug Gupta c0b8f5a708 docs: add documents for failover and failback
add a document to track the steps for failover
and failback in case of Async DR; for Planned
Migration and Disaster Recovery use case.

Signed-off-by: Yug Gupta <yuggupta27@gmail.com>
2021-10-21 01:07:22 +05:30
Travis Nielsen 8715964fd5 docs: update release process for github actions
Jenkins has been decommissioned so the release instructions are
updated to work more clearly with the new processes around
the github actions.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-10-20 12:10:21 -06:00
Blaine Gardner 010addaf5d bot: add more commitlint tags, remove ceph
Remove the unspecific 'ceph' tag, and add a few other specific tags:
  block (for block storage that is not pool-specific)
  file (for file storage that is not mds-specific)
  monitoring (for prometheus, etc.)
  nfs (for CephNFS and nfs-ganesha)
  object (for object storage that is not rgw-specific)

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-10-20 10:44:09 -06:00
Blaine Gardner 063c714c97 Merge pull request #9007 from BlaineEXE/remove-dynamic-clientset
ceph: get rid of dynamic clientset
2021-10-20 09:40:28 -06:00
Travis Nielsen 9655e3a21e Merge pull request #8927 from synarete/aarch64-graviton
build: support build of rook on aarch64 (AWS/graviton)
2021-10-20 07:55:20 -06:00
Travis Nielsen 8f639c61de Merge pull request #8938 from subhamkrai/update-minikube
ci: update minikube and kubernetes version
2021-10-20 07:52:06 -06:00
Sébastien Han de0ba669fe Merge pull request #9009 from PixelJonas/patch-quotation-marks
ceph: use normal quotation marks for comment
2021-10-20 13:52:55 +02:00
subhamkrai 0150966024 ceph: remove ceph nautilus, ceph octopus to default
since rook 1.8, ceph nautilus no longer supported,
ceph octopus will be the minimum ceph version.

Closes: https://github.com/rook/rook/issues/7908
Signed-off-by: subhamkrai <srai@redhat.com>
2021-10-20 14:45:12 +05:30
subhamkrai 6be9071a22 ci: update minikube.sh script to use minikube command
using `docker-env` command to copy image giving error
`X Exiting due to ENV_DRIVER_CONFLICT: 'none' driver does not support 'minikube docker-env' command`
so, using `minikube image load <image>` commmand to copy
image.

Signed-off-by: subhamkrai <srai@redhat.com>
2021-10-20 14:26:50 +05:30
PixelJonas 8733bf6272 ceph: use normal quotation marks for comment
replaces all occurences of lduo/rduo quotation marks to make
sure that using the snippets in a k8s manifest will work

This fixes an issue with ArgoCD not being able
to apply `common.yaml` because of an encoding issue

Signed-off-by: PixelJonas <jonas@janz.digital>
2021-10-20 10:09:22 +02:00
Sébastien Han d7213c086b Merge pull request #9008 from subhamkrai/fix-ci
ci: clean validate_cluster.sh script
2021-10-20 09:55:44 +02:00
Sébastien Han c512e5f335 Merge pull request #9006 from BlaineEXE/osd-purge-in-cluster-namespace
docs: move purge osd to cluster namespace
2021-10-20 09:52:50 +02:00
subhamkrai e49cdf0a8d ci: clean validate_cluster.sh script
removing `trap display_status SIGINT ERR` command
from the file as `display_status` func has been removed.

Closes: https://github.com/rook/rook/issues/9004
Signed-off-by: subhamkrai <srai@redhat.com>
2021-10-20 10:43:50 +05:30
subhamkrai 6d0a06365f ci: update minikube and kubernetes version
Updating minikube version to `v1.23.2` and
k8s version to `v1.22.2`

Signed-off-by: subhamkrai <srai@redhat.com>
2021-10-20 10:04:31 +05:30
Yug Gupta e584efa966 docs: add a document to set-up rbd mirroring
The document tracks the steps which are required
to set-up rbd mirroring on clusters.

Signed-off-by: Yug Gupta <yuggupta27@gmail.com>
2021-10-20 09:11:33 +05:30
Blaine Gardner 01e2feaef5 ceph: get rid of dynamic clientset
Stop using the dynamic clientset in favor of the controller-runtime
clientset.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-10-19 17:05:38 -06:00
Blaine Gardner d43327de2a docs: move purge osd to cluster namespace
The rook-ceph-purge-osd job should be run for a particular CephCluster
and should therefore be namespaced to the cluster.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-10-19 13:23:42 -06:00
Travis Nielsen d01ea3a0b3 Merge pull request #8900 from BlaineEXE/create-library-chart
helm: create shared library chart
2021-10-19 11:22:23 -06:00
Sébastien Han 4bd179a973 Merge pull request #8767 from leseb/secret-cmd
osd: use rook binary to fetch key
2021-10-19 18:41:12 +02:00
Sébastien Han 4017f94464 osd: use rook binary to fetch key encryption key
When deploying a cluster-wde encrypted cluster we now use the rook
binary to execute some code to fetch the key encryption key.

Using cURL all the time to fetch the key has its limitations. The
incoming integration with Kubernetes Authentication through service
accounts is leading the usage of cURL to its end.
The logic is really complex and prone to errors. Re-implementing the
Go logic into Bash is not a viable option.

Also, using the lib in a binary allows us to keep a consistent behavior
throughout the life cycle of our code.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-10-19 17:29:25 +02:00
Blaine Gardner d9146f6f95 helm: create shared library chart
Create a Helm library chart to share content between the Operator Helm
chart (rook-ceph) and the CephCluster (etc.) Helm chart
(rook-ceph-cluster).

This will ensure that when resources related to the CephCluster change,
notably RBAC resources, they will change for both charts.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-10-18 12:33:47 -06:00
Blaine Gardner d2a03bb2b3 Merge pull request #8976 from BlaineEXE/try-fix-flaky-ci-osd-provision
test: get more partition info setting up ci disk
2021-10-18 12:33:24 -06:00
Blaine Gardner 65619c2677 test: get more partition info setting up ci disk
Add some commands to get more partition info when setting up the GH
action runner's disk for use in integration tests. This will both aid in
debugging and may "jog" the system such that it will no longer need to
reload the partition info when running the OSD prepare job.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-10-18 11:29:13 -06:00
Sébastien Han df2b6faa96 Merge pull request #8995 from leseb/no-error-merge
ceph: only merge stderr on error
2021-10-18 18:28:04 +02:00
Travis Nielsen 034018a8ae Merge pull request #8984 from travisn/support-arbiter-failover
ceph: Enable mon failover for the arbiter in stretch mode
2021-10-18 09:48:54 -06:00
Sébastien Han 0e41e36ade ceph: only merge stderr on error
Previously we were merging the stderr even if it was empty, leading to
unmarshall errors.
The error simulation was done here
https://play.golang.org/p/Sk2yw9GUWNu.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-10-18 17:18:57 +02:00
Travis Nielsen 12689bd119 ceph: enable mon failover for the arbiter in stretch mode
Prior to ceph v16.2.7 the failover of the arbiter mon was
not supported. Now the new tiebreaker mon can be set during
the failover event and provide more dynamic stability to
the mon quorum if another node is available in the arbiter
zone.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-10-18 08:58:25 -06:00
Sébastien Han ceae7604ac Merge pull request #8990 from Madhu-1/correct-cephfs
csi: fix comment for the provisioner and clusterID
2021-10-18 09:45:24 +02:00
Sébastien Han 748a98de89 Merge pull request #8988 from BlaineEXE/do-not-use-head
test: do not use head because of pipe errors
2021-10-18 09:30:58 +02:00
Madhu Rajanna 83cd8cb300 csi: fix comment for the provisioner and clusterID
fixed provisioner and clusterID comment to match
the correct namespace.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2021-10-18 10:39:13 +05:30
Blaine Gardner ba7745d4af test: do not use head because of pipe errors
The `head` command exits once it has output which can result in a
SIGPIPE error if the command piping its output to head hasn't yet
finished. Use `awk 'FNR <= 1'` instead, which waits on the input pipe to
close before it exits.

See here for more info:
https://unix.stackexchange.com/a/256047

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-10-15 10:14:41 -06:00
Sébastien Han b0c5f610c4 Merge pull request #8981 from leseb/fix-prepare-list
ci: fix prepare pod wrong selector
2021-10-15 17:58:19 +02:00
Sébastien Han efa60b44c8 ci: only validate osds for mirror test
The Filesystem is deployed later in the run so at this point we only
need to validate the OSDs are running. This was failing since we were
validating the cephfs pool which is not present yet.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-10-15 10:36:15 +02:00
Sébastien Han 73970a56c5 ci: fix prepare pod wrong selector
We missed the `app=` in the selector.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-10-15 10:36:15 +02:00
Sébastien Han ecd75a2a46 Merge pull request #8985 from aruniiird/fix-CephMgrIsAbsent-n-CephMgrIsMissingReplicas-queries
ceph: fixing the queries for alerts 'CephMgrIsAbsent' and 'CephMgrIsMissingReplicas'
2021-10-15 10:22:42 +02:00