Commit Graph
13292 Commits
Author SHA1 Message Date
Travis Nielsen a6ab608361 bot: keep reliability issues open
The bot should not close issues that are related to reliability.
Rook's reliability is too critical to allow the bot to close
these issues.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-03-02 11:46:54 -07:00
Sébastien Han f423b48e04 Merge pull request #4915 from leseb/block-pool-crd-controller-runtime
ceph: separate controller for CephBlockPool CRD
2020-03-02 18:12:33 +01:00
Sébastien Han a3068dee0b ceph: separate controller for CephBlockPool CRD
Now, the CephBlockPool CRD is managed with the controller-runtime.
So the watcher is outside of the main controller reconciliation loop of
CephCluster which brings numerous benefit such as:

* having its own reconciliation loop
* won't block anything from the main CephCluster controller loop
* fast than waiting for CephCluster loop to completion

Partially close: https://github.com/rook/rook/issues/1981
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-03-02 17:31:03 +01:00
Stefan Haas 84cac45d2c Ceph: Ceph CSI fails to start. #4934
Signed-off-by: Stefan Haas <shaas@suse.com>
2020-03-02 16:27:59 +01:00
Sébastien Han 96daf44873 Merge pull request #4927 from cybozu-go/tests-simplify-function-names
ceph: simplify verbose function names and a wrong var name
2020-03-02 10:42:35 +01:00
Sébastien Han acab9b0ead ceph: enable command debug when DEBUG
Only print command debugs if the operator log level is DEBUG.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-03-02 09:29:48 +01:00
Sébastien Han 9f13cba8be ceph: print command output
Print the output so that we can parse it and silence it if we want.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-03-02 09:29:48 +01:00
Sébastien Han 65e1c054a3 ceph: only print command when running debug mode
We don't need commands e run under the hood. Enable debug logs to see
that.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-03-02 09:29:48 +01:00
Satoru Takeuchi b1dd05a59a ceph: simplify verbose function names and a wrong var name
Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-02-29 06:35:01 +09:00
Sébastien Han b12cd3e2a8 Merge pull request #4256 from shaas/master
ceph: ceph-csi version detection
2020-02-28 15:25:01 +01:00
Stefan Haas b3cc4aeb44 ceph: ceph-csi version detection #3824
Checks the version of the configured ceph-csi image while starting the operator. The operator will fail if the image is not supported.
Added an additional parameter to operator to disable the check e.g. to test not yet supported csi images.

Signed-off-by: Stefan Haas <shaas@suse.com>
2020-02-28 14:14:40 +01:00
Sébastien Han ca21442c20 Merge pull request #4903 from egafford/delete-csi-drivers
ceph: delete CSI drivers with deletion of last cluster
2020-02-28 10:46:34 +01:00
Elise Gafford de2c409d79 ceph: delete CSI drivers with deletion of last cluster
Prior attempts to delete CSI drivers using owner references to the
Ceph ConfigMap resulted in garbage collection of the driver
resources as described in rook#4590. This patch manually deletes these
resources by name as a stopgap to provide an appropriate user
experience while the team investigates this issue further.

Resolves: rook#4824
Signed-off-by: Elise Gafford <egafford@redhat.com>
2020-02-27 19:06:23 -05:00
Sébastien Han e2e80beaf2 Merge pull request #4922 from travisn/toolbox-mons
Allow mons from external cluster in toolbox config
2020-02-27 22:37:36 +01:00
Travis Nielsen d754520e1c ceph: allow mons from external cluster in toolbox
The toolbox generates a ceph.conf and extracts the names of the mons
based on the assumption that they all had the prefix rook-ceph.
This is no longer true for external clusters. The external clusters
may have mons with any variety of names.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-02-27 12:52:17 -07:00
Travis Nielsen 1b8e3da344 Merge pull request #4921 from nizamial09/extcluster_fail
ceph: Failed Condition to the external rook-ceph cluster
2020-02-27 09:02:51 -07:00
Nizamudeen 0382cc3c60 ceph: Failed Condition to the external rook-ceph cluster
This commit will add a phase and also a condition to display a Failed status on the external rook-ceph cluster if its failed to establish a connection.

Signed-off-by: Nizamudeen <nia@redhat.com>
2020-02-27 11:34:08 +05:30
Travis Nielsen 6f3db3df71 Merge pull request #4918 from travisn/stable-types
Move types from rook.io/v1alpha2 to rook.io/v1
2020-02-26 12:41:58 -07:00
Travis Nielsen bcb99d86ce crds: pick up the rook types in the v1 package
The rook types used across the storage providers moved from the v1alpha2
package to the v1 package. This commit points the packages at their new
location. Implementation is expected to remain unchanged.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-02-26 11:18:17 -07:00
Travis Nielsen 6807a0566d crds: move supporting types from v1alpha2 to rook.io/v1
The types that are used in CRDs across the storage providers do not need
to be in the v1alpha2 package. These should be declared stable in the v1
package. The only types remaining in the v1alpha2 package are the flex
volume types, which will never graduate since their replacement is the
csi driver.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-02-26 11:18:17 -07:00
Jared Watts 330877cc8b Merge pull request #4920 from jbw976/adopters-update
Update ADOPTERS.md with public production adopters in preparation for CNCF graduation proposal
2020-02-25 22:38:10 -08:00
Jared Watts c2e50dc7f7 adopters: Update ADOPTERS.md with public production adopters
This update is in preparation for CNCF graduation proposal

Signed-off-by: Jared Watts <jbw976@gmail.com>
2020-02-25 22:34:37 -08:00
Travis Nielsen acad369b94 Merge pull request #4520 from alimaredia/wip-object-store-realm
object-store-realm: Initial design doc
2020-02-25 16:06:42 -07:00
Travis Nielsen 0439a6df52 Merge pull request #4719 from travisn/steering-committee
Governance updates including a steering committee
2020-02-25 15:31:20 -07:00
Ali Maredia 429a4c336e ceph: initial design documents for ceph multisite
The implementation of this initial design will
allow object-stores to sync data across Rook Ceph
Clusters via a Day 1 setup of Ceph RGW Multisite

This design splits the realm, zonegroup, and zone
objects of Ceph RGW Multisite into seperate
resources.

This commit also moves all ceph object designs
into the design/ceph/object dir.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2020-02-25 17:10:08 -05:00
Blaine Gardner 2ba59ffa20 Merge pull request #4758 from SUSE/osd-add-remove-implementation-plan
design: ceph orchestrator module add/remove OSDs
2020-02-25 15:59:37 -05:00
Sébastien Han 18671a0dce Merge pull request #4895 from leseb/pool-size-1
ceph: add CRD setting for pool size 1
2020-02-25 18:03:52 +01:00
Sébastien Han dab9233c8b ceph: add CRD setting for pool size 1
As of Octopus, Ceph will prevent you from creating a pool with a
replica size of 1. Allowing such pool could lead to data loss, so enable
the new option: requireSafeReplicaSize: false if you are **ABSOLUTELY**
certain that is what you want.

Closes: https://github.com/rook/rook/issues/4889
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-02-25 16:28:58 +01:00
Sébastien Han 5ca4880ed0 Merge pull request #4888 from leseb/pvc-hybrid-dev-class
ceph: set crush device class via annotations on PVC
2020-02-25 14:07:22 +01:00
Sébastien Han ccef1f5601 Merge pull request #4867 from nizamial09/error_handling
rook: Handling Unhandled errors
2020-02-25 09:27:58 +01:00
Blaine Gardner 178187d035 design: ceph orchestrator module add/remove OSDs
Add a design document to plan how Rook will allow Ceph's Rook
Orchestrator Mgr Module to add and remove OSDs to/from a Rook-Ceph
cluster including changes needed in both the Orchestrator Module and in
Rook.

Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2020-02-24 11:06:46 -07:00
Blaine Gardner a871010337 Merge pull request #4906 from SUSE/nfs-ganesha-no-rook-container
ceph: nfs do not use rook binary
2020-02-24 12:46:51 -05:00
Blaine Gardner 5d2199dc87 ceph: nfs do not use rook binary
Do not use the Rook binary to generate minimal config for Ceph's
NFS-Ganesha pods. Instead, `cat` the minimal file in an init container
using the Ceph container.

Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2020-02-24 08:24:25 -07:00
Sébastien Han 5b87772738 Merge pull request #4900 from travisn/cleanup-ceph-config
Remove obsolete operator settings from ceph.conf
2020-02-24 10:45:10 +01:00
Travis Nielsen 81ae4b66d3 governance: add a steering committee
Add a steering committee to the Rook governance to oversee
the project and provide direction. Maintainers will still have
push access to the project. The steering committee are the ones
with the votes for conflict resolution.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-02-21 16:01:38 -07:00
Jared Watts 3de5be0482 Merge pull request #4395 from jbw976/security-disclosure
security: disclosure policy and release process
2020-02-21 14:19:22 -08:00
Jared Watts e9c7d36613 security: disclosure policy and release process
Signed-off-by: Jared Watts <jbw976@gmail.com>
2020-02-21 14:17:48 -08:00
Nizamudeen 53883f68cf ceph: Handling Unhandled errors
This commit is to handle all those unhandled errors which raises the gosec warning.

Fixed G104: Unhandled Errors are handled now

Signed-off-by: Nizamudeen <nia@redhat.com>
2020-02-21 22:48:24 +05:30
Travis Nielsen d81d2ff61d ceph: remove obsolete ceph.conf settings
The Ceph daemons no longer use the ceph.conf for settings generated
by the operator. The operator only generates the ceph.conf in order
to connect to the mons and configure the cluster. Now we reduce
to the minimal required settings.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-02-20 16:30:35 -07:00
Travis Nielsen 9e85fa6cd7 Merge pull request #4898 from travisn/ceph-14.2.7
Bump ceph version to v14.2.7
2020-02-20 14:19:49 -07:00
Travis Nielsen e35939b26c ceph: bump ceph version to v14.2.7
The ceph/ceph:v14.2.7 image is released so we can pick these fixes
up as the recommended version of ceph.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-02-20 11:06:40 -07:00
Sébastien Han a702f463cc ceph: set crush device class via annotations on PVC
When the OSD on PVC is backed by a metadata block PVC, the Ceph CRUSH
device class should be set to something else rather than the rotational
property of the drive.

Closes: https://github.com/rook/rook/issues/4881
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-02-20 18:53:31 +01:00
Travis Nielsen 2208b69c4f Merge pull request #4891 from travisn/increase-test-timeout
Increase timeout for file test pod start
2020-02-19 14:38:21 -07:00
Travis Nielsen 607e900f2c ceph: increase timeout for file test pod start
The integration tests have failed intermittently due to needing just
a little longer to start the file test pod. This increases the
wait timeout.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-02-19 13:34:09 -07:00
Sébastien Han 0cb6590087 Merge pull request #4885 from travisn/ec-pool-status
EC pool creation should have successful status
2020-02-19 11:45:45 +01:00
Travis Nielsen a9903ed8d7 ceph: fix status for EC pool creation
Creating an EC pool was succeeding, but then the update to the
status was failing because of an incorrect check for changing EC
parameters. Now we correctly check if EC parameters are changing
unexpectedly.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-02-18 15:34:01 -07:00
Sébastien Han 220ffbc07c Merge pull request #4853 from travisn/test-focus-csi
Focus integration tests on the CSI driver and less on Flex
2020-02-18 14:34:46 +01:00
Sébastien Han ca0ec376cb Merge pull request #4880 from cybozu-go/tests-enhance-readme
tests: enhance README.md
2020-02-18 09:48:48 +01:00
Satoru Takeuchi a0c21b237e tests: enhance README.md
- setting config path is necessary between kubeadm.sh and helm.sh
- fix the path of integration test binary

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-02-18 16:31:18 +09:00
Travis Nielsen 10ddf4b0df tests: retry wiping devices if failed
The job to wipe devices fails the integration tests periodically.
Now the job will be retried once if it fails to retry wiping the
disks.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-02-17 22:27:13 -07:00