Commit Graph
13292 Commits
Author SHA1 Message Date
Travis Nielsen 1d370b1314 ceph: during mon failover remove the backing pvc
If the mon is backed by a pvc, ensure the pvc is deleted when
the mon is failed over. The pvc is being left in a bound state
even though it will no longer be used in the cluster.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-06-24 15:37:42 -06:00
Travis Nielsen 0be6fdfa2d ceph: save mon config even if failed to remove dead mon
During mon failover if the mon fails to be removed, the new mon
config was not being saved. The mon removal anyway is not retried
if it fails, so it should make a best effort to remove all the
resources related to the mon, and then always update the mon
config after the failover.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-06-24 15:37:42 -06:00
Judson f89ecb6156 ceph: helm chart fix for rook-ceph
Go's template language doesn't treat infix `and` as a short-circuit,
which led to fatal errors after an update in Go 1.14 surfaced that as
a fatal error.  This commit removes the infix `and` and replaces it with
a default dict to handle the case of a missing Heml value.

Closes: https://github.com/rook/rook/issues/5378
Signed-off-by: Judson <nyarly@gmail.com>
2020-06-24 10:30:26 -07:00
Vineet Badrinath ce1003aef8 ceph: adds scripts and components to support admission controllers
adds deploy.sh script to deploy validatingwebhookconfiguration and create secrets.
adds new command ceph admission-controller to start webhook servers.
adds validation for various rook custom resources

Signed-off-by: Vineet Badrinath <vbadrina@redhat.com>
2020-06-24 14:59:00 +05:30
Sébastien Han 41dff79513 Merge pull request #5691 from cybozu-go/ceph-fix-the-wrong-document-of-tuneDeviceClass
ceph: fix the wrong document of tuneDeviceClass
2020-06-24 10:23:27 +02:00
Sébastien Han 3fcb04fe8b Merge pull request #5690 from cybozu-go/ceph-fix-a-wrong-link
ceph: fix a wrong link
2020-06-24 09:59:51 +02:00
Satoru Takeuchi c8c05ed7b9 ceph: fix the wrong document of tuneDeviceClass
The tuning parameter of slow device is defined as "tuneDeviceClass".
However, it's written in the document as "tuneSlowDeviceClass".

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-06-24 00:31:14 +00:00
Satoru Takeuchi 8ffe096616 ceph: fix a wrong link
There is a wrong link to the monitoring document.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-06-23 22:31:35 +00:00
Travis Nielsen 675c9673ca Merge pull request #5628 from cybozu-go/wip-fix-5504
ceph: fix ignoring device specification with non-kname
2020-06-23 12:21:31 -06:00
Anmol Sachan 624ca40817 ceph: added PVC utilization alerts
Added warning and critical alerts for all the PVC's created by rook-ceph provisioners. This is required to notify a admin timely to check on PVC utilization and take a required action to prevent workloads from failing.

Closes: BZ1849723
Signed-off-by: Anmol Sachan <anmol13694@gmail.com>
2020-06-23 21:06:59 +05:30
Sébastien Han 1bbbda194f Merge pull request #5673 from anmolsachan/utilization_alerts
ceph: Added CephClusterReadOnly alert and updated utilization alerts.
2020-06-22 15:30:47 +02:00
Satoru Takeuchi f65bb923ed ceph: fix ignoring device specification with non-kname
Partition's DevLinks are empty in osd-prepare-pod. So, the device
specification with non-kname, for example devicePathFilter, doesn't
work.

Closes: https://github.com/rook/rook/issues/5504

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-06-22 21:37:05 +09:00
Sébastien Han 27251023ab Merge pull request #5677 from binoue/fix-function-arg-name
ceph: fix an argument name
2020-06-22 13:28:10 +02:00
Satoru Takeuchi e2df534abe ceph: fix the test of OSD
Fix the following bugs.

- CephVersion is not back to Octopus
- `cephadm' here is called with three arguments,
  "info --query=property <devname>". We should use 'args[2]' instead.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-06-22 05:32:58 +09:00
binoue 57b944abfb ceph: fix an argument name
This commit fixes an argument of the CreateCrashCollectorSecret function as
it is expected to be the namespace of the cluster.

Signed-off-by: binoue <banji-inoue@cybozu.co.jp>
2020-06-21 20:27:34 +09:00
Anmol Sachan 7cebf15a7d ceph: added CephClusterReadOnly alert and updated utilization alerts
Added a new critical alert CephClusterReadOnly which notifies when the cluster becomes read-only
Updated the warning and critical alert to accomodate the new alert

Closes: BZ1809248
Signed-off-by: Anmol Sachan <anmol13694@gmail.com>
2020-06-19 14:07:51 +05:30
Sébastien Han aca541803b Merge pull request #5664 from leseb/ceph-object-user-external
ceph: add external support for object store user
2020-06-18 20:10:05 +02:00
Sébastien Han 5f74e493ef ceph: small user delete refactor
Do not return error code, interpret it directly, put the error as part
of the output on failures.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-18 18:49:03 +02:00
Sébastien Han 6eae9b0c5f Merge pull request #5668 from travisn/max-mon-id
ceph: Update maxMonId if incorrect
2020-06-18 17:22:07 +02:00
Sébastien Han 84d1e28c99 ceph: add external support for objectstoreuser
Now, the object store user is capable of creating s3 users on an
external Ceph cluster.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-18 16:34:01 +02:00
Sébastien Han 1e4a4b477a Merge pull request #5111 from leseb/lang-neutral-ceph
ceph: use octopus base image
2020-06-18 10:46:54 +02:00
Travis Nielsen 0e4c5e1d58 ceph: update maxMonId if incorrect
When the operator loads the mons and checks for a valid maxMonId
the check of the id against the currently running mons was outdated
from legacy mon ids. The check now has to parse the new id which is
just the letter instead of having a number from legacy mon ids.
Without this fix, the maxMonId would stay incorrect if it was somehow
corrupted.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-06-17 17:44:58 -06:00
Sébastien Han 68e62836c5 ceph: use newer octopus time format
radosgw-admin as of Octopus uses a different time format, it uses
"2006-01-02T15:04:05.999999999Z". It's close from RFC3339 but not quite
the same. This change is needed in order for the operator image (with a
Ceph Octopus based image) to perform radosgw-admin call correctly.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-17 23:00:17 +02:00
Sébastien Han 52242fb933 Merge pull request #5623 from leseb/fix-5608
ceph: add the ability to set any pool property
2020-06-17 18:19:09 +02:00
Sébastien Han 0a002dfae0 docs: fix wrong section
The multipath feature was in the wrong section (breaking changes).

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-17 10:08:03 +02:00
Sébastien Han c7f255a0e8 ceph: add the ability to set any pool property
We can now explicitly set any property on a given pool by using the new
Property field in the CephBlockPool Spec.

Also, this fixes the case where both `CephBlockPool` and `CephCluster`
are created at the same time. When Rook creates the pool, the cluster is
still being bootstrapped and the global option
`osd_pool_default_pg_autoscale_mode` has not bee set yet. So the pool
gets created but its `pg_autoscale_mode` property is set to `warn`
instead of `on`.

Closes: https://github.com/rook/rook/issues/5608V
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-17 10:08:00 +02:00
Sébastien Han c143bdb68d Merge pull request #5626 from cloudical-io/fix_5625
discover: fix info log for discovered devices
2020-06-16 16:11:44 +02:00
Sébastien Han 83acb5d91b Merge pull request #5657 from leseb/fix-ip-script
ceph: fix script IP parsing
2020-06-16 16:06:56 +02:00
Sébastien Han 82877f0c02 ceph: fix script IP parsing
The script wasn't allowing IPs like 192.168.0.2, 0 has part of the
subnet is valid.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-16 16:04:45 +02:00
Sébastien Han 4a8069321e Merge pull request #5618 from leseb/external-monitoring-design
docs: add external monitoring design
2020-06-16 15:51:03 +02:00
Sébastien Han c5095fa74a docs: add external monitoring design
Enhance the external cluster functionality by plugin monitoring.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-16 15:43:19 +02:00
Sébastien Han aa8bf4c763 ceph: expose operator ceph base image
We now have a new env variable ROOK_CEPH_BASE_IMAGE_VERSION which
contains the ceph version on the operator image.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-16 15:13:40 +02:00
Sébastien Han d950f4f823 ci: add more debug
If we cannot get the bucket we need more debug information.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-16 10:19:01 +02:00
Sébastien Han 6c5c726d14 ceph: use octopus base image
Since 1.3 will support both Nautilus and Octopus, let's use Octopus for
the base image. Newer images have retro-compatibility with older Ceph
versions.

Closes: https://github.com/rook/rook/issues/1765
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-16 10:19:01 +02:00
Sébastien Han ad0da4cf76 Merge pull request #5655 from thotz/cleanupolm
build: add a seperate make command for cleaning olm files
2020-06-16 10:13:59 +02:00
Alexander Trost 1a072be677 core: fix info log for discovered devices
Fix the info log statement to log the discovered devices as their string
representation instead of pointers.
This changes the info log to only be the device names and the debug log
to be the whole disk struct as well.

Resolves #5625

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2020-06-16 09:37:33 +02:00
Jared Watts c0ed19aa4b Merge pull request #5567 from prksu/design-nfs-controller-runtime
design: nfs operator using controller-runtime
2020-06-15 12:05:49 -07:00
Jiffin Tony Thottan 51c98bf3a4 build: add a seperate make command for cleaning olm files
Currently olm will be removed as part of clean command, but it cleans up
all the dependent modules as well
Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2020-06-15 17:07:08 +05:30
Sébastien Han 3d8fd2ca5a Merge pull request #5630 from cybozu-go/add-osdpodspec-schedulername
ceph: add schedulerName property to storageClassDeviceSet
2020-06-15 10:25:57 +02:00
Sébastien Han 126dc45dc7 Merge pull request #5647 from travisn/doc-ssd-cleanup
docs: clean ssds with blkdiscard
2020-06-15 10:17:18 +02:00
UMEZAWA Takeshi 6085ff3223 ceph: add schedulerName property to storageClassDeviceSet
Support schdulerName to use another scheduler for OSD pod placement.

Closes: https://github.com/rook/rook/issues/5536
Signed-off-by: UMEZAWA Takeshi <takeshi-umezawa@cybozu.co.jp>
Signed-off-by: Masayuki Ishii <masa213f@gmail.com>
2020-06-12 11:53:28 +09:00
Travis Nielsen 899e8e547e docs: clean ssds with blkdiscard
blkdiscard is the better tool for cleaning SSDs instead
of dd.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-06-11 15:45:10 -06:00
Jared Watts 00ca9beb78 Merge pull request #5637 from aberfeldy/aberfeldy/master
nfs: changing the loglevel into INFO
2020-06-11 09:57:08 -07:00
Travis Nielsen b28db31a01 Merge pull request #5639 from travisn/volume-source-map
ceph: metadata pvcs use a map instead of index
2020-06-11 10:33:32 -06:00
Travis Nielsen 5a02de5621 ceph: metadata pvcs use a map instead of slice index
The volume sources for an OSD on PVC were relying on the ordering
of the volume sources slice. While this was working, it was causing
headaches and potential future developer error when being
interpreted incorrectly. The addition of the wal pvc device
would make the issue even more pronounced. Now each PVC used
for the OSD will be identified in a map by name such as data
 and metadata.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-06-11 08:58:53 -06:00
Sébastien Han 70cd4e0e4d Merge pull request #5509 from thotz/deleteuserorbucket
ceph: obc clean up resources incase of failure
2020-06-11 11:52:10 +02:00
Travis Nielsen 609d43d050 Merge pull request #5640 from binoue/fix-error-message
ceph: fix error message
2020-06-10 17:24:26 -06:00
binoue b52b59669f ceph: fix error message
This commit fixes an error message

Signed-off-by: binoue <banji-inoue@cybozu.co.jp>
2020-06-11 07:10:29 +09:00
Travis Nielsen 955dcb930e Merge pull request #5377 from alimaredia/wip-object-store-multisite
Foundation for Object Store Multisite CRs
2020-06-10 16:07:53 -06:00
Travis Nielsen e0ab3b2bbb Merge pull request #5616 from leseb/design-guidelines
docs: add design doc template
2020-06-10 11:18:25 -06:00