Commit Graph
13292 Commits
Author SHA1 Message Date
Jiffin Tony Thottan e837082de7 docs: update obc documentation
Remove wrong information from OBC CRD example

Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2020-10-06 13:32:12 +05:30
Travis Nielsen 95358bc659 Merge pull request #6369 from raghavendra-talur/rtalur-master-fix-crash
ceph: prevent closing of channel more than once
2020-10-05 13:04:12 -06:00
Raghavendra TalurandTravis Nielsen 0c21abd535 ceph: prevent closing of channel more than once
Once we close the channel for the monitoring daemons, we update the
monitoring status so as to not call them again.

This is to prevent "close of closed channel" panic.

Co-authored-by: Travis Nielsen <tnielsen@redhat.com>
Signed-off-by: Nitin Goyal <nigoyal@redhat.com>
Signed-off-by: Raghavendra Talur <raghavendra.talur@gmail.com>
2020-10-05 22:14:16 +05:30
Travis Nielsen 6557cb1bc8 Merge pull request #6303 from subhamkrai/tunefast-deviceclass
ceph: tune fast device class for OSD on PVC in the Azure
2020-10-05 10:18:41 -06:00
Travis Nielsen 32483c72d8 Merge pull request #6366 from subhamkrai/test-flex
ceph: flex test failing in CI
2020-10-05 10:18:01 -06:00
subhamkrai c2c59ec47b ceph: tune fast device class for OSD on PVC in the Azure
on Azure, all SSDs are reporting as a rotational disk.
This commit will add `tuneFastDeviceClass` flag which will
tune for an SSD even if the cloud provider is reporting
rotational. We have a flag `tuneDeviceClass`
which works vice-versa.

Signed-off-by: subhamkrai <srai@redhat.com>
2020-10-05 20:19:55 +05:30
Sébastien Han 778e01aab2 Merge pull request #6367 from leseb/encryption-dev-lost
ceph: check underlaying block status
2020-10-05 16:47:18 +02:00
subhamkrai 5be7f0ae07 ceph: flex test failing in CI
this commit will add error not found condition
check before assert delete on PVC and
statefulset due to whch flex test was failing.

Signed-off-by: subhamkrai <srai@redhat.com>
2020-10-05 20:00:01 +05:30
Sébastien Han 95ac992e48 ceph: check underlaying block status
During the initialization encrypted OSD initialization sequence, we check
for the presence of the encrypted container. If it exists we don't try
  to open it again since this will result in an error.
However, there is another case we need to handle, when the underlying
device is gone. For instance, if the pod/PV couple was drained and move
back, living the orphan dm. Once the pod comes back, the dm is still
present and perfectly matches. Unfortunately, the underlying disk is
different and thus the dm must be removed and the disk re-opened.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-10-05 15:47:29 +02:00
Sébastien Han f0748f6425 Merge pull request #6331 from dungdm93/master
docs: fix typo in ObjectMultisite docs
2020-10-05 14:05:22 +02:00
Travis Nielsen 3e7e31fd3e Merge pull request #6359 from travisn/skip-smoke-suite-k8s-1.11
ceph: Skip smoke suite on k8s 1.11
2020-10-02 09:37:16 -06:00
Travis Nielsen c13d1edf22 ceph: skip smoke suite on k8s 1.11
The smoke suite relies on the csi driver for all the file and block
tests. In the release branch on k8s 1.11 we only need to run the
flex suite and can skip the smoke suite.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-10-01 15:57:00 -06:00
Santosh Pillai 70c5f70701 ceph: support IPv6 single-stack for ceph
Add --ms-bind-ipv6 true args to mom, osd, mgr, object, mds, rbd daemons.

Signed-off-by: Santosh Pillai <sapillai@redhat.com>
2020-10-02 01:03:03 +05:30
Travis Nielsen d5c8be2518 Merge pull request #6352 from Strangerxxx/master
ceph: allow manipulations on monitoring.coreos.com resources to operator within helm chart
2020-10-01 11:45:54 -06:00
Travis Nielsen cebcf0a04e Merge pull request #6353 from leseb/fix-obc-external
ceph: fix obc upgrade from 1.3 to 1.4 external cluster
2020-10-01 07:37:35 -06:00
Sébastien Han 7b8f601c4b Merge pull request #6317 from subhamkrai/golangci-errcheck
Handle golangci-lint linter errcheck error
2020-10-01 12:26:11 +02:00
Sébastien Han d2d1da5970 ceph: fix obc upgrade from 1.3 to 1.4 external cluster
During the 1.3 cycle, we had implemented support for OBC external mode
through an Endpoint in the StorageClass parameter. In 1.4, this is not
the case anymore as we directly use the CephObjectStore external mode.
However, we must maintain backward compatibility with the cluster using
the Endpoint and not fail the upgrade.
Thus checking for a CephObjectStore is invalid and should not always be
assumed, now if we detect an Endpoint we return a simple context which
fixes the upgrade.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-10-01 11:33:54 +02:00
Daniel Chaplin 231317c5f1 core: rbac: allow manipulations on monitoring.coreos.com resources
Before it wasn't allowed but required to successfully deploy Ceph cluster with monitoring enabled.
Fixed by adding more rules to rook-ceph-system rbac role

Closes: https://github.com/rook/rook/issues/6255
Signed-off-by: Daniel Chaplin <black.danek@gmail.com>
2020-10-01 12:11:57 +03:00
subhamkrai 679230f285 ci: enable all golangci-lint linter
this commit enable defalut error check
for golangci-lint linter.

Signed-off-by: subhamkrai <srai@redhat.com>
2020-09-30 22:26:02 +05:30
subhamkrai 0fddfcf307 ceph: handle golangci-lint linter errcheck error
this commit handle golangci-lint linter errcheck.

`errcheck` - Errcheck is a program for checking for
unchecked errors in go programs. These unchecked errors
can be critical bugs in some cases

To see only staticcheck linter output
`golangci-lint run --disable-all -E errcheck`

Signed-off-by: subhamkrai <srai@redhat.com>
2020-09-30 22:24:34 +05:30
Sébastien Han 61b2c6186d Merge pull request #6350 from leseb/fix-luks2-resize
ceph: disable keyring after opening encrypted block
2020-09-30 16:42:51 +02:00
Sébastien Han a7e78858ce ceph: disable keyring after opening encrypted block
On LUKS2 format, the resize operation requires the KEK to be passed. To
maintain a single simple init container for resize, we now open the
encrypted block with  "--disable-keyring" so that further operations
won't require the keyring.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-09-30 15:53:36 +02:00
Sébastien Han 7852f75418 Merge pull request #6344 from varshar16/create-user-per-nfs-daemon
ceph: create user for each ganesha daemon
2020-09-30 10:49:07 +02:00
Varsha Rao 8d3140c8a0 ceph: create user for each ganesha daemon
Ganesha daemons don't need to acess ceph cluster with admin capabilities.
Instead new user with restricted caps can be used.

Signed-off-by: Varsha Rao <varao@redhat.com>
2020-09-29 22:27:17 +05:30
Travis Nielsen 5351968181 Merge pull request #6330 from travisn/osd-reconcile-perf
ceph: Detect OSDs on PVCs in batches instead of with label selectors individually
2020-09-29 09:24:35 -06:00
Sébastien Han eecfa1b7b0 Merge pull request #6338 from thotz/fixobcdeleteissue
ceph: remove user unlink while deleting OBC
2020-09-29 17:14:04 +02:00
Travis Nielsen e2cf76a15e Merge pull request #6343 from leseb/fix-6329
ceph: only support one external cluster secret
2020-09-29 08:23:26 -06:00
Travis Nielsen 2f3313475b Merge pull request #6340 from Madhu-1/csi-v3.1.1
ceph: update cephcsi to v3.1.1
2020-09-29 08:14:15 -06:00
Jiffin Tony Thottan b7bc51ea69 ceph: remove user unlink while deleting OBC
User unlink is performed just before deleting OBC resources.
Since user is internal to OBC and next to remove to delete user,
unlinking user is not necessary.

Fixes: 6300
Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2020-09-29 17:20:54 +05:30
Sébastien Han 08944c4e50 ceph: only support one external cluster secret
We do not support providing both ROOK_EXTERNAL_USER_SECRET and
ROOK_EXTERNAL_ADMIN_SECRET. When both are provided in the mon secret,
the operator code will use the client.admin user for all its operations.
This will break some of the logic when creating OBC since if
client.admin is detected we assume the cluster is converged and thus
pass args like this:

```
--rgw-realm=external-store --rgw-zonegroup=external-store --rgw-zone=external-store
```

To the radosgw-admin command, which won't work since Rook has no idea
what the external realm/zonegroup/zone are, if any are configured.

This fix should be sufficient for now, but moving forward we should
probably enhance clusterInfo with an "isExternal" property to make
things easier. Also supporting external realm/zonegroup/zone would be
nice. This will probanly hit 1.5 once this code is promoted to stable.
See: https://github.com/rook/rook/issues/6342

Closes: https://github.com/rook/rook/issues/6329
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-09-29 11:06:19 +02:00
Madhu Rajanna 2fa3e71733 ceph: update cephcsi to v3.1.1
as cephcsi v3.1.1 is released today
with many bug fixes and enhancements,
more details can be found at
https://github.com/ceph/ceph-csi/releases/tag/v3.1.1

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-09-29 14:03:44 +05:30
Travis Nielsen caa51e4cb8 ceph: detect osd deployments on pvcs in a batch
OSD prepare jobs only need to be run if the OSD deployments on PVCs were
not already started. For efficiency, we now query them in a batch instead
of querying them one-by-one with a label selector, which proves to be very
slow in large clusters.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-09-28 12:52:17 -06:00
Travis Nielsen c73022060a ceph: detect osd pvcs in a batch
The OSD PVCs were being detected one by one with a label selector.
This proves to be slow in large clusters. Instead, we now make this
more efficient by querying for all existing PVCs and looking up their
existing in memory with a map.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-09-28 12:52:17 -06:00
Jared Watts d15eea7d6e Merge pull request #6339 from jbw976/zoom-pwd
readme: update community meeting zoom link with password (required by zoom now)
2020-09-28 11:19:10 -07:00
Jared Watts 40928ceaef docs: update community meeting zoom link with password
Signed-off-by: Jared Watts <jbw976@gmail.com>
2020-09-28 11:12:28 -07:00
Travis Nielsen 6472544b84 Merge pull request #6336 from agarwal-mudit/csi
csi: update csi sidecar images
2020-09-28 10:18:02 -06:00
Travis Nielsen dd41f75d33 Merge pull request #6337 from subhamkrai/yugabytedb-test
yugabytedb: integration test failing
2020-09-28 10:15:40 -06:00
subhamkrai bfc878e33a yugabytedb: integration test failing
this commit reverts the changes done in
controller file as previous changes failing
in ci and those changes are related to linter
so we can supress them.

Signed-off-by: subhamkrai <srai@redhat.com>
2020-09-28 19:16:52 +05:30
Mudit Agarwal c547b36aa0 ceph: update csi sidecar images
This PR makes the changes in csi templates and
upgrade documentation required for updating
csi sidecar images.

Signed-off-by: Mudit Agarwal <muagarwa@redhat.com>
2020-09-28 18:58:52 +05:30
Đặng Minh Dũng 27914964d8 docs: fix cleanup instruction in 'Object Multisite' docs
Signed-off-by: Đặng Minh Dũng <dungdm93@live.com>
2020-09-27 16:17:36 +07:00
Đặng Minh Dũng 106a6ee5c0 docs: fix typo in 'Object Multisite CRDs' docs
Signed-off-by: Đặng Minh Dũng <dungdm93@live.com>
2020-09-27 13:07:13 +07:00
Jared Watts e14f00f028 Merge pull request #6112 from prksu/design-nfs-quota
nfs: design nfs quota
2020-09-24 17:20:41 -07:00
Travis Nielsen bec39f277e Merge pull request #6319 from timhughes/compression_mode
[skip ci] example yamls: use new style parameters.compression_mode
2020-09-24 16:31:32 -06:00
Tim Hughes 406d3f44f8 docs: remove compression from test yamls
Signed-off-by: Tim Hughes <thughes@thegoldfish.org>
2020-09-24 22:46:43 +01:00
Travis Nielsen d3ce1574f3 Merge pull request #6309 from bhavin192/update-yugabytedb-version
yugabytedb: update YugabyteDB container image
2020-09-24 13:01:53 -06:00
Tim Hughes 363baeb19b docs: changes example yamls to use parameters.compression_mode
Makes compression_mode in example yamls consistent

Closes: https://github.com/rook/rook/issues/6318
Signed-off-by: Tim Hughes <thughes@thegoldfish.org>
2020-09-24 18:59:15 +01:00
Ahmad Nurus S 76c0bfd0c3 nfs: design nfs quota
Signed-off-by: Ahmad Nurus S <prksu.sh@gmail.com>
2020-09-24 22:12:02 +07:00
Travis Nielsen deb2ab0da6 Merge pull request #6306 from subhamkrai/golangci-staticcheck
ceph: handle golangci-lint linter staticcheck error
2020-09-24 09:00:45 -06:00
subhamkrai ff0fb897ff ci: update golangci-lint with staticcheck
adding linter staticcheck in golangci-lint.
staticcheck - Staticcheck is a go vet on steroids,
applying a ton of static analysis checks

Signed-off-by: subhamkrai <srai@redhat.com>
2020-09-24 15:12:49 +05:30
subhamkrai de8dbbcdcc ceph: handle golangci-lint linter staticcheck error
this commit handle golangci-lint linter staticcheck error.

`staticcheck` - Staticcheck is a go vet on steroids,
applying a ton of static analysis checks.

To see only `staticcheck` linter output

`golangci-lint run --disable-all -E staticcheck`

Signed-off-by: subhamkrai <srai@redhat.com>
2020-09-24 15:04:55 +05:30