Commit Graph
5674 Commits
Author SHA1 Message Date
Arun Kumar Mohan fbb8af12e1 ceph: adding '--upgrade' option to external script
An '--upgrade' option is added to the option list, which upgrades the user
permissions (caps) to match newer version. Will try to detect
'rgw-pool-prefix' or user can provide it through the argument.

Segregated the command line arguments into three groups, common, output and
upgrade

Signed-off-by: Arun Kumar Mohan <amohan@redhat.com>
2020-10-09 18:59:25 +05:30
Travis Nielsen cebcf0a04e Merge pull request #6353 from leseb/fix-obc-external
ceph: fix obc upgrade from 1.3 to 1.4 external cluster
2020-10-01 07:37:35 -06:00
Sébastien Han 7b8f601c4b Merge pull request #6317 from subhamkrai/golangci-errcheck
Handle golangci-lint linter errcheck error
2020-10-01 12:26:11 +02:00
Sébastien Han d2d1da5970 ceph: fix obc upgrade from 1.3 to 1.4 external cluster
During the 1.3 cycle, we had implemented support for OBC external mode
through an Endpoint in the StorageClass parameter. In 1.4, this is not
the case anymore as we directly use the CephObjectStore external mode.
However, we must maintain backward compatibility with the cluster using
the Endpoint and not fail the upgrade.
Thus checking for a CephObjectStore is invalid and should not always be
assumed, now if we detect an Endpoint we return a simple context which
fixes the upgrade.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-10-01 11:33:54 +02:00
subhamkrai 679230f285 ci: enable all golangci-lint linter
this commit enable defalut error check
for golangci-lint linter.

Signed-off-by: subhamkrai <srai@redhat.com>
2020-09-30 22:26:02 +05:30
subhamkrai 0fddfcf307 ceph: handle golangci-lint linter errcheck error
this commit handle golangci-lint linter errcheck.

`errcheck` - Errcheck is a program for checking for
unchecked errors in go programs. These unchecked errors
can be critical bugs in some cases

To see only staticcheck linter output
`golangci-lint run --disable-all -E errcheck`

Signed-off-by: subhamkrai <srai@redhat.com>
2020-09-30 22:24:34 +05:30
Sébastien Han 61b2c6186d Merge pull request #6350 from leseb/fix-luks2-resize
ceph: disable keyring after opening encrypted block
2020-09-30 16:42:51 +02:00
Sébastien Han a7e78858ce ceph: disable keyring after opening encrypted block
On LUKS2 format, the resize operation requires the KEK to be passed. To
maintain a single simple init container for resize, we now open the
encrypted block with  "--disable-keyring" so that further operations
won't require the keyring.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-09-30 15:53:36 +02:00
Sébastien Han 7852f75418 Merge pull request #6344 from varshar16/create-user-per-nfs-daemon
ceph: create user for each ganesha daemon
2020-09-30 10:49:07 +02:00
Varsha Rao 8d3140c8a0 ceph: create user for each ganesha daemon
Ganesha daemons don't need to acess ceph cluster with admin capabilities.
Instead new user with restricted caps can be used.

Signed-off-by: Varsha Rao <varao@redhat.com>
2020-09-29 22:27:17 +05:30
Travis Nielsen 5351968181 Merge pull request #6330 from travisn/osd-reconcile-perf
ceph: Detect OSDs on PVCs in batches instead of with label selectors individually
2020-09-29 09:24:35 -06:00
Sébastien Han eecfa1b7b0 Merge pull request #6338 from thotz/fixobcdeleteissue
ceph: remove user unlink while deleting OBC
2020-09-29 17:14:04 +02:00
Travis Nielsen e2cf76a15e Merge pull request #6343 from leseb/fix-6329
ceph: only support one external cluster secret
2020-09-29 08:23:26 -06:00
Travis Nielsen 2f3313475b Merge pull request #6340 from Madhu-1/csi-v3.1.1
ceph: update cephcsi to v3.1.1
2020-09-29 08:14:15 -06:00
Jiffin Tony Thottan b7bc51ea69 ceph: remove user unlink while deleting OBC
User unlink is performed just before deleting OBC resources.
Since user is internal to OBC and next to remove to delete user,
unlinking user is not necessary.

Fixes: 6300
Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2020-09-29 17:20:54 +05:30
Sébastien Han 08944c4e50 ceph: only support one external cluster secret
We do not support providing both ROOK_EXTERNAL_USER_SECRET and
ROOK_EXTERNAL_ADMIN_SECRET. When both are provided in the mon secret,
the operator code will use the client.admin user for all its operations.
This will break some of the logic when creating OBC since if
client.admin is detected we assume the cluster is converged and thus
pass args like this:

```
--rgw-realm=external-store --rgw-zonegroup=external-store --rgw-zone=external-store
```

To the radosgw-admin command, which won't work since Rook has no idea
what the external realm/zonegroup/zone are, if any are configured.

This fix should be sufficient for now, but moving forward we should
probably enhance clusterInfo with an "isExternal" property to make
things easier. Also supporting external realm/zonegroup/zone would be
nice. This will probanly hit 1.5 once this code is promoted to stable.
See: https://github.com/rook/rook/issues/6342

Closes: https://github.com/rook/rook/issues/6329
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-09-29 11:06:19 +02:00
Madhu Rajanna 2fa3e71733 ceph: update cephcsi to v3.1.1
as cephcsi v3.1.1 is released today
with many bug fixes and enhancements,
more details can be found at
https://github.com/ceph/ceph-csi/releases/tag/v3.1.1

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-09-29 14:03:44 +05:30
Travis Nielsen caa51e4cb8 ceph: detect osd deployments on pvcs in a batch
OSD prepare jobs only need to be run if the OSD deployments on PVCs were
not already started. For efficiency, we now query them in a batch instead
of querying them one-by-one with a label selector, which proves to be very
slow in large clusters.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-09-28 12:52:17 -06:00
Travis Nielsen c73022060a ceph: detect osd pvcs in a batch
The OSD PVCs were being detected one by one with a label selector.
This proves to be slow in large clusters. Instead, we now make this
more efficient by querying for all existing PVCs and looking up their
existing in memory with a map.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-09-28 12:52:17 -06:00
Jared Watts d15eea7d6e Merge pull request #6339 from jbw976/zoom-pwd
readme: update community meeting zoom link with password (required by zoom now)
2020-09-28 11:19:10 -07:00
Jared Watts 40928ceaef docs: update community meeting zoom link with password
Signed-off-by: Jared Watts <jbw976@gmail.com>
2020-09-28 11:12:28 -07:00
Travis Nielsen 6472544b84 Merge pull request #6336 from agarwal-mudit/csi
csi: update csi sidecar images
2020-09-28 10:18:02 -06:00
Travis Nielsen dd41f75d33 Merge pull request #6337 from subhamkrai/yugabytedb-test
yugabytedb: integration test failing
2020-09-28 10:15:40 -06:00
subhamkrai bfc878e33a yugabytedb: integration test failing
this commit reverts the changes done in
controller file as previous changes failing
in ci and those changes are related to linter
so we can supress them.

Signed-off-by: subhamkrai <srai@redhat.com>
2020-09-28 19:16:52 +05:30
Mudit Agarwal c547b36aa0 ceph: update csi sidecar images
This PR makes the changes in csi templates and
upgrade documentation required for updating
csi sidecar images.

Signed-off-by: Mudit Agarwal <muagarwa@redhat.com>
2020-09-28 18:58:52 +05:30
Jared Watts e14f00f028 Merge pull request #6112 from prksu/design-nfs-quota
nfs: design nfs quota
2020-09-24 17:20:41 -07:00
Travis Nielsen bec39f277e Merge pull request #6319 from timhughes/compression_mode
[skip ci] example yamls: use new style parameters.compression_mode
2020-09-24 16:31:32 -06:00
Tim Hughes 406d3f44f8 docs: remove compression from test yamls
Signed-off-by: Tim Hughes <thughes@thegoldfish.org>
2020-09-24 22:46:43 +01:00
Travis Nielsen d3ce1574f3 Merge pull request #6309 from bhavin192/update-yugabytedb-version
yugabytedb: update YugabyteDB container image
2020-09-24 13:01:53 -06:00
Tim Hughes 363baeb19b docs: changes example yamls to use parameters.compression_mode
Makes compression_mode in example yamls consistent

Closes: https://github.com/rook/rook/issues/6318
Signed-off-by: Tim Hughes <thughes@thegoldfish.org>
2020-09-24 18:59:15 +01:00
Ahmad Nurus S 76c0bfd0c3 nfs: design nfs quota
Signed-off-by: Ahmad Nurus S <prksu.sh@gmail.com>
2020-09-24 22:12:02 +07:00
Travis Nielsen deb2ab0da6 Merge pull request #6306 from subhamkrai/golangci-staticcheck
ceph: handle golangci-lint linter staticcheck error
2020-09-24 09:00:45 -06:00
subhamkrai ff0fb897ff ci: update golangci-lint with staticcheck
adding linter staticcheck in golangci-lint.
staticcheck - Staticcheck is a go vet on steroids,
applying a ton of static analysis checks

Signed-off-by: subhamkrai <srai@redhat.com>
2020-09-24 15:12:49 +05:30
subhamkrai de8dbbcdcc ceph: handle golangci-lint linter staticcheck error
this commit handle golangci-lint linter staticcheck error.

`staticcheck` - Staticcheck is a go vet on steroids,
applying a ton of static analysis checks.

To see only `staticcheck` linter output

`golangci-lint run --disable-all -E staticcheck`

Signed-off-by: subhamkrai <srai@redhat.com>
2020-09-24 15:04:55 +05:30
Travis Nielsen 1d5c590e4f Merge pull request #6307 from travisn/osd-pvc-template-name
ceph: allow osd pvc template name set to any value
2020-09-23 09:45:35 -06:00
Bhavin Gandhi 4eac82a3d0 yugabytedb: update YugabyteDB container image
This updates the YugabyteDB image to a latest stable version.

Signed-off-by: Bhavin Gandhi <bhavin7392@gmail.com>
2020-09-23 13:55:18 +05:30
Travis Nielsen 2b9e7a5335 ceph: allow osd pvc template name set to any value
The pvc template name has either been require to be empty, or one of the
expected values such as data and metadata. Those who upgrade from 1.1
may find that if they changed it to something else, their upgrade will
fail when not one of these values. If there is only a single template,
always treat it as the data template.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-09-22 15:20:54 -06:00
Sébastien Han 1d8bd3d00a Merge pull request #6286 from subhamkrai/golanci-lint-staticcheck
ceph: handle golangci-lint linter ineffassign
2020-09-22 10:16:32 +02:00
Travis Nielsen 31f756d278 Merge pull request #6284 from leseb/doc-6279
docs: common issue low aio-max-nr setting
2020-09-21 10:17:48 -06:00
subhamkrai af7ba588c6 ci: update golangci-lint with ineffassign linter
adding one more linter ineffassign in golangci-lint.
ineffassign - Detects when assignments to existing
variables are not used.

Signed-off-by: subhamkrai <subhamkumarrai03@gmail.com>
2020-09-21 14:35:00 +05:30
subhamkrai 829778f251 ceph: handle golangci-lint linter ineffassign
this commit will enable one more linter ineffassign
in golangci-lint.

This linter throws an error when variable is assigned and never used.

`golangci-lint run --disable-all -E ineffassign` is used detects ineffassign
errors only.

Signed-off-by: subhamkrai <subhamkumarrai03@gmail.com>
2020-09-21 14:31:18 +05:30
Sébastien Han 005f17036a docs: common issue low aio-max-nr setting
When the system has a low ow aio-max-nr setting, the osd prepare pod can
fail to complete. This value must be increased.
Adding a documentation section for it.

Closes: https://github.com/rook/rook/issues/6279
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-09-21 09:44:45 +02:00
Travis Nielsen 02fa0eb921 Merge pull request #6228 from Madhu-1/fix-ownerref
ceph: remove owner reference set by rook on csidriver
2020-09-18 10:09:36 -06:00
Travis Nielsen bbb59d4949 Merge pull request #6274 from alimaredia/object-zonegroup-testing
ceph: add unit tests for zone group
2020-09-18 09:56:47 -06:00
Travis Nielsen 23108cc94a Merge pull request #6282 from subhamkrai/golanci-lint-deadcode
ceph: handle golangci-lint linter deadcode
2020-09-18 09:27:46 -06:00
Sébastien Han 56fa357c5d Merge pull request #6285 from varshar16/update-ceph-cluster-yaml
ceph: update about 'rook' module  in cluster.yaml
2020-09-18 16:55:14 +02:00
Varsha Rao 9a4403b55e ceph: update about 'rook' module in cluster.yaml
'rook' module is not enabled by default. So update the wrong comment about it.

Signed-off-by: Varsha Rao <varao@redhat.com>
2020-09-18 20:10:55 +05:30
subhamkrai 54fe97c988 ci: add deadcode linter in golangci-lint
this commit will add one more linter deadcode
in golangci-lint tool.

Signed-off-by: subhamkrai <subhamkumarrai03@gmail.com>
2020-09-18 16:56:37 +05:30
subhamkrai 1e9bb8e6e2 ceph: handle golangci-lint linter deadcode
this commit will enable one more linter `deadcode`
in golangci-lint .

Signed-off-by: subhamkrai <subhamkumarrai03@gmail.com>
2020-09-18 16:53:49 +05:30
Sébastien Han d118bd38a6 Merge pull request #6278 from subhamkrai/golanci-lint-unused
ceph: handle golangci-lint linter unused
2020-09-18 12:44:37 +02:00