Commit Graph
13292 Commits
Author SHA1 Message Date
Sébastien Han f66473a8f8 ceph: fix healtcheck for external cluster
For external cluster, it is not an issue to have a mon count set to 0
since Rook is not deploying/managing the monitors.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-10 11:46:35 +02:00
Humble Chirammal 6613b3a9e9 ceph: update e2e manifest for cephfs snapshotter sidecar
Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2020-08-10 11:31:30 +05:30
Humble Chirammal 801b2a5852 ceph: add cephfs snapshotter rbac to cephfs provisioner role
Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2020-08-10 11:31:30 +05:30
Humble Chirammal a795ff01e0 ceph: add cephfs examples yamls for restore,clone and snapshotclass
Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2020-08-10 11:31:10 +05:30
Humble Chirammal dacc013cc9 ceph: add csi-snapshotter sidecar to cephfs deployment
Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2020-08-10 11:27:05 +05:30
Humble Chirammal f2af549371 ceph: add cephfs snapshotter rbac for the cephfs provisioner role
Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2020-08-10 11:26:59 +05:30
Chen, Tingjie 0e87348093 ceph: add support for wal device for OSD on PVC
Based on the feature of metadata PVC for OSD: #4818, add the wal device.

For this, you need to create a new volumeClaimTemplates, its name must be "wal", if "wal" is
set, "metadata" device will refers specially for block.db device, and "wal" refers for block.wal
device in BlueStore.

A template will look like this:

```
volumeClaimTemplates:
- metadata:
    name: data
  spec:
    resources:
      requests:
        storage: 10Gi
    # IMPORTANT: Change the storage class depending on your environment (e.g. local-storage, gp2)
    storageClassName: gp2
    volumeMode: Block
    accessModes:
      - ReadWriteOnce
- metadata:
    name: metadata
  spec:
    resources:
      requests:
        storage: 6Gi
    # IMPORTANT: Change the storage class depending on your environment (e.g. local-storage, io1)
    storageClassName: io1
    volumeMode: Block
    accessModes:
      - ReadWriteOnce
- metadata:
    name: wal
  spec:
    resources:
      requests:
        storage: 6Gi
    # IMPORTANT: Change the storage class depending on your environment (e.g. local-storage, io1)
    storageClassName: io1
    volumeMode: Block
    accessModes:
      - ReadWriteOnce
```

We now map block, block.db and block.wal directly inside the container instead of
running ceph-volume activate.

Signed-off-by: Chen, Tingjie <tingjie.chen@intel.com>
2020-08-10 08:48:20 +08:00
mridulv 30cd786303 ceph: adding ability to specify crushroot in the CRD
Previously we did not supported defining crushRoot in some of the CRDs. With this fix, we plan to fix this behaviour.

Signed-off-by: mridulv <mridulv09@gmail.com>
2020-08-08 16:24:15 +05:30
Travis Nielsen a8381c3376 Merge pull request #6010 from unai-ttxu/docs/ceph_cs
docs: add provisioner prefix namespace comment in ceph csi examples
2020-08-07 13:14:43 -06:00
Unai Arrien f6087b280a docs: add provisioner prefix namespace comment in ceph csi examples
Signed-off-by: Unai Arrien <unaittxu@gmail.com>
2020-08-07 15:39:36 +02:00
Travis Nielsen bd7db7a788 Merge pull request #6001 from travisn/object-test-crash
ceph: Improve object bucket test stability
2020-08-06 10:32:28 -06:00
Travis Nielsen 89284d9155 ceph: improve object bucket test stability
The object bucket check is sometimes not completed yet
that causes the integration test to fail intermittently.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-08-06 09:25:35 -06:00
Sébastien Han 2dcc6ee392 Merge pull request #5864 from rohan47/whereabouts_fix
ceph: fix networkAttachmentConfig to be compatible with whereabouts cni
2020-08-06 15:11:16 +02:00
Sébastien Han f9ae232bc8 Merge pull request #5984 from Madhu-1/fix-nil-pointer
ceph: add check for nil object status
2020-08-06 14:23:24 +02:00
Sébastien Han f936ad3cbf Merge pull request #5680 from umangachapagain/rbd-pool-stats
Add spec to enable/disable RBD pool stats collection
2020-08-06 10:53:49 +02:00
Sébastien Han f91616f1e6 Merge pull request #5982 from Madhu-1/remove-csi-1.13
ceph: remove csi support for kubernetes 1.13
2020-08-06 09:53:49 +02:00
Sébastien Han 52566ad851 Merge pull request #5990 from travisn/status-update
ceph: Update the cluster status with a non-cached object
2020-08-06 09:12:07 +02:00
Sébastien Han 8da53de7ef Merge pull request #5989 from travisn/prometheus-manifest-path
ceph: Symlink prometheus manifests in same dir
2020-08-06 09:07:05 +02:00
Madhu Rajanna 99cd310cd2 ceph: add check for nil object status
in couple of unit testing the tests are
panicing with nil pointer exception,This
commit adds a check for status pointer before
operating on it.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-08-06 12:19:49 +05:30
Umanga Chapagain da1910840a ceph: add CRD changes and documentation
adds `enableRBDStats` to CRD manifets and updates documentation
on its usage.

Signed-off-by: Umanga Chapagain <chapagainumanga@gmail.com>
2020-08-06 12:11:55 +05:30
Umanga Chapagain edcb80b237 ceph: unit test cases for enableRBDStats
Signed-off-by: Umanga Chapagain <chapagainumanga@gmail.com>
2020-08-06 12:07:21 +05:30
Umanga Chapagain 83d7cdb85c ceph: configure mgr to enable collection of RBD stats
Signed-off-by: Umanga Chapagain <chapagainumanga@gmail.com>
2020-08-06 12:07:21 +05:30
Umanga Chapagain 7563077308 ceph: add enableRBDStats spec to CephBlockPool
Signed-off-by: Umanga Chapagain <chapagainumanga@gmail.com>
2020-08-06 12:07:21 +05:30
tenzen-y 1d7d715482 ci: remove unnecessary "rm" command
This commit will remove "sudo rm /usr/local/bin/kube*" and "sudo rm kubectl" in "tests/scripts/kubeadm.sh".
I think that CI-test doesn't make those files.

Signed-off-by: tenzen-y <toyonomajyutushi@yahoo.co.jp>
2020-08-06 05:34:01 +00:00
Travis Nielsen 99d2131209 ceph: symlink prometheus manifests in same dir
The prometheus manifests should be symlinked in the same directory
instead of from the root of the repo for building across all
platforms

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-08-05 15:55:16 -06:00
Travis Nielsen a3bf935957 ceph: update the cluster status with a clean object
The cluster CR status needs to be updated with the latest object
instead of a cached copy or else it could fail if there is some
other update. Using the Rook clientset ensures it is the latest
instead of using the cached controller runtime object.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-08-05 15:55:01 -06:00
Travis Nielsen e45fbf9205 Merge pull request #5974 from guni1192/ceph-use-fixed-mon-directory-in-ci
ceph: use fixed mon directory in ci
2020-08-05 14:53:35 -06:00
Travis Nielsen 943bb839d8 Merge pull request #5985 from travisn/mon-svc-upgrade
ceph: During upgrade the mon service selector cannot be changed
2020-08-05 14:26:11 -06:00
Travis Nielsen 15fae3c4cd ceph: during upgrade service selector cannot be changed
The service selector labels cannot be updated during the upgrade or else the
mon commands will not respond until the mon deployment is also updated.
Since there is a mon command to check for the ceph versions before the
deployment is updated, the operator would remain stuck during the upgrade.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-08-05 11:32:42 -06:00
Ahmad Nurus S 92fffca1e4 nfs: add unit test for nfs provisioner
Signed-off-by: Ahmad Nurus S <prksu.sh@gmail.com>
2020-08-05 22:55:51 +07:00
Madhu Rajanna 1989e0d8c5 ceph: remove csi support for kubernetes 1.13
as the kubernetes 1.13 is EOL and there is no major
functionalities available in 1.13 (resize,snapshot,clone
metrics etc) we are removing the support for kubernetes
for the same.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-08-05 21:19:59 +05:30
rohan47 f5bbc8c5c5 ceph: fix networkAttachmentConfig to be compatible with whereabouts cni
In the whereabouts config, the network range is determined by range
option unlike other cni plugins that use Subnet option.

Signed-off-by: rohan47 <rohgupta@redhat.com>
2020-08-05 21:17:13 +05:30
Sébastien Han 43b07ef9fb Merge pull request #5980 from leseb/fix-5976
ceph: fix unit test mock
2020-08-05 17:20:55 +02:00
Sébastien Han a039c94086 Merge pull request #5979 from anmolsachan/rgw_integration
ceph: added rgw poolPrefix on ceph external script output
2020-08-05 16:24:20 +02:00
Sébastien Han 7d7523a8a2 ceph: fix unit test mock
Mock the user creation otherwise the health check fails and panics.

Closes: https://github.com/rook/rook/issues/5976
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-05 16:09:24 +02:00
Anmol Sachan 9dfd684ab5 ceph: added rgw poolPrefix on ceph external script output
RGW poolPrefix is required for the UI and alerting, to provide right information about the respective pool in external mode.

Signed-off-by: Anmol Sachan <anmol13694@gmail.com>
2020-08-05 19:35:33 +05:30
Sébastien Han dfc701805a Merge pull request #5873 from leseb/encryption-raw-mode
ceph: add encryption support for osd pvc
2020-08-05 13:34:59 +02:00
Takashi IIGUNI 18a28f7dee ceph: use fixed mon directory in ci
It's not necessary to use random string for mon directory.
In addition, current implementation leaves garbage under /var/lib/rook.

Signed-off-by: Takashi IIGUNI <iiguni.tks@gmail.com>
2020-08-05 09:04:34 +00:00
Sébastien Han 6c8f4e1ffc Merge pull request #5972 from tenzen-y/ci-fix-wrong-document-of-functions
ci: fix function comments
2020-08-05 10:19:03 +02:00
Sébastien Han 3c73e5f5d7 Merge pull request #5886 from alimaredia/wip-object-store-multisite-doc-fixes
ceph: minor fixes for multisite docs
2020-08-05 10:16:11 +02:00
tenzen-y 29087f8e41 ci: fix function comments
This commit will fix outdated function comments.

Signed-off-by: tenzen-y <toyonomajyutushi@yahoo.co.jp>
2020-08-05 08:08:53 +00:00
Sébastien Han 89b3225441 ceph: add encryption support for osd pvc
We can now encrypted OSD device that were provisioned via a storage
class using the PV interface.
The encryption works at the storageClassDeviceSets level, which means we
can have encrypted and non-encrypted sets.
Using the new key `encrypted` we can turn it on.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-05 10:06:11 +02:00
Sébastien Han af1e8c320a ceph: do not log an error if no clusters
If the list of cluster is empty there is no need to report an error in
the logs.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-05 10:05:51 +02:00
Sébastien Han ec8e749ef5 Merge pull request #5581 from cybozu-go/ceph-support-crypt-type-device-in-osd-on-pvc
ceph: support crypt type device in OSD on PVC
2020-08-05 09:42:30 +02:00
Travis Nielsen af22cec9f0 Merge pull request #5929 from travisn/upgrade-1.4-docs
ceph: Upgrade guide from v1.3 to v1.4
2020-08-04 23:50:29 -06:00
Travis Nielsen 5197864a01 Merge pull request #5969 from guni1192/ci-fix-os-version
ci: fix os version
2020-08-04 23:46:11 -06:00
Takashi IIGUNI 4553407f10 ci: fix os version
The OS version for CI environment is ubuntu 18.04 now.

Signed-off-by: Takashi IIGUNI <iiguni.tks@gmail.com>
2020-08-05 05:28:23 +00:00
Ali Maredia ba169fa167 ceph: fixes for multisite docs
Reformatting and fixes in ceph-object-multisite.md.
Also a minor fix in object-store crd docs.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2020-08-04 23:50:18 -04:00
Travis Nielsen 06c21954e1 ceph: labels are immutable for match selectors
The labels cannot be updated on a deployment match selector.
In v1.4 a new label was added for ceph_daemon_type that is intended
to be on the pod labels, but cannot be applied to the match selectors.
Therefore, we suppress any new labels that are added to the daemons.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-08-04 16:47:00 -06:00
Travis Nielsen 772b7990db ceph: updated clusterroles applied in upgrade test
In the upgrade integration test we need to mirror what we expect
users to do during the upgrade by applying the new clusterroles.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-08-04 16:04:07 -06:00