Commit Graph
7961 Commits
Author SHA1 Message Date
Travis Nielsen 513567f309 Merge pull request #6269 from varshar16/set-correct-ROOK_CEPH_CLUSTER_CRD_NAME
ceph: set ROOK_CEPH_CLUSTER_CRD_NAME with cluster name
2020-09-16 16:01:24 -06:00
Travis Nielsen 5971a8ba4f Merge pull request #6243 from travisn/roadmap-1.5
docs: Update the roadmap for v1.5
2020-09-16 14:49:37 -06:00
Travis Nielsen 259505cb81 Merge pull request #6252 from ashangit/merge_conf_override
ceph: merge config from rook-config-override configmap to the default global config file
2020-09-16 13:29:06 -06:00
Varsha Rao 195dee9bc2 ceph: set ROOK_CEPH_CLUSTER_CRD_NAME with cluster name
ROOK_CEPH_CLUSTER_CRD_NAME is incorrectly set to cluster namespace value

Signed-off-by: Varsha Rao <varao@redhat.com>
2020-09-16 23:53:52 +05:30
Travis Nielsen f044969702 Merge pull request #6267 from SUSE/ceph-fix-drive-group-empty-string-unmarshal-failure
ceph: fix drive group deployment failure
2020-09-16 11:05:41 -06:00
Blaine Gardner 76f1d9944e ceph: fix drive group deployment failure
Drive Groups will fail to deploy due to a message: `failed to parse
device list (""): failed to JSON unmarshal configured devices (""):
unexpected end of JSON input`

This is due to trying to JSON unmarshal an empty string which does not
contain any devices to provision when Drive Groups are specified. Fix so
that an empty string represents no non-Drive Group devices.

Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2020-09-16 09:32:06 -06:00
n.fraison de7ca01930 ceph: merge rook-config-override to the default global config file
Some parameter like bluestore_min_alloc_size, bluestore_min_alloc_size_hdd need to be set during the bootstrap of the
ceph cluster in order to have bluestore created accordingly.
To do so rook users rely on the rook-config-override configmap.
Sadly the rook-ceph-osd-prepare job does not take in account this configmap to generate its ceph config.
Changing the behaviour to merge the config from rook-config-override configmap to the default ceph config

Signed-off-by: n.fraison <n.fraison@criteo.com>
2020-09-16 15:08:50 +02:00
Travis Nielsen 8a2ea742c7 docs: update the ceph roadmap for v1.5
This is a draft of the features planned for v1.5 and mention of
features that may extend beyond v1.5. Roadmap to other storage providers
are expected separately by each of the storage provider owners.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-09-15 13:56:32 -06:00
Travis Nielsen 00e6398fe8 Merge pull request #6235 from fanjunwei/user_truncated_node_name
ceph: Use truncated node name
2020-09-15 13:19:49 -06:00
Sébastien Han a18eab112b Merge pull request #6256 from travisn/skip-labels-during-upgrade
ceph: Upgrade to v1.4.3 for cluster-on-pvc example hangs due to changing label selectors on the mons
2020-09-15 13:21:48 +02:00
Sébastien Han 484399148a Merge pull request #6254 from mcsaucy/patch-1
ceph: tweak removeOSDsIfOutAndSafeToRemove wording
2020-09-15 10:26:00 +02:00
Madhu Rajanna a1024ebc75 ceph: remove owner reference set by rook on csidriver
currently, we are setting the rook operator as owner
on the csidriver objects,  as csidriver is cluster
scoped object we should not set namespaced object as
owner on cluster scoped object

fixes #6162

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-09-15 11:39:27 +05:30
Travis Nielsen da863e4156 ceph: do not change selector labels during upgrade
The selector labels used for mons cannot change during upgrade
or else the upgrade will hang when the cluster is checking
for mon status immediately after the upgrade begins.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-09-14 21:43:25 -06:00
Josh McSavaney cc7b07c840 ceph: tweak removeOSDsIfOutAndSafeToRemove wording
- Corrects what I think was a typo ("when then" -> "when they")
- Picks a single tense
- capitalizes OSD

Signed-off-by: Josh McSavaney <me@mcsau.cc>
2020-09-14 18:17:47 -04:00
Travis Nielsen d55815d698 Merge pull request #6066 from Madhu-1/rbd-snap-clone-test
ceph: Add E2E testing for csi snapshot and clone
2020-09-14 11:24:58 -06:00
Travis Nielsen 4df34f4bf4 Merge pull request #6226 from leseb/fix-6217
ceph: allow running rgw in rook with external mode
2020-09-14 11:18:53 -06:00
Sébastien Han bf8b87fc80 Merge pull request #6227 from aruniiird/support-TLS-RGW
ceph: fix to support TLS enabled rgw-endpoint
2020-09-14 09:05:06 +02:00
Travis Nielsen 2052d5e657 Merge pull request #6225 from subhamkrai/add-label-osd
ceph: add storageClassDeviceSet label to osd pods
2020-09-11 09:15:13 -06:00
Sébastien Han 61dea11de3 Merge pull request #6234 from subhamkrai/fix-dns-suffix
ceph: fixed DNS suffix breaks in custom DNS suffix clusters
2020-09-11 15:06:59 +02:00
Travis Nielsen b93fcbe208 Merge pull request #6232 from Madhu-1/csidriv-ownerref
ceph: dont set ownerRef when creating csidriver object
2020-09-11 07:05:59 -06:00
fanjunwei f013add62e ceph: use truncated node name
Signed-off-by: fanjunwei <fanjunwei@t2cloud.net>
2020-09-11 19:48:38 +08:00
subhamkrai 209dc6251d ceph: fixed DNS suffix breaks in custom DNS suffix clusters
By addding ".svc" to the endpoint of the object store,
will fix the custom DNS suffix cluster.

Signed-off-by: subhamkrai <subhamkumarrai03@gmail.com>
2020-09-11 13:29:53 +05:30
Sébastien Han a51b76889a ceph: allow running rgw in rook with external mode
We don't fail anymore if the cluster is external and user wants to
bootstrap rgw gateways in Kubernertes.

Closes: https://github.com/rook/rook/issues/6217
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-09-11 09:28:40 +02:00
Arun Kumar Mohan 3de87ccd35 ceph: fix to support TLS enabled rgw-endpoint
Signed-off-by: Arun Kumar Mohan <amohan@redhat.com>
2020-09-11 12:14:56 +05:30
Madhu Rajanna b88373f9f3 ceph: dont set ownerRef when creating csidriver object
currently, we are setting the rook operator as the
owner on the csidriver objects, as csidriver is cluster
the scoped object we should not set a namespaced object
as owner on cluster scoped object.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-09-11 11:59:44 +05:30
subhamkrai 6d08d94948 ceph: add storageClassDeviceSet label to osd pods
this commit will add a new flag to the osd pods
which will be named according to the name of the
storageClassDeviceSet. This will help in differentiate
pods immediately.

Signed-off-by: subhamkrai <subhamkumarrai03@gmail.com>
2020-09-11 07:26:40 +05:30
Travis Nielsen 6998d00740 Merge pull request #6229 from travisn/k8s-1.19-tests
ceph: Run integration tests on k8s 1.19 for PRs
2020-09-10 14:04:23 -06:00
Travis Nielsen a26b8217aa Merge pull request #6224 from travisn/cleanup-mon-canary-pvc
ceph: Cleanup mon canary pvc if the failover failed
2020-09-10 11:09:28 -06:00
Travis Nielsen df47f58c05 ceph: run integration tests on k8s 1.19 for PRs
In K8s 1.19 the integration tests are not running in PRs since no test suites
were assigned to 1.19. Similarly, the flex suite was not being run since 1.14
was removed from the test matrix in master.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-09-10 11:04:40 -06:00
Madhu Rajanna e864b8d42d ceph: add E2E testing for snapshot and clone
Added E2E testing to create,delete and restore
a snapshot, create a pvc-pvc clone, install
and uninstall snapshot controller and snapshot
CRD.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-09-10 22:05:15 +05:30
Travis Nielsen 7a6620f2c0 ceph: remove orphaned mon pvc after failed failover
If the mon failover fails, if the mon is on a pvc, the pvc could remain
orphaned. This is likely to happen if there is not a node available
for scheduling the mon. Therefore, the operator will ensure after a failover
that any orphaned mon pvc is cleaned up.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-09-10 10:21:33 -06:00
Travis Nielsen 2e36913dad ceph: set the pvc name label on mon deployments
When the mons are based on pvcs, the pvc_name label was not being set
as expected. Now the label will always be set on both the canary and
the daemon pods.

The mon pvcs were also never being deleted during canary cleanup. This
code is now removed since we must be very careful when the pvcs are
removed.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-09-09 16:08:07 -06:00
Travis Nielsen eee2151210 Merge pull request #6220 from xenolinux/osd-remove
ceph: update remove.go
2020-09-09 10:03:21 -06:00
Servesha Dudhgaonkar 2cf0518545 ceph: update remove.go
Call logger.Infof() instead of Debugf() in remove.go file.

Signed-off-by: Servesha Dudhgaonkar <sdudhgao@redhat.com>
2020-09-09 20:06:27 +05:30
Sébastien Han 1a4852d2cc Merge pull request #6218 from travisn/build-amd64-for-prs
ci: Only build amd64 for PRs
2020-09-09 09:05:08 +02:00
Travis NielsenandSébastien Han 40cfc9c70e ci: only build amd64 for PRs
The PRs only test against amd64 and have no need for the arm64
builds. This will save several minutes of build time.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
Co-authored-by: Sébastien Han <seb@redhat.com>
2020-09-08 16:18:39 -06:00
Travis Nielsen bea518a4c4 Merge pull request #6192 from cybozu-go/ceph-update-the-note-of-osd-on-lv-backed-pvc
ceph: update the note of OSD on LV-backed PVC
2020-09-08 14:32:15 -06:00
Sébastien Han 66aaebf5ea Merge pull request #6208 from subhamkrai/objectstore-monitoring
ceph: update cephobjectstore monitoring logic
2020-09-08 14:34:19 +02:00
Sébastien Han d5fb3822a9 Merge pull request #6204 from satoru-takeuchi/ci-update-readme
ceph: update readme
2020-09-08 09:26:16 +02:00
Satoru Takeuchi 15a159b1ff ci: fix how to run the integration test
If we try to run the integration test with `go test`, it fails as follows.

```
$ go test -v -timeout 1800s -run CephMultiClusterDeploySuite github.com/rook/rook/tests/integration
=== RUN   TestCephMultiClusterDeploySuite
2020-09-02 00:00:31.874738 I | installer: test environment variable (default) "STORAGE_PROVIDER_TESTS"=""
2020-09-02 00:00:31.950226 I | testutil: Loaded kubectl context kubernetes at https://192.168.123.2:6443. secure=false
2020-09-02 00:00:31.951121 I | integrationTest: running all tests
2020-09-02 00:00:32.027964 I | testutil: Loaded kubectl context kubernetes at https://192.168.123.2:6443. secure=false
2020-09-02 00:00:32.028640 I | installer: Rook Version: master
2020-09-02 00:00:32.028667 I | installer: Ceph Version: ceph/ceph:v14
2020-09-02 00:00:32.028686 I | installer: test environment variable "TEST_HELM_PATH"="/tmp/rook-tests-scripts-helm/linux-amd64/helm"
2020-09-02 00:00:32.031927 I | installer: test environment variable "TEST_SCRATCH_DEVICE"="/dev/sdb"
2020-09-02 00:00:32.031982 I | testutil: Running tests/scripts/localPathPV.sh [/dev/sdb]
    ceph_multi_cluster_test.go:161:
                Error Trace:    ceph_multi_cluster_test.go:161
                                                        ceph_multi_cluster_test.go:151
                                                        ceph_multi_cluster_test.go:81
                                                        suite.go:102
                                                        ceph_multi_cluster_test.go:62
                Error:          Received unexpected error:
                                fork/exec tests/scripts/localPathPV.sh: no such file or directory
                Test:           TestCephMultiClusterDeploySuite
--- FAIL: TestCephMultiClusterDeploySuite (0.16s)
FAIL
FAIL    github.com/rook/rook/tests/integration  0.211s
FAIL
$

```

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-09-08 15:03:05 +09:00
Satoru Takeuchi 8242011307 ci: add the descriptions of important environment variables
Some environment variables are mandatory to run the integration test.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-09-08 15:03:05 +09:00
Satoru Takeuchi 1b2ccf2b6c ci: remove unnecessary argument of kubeadm-install
The second argument of kubeadm-install.sh is not used.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-09-08 15:03:05 +09:00
Satoru Takeuchi a824c253ef ci: update the default Kubernetes version
Update the default Kubernetes version to v1.15.12 that is tested in CI.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-09-08 15:03:05 +09:00
subhamkrai 34d27d55d5 ceph: update cephobjectstore monitoring logic
currently, cephobjectstore monitoring is never
stopped for the following flow:
 1. objectstore is deleted
 2. go routine is stopped
 3. objectstore is created
 4. objectstore is deleted
so, removing clusterResourceDeleted flag and
working with the map only.

Signed-off-by: subhamkrai <subhamkumarrai03@gmail.com>
2020-09-03 15:58:48 +05:30
Sébastien Han bd69367216 Merge pull request #6205 from subhamkrai/update-object-test
ceph: update object prefixed manifests and related docs
2020-09-03 11:12:51 +02:00
Sébastien Han e532d58ece Merge pull request #6207 from varshar16/nfs-remove-nparts-cache-size
ceph: Remove NParts and Cache_Size from MDCACHE block
2020-09-03 10:23:32 +02:00
subhamkrai badf2887bb ceph: update object prefixed manifests and related docs
apply latest changes to prefixed manifests and
related docs.

Signed-off-by: subhamkrai <subhamkumarrai03@gmail.com>
2020-09-03 12:17:15 +05:30
Varsha Rao a0dab8faab ceph: remove NParts and Cache_Size from MDCACHE block
As setting them to small value affects the performance and they are not related
to metadata caching. https://review.gerrithub.io/c/ffilz/nfs-ganesha/+/495185

Signed-off-by: Varsha Rao <varao@redhat.com>
2020-09-02 16:41:15 +05:30
Sébastien Han d1e204278f Merge pull request #6197 from leseb/disable-mgr-master
ceph: disable ceph mgr test temporarily
2020-09-01 14:47:57 +02:00
Sébastien Han a11b12c760 Merge pull request #6127 from xenolinux/remove-replace-osd
ceph: purge a down osd with a job
2020-09-01 14:43:57 +02:00