Commit Graph
1341 Commits
Author SHA1 Message Date
Noah Watkins 379cb98689 ceph: replace release name with fine-grained version
The basic idea here is to replace the release name in the ClusterInfo
object with the fine grained version information queried at runtime.
This patch also removes the Name field from the cluster spec, which was
also runtime determined and was redundant with ClusterInfo relase name.

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2019-03-18 12:57:29 -07:00
Alexander Trost 64a9308d07 tests/scripts: Added basic k8s-vagrant-multi-node wrapper script
This adds a basic wrapper script around k8s-vagrant-multi-node project.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2019-03-18 15:30:31 +01:00
Travis Nielsen 6d3f7ab633 Merge pull request #2823 from nakabonne/cockroach-installation
Add 'if not exists' to the command that creates a test database/table
2019-03-14 13:19:29 -06:00
Ryo Nakao e7fd7ac47e Add 'if not exists' to the command that creates a test database/table
Signed-off-by: Ryo Nakao <nakabonne@gmail.com>
2019-03-14 17:55:39 +09:00
travisn eece96eea4 tests: retry the file mount integration test for stability
Signed-off-by: travisn <tnielsen@redhat.com>
2019-03-12 17:30:06 -06:00
zhangyue 1859096041 test: add ci logs when build is successful
Signed-off-by: zhangyue <zy675793960@yeah.net>
2019-03-10 12:18:23 +08:00
Alexander Trost 70196e5f5f Merge pull request #2786 from nakabonne/add-wget
Add wget to required tool list
2019-03-09 12:19:52 +01:00
Jared Watts cb3ada9795 Merge pull request #2752 from ZYecho/add-rbac
cockroachdb: add minimal rbac access for cockroachdb pod
2019-03-07 20:21:56 -08:00
Ryo Nakao 64de987cde Add wget to required tool list
Signed-off-by: Ryo Nakao <nakabonne@gmail.com>
2019-03-08 12:59:32 +09:00
Travis Nielsen 4dfdf2f022 Merge pull request #2310 from SUSE/ceph-add-extra-integration-test-logging
Ceph integration tests: add more verbose logging
2019-03-07 14:40:37 -07:00
Blaine Gardner 086fa8231c rgw: configure entirely in operator
Configure the Ceph rgw daemon completely from the operator a la the
recent changes to the Ceph mon, mgr, and mds operators.

Create the rgw deployment or daemonset first, and then create the
keyring secret for the object store with its owner reference as the
corresponding deployment or daemonset. When the replication controller
is deleted, the secret is also deleted.

The RGW's mime.types file is now stored in a configmap with a different
file created for each object store. This is primarily just a means to
get the mime.types file into the rgw pod, but the added benefit is that
the administrator can modify the configmap, which could reduce
susceptibility to file type execution vulnerabilities (worst case).

Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2019-03-07 08:02:42 -07:00
Blaine Gardner 51cc7c2e85 Ceph integration tests: add more verbose logging
Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2019-03-05 14:14:09 -07:00
zhangyue baf27bdd8e cockroachdb: modify cockroachdb operator rbac access
Signed-off-by: zhangyue <zy675793960@yeah.net>
2019-03-05 14:16:10 +08:00
Travis Nielsen a145f4dcb7 Merge pull request #2703 from travisn/osds-per-device-with-filter
Clean up provisioning of OSDs on devices
2019-03-04 07:58:56 -07:00
travisn b24ebc8168 tests: remove unnecessary string returns from kubectl calls
Various kubectl helper methods return strings from calls to
create, delete, or apply resources. There is no need for this.
It is sufficient and complete to check the err from these calls to determine failure.

Signed-off-by: travisn <tnielsen@redhat.com>
2019-03-01 16:16:41 -07:00
travisn 6ca573bb34 tests: remove unreliable substring checking
The integration tests check for the return of substrings from calls to kubectl
in a number of places. On occasion these return something slightly different
and cause an unnecessary failure in the integration tests.

Signed-off-by: travisn <tnielsen@redhat.com>
2019-03-01 16:16:41 -07:00
zhangyue 87b4f45fd9 test: add nfs with multi export integration test
Signed-off-by: zhangyue <zy675793960@yeah.net>
2019-02-28 09:02:52 +08:00
travisn bdc3cf8146 osd: fix the device filter and improve device provisioning reliability
All devices detected by the discovery pod were being passed to the OSD provisioning pod
thus not always honoring the desired device list that should be provisioned.
Now the provisioning pod will be given the desired state from the crd,
then apply that state depending on the actual devices detected.
Also added a helper to ensure OSDsPerDevice is always valid.

Signed-off-by: travisn <tnielsen@redhat.com>
2019-02-26 16:11:25 -07:00
Jeff Layton a5252dccee ceph: fix up RBAC permissions
I had some trouble with RBAC under minikube when testing some
ceph-mgr functionality. This patch tweaks rook-ceph-mgr-system to
be a ClusterRole, and rook-ceph-mgr-cluster to use a
ClusterRoleBinding.

While we're in there, remove the namespace fields from the
ClusterRoleBindings since they just get ignored.

Finally, also fix up the upgrade test to remove the objects that have
changed and reinstantiate them properly.

Suggested-by: Travis Nielsen <tnielsen@redhat.com>
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-02-22 06:30:49 -05:00
travisn ecf8d890c1 convert remaining extensions to apps api
Signed-off-by: travisn <tnielsen@redhat.com>
2019-02-14 16:48:12 -07:00
Huamin Chen 1b21e42a90 convert extensions to apps
Signed-off-by: Huamin Chen <hchen@redhat.com>
2019-02-14 16:06:05 -05:00
Huamin Chen 3806baffe1 add ceph csi deploy options
Signed-off-by: Huamin Chen <hchen@redhat.com>
2019-02-12 21:20:41 -05:00
Travis Nielsen 8a2001c3d7 Merge pull request #2522 from travisn/reference-k8s-provisioner
Reference the k8s provisioner instead of the outdated in-tree provisioner
2019-02-07 19:39:32 -07:00
Blaine Gardner 78d4719125 ceph: no longer create fallback osd
Rook's behavior should not be to create a default OSD in dataDirHostPath
when no devices are present on a node. Any preexisting fallback osd
should be kept as long as no dirs or disks have been specified to keep
the legacy behavior for those clusters running with these osds in place.
The legacy deletion behavior is also kept, removing the osd as soon as
any dir or device is specified other than the dataDirHostPath dir.

Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2019-02-01 09:41:32 -07:00
Christopher P. Maher 19d953d51f Changing timeout for dpkg unlock for Ubuntu GCE CI/CD systems
Signed-off-by: Christopher P. Maher <chris@mahercode.io>
2019-01-23 22:11:46 -08:00
travisn c9d3d1bf17 reference the k8s pvc provisioner and remove outdated in-tree provisioner
Signed-off-by: travisn <tnielsen@redhat.com>
2019-01-19 07:48:00 -07:00
travisn feb33de24b tests: upgrade test is from v0.9 instead of v0.8
Signed-off-by: travisn <tnielsen@redhat.com>
2019-01-14 23:06:19 -07:00
Travis Nielsen 2a6d89ff78 Merge pull request #2381 from travisn/add-remove-k8s-tests
Remove 1.8 and 1.9 and add 1.13 to integration tests
2018-12-20 09:38:19 -07:00
travisn 0230400e27 build: remove 1.8 and 1.9 and add 1.13 to integration tests
Signed-off-by: travisn <tnielsen@redhat.com>
2018-12-19 23:42:01 -07:00
Jared Watts d1414e92a1 Merge pull request #2389 from farhaanbukhsh/grammar-fix
Fix the typo in helm.sh
2018-12-17 16:53:18 -08:00
Earl C. Ruby III 3b727d8c98 Fix the test function that deletes the replicapool
The command `kubectl delete -n rook-ceph pool replicapool` used to
work, but currently returns the error `error: the server doesn't
have a resource type "pool"`. The actual resource type is
`cephblockpools`. The resource type `cluster` was also recently
changed to `cephcluster`.

Since the function commands end with `|| true`, the errors are
silently masked and the resources are not deleted.

This PR adds delete commands for `cephblockpools` and `cephcluster`,
so that regardless of whether you're testing old or new versions
of Rook the delete commands will work.

Signed-off-by: Earl C. Ruby III <earlruby@users.noreply.github.com>
2018-12-17 15:38:25 -08:00
Farhaan Bukhsh f77fc727ca Fix the typo in helm.sh
Signed-off-by: Farhaan Bukhsh <farhaan.bukhsh@gmail.com>
2018-12-16 22:09:00 +05:30
Travis Nielsen f6bcdfa687 Merge pull request #2346 from travisn/mgr-configmap-access
Grant access for ceph-mgr to access the configmaps in the system namespace
2018-12-07 16:51:02 -07:00
Alexander Trost 6dc508b704 Merge pull request #2318 from galexrt/minio_arbitary_pvcs
Cockroachdb + Minio: Use PersistentVolumeClaimTemplates storage
2018-12-08 00:20:07 +01:00
travisn ff3f73d73c mgr: grant access to the configmaps to read devices in the system namespace
Signed-off-by: travisn <tnielsen@redhat.com>
2018-12-07 14:10:35 -07:00
Sebastian Wagner 71c0328b09 Ceph CRDs: Add additionalPrinterColumns to enhance command line output
Like so:
```
$ kubectl get cluster.ceph.rook.io
NAME        DATADIRHOSTPATH   MONCOUNT   AGE
rook-ceph   /var/lib/rook     1          4h
```

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-12-07 10:58:43 -07:00
Alexander Trost 5fc8584422 Cockroachdb + Minio: Use PersistentVolumeClaimTemplates storage
selection field.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2018-12-07 12:20:49 +01:00
travisn 9660f49624 ceph: remove crd short names to avoid conflict with beta crds
Signed-off-by: travisn <tnielsen@redhat.com>
2018-12-05 16:23:55 -07:00
travisn a29b876337 rename ceph v1 crds with the ceph prefix
Signed-off-by: travisn <tnielsen@redhat.com>
2018-12-05 16:23:55 -07:00
travisn 62f7e5d6ea ceph: update docs, code, and tests to use v1 crd types
Signed-off-by: travisn <tnielsen@redhat.com>
2018-12-05 14:33:11 -07:00
Yannis Zarkadas b23d874856 cassandra: integration tests and scripts
Simple integration test for Cassandra.
Boilerplate in setup scripts for Jenkins.

Signed-off-by: Yannis Zarkadas <yanniszarkadas@gmail.com>
2018-12-05 12:50:09 +02:00
Alexander Trost ac19f85fbb Allow specifying custom Ceph user and secret name for mounting
Introduce mount security mode for basic multi tenancy

Fixes #2164.

This adds three new parameters/options to StorageClass/flexvolume entry:
* `mountUser`
* `mountSecret`
* `mountSecretNamespace`

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2018-12-04 20:17:15 +01:00
travisn fed0d9022a tests: add new mgr and osd service accounts and related resources to upgrade
Signed-off-by: travisn <tnielsen@redhat.com>
2018-11-30 13:39:59 -07:00
travisn ea03f58048 rbac: rename service account rook-ceph-cluster to rook-ceph-osd
Signed-off-by: travisn <tnielsen@redhat.com>
2018-11-30 13:39:58 -07:00
travisn 16c2a56591 add ceph mgr roles to the tests and helm chart
Signed-off-by: travisn <tnielsen@redhat.com>
2018-11-30 13:39:58 -07:00
Travis Nielsen 9654e51db1 Merge pull request #2290 from travisn/rbd-mirror
Enable rbd mirror daemon in the cluster crd
2018-11-30 08:54:40 -07:00
travisn 40ad6c7ac7 tests: upgrade needs to add log access to cluster role
Signed-off-by: travisn <tnielsen@redhat.com>
2018-11-29 12:12:53 -07:00
travisn fdd64bb95a enable rbd mirror daemon in the cluster crd
Signed-off-by: travisn <tnielsen@redhat.com>
2018-11-28 08:29:57 -07:00
Alexander Trost f46efa452c Merge pull request #2282 from galexrt/pera_fix
Use truncated node name for missed sections
2018-11-27 16:30:21 +01:00
Alexander Trost 5325d4dcec Use a very long testprefix for nodes
Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2018-11-23 10:13:53 +01:00