Commit Graph
7961 Commits
Author SHA1 Message Date
Alexander Trost 2b0c088572 Merge pull request #2763 from galexrt/feature_1504
tests/scripts: Added basic k8s-vagrant-multi-node wrapper script
2019-03-18 15:54:04 +01:00
Alexander Trost 64a9308d07 tests/scripts: Added basic k8s-vagrant-multi-node wrapper script
This adds a basic wrapper script around k8s-vagrant-multi-node project.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2019-03-18 15:30:31 +01:00
Noah Watkins 7afe9d4b58 ceph: consolidate ceph version handling
Add a new package for parsing and interacting with ceph version
information. Previously ceph versions were limited to the release name,
and this patch supports ceph versions parts X.Y.Z for more fine grained
behavior.

The main structure introduced here in CephVersion which contains the
version parts. This will be used in the next patch to replace the Name
string component of the cluster CRD spec which was populated at runtime.

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2019-03-17 15:33:44 -07:00
Travis Nielsen cbbfd6ee37 Merge pull request #2832 from sabbot/fix-2807
Edgefs,Issue 2807: Remove glog from edgefs rook operator
2019-03-15 14:06:36 -06:00
Travis Nielsen 935a6ec77b Merge pull request #2804 from SUSE/rbdmirror-updateandwait
Ceph rbd-mirror: use updateAndWait for daemons
2019-03-15 13:22:22 -06:00
Alexander Trostandnull 49f9a11cd4 Merge pull request #2813 from dyusupov/master
support for configurable rtlfs backend

Co-authored-by: null <dmitry.yusupov@nexenta.com>
2019-03-15 20:11:16 +01:00
Travis Nielsen 511cc6c365 Merge pull request #2764 from leseb/ceph-process-tuning
Ceph memory process tuning
2019-03-15 12:18:33 -06:00
Anton Skriptsov 3e5749c18f Remove glog from edgefs rook operator
Signed-off-by: Anton Skriptsov <sabbotagge@gmail.com>
2019-03-15 10:22:53 -07:00
Dmitry Yusupov 213e440923 support for configurable rtlfs backend
Signed-off-by: Dmitry Yusupov <dmitry.yusupov@nexenta.com>
2019-03-15 10:14:44 -07:00
Sébastien Han 871054e887 ceph: implement pod restriction on memory
If someone sets limits to pod, we want to ensure the possible
experience, so we want to make sure that people do not configure
inapropriate values for certain daemons.
We decide to fail if the memory.limit is too low.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-03-15 17:35:44 +01:00
Travis Nielsen b3217173bf Merge pull request #2829 from noahdesu/dashboard-retry
retry dashboard operations
2019-03-15 07:59:32 -06:00
Sébastien Han b7fd64074c ceph: osd spec: tune osd memory target
If the spec of the OSD daemon contains resource limits, especially
memory.limit we will use that value for setting the osd memory target
value so the bluestore OSD knows the amount of memory available for its
cache.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-03-15 11:45:29 +01:00
Sébastien Han 004e2e95c3 ceph: mds spec: tune mds cache memory limit
If the spec of the MDS daemon contains resource limits, especially
memory.limit we will use that value for setting the mds cache memory
limit value so the MDS knows the amount of memory available.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-03-15 11:45:29 +01:00
Sébastien Han fa61c0441b ceph: pod: expose resource limits and requests
We now expose resource as environment variable in the pod.
They will be used by Ceph to report as a daemon metadata.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-03-15 11:45:29 +01:00
Noah Watkins 1ee7cdfa8b ceph: refactor dashboard retry logic to use helper
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2019-03-14 14:52:44 -07:00
Noah Watkins 8ebf9ac722 ceph: retry dashboard credentials setup
may need retry if manager hasn't fully loaded its modules.

fixes: #2809

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2019-03-14 14:51:50 -07:00
Noah Watkins 5c9bb7d9d7 ceph: add helper to execute cmd with retries
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2019-03-14 14:50:54 -07:00
Travis Nielsen b4c90b651f Merge pull request #2780 from travisn/crd-triggers-orchestration
Trigger an orchestration on any crd update
2019-03-14 15:35:17 -06:00
Alexander Trost 4816c15d08 Merge pull request #2767 from sabbot/master
EdgeFS CSI for Block interface CRDs, dockumentation and examples
2019-03-14 22:29:13 +01:00
Travis Nielsen 6d3f7ab633 Merge pull request #2823 from nakabonne/cockroach-installation
Add 'if not exists' to the command that creates a test database/table
2019-03-14 13:19:29 -06:00
Alexander Trost 99c71ab03a Merge pull request #2819 from galexrt/go_1_12
Added Golang v1.12 to supported versions
2019-03-14 20:19:14 +01:00
travisn 3548418774 print the diff for changes to the cluster crd
Signed-off-by: travisn <tnielsen@redhat.com>
2019-03-14 13:10:52 -06:00
travisn c1628141aa minimize args to mon creation in the operator
Only the args necessary have traditionally been passed to the mon package.
This has led to many properties in the mon struct, whereas we will
now simply pass the cluster crd spec to simplify.

Signed-off-by: travisn <tnielsen@redhat.com>
2019-03-14 13:10:52 -06:00
travisn 2fd1f7345d Trigger an orchestration on any crd update and only allow a single orchestration of mons at a time
The orchestrations need to be triggered on any update to the crd.
Users today restart the operator for various scenarios when the
operator could take care of it automatically. If unsupported options
are updated, they should just be ignored.

There are two goroutines that are working with the mons.
The first is an orchestration that is triggered by the operator
at startup, or when the cluster crd is updated. The second
is the health check that triggers periodically by default every
45 seconds. These goroutines must not try to make updates at the
same time. A mutex is added so one will block if the other is
still active. The mutex is only active for the duration of working
with mons, and not an entire orchestration of mgr, osd, etc

Signed-off-by: travisn <tnielsen@redhat.com>
2019-03-14 13:10:12 -06:00
Travis Nielsen a05ce45280 Merge pull request #2693 from SUSE/SH_#2208
#2208 OSDs not automatically started when adding nodes to existing cluster
2019-03-14 13:01:29 -06:00
Stefan Haas 1f1dbc7461 issue #2208 OSDs not automatically started when adding nodes to existing cluster
Signed-off-by: Stefan Haas <shaas@suse.com>
2019-03-14 18:54:40 +01:00
Travis Nielsen 066e65a5db Merge pull request #2815 from travisn/retry-file-mount-test
Retry the file mount integration test for stability
2019-03-14 10:37:35 -06:00
Alexander Trost ea1956c2d3 Merge pull request #2761 from marklester/kubespray-update
docs: add kubespray instructions to flexvolume doc
2019-03-14 14:42:50 +01:00
Ryo Nakao e7fd7ac47e Add 'if not exists' to the command that creates a test database/table
Signed-off-by: Ryo Nakao <nakabonne@gmail.com>
2019-03-14 17:55:39 +09:00
Alexander Trost a33503493b Added Golang v1.12 to supported versions
Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2019-03-14 09:45:45 +01:00
Anton Skriptsov 8049de452b EdgeFS CSI for Block interface CRDs, dockumentation and examples
Signed-off-by: Anton Skriptsov <anton.skriptsov@nexenta.com>
2019-03-13 14:40:06 -07:00
Mark 44a5f1392b docs: add kubespray instructions to flexvolume doc
updated page to include information about how the flexvolume path is setup in kubespray

Signed-off-by: Mark <mlester@gmail.com>

update docs with suggested pr changes

made recommended change to link text
made kubespray section more clear
added link to where kubespray sets the dir
changed links to k8s docs to the moved location

Signed-off-by: Mark <mlester@gmail.com>
2019-03-13 16:36:53 -04:00
Alexander Trost 6140661766 Merge pull request #2817 from jarrpa/ceph-job-placement
Allow Ceph detect version Job to accept placement
2019-03-13 20:28:51 +01:00
Blaine Gardner 6f22781961 ceph rbd-mirror: update deployment if exists
Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2019-03-13 12:43:46 -06:00
Travis Nielsen 73c24ddf72 Merge pull request #2789 from SUSE/rbdmirror-all-in-operator
ceph rbd-mirror: configure entirely in operator
2019-03-13 12:02:10 -06:00
Jose A. Rivera a211a3cd26 Allow Ceph detect version Job to accept placement
Signed-off-by: Jose A. Rivera <jarrpa@redhat.com>
2019-03-13 11:18:17 -05:00
Blaine Gardner c12aa6c7c5 ceph rbd-mirror: configure entirely in operator
In the form of mon, mgr, mds, and rgw, convert the rbd-mirror to be
configured completely from the operator. This is a straightforward
conversion with one functional addition: the rbd-mirror daemon stores
*no* data and has no default data dir, so the concept of a `Dataless`
daemon is here introduced.

Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2019-03-13 09:54:09 -06:00
travisn eece96eea4 tests: retry the file mount integration test for stability
Signed-off-by: travisn <tnielsen@redhat.com>
2019-03-12 17:30:06 -06:00
Travis Nielsen fb4fa464e1 Merge pull request #2726 from Madhu-1/cephfs-csi
Add cephfs csi doc
2019-03-12 14:02:10 -07:00
Travis Nielsen 28d9f9a9f3 Merge pull request #2802 from ajarr/fix-2725
ceph filesystem: don't use `mds deactivate` mimic onwards
2019-03-12 12:03:24 -07:00
Travis Nielsen 09d7f75a25 Merge pull request #2793 from ZYecho/add-logs
test: add ci logs when build is successful
2019-03-12 12:02:43 -07:00
Travis Nielsen 63e9e65815 Merge pull request #2803 from SUSE/typo
Ceph file/mds: fix typo: mgr -> mds
2019-03-12 11:23:11 -07:00
Travis Nielsen c58e82df61 Merge pull request #2799 from JoeWrightss/patch-3
Fix typo in config.go
2019-03-12 08:37:29 -07:00
Ramana Raja 828d2dd366 ceph filesystem: don't use mds deactivate from mimic onwards
From ceph mimic (13.x) onwards, `mds deactivate` command is
deprecated. To scale down the number of active MDSes of a filesystem,
it's sufficient to set the desired number of active MDSes using
'max_mds' setting, and is no longer required to individually
deactivate the unwanted MDSes.

Resolves: #2725
Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-03-12 15:04:11 +05:30
Alexander Trost 5a055ec6f3 Merge pull request #2798 from dimm0/patch-1
Added PSP RBAC for rook-edgefs-cluster SA
2019-03-12 09:37:35 +01:00
Dmitry Mishin 0aa1d788ef Added PSP RBAC for rook-edgefs-cluster SA
Fixes https://github.com/rook/rook/issues/2795

Signed-off-by: Dmitry Mishin <dmitry.mishin@gmail.com>
2019-03-11 21:57:37 -07:00
Blaine Gardner 64d8b6d66b Ceph file/mds: fix typo: mgr -> mds
Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2019-03-11 09:46:52 -06:00
zhoulin xie 7f8d3a35c5 Fix typo in config.go
Signed-off-by: zhoulin xie <zhoulin.xie@daocloud.io>
2019-03-10 20:32:04 +08:00
zhangyue 1859096041 test: add ci logs when build is successful
Signed-off-by: zhangyue <zy675793960@yeah.net>
2019-03-10 12:18:23 +08:00
Alexander Trost 70196e5f5f Merge pull request #2786 from nakabonne/add-wget
Add wget to required tool list
2019-03-09 12:19:52 +01:00