Commit Graph
5771 Commits
Author SHA1 Message Date
Satoru Takeuchi e2e4afe26f Merge pull request #6471 from cybozu-go/ceph-the-number-of-admission-controller-pods
ceph: reduce the number of admission controller pods in small cluster
2020-10-22 05:51:07 +09:00
Alexander Trost 1320696c46 Merge pull request #6470 from cybozu-go/make-the-second-scratch-device-configurable
ci: remove an unnecessary code
2020-10-21 17:29:56 +02:00
Satoru Takeuchi 081c7c4dba ceph: reduce the number of admission controller pods in small cluster
The number of admission controller pods is 2. When there is only one
node as the CI environment, one of these becomes Pending state.
Although it's harmless, it's better to reduce this value to 1.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-10-21 11:47:08 +00:00
Satoru Takeuchi 9621671e5e ci: remove an unnecessary code
Remove a workaround code of old-Jenkins-file-is-used-in-CI problem.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-10-21 11:08:58 +00:00
Travis Nielsen 66636f5420 Merge pull request #6447 from MG40/docs
docs: Ceph disaster recovery
2020-10-20 16:33:03 -06:00
Alexander Trost 94eb052f28 Merge pull request #6462 from toabctl/use-get-helm-sh
helm: use get.helm.sh instead of storage.googleapis.com
2020-10-20 15:43:42 +02:00
Thomas Bechtold 7eae8086e4 ceph: use get.helm.sh instead of storage.googleapis.com
To be able to switch to helm v3, helm itself needs to be downloaded from
get.helm.sh. The old location from googleapis.com will only contain
helm v2 binaries. See [1].

[1] https://helm.sh/blog/get-helm-sh/

Signed-off-by: Thomas Bechtold <tbechtold@suse.com>
2020-10-20 14:47:09 +02:00
Sébastien Han dfb37dd0f7 Merge pull request #6461 from ZhenLiu94/liuzhen
build: fix error when building rook in centos7
2020-10-20 14:18:33 +02:00
ZhenLiu94 b83c8e9942 build: fix error when building rook in centos7
if I don't delete arg 'z' in 'tar -zxvf', compile process while return compilation fails in centos7.

Signed-off-by: ZhenLiu94 <zhenliu94@163.com>
2020-10-20 16:31:46 +08:00
Travis Nielsen 9b40f17ec4 Merge pull request #6328 from subhamkrai/test-gosec
ci: enable gosec linter in golangci-lint
2020-10-19 10:00:13 -06:00
Sébastien Han f223ae79bb Merge pull request #6444 from cybozu-go/ci-clarify-the-supported-vm-driver-of-minikube
ci: clarify the supported vm-driver of minikube scripts
2020-10-19 10:00:53 +02:00
Sébastien Han df9b560941 Merge pull request #6458 from umangachapagain/kube-dep-fix
fixing "requires" for kube-controller-manager
2020-10-19 09:25:33 +02:00
subhamkrai cb0ca66a6b ci: enable gosec linter in golangci-lint
golangci-lint linter gosec showing more errors
than gosec gh. This commit resolve
new errors. And, removing
nosec comments from autogenerated files.

Signed-off-by: subhamkrai <srai@redhat.com>
2020-10-19 11:50:06 +05:30
Umanga Chapagain 6bb76189ad build: fixes "requires" for kube-controller-manager
using v0.0.0 is causing issues with unknown version even
though the replace block uses correct version. So updating
requires block to match replaces block version.

Signed-off-by: Umanga Chapagain <chapagainumanga@gmail.com>
2020-10-19 11:24:41 +05:30
Alexander Trost 268329709e Merge pull request #6440 from prksu/update-rook-nfs-doc
nfs: update documentation and example
2020-10-18 01:33:28 +02:00
Travis Nielsen ff23835bd8 Merge pull request #6445 from cybozu-go/add-a-maintainer
ceph: add a maintainer
2020-10-16 09:14:11 -06:00
MG 1063c387f9 docs: ceph disaster recovery
updated by removing the paranthesis around the arguments  to pass the value
Eg: ROOK_CEPH_MON_INITIAL_MEMBERS

Signed-off-by: MG <gmadhavi@gmail.com>
2020-10-16 23:03:11 +08:00
Satoru Takeuchi 625f3ca4b4 ceph: add a maintainer
Add a new Ceph maintainer.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-10-15 22:59:01 +00:00
Satoru Takeuchi a188a80289 ci: clarify the supported vm-driver of minikube scripts
We can't use vm-drivers other than "docker" or "none" in minikube
scripts. It's because there is no device for OSD.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-10-15 20:11:31 +00:00
Travis Nielsen 662bde6d4a Merge pull request #6437 from cybozu-go/ceph-the-number-of-provisioner-pods
ceph: reduce the number of provisioner pods in small K8s cluster
2020-10-15 13:23:08 -06:00
Satoru Takeuchi e22bedbd9b ceph: reduce the number of provisioner pods in small K8s cluster
The default number of provisioner pods are 2. When there is only one node,
for example the CI environment, one of these becomes Pending state.
Although it's harmless, it's better to reduce this value to 1.

Closes: https://github.com/rook/rook/issues/6294

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-10-15 18:25:27 +00:00
Ahmad Nurus S c22189ba74 nfs: update documentation and example
Signed-off-by: Ahmad Nurus S <prksu.sh@gmail.com>
2020-10-16 01:11:44 +07:00
Sébastien Han 4181338c7a Merge pull request #5994 from tenzen-y/fix-basetestdir-function
ci: cleanup base directory code
2020-10-15 18:52:51 +02:00
tenzen-y 356f21569f ci: cleanup base directory code
Fix the following minor bugs.

- The wrong description of TEST_BASE_DIR environment variable.
- baseTestDir() don't handle error properly

Signed-off-by: tenzen-y <toyonomajyutushi@yahoo.co.jp>
Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-10-15 14:14:23 +00:00
Sébastien Han f0b2c6eacf Merge pull request #6184 from cybozu-go/ceph-raw-mode-on-lv-backed-pvc
ceph: raw mode OSD on LV-backed PVC
2020-10-15 09:46:56 +02:00
Sébastien Han 0dca391659 Merge pull request #5991 from guni1192/ci-fix-helm-path
ci: fix helm path
2020-10-15 09:45:52 +02:00
Takashi IIGUNI 27c7146526 ci: simplify helm path setting
Download the pre-defined helm by default to make the integration test simpler.
As a result, we can make PATH/TEST_HELM_PATH environment variable optional.
In addition, the default helm path can be simplified that doesn't include arch and os.

Signed-off-by: Takashi IIGUNI <iiguni.tks@gmail.com>
Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-10-15 10:09:00 +09:00
Daichi Sakaue b9f29349ed ceph: use raw mode instead of lvm mode even if lv-backed PVC
It can simplify OSD management in many ways and can avoid many problems
that come from LVM.

Closes: https://github.com/rook/rook/issues/5939
Signed-off-by: Yuji Ito <llamerada.jp@gmail.com>
Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-10-14 01:46:25 +00:00
Sébastien Han 4736ddcc87 Merge pull request #6379 from leseb/fix-5591
ceph: add support for stretched cluster crush rule
2020-10-13 17:40:01 +02:00
Sébastien Han 86bcfa744b Merge pull request #6213 from leseb/gh-action-minikube
ci: add integration test for external python script
2020-10-13 16:55:33 +02:00
Sébastien Han 7afa0e125c Merge pull request #6362 from travisn/stretch-cluster-design
ceph: Design doc for stretch clusters
2020-10-13 16:51:34 +02:00
Sébastien Han b70b098405 ceph: add support for stretched cluster crush rule
The pool spec has now a new property called "replicasPerFailureDomain"
which essentially represents the number of replicas to store in each
failure domain.
Assuming the failure domain is a datacenter (if the cluster is
stretched) then you will have 2 replicas per datacenter where each
replica ends up on a different host. This gives you a total of 4
replicas and for this, the "size" must be set to 4.

Closes: https://github.com/rook/rook/issues/5591
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-10-13 16:33:34 +02:00
Sébastien Han bf9eb38f2a ci: add integration test for external python script
The CI runs a github action that builds and deploys a Rook cluster and
then execute various tests on the create-external-cluster-resources.py
script.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-10-13 16:31:59 +02:00
Sébastien Han 6c73493f8a Merge pull request #6420 from travisn/disallow-two-mons
ceph: Require an odd number of mons and sufficient nodes for mons
2020-10-13 16:10:19 +02:00
Travis Nielsen fe602e0902 Merge pull request #6426 from leseb/add-cv-log-to-non-pvc
ceph: add ceph-volume log to non-pvc scenario
2020-10-13 07:48:47 -06:00
Travis Nielsen 23e4b755b4 ceph: design doc for stretch clusters
Design document to support stretch clusters with an arbiter mon
based on the new design for stretch clusters in Ceph.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-10-12 15:33:33 -06:00
Travis Nielsen a4b1ca3faa docs: clarify cluster-on-pvc scenario for ceph
A frequently asked question is how to configure the cluster in dynamic
environments, or basically to use the cluster-on-pvc configuration.
This adds more details to the examples in the docs.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-10-12 15:21:28 -06:00
Travis Nielsen c7e0338d5e ceph: require an odd number of mons and sufficient nodes
The ceph mons should never be started with an even number in quorum.
The desired state should always be an odd number of mons to ensure
a healthy majority quorum. The operator now rejects a request for
an even number of mons.

If there are not a sufficient number of nodes for mons to be on a
unique host, the operator also returns an early error instead of
getting stuck waiting for a pending mon. This is not foolproof since
there might be fewer available nodes for the mons, but at least it
is a quick check for the common case.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-10-12 15:21:27 -06:00
Travis Nielsen ede7808960 Merge pull request #6421 from cybozu-go/ci-update-k8s-version-for-stability
ci: update K8s version for stability
2020-10-12 08:03:59 -06:00
Sébastien Han 8da0a146c9 Merge pull request #6427 from toabctl/ceph-watcher-debug-message-improvements
ceph: Improve watcher debug message when node is not tolerable
2020-10-12 15:52:54 +02:00
Thomas Bechtold ede4b9cb1a ceph: improve watcher debug message when node is not tolerable
When a node is not tolerable, also output the node name so it's clear
which not it is which is not tolerable.

Signed-off-by: Thomas Bechtold <tbechtold@suse.com>
2020-10-12 14:19:17 +02:00
Sébastien Han b623133fb6 ceph: add ceph-volume log to non-pvc scenario
When deploying on non-PVC, we still need to gather c-v logs on failures.
Now if the bootstrap fails, the c-v log will be printed.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-10-12 14:10:17 +02:00
Sébastien Han 010a2804f6 Merge pull request #6392 from aruniiird/add-upgrade-option-to-external-script
ceph: adding '--upgrade' option to external script
2020-10-12 09:55:15 +02:00
Sébastien Han 0b253ef7f9 Merge pull request #6416 from cybozu-go/ci-ceph-fix-readme
ci: ceph fix tests/README.md
2020-10-12 09:13:38 +02:00
Satoru Takeuchi d8211135ea ci: update K8s version for stability
K8s v1.16.13 is used in CI. In this version, there is a serious bug
which causes a continuous restart of both kube-scheduler
and kube-controller-manager. It results in the instability of CI.

This bug is fixed in v1.16.14 or later by the following PR.
https://github.com/kubernetes/kubernetes/pull/93208

Both 6415 and 6390, which only happen in v1.16.13, would be
caused by this issue.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-10-11 02:46:56 +00:00
Satoru Takeuchi 90c03c814a ci: fix tests/README to use proper test command
In local environment, We should use `go test` than the test binary
under "_output/".

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-10-09 22:20:09 +00:00
Travis Nielsen e229a4f12e Merge pull request #6418 from travisn/doc-clarifications
docs: Clarifications for the readme and other documentation
2020-10-09 14:11:29 -06:00
Travis Nielsen 2f86051b1c docs: remove obsolete reference to v1alpha2 in design doc
The storageClassDeviceSets unnecessarily references the obsolete v1alpha2
version.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-10-09 12:53:45 -06:00
Travis Nielsen c1d553c318 docs: move ceph common issues subtopics under ceph tools
The ceph tools were split across different areas of the table of contents
that was confusing. Now the Ceph tools and troubleshooting guides are all
found under the Ceph tools.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-10-09 12:40:50 -06:00
Travis Nielsen 13da75a1db docs: clarify that the flex driver is disabled by default
The ceph flex driver has been disabled by default for some time.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-10-09 12:24:20 -06:00