Commit Graph
5872 Commits
Author SHA1 Message Date
Mike Latimer afd6c421bb docs: link to master branch for ceph-csi-snapshot
Due to upstream code motion, the current link to the upstream
ceph-csi-snapshot documentation no longer points to the correct
location of their CRDs. Fix this by just using the master branch.

Signed-off-by: Mike Latimer <mlatimer@suse.com>
2020-11-10 15:10:54 -07:00
Sébastien Han 969225c0c2 Merge pull request #6483 from cybozu-go/ceph-make-the-placement-of-admission-controller-configurable
ceph: make the placement of admission controller configurable
2020-11-09 14:32:02 +01:00
Satoru Takeuchi c7990777d2 ceph: make the placement of admission controller configurable
If users want to restrict the nodes where Ceph daemons should exist,
it's better to make the placement of admission controller configurable
as other daemons.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-11-09 11:54:52 +00:00
Sébastien Han b72382f51e Merge pull request #6576 from terorie/patch-1
docs: better Ceph toolbox kubectl commands
2020-11-09 10:20:27 +01:00
Richard Patel 865c3b263e docs: better Ceph toolbox kubectl commands
Signed-off-by: Richard Patel <me@terorie.dev>
2020-11-08 03:38:48 +01:00
Travis Nielsen 6f13dd6559 Merge pull request #6574 from travisn/build-fixes-from-1.5
Integration test fixes for release branch to preserve in master
2020-11-06 12:58:30 -07:00
Satoru Takeuchi aa85577ff3 Merge pull request #6567 from gseidel/precise-three-nodes
docs: precise three nodes
2020-11-07 04:32:43 +09:00
Travis Nielsen f1287bdb19 ceph: skip csi tests on k8s 1.13
The csi tests require 1.14 or newer to run

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-11-06 11:16:32 -07:00
Travis Nielsen c029b1513d ceph: remove nullable attribute from pre-1.16 schema
The nullable attribute was causing the integration tests to fail
on 1.13 and earlier where it is not supported in the schema.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
(cherry picked from commit cc8f406ce9)
2020-11-06 10:47:26 -07:00
Travis Nielsen 556de488c0 nfs: skip running tests on older than k8s 1.14
NFS tests are not supported on older than K8s 1.14.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
(cherry picked from commit 4adc54e6f1)
2020-11-06 10:47:26 -07:00
Travis Nielsen cf9fdb683f Merge pull request #6564 from invidian/codespell-pipeline
ci: .github/workflows: add codespell pipeline
2020-11-06 09:25:21 -07:00
Gerhard Seidel 042e10bcf6 docs: precise three nodes
When following the quick start, it may not work, because the user don't know that he need three nodes. And three nodes may also not be correct, because the control plane is also a node. So we should precise what the user need to run his cluster correctly.

Closes: https://github.com/rook/rook/issues/6540
Signed-off-by: Gerhard Seidel <gseidel.message@googlemail.com>
2020-11-06 16:22:59 +01:00
Sébastien Han e3d032dbc1 Merge pull request #6489 from travisn/stretch-mons
ceph: Stretch cluster configuration
2020-11-06 15:16:39 +01:00
Sébastien Han f938447398 Merge pull request #6562 from leseb/mergify-1.5
bot: update mergify to release 1.5 branch
2020-11-06 15:16:17 +01:00
Travis Nielsen 67ce7e4c3b Merge pull request #6561 from Madhu-1/cephfs-priv-pod
ceph: add privileged securityContext to cephfs deployment
2020-11-06 07:13:33 -07:00
Mateusz Gozdek 8912e491d8 ci: .github/workflows: add codespell pipeline
As a follow up to #6563 which fixed all the typos found in the
repository, to avoid adding more obvious typos.

Signed-off-by: Mateusz Gozdek <mgozdekof@gmail.com>
2020-11-06 12:43:29 +01:00
Satoru Takeuchi afcfe40b5e Merge pull request #6563 from invidian/typos
docs: fix bunch of typos
2020-11-06 18:57:45 +09:00
Mateusz Gozdek 8ba3762fa4 docs: fix bunch of typos
Found by running the following command:

codespell -S .git,*.png,*.jpg -L \
aks,keyserver,atleast,dne,ser,ist,files\',ba,dum,iam,te -f -H

Signed-off-by: Mateusz Gozdek <mgozdekof@gmail.com>
2020-11-06 10:01:04 +01:00
Sébastien Han 1b45127056 bot: mergify add release 1.5
Update mergify to auto backport PR with label on release 1.5 branch and
auto merge.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-11-06 08:58:46 +01:00
Sébastien Han 896d721737 bot: mergify remove release-1.2 actions
1.2 is getting old and automatic backport will likely fail anyways.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-11-06 08:54:50 +01:00
Madhu Rajanna 8f5196a559 ceph: add privileged securityContext to cephfs deployment
cephfs csi driver still uses the ceph CLI for all the
ceph fs operations, when cephcsi gets a request from
the kubernetes it will internally starts threads for
each call. in cephcsi we are setting the pids
limit to max, to set this value the container has
to be running as the privileged one.

if we go with default pid limit we will face core dump
due to resource crunch.

without privileged access we will see Failed to set new
PID limit to -1: open /sys/fs/cgroup/pids/kubepods.slice/
kubepods-besteffort.slice/kubepods-besteffort-pod1029ed37_bebc_466d_9e53_79e7323a67ed.slice/crio-9ef6768d027916f414bf30b54ef13eebad8efd0aa4741d97618affa838d7b4c0.scope/pids.max: permission denied

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-11-06 09:40:18 +05:30
Travis Nielsen 372b74b4d7 Merge pull request #6558 from travisn/latest-octopus
ceph: Update base image and examples to v15.2.5
v1.5.0-alpha.0
2020-11-05 16:40:53 -07:00
Travis Nielsen a5b9fbc994 ceph: update base image and examples to v15.2.5
For the v1.5 release we use the latest version of ceph by default,
which is now v15.2.5

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-11-05 15:50:23 -07:00
Travis Nielsen 6e2679cbff Merge pull request #6545 from leseb/fix-6532
ceph: add unit test for ceph-volume batch mode and warn about unsupported ceph version
2020-11-05 11:42:01 -07:00
Sébastien Han 64fe9f7685 ceph: introduced unsupported releases
These are a collection of unstable ceph release that are not recommended
for production. It is recommended to rollback to the previous or
  upgrading to the next one if possible.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-11-05 18:35:57 +01:00
Sébastien Han 8631eef1f7 ceph: correctly populate variable
The wrong variable was referenced in the print.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-11-05 18:06:47 +01:00
Sébastien Han bc5c8d32f1 ceph: fix crush-class osd on non-PVC
We need to use storeConfig instead device config as the later never
seems to be populated.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-11-05 18:06:47 +01:00
Sébastien Han 6b211eacba ceph: add unit test for osd batch mode
We now have much better coverage on the c-v on non-pvc scenario.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-11-05 18:06:11 +01:00
Travis Nielsen 7c3cdbce50 ceph: use constants for k8s topology labels
Instead of directly defining our own constants, we should be using the k8s
constants for the well-known topology labels.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-11-05 09:23:58 -07:00
Travis Nielsen e72b69f8e0 ceph: validate pools for stretch clusters
Pools in stretch clusters will all use the same crush rule that
is generated by the operator when configuring the cluster for
stretch mode, with replica 4 and two replicas per failure domain.
Pools cannot create new crush rules, so we require that replica be
4 when the pools is created, EC is not allowed, and no new
crush rule will be created.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-11-05 09:23:57 -07:00
Travis Nielsen b91f4211c9 ceph: configure a stretched cluster
In clusters where only two datacenters (or similar failure domains)
are available, a different mon and osd approach is needed to deal
with the network partitions or some other reason for one of the failure
domains going down. The Ceph stretched cluster makes the mons aware
of the failure domains by configuring one as the arbiter in a third
zone, while keeping two replicas of the data in each of the data
zoens.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-11-05 09:17:52 -07:00
Travis Nielsen 3b188a447a ceph: reorganize admission controller validation helpers
The validation code for the admission controller is found in the
ceph.rook.io/v1 package, corresponding to each of the types.
To be better organized, the validators are now found in a source
file of the corresponding type name.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-11-05 09:17:52 -07:00
Travis Nielsen 09b84a4c26 ceph: allow pool subdomains from bucket types
The pool subdomains were being validated based on the names of the
crush buckets instead of the crush failure domains, or types.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-11-05 09:17:52 -07:00
Travis Nielsen 772865fa01 ceph: create and remove mon canaries in parallel
The mon canaries are now being added and removed at the same time
instead of starting or stopping them one-by-one. This will simplify
scheduling execution time to much more quickly detect where the mons
can be scheduled.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-11-05 09:17:50 -07:00
Travis Nielsen 3fb167685e Merge pull request #6550 from subhamkrai/fs-crd
ceph: some fields in FS CRD are missing
2020-11-05 09:11:29 -07:00
subhamkrai b80d83fcfa ceph: some fields in FS CRD are missing
this commit add the missing `deviceClass` field
in filesystem CRD with replication of pool spec.

Signed-off-by: subhamkrai <srai@redhat.com>
2020-11-05 20:14:11 +05:30
Sébastien Han 4c3981bdba Merge pull request #6551 from aruniiird/some-cosmetic-fixes
ceph: some minor changes to external python script
2020-11-05 13:52:56 +01:00
Arun Kumar Mohan 0c9bd0fbae ceph: some minor changes
Some cosmetic changes and an extra negative test

Signed-off-by: Arun Kumar Mohan <amohan@redhat.com>
2020-11-05 15:55:59 +05:30
Sébastien Han 8a83d93d93 Merge pull request #6546 from leseb/exporter-script-lint
ceph: lint exporter script file
2020-11-05 09:41:07 +01:00
Travis Nielsen bea2a7bcc5 Merge pull request #6526 from Madhu-1/csi-rbac
ceph: update required rbac for csi
2020-11-04 15:17:09 -07:00
Sébastien Han d5bd79d5a2 Merge pull request #6534 from subhamkrai/ci-v1beta1
ceph: helm test for k8s 1.15 failing
2020-11-04 17:37:06 +01:00
Sébastien Han 671c5f2f25 ceph: lint exporter script file
Listening to what my linter says...

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-11-04 16:49:28 +01:00
Travis Nielsen f4fc56aa47 Merge pull request #6504 from leseb/external-script-only-support-default-prom-port
ceph: fail if mgr prometheus is not default
2020-11-04 08:17:08 -07:00
subhamkrai 4f9b8a2561 ceph: helm test for k8s 1.15 failing
helm test for k8s 1.15 failing showing errors
CRDs not found, after some latest changes to CRDS.

Signed-off-by: subhamkrai <srai@redhat.com>
2020-11-04 20:01:37 +05:30
Sébastien Han 1ed307cb09 ceph: fail if mgr prometheus is not default
Currently, Rook does not support a prometheus exporter port different
than 9283 so let's fail and force the user to set it to the default.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-11-04 10:52:58 +01:00
Sébastien Han d4c486bf0f Merge pull request #6535 from leseb/kms-tls-server-support
ceph: add support for VAULT_TLS_SERVER_NAME
2020-11-04 09:57:14 +01:00
Madhu Rajanna 5de2ded83c ceph: update required rbac for csi
as we are approaching the rook 1.5 release, we
are making a required RBAC changes for cephcsi ahead
of cephcsi release to provide smooth upgrade experience
for the users without any RBAC changes in rook minor release.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-11-04 12:32:08 +05:30
Travis Nielsen 5814e43364 Merge pull request #6533 from travisn/remove-osd-pvc-from-job
ceph: Remove the osd pvc when purging the osd
2020-11-03 10:29:21 -07:00
Travis Nielsen c356fcd2aa Merge pull request #6537 from travisn/test-nautilus-14-2-12
ceph: Tests need to use v14.2.12 due to broken osds in v14.2.13
2020-11-03 10:28:24 -07:00
Travis Nielsen d674dcd88c ceph: tests use v14.2.12 due to broken osds in v14.2.13
The ceph v14.2.13 release has breaking changes for the ceph-volume batch
scenario that is preventing non-pvc OSDs from being created. In the short
term we will pin the tests to v14.2.12 and separately we will need to
address the changes needed and/or wait for a fix from ceph.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-11-03 09:30:07 -07:00