Commit Graph
7961 Commits
Author SHA1 Message Date
Sébastien Han f938447398 Merge pull request #6562 from leseb/mergify-1.5
bot: update mergify to release 1.5 branch
2020-11-06 15:16:17 +01:00
Travis Nielsen 67ce7e4c3b Merge pull request #6561 from Madhu-1/cephfs-priv-pod
ceph: add privileged securityContext to cephfs deployment
2020-11-06 07:13:33 -07:00
Mateusz Gozdek 8912e491d8 ci: .github/workflows: add codespell pipeline
As a follow up to #6563 which fixed all the typos found in the
repository, to avoid adding more obvious typos.

Signed-off-by: Mateusz Gozdek <mgozdekof@gmail.com>
2020-11-06 12:43:29 +01:00
Satoru Takeuchi afcfe40b5e Merge pull request #6563 from invidian/typos
docs: fix bunch of typos
2020-11-06 18:57:45 +09:00
Mateusz Gozdek 8ba3762fa4 docs: fix bunch of typos
Found by running the following command:

codespell -S .git,*.png,*.jpg -L \
aks,keyserver,atleast,dne,ser,ist,files\',ba,dum,iam,te -f -H

Signed-off-by: Mateusz Gozdek <mgozdekof@gmail.com>
2020-11-06 10:01:04 +01:00
Sébastien Han 1b45127056 bot: mergify add release 1.5
Update mergify to auto backport PR with label on release 1.5 branch and
auto merge.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-11-06 08:58:46 +01:00
Sébastien Han 896d721737 bot: mergify remove release-1.2 actions
1.2 is getting old and automatic backport will likely fail anyways.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-11-06 08:54:50 +01:00
Madhu Rajanna 8f5196a559 ceph: add privileged securityContext to cephfs deployment
cephfs csi driver still uses the ceph CLI for all the
ceph fs operations, when cephcsi gets a request from
the kubernetes it will internally starts threads for
each call. in cephcsi we are setting the pids
limit to max, to set this value the container has
to be running as the privileged one.

if we go with default pid limit we will face core dump
due to resource crunch.

without privileged access we will see Failed to set new
PID limit to -1: open /sys/fs/cgroup/pids/kubepods.slice/
kubepods-besteffort.slice/kubepods-besteffort-pod1029ed37_bebc_466d_9e53_79e7323a67ed.slice/crio-9ef6768d027916f414bf30b54ef13eebad8efd0aa4741d97618affa838d7b4c0.scope/pids.max: permission denied

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-11-06 09:40:18 +05:30
Travis Nielsen 372b74b4d7 Merge pull request #6558 from travisn/latest-octopus
ceph: Update base image and examples to v15.2.5
v1.5.0-alpha.0
2020-11-05 16:40:53 -07:00
Travis Nielsen a5b9fbc994 ceph: update base image and examples to v15.2.5
For the v1.5 release we use the latest version of ceph by default,
which is now v15.2.5

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-11-05 15:50:23 -07:00
Travis Nielsen 6e2679cbff Merge pull request #6545 from leseb/fix-6532
ceph: add unit test for ceph-volume batch mode and warn about unsupported ceph version
2020-11-05 11:42:01 -07:00
Sébastien Han 64fe9f7685 ceph: introduced unsupported releases
These are a collection of unstable ceph release that are not recommended
for production. It is recommended to rollback to the previous or
  upgrading to the next one if possible.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-11-05 18:35:57 +01:00
Sébastien Han 8631eef1f7 ceph: correctly populate variable
The wrong variable was referenced in the print.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-11-05 18:06:47 +01:00
Sébastien Han bc5c8d32f1 ceph: fix crush-class osd on non-PVC
We need to use storeConfig instead device config as the later never
seems to be populated.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-11-05 18:06:47 +01:00
Sébastien Han 6b211eacba ceph: add unit test for osd batch mode
We now have much better coverage on the c-v on non-pvc scenario.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-11-05 18:06:11 +01:00
Travis Nielsen 7c3cdbce50 ceph: use constants for k8s topology labels
Instead of directly defining our own constants, we should be using the k8s
constants for the well-known topology labels.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-11-05 09:23:58 -07:00
Travis Nielsen e72b69f8e0 ceph: validate pools for stretch clusters
Pools in stretch clusters will all use the same crush rule that
is generated by the operator when configuring the cluster for
stretch mode, with replica 4 and two replicas per failure domain.
Pools cannot create new crush rules, so we require that replica be
4 when the pools is created, EC is not allowed, and no new
crush rule will be created.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-11-05 09:23:57 -07:00
Travis Nielsen b91f4211c9 ceph: configure a stretched cluster
In clusters where only two datacenters (or similar failure domains)
are available, a different mon and osd approach is needed to deal
with the network partitions or some other reason for one of the failure
domains going down. The Ceph stretched cluster makes the mons aware
of the failure domains by configuring one as the arbiter in a third
zone, while keeping two replicas of the data in each of the data
zoens.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-11-05 09:17:52 -07:00
Travis Nielsen 3b188a447a ceph: reorganize admission controller validation helpers
The validation code for the admission controller is found in the
ceph.rook.io/v1 package, corresponding to each of the types.
To be better organized, the validators are now found in a source
file of the corresponding type name.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-11-05 09:17:52 -07:00
Travis Nielsen 09b84a4c26 ceph: allow pool subdomains from bucket types
The pool subdomains were being validated based on the names of the
crush buckets instead of the crush failure domains, or types.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-11-05 09:17:52 -07:00
Travis Nielsen 772865fa01 ceph: create and remove mon canaries in parallel
The mon canaries are now being added and removed at the same time
instead of starting or stopping them one-by-one. This will simplify
scheduling execution time to much more quickly detect where the mons
can be scheduled.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-11-05 09:17:50 -07:00
Travis Nielsen 3fb167685e Merge pull request #6550 from subhamkrai/fs-crd
ceph: some fields in FS CRD are missing
2020-11-05 09:11:29 -07:00
subhamkrai b80d83fcfa ceph: some fields in FS CRD are missing
this commit add the missing `deviceClass` field
in filesystem CRD with replication of pool spec.

Signed-off-by: subhamkrai <srai@redhat.com>
2020-11-05 20:14:11 +05:30
Sébastien Han 4c3981bdba Merge pull request #6551 from aruniiird/some-cosmetic-fixes
ceph: some minor changes to external python script
2020-11-05 13:52:56 +01:00
Arun Kumar Mohan 0c9bd0fbae ceph: some minor changes
Some cosmetic changes and an extra negative test

Signed-off-by: Arun Kumar Mohan <amohan@redhat.com>
2020-11-05 15:55:59 +05:30
Sébastien Han 8a83d93d93 Merge pull request #6546 from leseb/exporter-script-lint
ceph: lint exporter script file
2020-11-05 09:41:07 +01:00
Travis Nielsen bea2a7bcc5 Merge pull request #6526 from Madhu-1/csi-rbac
ceph: update required rbac for csi
2020-11-04 15:17:09 -07:00
Sébastien Han d5bd79d5a2 Merge pull request #6534 from subhamkrai/ci-v1beta1
ceph: helm test for k8s 1.15 failing
2020-11-04 17:37:06 +01:00
Sébastien Han 671c5f2f25 ceph: lint exporter script file
Listening to what my linter says...

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-11-04 16:49:28 +01:00
Travis Nielsen f4fc56aa47 Merge pull request #6504 from leseb/external-script-only-support-default-prom-port
ceph: fail if mgr prometheus is not default
2020-11-04 08:17:08 -07:00
subhamkrai 4f9b8a2561 ceph: helm test for k8s 1.15 failing
helm test for k8s 1.15 failing showing errors
CRDs not found, after some latest changes to CRDS.

Signed-off-by: subhamkrai <srai@redhat.com>
2020-11-04 20:01:37 +05:30
Sébastien Han 1ed307cb09 ceph: fail if mgr prometheus is not default
Currently, Rook does not support a prometheus exporter port different
than 9283 so let's fail and force the user to set it to the default.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-11-04 10:52:58 +01:00
Sébastien Han d4c486bf0f Merge pull request #6535 from leseb/kms-tls-server-support
ceph: add support for VAULT_TLS_SERVER_NAME
2020-11-04 09:57:14 +01:00
Madhu Rajanna 5de2ded83c ceph: update required rbac for csi
as we are approaching the rook 1.5 release, we
are making a required RBAC changes for cephcsi ahead
of cephcsi release to provide smooth upgrade experience
for the users without any RBAC changes in rook minor release.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-11-04 12:32:08 +05:30
Travis Nielsen 5814e43364 Merge pull request #6533 from travisn/remove-osd-pvc-from-job
ceph: Remove the osd pvc when purging the osd
2020-11-03 10:29:21 -07:00
Travis Nielsen c356fcd2aa Merge pull request #6537 from travisn/test-nautilus-14-2-12
ceph: Tests need to use v14.2.12 due to broken osds in v14.2.13
2020-11-03 10:28:24 -07:00
Travis Nielsen d674dcd88c ceph: tests use v14.2.12 due to broken osds in v14.2.13
The ceph v14.2.13 release has breaking changes for the ceph-volume batch
scenario that is preventing non-pvc OSDs from being created. In the short
term we will pin the tests to v14.2.12 and separately we will need to
address the changes needed and/or wait for a fix from ceph.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-11-03 09:30:07 -07:00
Travis Nielsen 37a56f39a6 ceph: remove the osd pvc when purging the osd
The osd purge job was not removing the osd prepare job or the
osd pvc due to an invalid label query for the pvc. Now the
prepare job and pvc will be removed as expected from the job.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-11-03 08:32:37 -07:00
Sébastien Han bf7203ab65 Merge pull request #6473 from aruniiird/monitoring_endpoint_checks
ceph: added additional checks on accepting monitoring endpoint
2020-11-03 15:58:33 +01:00
Sébastien Han b477d9c33d ceph: add support for VAULT_TLS_SERVER_NAME
We now support VAULT_TLS_SERVER_NAME which represents the name to use as
the SNI host when connecting via TLS.
This is typically needed when a single host has multiple certificates,
same as virtual hosts but for SSL certificates.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-11-03 14:59:15 +01:00
Arun Kumar Mohan 20e7c4fbb9 ceph: changes to run unittests for external script
Signed-off-by: Arun Kumar Mohan <amohan@redhat.com>
2020-11-03 19:24:10 +05:30
Arun Kumar Mohan b0b8c8222b ceph: fixed monitoring port issue
Fixed an issue where monitoring port, even when set by user, being
overridden by the default value.

Signed-off-by: Arun Kumar Mohan <amohan@redhat.com>
2020-11-03 08:55:13 +05:30
Arun Kumar Mohan bb753caf52 ceph: need to shift 'DummyRados' class to top
As 'DummyRados' object is being used in other parts of the code, had to
shift this to top.

Signed-off-by: Arun Kumar Mohan <amohan@redhat.com>
2020-11-03 08:55:13 +05:30
Arun Kumar Mohan 72a8a6071b ceph: new tests for monitoring endpoints and upgrade user changes added
Signed-off-by: Arun Kumar Mohan <amohan@redhat.com>
2020-11-03 08:55:13 +05:30
Arun Kumar Mohan 7b8da65c81 ceph: fixed existing test cases
Modified / Fixed all the existing tests according to the latest changes.

Signed-off-by: Arun Kumar Mohan <amohan@redhat.com>
2020-11-03 08:55:13 +05:30
Arun Kumar Mohan c1a4ef6455 ceph: added additional checks on accepting monitoring endpoint
Changes related to Monitoring endpoint
a. for any monitoring endpoint and port (either user given through arguments
or internally found), added code to make sure we convert the endpoint
host_name to a proper IP address.
b. checks added to make sure we have a valid and reachable endpoint

Signed-off-by: Arun Kumar Mohan <amohan@redhat.com>
2020-11-03 08:55:13 +05:30
Jared Watts 8d445c919d Merge pull request #6202 from prksu/nfs-quota
nfs: implement disk quota
2020-11-02 08:34:54 -08:00
Sébastien Han 341e2d7116 Merge pull request #6529 from leseb/rework-tests
ceph: rework unit test
2020-11-02 15:01:04 +01:00
Sébastien Han b7e0e206d3 ceph: rework unit test
Golang maps order is not always guaranteed to be identical, which makes
the table driven test to fail. Because of the nature of the maps, it is
hard to predict the exact position of an element in the map. This
makes the table driven test flappy.
Reworked the unit test using a contains statement which achieves the
same validation.

Closes: https://github.com/rook/rook/issues/6522
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-11-02 12:14:09 +01:00
Deshi XiaoandAlexander Trost 0ada78ecb0 docs: fix issue#6460 remove helm2 section
1. only helm3 support,deprecated helm2.x docs
2. remove useless helm3 comments
3. update documentation for helm-operator.md

Co-authored-by: Alexander Trost <Galexrt@googlemail.com>
Signed-off-by: Deshi Xiao <xiaods@gmail.com>
2020-10-31 10:52:24 +08:00