Commit Graph
4685 Commits
Author SHA1 Message Date
Sébastien Han 8d4efc4d7f Merge pull request #5248 from cybozu-go/ceph-remove-unnecessary-lvremove-in-test
ceph: remove unnecessary lvremove in test
2020-04-14 10:36:32 +02:00
Satoru Takeuchi 6a09cc0177 ceph: remove unnecessary lvremove in test
LVs in a VG are removed with vgremove. So lvremove before vgremove
is not necessary.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-04-13 14:49:05 +09:00
Sébastien Han 3d9babba6d Merge pull request #5237 from zerkms/issue-5236
ceph: helm add default value for the `nodeSelector`
2020-04-10 09:56:02 +02:00
Ivan Kurnosov b5e1e9f7e2 ceph: helm add default value for the nodeSelector
Without the default value helm does not have chance
to infer the field type and fails during type check
when custom `nodeSelector` value is specified;

Closes: https://github.com/rook/rook/issues/5236
Signed-off-by: Ivan Kurnosov <zerkms@zerkms.com>
2020-04-10 12:22:49 +12:00
Travis Nielsen 66f310c73b Merge pull request #5219 from travisn/status-reconcile-loop
Skip reconcile events where the spec is not updated
2020-04-09 16:53:40 -06:00
Travis Nielsen 8622583154 Merge pull request #5183 from umangachapagain/mgr-minimal-privilege
Ceph: revert mgr to minimal privilege
2020-04-09 16:53:32 -06:00
Travis Nielsen 8ba023764b Merge pull request #4433 from rajatsingh25aug/dataPool-Fix
Ceph: Filesystem Pool Size are ignored
2020-04-09 16:53:16 -06:00
Travis Nielsen 3298943b95 Merge pull request #5229 from travisn/upgrade-rgw-svc
Update the object store service port during upgrade
2020-04-09 14:16:41 -06:00
Travis Nielsen 24789f4c6a ceph: update the object store service port during upgrade
In the v1.3 release the target port for the rgw daemons changed to 8080.
The upgrade was skipping the service update anytime the service already existed.
Now the service will be updated with every reconcile to ensure the target port
is correct.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-09 12:42:20 -06:00
Travis Nielsen ff1ab64d8d ceph: skip reconcile events where the spec not updated
The controllers should ignore events for status updates. The reconcile
only needs to happen when the spec is updated or the resource is marked
for deletion. Otherwise, the controllers may stay in an update loop as
the reconcile events are triggered again every time there is a status
update during the reconcile.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-09 11:20:45 -06:00
Travis Nielsen 269cfe1199 ceph: update status on current version of resources
When updating the status on resources sometimes the update fails due to
the resource being an outdated version. This frequently occurs when
the same reconcile loop updates the status multiple times, or the finalizer
is added, or some other update to the resource. Upon the next reconcile
the error would generally go away since the status or finalizer didn't
need to be updated multiple times. But now the error is not expected
since the controller will retrieve the latest version of the resource
immediately before attempting to update it.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-09 11:20:45 -06:00
Sébastien Han 39aa5902b4 Merge pull request #5226 from leseb/reset-release-note
rook: reset PendingReleaseNotes
2020-04-09 17:32:13 +02:00
Sébastien Han dc364e17fa rook: reset PendingReleaseNotes
Since we ship 1.3, we need to reset this file.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-04-09 17:21:08 +02:00
Sébastien Han 85185f421a Merge pull request #5224 from leseb/helm-crds
ceph: helm add missing subresources to CRD
2020-04-09 16:38:09 +02:00
Sébastien Han 0e42222c50 ceph: helm add missing subresources to CRD
The subresources field was missing, this was missed in
https://github.com/rook/rook/pull/4964.

The .metadata.generation field is updated if and only if the value at the .spec subpath changes.
Additionally, if the spec does not change, .metadata.generation is not updated.
This is a must-have for the controller-runtime work, if we don't have
this, the generation field will always be incremented, resulting in a
endless reconcile loop.

Closes: https://github.com/rook/rook/issues/5173
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-04-09 11:30:33 +02:00
Sébastien Han c83ec7598b Merge pull request #5221 from travisn/pr-template
Clarify the CI flags in the PR template
2020-04-09 10:27:06 +02:00
Travis Nielsen c7310ec802 git: clarify CI flags in PR template
The commitlint bot is rarely understood and flags to skip the CI are
rarely used by new contributors. This update to the PR template
aims to make these options more discoverable to newer members of
the community

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-09 00:11:16 -06:00
Travis Nielsen a4e598b7c7 Merge pull request #5215 from joshuacox/fixdocpath-signed
ceph: Fixing path on ceph-quickstart to include rook
2020-04-08 11:57:58 -06:00
Josh Cox 263661adbe docs: Fixing path on ceph-quickstart to include rook
Signed-off-by: Josh Cox <josh@webhosting.coop>
2020-04-08 12:38:17 -05:00
Travis Nielsen f4fad939e9 Merge pull request #5189 from asoltesz/patch-1
ceph: Add example for using a specific partition for storage
2020-04-08 09:25:22 -06:00
asoltesz a70cafdd9b ceph: Add example for using a specific partition for storage
The documentation has no example yet about how to use a specific partition

Signed-off-by: András Soltész <soltesz.andras@gmail.com>
2020-04-08 12:14:58 +02:00
Sébastien Han 3daa118b76 Merge pull request #5210 from obnoxxx/nfs-fix-comment-typo
nfs: fix comment typo
2020-04-08 10:03:57 +02:00
Michael Adam 76434a8bc1 nfs: fix comment typo
Signed-off-by: Michael Adam <obnox@redhat.com>
2020-04-08 00:32:08 +02:00
Travis Nielsen 7701c0b266 Merge pull request #4966 from cybozu-go/ceph-prevent-existing-lvms-from-wipe
Ceph: prevent pre-existing lvms from wipe
2020-04-07 13:58:58 -06:00
Travis Nielsen d605ace454 Merge pull request #5204 from cloudical-io/fix_5194
build: update manifest-tools version to v1.0.2
2020-04-07 13:58:32 -06:00
Alexander Trost e5ba1fa7a8 build: update manifest-tools version to v1.0.2
This updates the manifest-tools from v1.0.0 to v1.0.2 to
pickup the following fix
https://github.com/estesp/manifest-tool/pull/90.

This currently prevents the build to push images to Docker
hub.

Resolves #5194

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2020-04-07 19:47:50 +02:00
Satoru Takeuchi ea5177c4a1 ceph: suppress shellcheck warnings
Suppress the following shellcheck warnings.

https://github.com/koalaman/shellcheck/wiki/SC2018
https://github.com/koalaman/shellcheck/wiki/SC2019
https://github.com/koalaman/shellcheck/wiki/SC2021

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-04-07 16:49:58 +00:00
Satoru Takeuchi 7e4f32790d ceph: prevent pre-exisiting lvms from wipe
Ceph integration test tries to wipe all lvms including
the ones that are not related to this test.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-04-07 14:09:00 +00:00
Satoru Takeuchi 7bd17c4806 tests: fix minor bugs
- `helm_read` is not a command, but a variable
- If `helm` was installed in `helm.sh up`, the following `heml.sh clean`
  fails since `helm_rest` can't find the installed `helm`.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2020-04-07 14:09:00 +00:00
Travis Nielsen f4df6f6069 Merge pull request #5143 from shellwedance/ceph_add_size_in_pool_create
Ceph: Add replica_size flag in replicated pool creation time
2020-04-07 07:21:05 -06:00
Sébastien Han 36f6726405 Merge pull request #5200 from leseb/fix-codegen
rook: fix codegen
2020-04-07 14:46:38 +02:00
Sébastien Han c97d54ec77 Merge pull request #5199 from cybozu-go/fix-lv-backed-pv-restart
ceph: fix resync failure of OSD pod using LV-backed-PV
2020-04-07 14:07:34 +02:00
Sébastien Han 6a1c9ec5f0 rook: fix codegen path
The path was copied in the wrong location, ending up with a duplicated
directory in pkg/pkg/api. We need pkg/ only.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-04-07 13:11:59 +02:00
morimoto-cybozu 9edf8c45b5 ceph: fix resync failure of OSD pod using LV-backed-PV
This fixes the resync of the Deployment of the OSD pod that uses
an LV-backed PV.
`getOSDInfo()` reads the configuration of the OSD pod from the existing
Deployment, but it overlooked this case.

Closes: https://github.com/rook/rook/issues/5139
Signed-off-by: morimoto-cybozu <kenji_morimoto@cybozu.co.jp>
2020-04-07 09:53:00 +00:00
RAJAT SINGH 013c5bbac3 Ceph: Filesystem Pool Size are ignored
The old Filesystem's pool is not getting updated when changed with the new File system.
So, we added two helper functions namely generateDataPoolNames and generateMetaDataPoolName  that will generate the names of the pools and then change those pool's values using the SetPoolSize method.

Signed-off-by: RAJAT SINGH <rajasing@redhat.com>
2020-04-07 14:54:45 +05:30
taeuk_kimanddonggyu_park c266c982c9 Ceph: Add replica_size to replicated pool creation
Add size parameter to pool create command instead of executing pool set command only for size
This makes pool min_size reflect replica size.

Co-authored-by: donggyu_park <donggyu_park@tmax.co.kr>
Signed-off-by: taeuk_kim <taeuk_kim@tmax.co.kr>
2020-04-07 07:06:35 +00:00
Travis Nielsen 6532b798c4 Merge pull request #5196 from dyusupov/master
edgefs: fix SMB controller update path
2020-04-06 22:25:16 -06:00
Dmitry Yusupov b640f75c08 edgefs: fix SMB controller update path
Signed-off-by: Dmitry Yusupov <dmitry.yusupov@nexenta.com>
2020-04-06 18:32:23 -07:00
Travis Nielsen 099ed307d5 Merge pull request #5177 from ashangit/set_pg_num_min
ceph: set pg_num_min for rgw metadata pools
2020-04-06 11:24:39 -06:00
n.fraison 27579733b8 ceph: set pg_num_min for rgw metadata pools
Since e396379 rook create rgw metadata pools with 8 PGs instead of
32. But the pg_autoscaler increase it back to 32 as the pg_num_min parameter
is not set on those pools.

Signed-off-by: n.fraison <n.fraison@criteo.com>
2020-04-06 18:14:56 +02:00
n.fraison ddadfbc993 ceph: remove leading and trailing space from get config
Value returned by ceph config get can contains some trailing space which leads to
issues when running other ceph command.
For ex.:
2020-04-06 15:32:43.543050 I | exec: Running command: ceph osd pool set test-1.rgw.control pg_num_min 8
 --connect-timeout=15 --cluster=rook-ceph --conf=/var/lib/rook/rook-ceph/rook-ceph.config --keyring=/var/lib/rook/rook-ceph/client.admin.keyring --format json --out-file /tmp/249563089
2020-04-06 15:32:44.005018 I | exec: Error EINVAL: error parsing int value '8

Signed-off-by: n.fraison <n.fraison@criteo.com>
2020-04-06 18:14:50 +02:00
Sébastien Han b33804d034 Merge pull request #5184 from leseb/travisn-octopus-upgrade-test
Integration test for upgrade from nautilus to octopus
2020-04-06 18:10:46 +02:00
Sébastien Han e17b6e11d5 ci: use exec combined output to check fs status
On Octopus, the "ceph fs status" reports on stderr for some reason.
So we need to combined the output to read the filesystem status.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-04-06 16:07:01 +02:00
Sébastien Han 71799682ca ceph: print the reason for reconciling
General debugging helper without having to turn on DEBUG logs.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-04-06 16:07:01 +02:00
Travis Nielsen eeb687ad14 ceph: log skipped reconcile based on ceph health
When the Ceph health is HEALTH_ERR the controllers will skip the
reconcile. With info level logging there needs to be an indication
of this decision to skip the reconcile, otherwise users will
wonder why their resources aren't being created.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-06 16:07:01 +02:00
Travis Nielsen a737975077 ceph: integration test for upgrade from nautilus to octopus
The upgrade test will now support upgrading from nautilus
to octopus and that files and be read and written
after the upgrade.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-06 16:07:01 +02:00
Umanga Chapagain 362a9c78e0 Ceph: revert mgr to minimal privilege
mgr should only include "mon allow profile mgr" instead
of "mon allow *"

Fixes: #2529
Reverts: #2523
Signed-off-by: Umanga Chapagain <chapagainumanga@gmail.com>
2020-04-06 16:03:51 +05:30
Sébastien Han 56707ddcc4 Merge pull request #5179 from ashangit/auth_key_not_deleted
ceph: remove appropriate rgw ceph user when CephObjectStore is deleted
2020-04-06 10:02:20 +02:00
Sébastien Han c68d2a31cd Merge pull request #5172 from travisn/skip-csi-test
Skip upgrade test where csi is not supported
2020-04-06 09:57:44 +02:00
Sébastien Han eed14341cc Merge pull request #5174 from umangachapagain/handle-type-assertions
Handle type assertions
2020-04-06 09:54:49 +02:00