Commit Graph
13292 Commits
Author SHA1 Message Date
Travis Nielsen 8304303120 Merge pull request #8355 from anmolsachan/add_metric_label
ceph: added monitoring managedBy label to metrics
2021-07-30 07:28:42 -06:00
Sébastien Han fa3ab50eff Merge pull request #8429 from leseb/admin-ops-api-debug
ceph: change the debug implementation of the admin ops API
2021-07-30 15:23:07 +02:00
Sébastien Han 65aea09e7d ceph: small bootstrap sequence refactor
Moving and factoring code here and there to hopefully make the
initialization sequence easier to go by.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-07-30 15:03:25 +02:00
Anmol Sachan c6944edc37 ceph: added monitoring managedBy label to metrics
This commit adds 'managedBy' label to the ceph metrics if the
cephcluster is managed by another higher Resource. The optional
label shall be added as part of cephcluster CRs monitoring labels.

Signed-off-by: Anmol Sachan <anmol13694@gmail.com>
2021-07-30 11:41:33 +05:30
Carlos Eduardo Moreira dos Santos 9ab343f409 docs: fix command to remove cluster CRD finalizer
Add the namespace option to the `kubectl patch` command.

Signed-off-by: Carlos Eduardo Moreira dos Santos <cems@cemshost.com.br>
2021-07-30 02:58:39 -03:00
Travis Nielsen 8a48374965 ceph: update docs to point to quay for ceph images
Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-07-29 17:27:37 -06:00
Travis Nielsen cad9c5dd90 ceph: remove obsolete instructions in upgrade guide
Previous release upgrades included instructions for removing obsolete
drive groups and dealing with a preserveUnknownFields error. These
should no longer be an issue with the v1.7 upgrades.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-07-29 17:20:06 -06:00
Blaine Gardner 88adffb3b2 Merge pull request #8389 from BlaineEXE/add-ocs-build-target
build: stage CSV files into tmp while building
2021-07-29 10:19:18 -06:00
Satoru Takeuchi 2218c53fda Merge pull request #8403 from cybozu-go/ceph-dont-remove-pvc-in-osd-purge-job
ceph: add an option to preserve pvc in osd purge job
2021-07-30 01:04:28 +09:00
Blaine Gardner 8a19f6d758 Merge pull request #8419 from BlaineEXE/upgrade-docs-1.7
docs: ceph: update upgrade docs for Rook v1.7
2021-07-29 09:56:04 -06:00
Satoru Takeuchi 89b6a6028c ceph: add an option to preserve pvc in osd purge job
Sometimes we want to investigate a PVC for removed OSD.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2021-07-29 14:20:06 +00:00
Travis Nielsen 990d92790b Merge pull request #8420 from travisn/cleanup-old-versions
ceph: Remove old references to luminous and mimic versions
2021-07-29 07:40:46 -06:00
Sébastien Han ad45924807 ceph: change the debug implementation of the admin ops API
The go-ceph library has removed the `Debug` field from the API type in
https://github.com/ceph/go-ceph/pull/543. Since the HTTP Client can be
mutated we now have our own client to dump requests and responses when
the operator log level is DEBUG.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-07-29 13:59:50 +02:00
Sébastien Han f415a58e25 Merge pull request #8265 from leseb/auto-detect-vault-kv-version
ceph: auto detect vault k/v version
2021-07-29 11:41:01 +02:00
Sébastien Han 99e00dea1e ceph: auto detect vault k/v version
Rook will now auto detect the kv version of the vault server. This
allows users not having to pass the VAULT_BACKEND configuration in the
CephCluster CR.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-07-29 10:16:31 +02:00
Travis Nielsen c2a551123f Merge pull request #8401 from TomHellier/add-additional-rook-ceph-cluster-helm-features
ceph: Add additional helm chart functionality for ingresses and defining the ceph storage crds
2021-07-28 16:14:48 -06:00
Blaine Gardner 9dfcb943d1 docs: ceph: update upgrade docs for Rook v1.7
Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-07-28 14:54:06 -06:00
Tom Hellier 89ab4f90ec ceph: adds helm functionality for ingress, and ceph storage crds
This commit adds an ingress resource to the rook-ceph-cluster helm chart, allowing
ingress to the ceph-dashboard service. It also adds the ability to define the
various storage types that you can run on ceph inside kubernetes.

Closes https://github.com/rook/rook/issues/8384

Signed-off-by: Tom Hellier <me@tomhellier.com>
2021-07-28 21:51:56 +01:00
Travis Nielsen f5030f0560 ceph: remove old references to mimic version
References to luminous and mimic, and unnecessary references to nautilus
were found in the docs that have been cleaned up and clarified. At the same
time, the tests are updated to use more recent versions.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-07-28 14:00:35 -06:00
Travis Nielsen 22c3cfdd21 Merge pull request #8406 from BlaineEXE/add-upgrade-section-for-monitoring
docs: update ancillary resources (monitoring)
2021-07-28 10:08:42 -06:00
Sébastien Han a62e7e75e7 Merge pull request #8380 from sp98/update-cephblockpool-cr
ceph: add mirroring peer specification to CephBlockPool CRD
2021-07-28 17:34:52 +02:00
Travis Nielsen 643eddf261 Merge pull request #8291 from jmolmo/enable_mgr_tests
ceph: enable again the Rook orchestrator mgr test
2021-07-28 09:27:46 -06:00
Juan Miguel Olmo Martínez 9edff582c3 ceph: enable again the Rook orchestrator mgr test
Enable again the mgr test:
- Now is more reliable and robust the start of the test.
- Minor fixes to adapt the <service ls>  to the new name of the crash daemon
deployed by rook

- The creation of OSDs is disabled in the orchestrator, so i have removed
this test until we will have the functionality ready again in the orchestrator
part

My plan is to provide in the orchestrator two different ways to create OSDs:
- Creation of OSD using specific devices if discovery daemon is running
- Creation of OSds using PVS (if we have LSO/other LS operator running)

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2021-07-28 16:27:42 +02:00
Travis Nielsen a2fa57eab9 Merge pull request #8408 from travisn/git-build-version
build: Detect git version instead of setting to 0
2021-07-28 08:02:54 -06:00
Travis Nielsen 87596c6f8e build: detect git version instead of setting to 0
The build version should be detected with the git describe
command, but if the VERSION var is already set, it will be
used instead of being detected from git. During the official
builds or even local builds, we just want to let the makefile
detect the git version.

The full git history is added to enable proper detection of the
version. Without the full history only a hash is returned for
the version, which then results in an invalid semantic version
error for the helm chart.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-07-28 07:25:10 -06:00
Santosh Pillai 3b50f5fd00 ceph: add MirroringPeerSpec to CephBlockPool.Spec.Mirroring
Instead of having the RBDMirroringPeerSpec in the RBDMirror CRD we want
to move it on the CephBlockPool CRD so that each pool can have its own peer.
This enables pool to re-use an existing peer secret if it points to the
same cluster peer.So we don't need to duplicate secret peer anymore.

Signed-off-by: Santosh Pillai <sapillai@redhat.com>
2021-07-28 17:47:36 +05:30
Blaine Gardner 1ac184894c docs: update ancillary resources (monitoring)
Add sections to docs to mention updating ancillary resources, of which
monitoring is the only one currently.

Fixes #7750

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-07-27 16:26:17 -06:00
Blaine Gardner 9138732c81 build: stage CSV files into tmp while building
If a user were to `make build` Rook, and after the Ceph CSV was
generated and before make had finished, the Rook repo would be left with
changes caused by the build modifying files temporarily in-place.

All CSV template generation in the Ceph makefile is now self-contained
and can be configured to operate outside of the main repo so that files
are not modified in-place.

In-place modification of files was also incorrect. On Mac some files
with `-e` trailing were left, and in-place backups were also present in
the form `<filename>''`. Therefore, also fix the generation to fix
in-place modifications.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-07-27 16:11:58 -06:00
Travis Nielsen 6dcc60173a Merge pull request #8347 from josephsawaya/rook-ceph-mgr-role-changes
ceph: update rook-ceph-mgr-cluster role rules to include PV and SC
2021-07-27 11:22:31 -06:00
Travis Nielsen b8ad33be1e Merge pull request #7995 from cybozu-go/ceph-make-timeout-of-radosgw-admin-configurable
ceph: make the timeout of ceph commands configurable
2021-07-27 10:44:04 -06:00
Travis Nielsen 38c4d524e6 Merge pull request #8391 from travisn/publish-promote-action
build: Publish and promote with correct branch name
2021-07-27 07:22:35 -06:00
Satoru Takeuchi 30e4fbb01f ceph: make the timeout of ceph commands cofigurable
Sometimes the default 15s is not enough for timeout of ceph commands. For examples,
I encountered that `radosgw-admin` command took dozens of seconds under heavy load.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2021-07-27 12:42:16 +00:00
Travis Nielsen 7830095809 build: promote the build with tag suffix if needed
The beta releases should have the tag suffx included in
the helm chart and release version tags.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
(cherry picked from commit a1d37b4efc)
2021-07-26 17:34:25 -06:00
Travis Nielsen 0f797e74ca build: unshallow not needed with fetch-depth 0
The unshallow step in the action is replaced now with the
fetch-depth: 0 option on the checkout@v2 action.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
(cherry picked from commit c6d8df931f)
2021-07-26 17:34:19 -06:00
Travis Nielsen 67a3822e95 build: publish and promote with correct branch name
The tagged builds will run git checkout on the correct tag,
though the publish and promote actions expect a branch name
to be available due to internal build assumptions. Now the
publish looks up the branch name from the tag and passes
it to the publish command as expected.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
(cherry picked from commit d8c5f459de)
2021-07-26 17:34:10 -06:00
Travis Nielsen 0330afeea6 Merge pull request #8370 from parth-gr/mon-interval
ceph: updated mon health check goroutine for reconfiguring patch values
2021-07-26 16:30:10 -06:00
Joseph Sawaya 1ddc390d1e ceph: update rook-ceph-mgr-cluster role rules to include PV and SC
Since we changed the Rook orchestrator module for Ceph, it now has
to access Storage Classes and Persistent Volumes in the cluster to
gather inventory and create OSDs so we have to make changes to the
rook-ceph-mgr-cluster role so the orchestrator has permission to
access these resources.

Signed-off-by: Joseph Sawaya <jsawaya@redhat.com>
2021-07-26 13:42:21 -04:00
parth-gr 6ebd109088 ceph: updated mon health check goroutine for reconfiguring patch values
When changing the settings for the Rook mon health check
(.spec.healthCheck.mon) in the CephCluster resource,
the mon health check isn't reconfigured with the new values

Updated checkHealth goroutine so it can
updates the new patched values

Closes: https://github.com/rook/rook/issues/8363
Signed-off-by: parth-gr <paarora@redhat.com>
2021-07-26 22:51:37 +05:30
Sébastien Han 40489028f5 Merge pull request #8037 from TimothyAsirJeyasing/ocs-ceph-dashboar-link
ceph: add ceph dashboard link
2021-07-26 18:03:54 +02:00
Travis Nielsen ed07d5f5a8 Merge pull request #8375 from travisn/release-run-tests
build: Run integration tests on release branch and tags
2021-07-26 07:51:37 -06:00
Timothy Asir Jeyasingh 8426f63404 ceph: add ceph dashboard link
Ceph dashboard link will be used for the
external cluster in OCS.
Ignore error handling.

Signed-off-by: Timothy Asir Jeyasingh <tjeyasin@redhat.com>
2021-07-26 19:00:16 +05:30
Sébastien Han 95505592c8 Merge pull request #8376 from travisn/release-1.7-backport-bot
build: Add release-1.7 mergify backport rule
2021-07-26 09:29:26 +02:00
Travis Nielsen 3f3c97a586 build: auto add the nfs label based on the pr title
The cassandra and ceph PRs already had the label added automatically,
now the nfs PRs will also have a label added.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-07-23 15:57:13 -06:00
Travis Nielsen 27a2b468ba build: add mergify backport for 1.7 and remove 1.3 support
The mergify bot now has rules for backporting to the release-1.7
branch. Backporting to 1.3 is no longer needed, so we can remove
that backport rule.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-07-23 15:55:59 -06:00
Travis Nielsen b9b2391fe9 build: run integration tests on release branch and tags
The integration test actions were not running on the release branch
or tags due to an incorrect condition.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
(cherry picked from commit 1052abac30)
2021-07-23 15:46:03 -06:00
Travis Nielsen 3b251a450e Merge pull request #8371 from leseb/fix-master
ceph: remove non-existing mock
v1.7.0-alpha.0
2021-07-23 10:55:36 -06:00
Travis Nielsen 61b85a2d3a Merge pull request #8372 from subhamkrai/add-missing-function
ci: missing function call in script
2021-07-23 10:55:10 -06:00
subhamkrai e291afad07 ci: missing function call in script
in pr 8328, function call was missing
so action for pushing the image is not
starting.

Signed-off-by: subhamkrai <srai@redhat.com>
2021-07-23 22:05:15 +05:30
Sébastien Han 2481e0c85c ceph: remove non-existing mock
This is what happens when you merge without rebasing onto master
first...
MockExecuteCommandWithOutputFile is gone in
https://github.com/rook/rook/pull/8351 but
https://github.com/rook/rook/pull/8353 was merged before and
https://github.com/rook/rook/pull/8351 should have been rebased first.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-07-23 18:29:08 +02:00
Travis Nielsen 069bc484ee Merge pull request #8328 from subhamkrai/action-for-release-build
ci: action for release build
2021-07-23 10:21:30 -06:00