Commit Graph
13292 Commits
Author SHA1 Message Date
Sébastien Han f040c37ad1 ci: fix mirror test with v16.2.6
The new version v16.2.6 has a different behavior when it comes to the
number of cephfs-mirror socket files. Previous version had exactly 3 and
now has like way more...
So let's just check for the presence of more sockets.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-09-21 09:16:33 +02:00
Sébastien Han 0c33493f27 ceph: bump manifests to ceph pacific 16.2.6
New version is out so let's use it.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-09-21 09:16:32 +02:00
Travis Nielsen 404dccdf2d Merge pull request #8721 from jmolmo/8510
ceph: do not use http for mgr liveness probe
2021-09-20 17:05:30 -06:00
Sébastien Han 19837969ea Merge pull request #8722 from leseb/scc-rile
ceph: export security context constraints
2021-09-20 18:43:03 +02:00
Blaine Gardner acbda9381b Merge pull request #8708 from BlaineEXE/health-checker-failure-should-fail-reconcile
ceph: retry object health check if creation fails
2021-09-20 10:27:20 -06:00
Travis Nielsen 8755759a0a Merge pull request #8690 from jmolmo/issue_8669
ceph: fix probable cause of intermittent fails in the manager test
2021-09-20 09:59:54 -06:00
Sébastien Han a8c3b363ee ceph: export security context constraints
Rook now exports both ceph and csi SCCs to run on openshift so any
program pulling rook can inject the right SCCs.
In the meantime, default SCC has been reinforced to be less permissive.
Documentation has been reworked and a new path for openshift
installations has been created. Rook still provides the YAML files for
manual installations.

Closes: #8713
Signed-off-by: Sébastien Han <seb@redhat.com>
2021-09-20 17:54:48 +02:00
Juan Miguel Olmo Martínez 5c75139581 ceph: fix probable cause of intermittent fails in the manager test
Explicitly set the length of the string parameter in json.Unmarshal method

fixes: https://github.com/rook/rook/issues/8669

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2021-09-20 13:29:45 +00:00
Juan Miguel Olmo Martínez 7fbd9f2225 ceph: do not use http for mgr liveness probe
When private/public network have been defined in the Ceph rook cluster it is not
possible to configure properly the ip address of the liveness probe
for the manager.
Changes in the manager in Pacific introduced this regression.

This change replaces the http probe by a command probe, avoiding thus to
determine what is going to be the ip address of the manager before launching
the pod.

fixes: https://github.com/rook/rook/issues/8510

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2021-09-20 13:28:51 +00:00
Blaine Gardner a357db9bb5 Merge pull request #8736 from BlaineEXE/remove-jenkins-minimal-test-versions
test: remove unused minimal test versions
2021-09-17 17:08:06 -06:00
Blaine Gardner 264256acfb test: remove unused minimal test versions
The `*SuiteMinimalTestVersion` vars in
`tests/integration/ceph_base_deploy_test.go` are no longer needed with
Jenkins no longer being used. Remove them.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-09-17 16:49:29 -06:00
Blaine Gardner 5383ba2df2 ceph: retry object health check if creation fails
If the CephObjectStore health checker fails to be created, return a
reconcile failure so that the reconcile will be run again and Rook will
retry creating the health checker. This also means that Rook will not
list the CephObjectStore as ready if the health checker can't be
started.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-09-17 16:24:18 -06:00
Travis Nielsen 5795df728a Merge pull request #8723 from BlaineEXE/separate-object-full-test-suite
test: make object e2e test its own test
2021-09-17 15:57:49 -06:00
Blaine Gardner c60bf241e1 test: make object e2e test its own test
The CephSmokeSuite is becoming quite large and long, and most of the
length is now related to the object e2e tests. Separate the full object
e2e test into CephObjectSuite, and only test the object 'lite' test in
the CephSmokeSuite.

Resolves #8714

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-09-17 15:27:27 -06:00
Travis Nielsen 0d8fd9d8a4 Merge pull request #8607 from leseb/refact
ceph: refactor operator initialization sequence and add more controllers (csi, lib-bucket-prov, discover daemon, flex)
2021-09-17 11:38:35 -06:00
Sébastien Han b89730d895 ceph: refactor operator initialization sequence
This commit is a large refactor on how the operator starts, stops and
how it starts various sub-components such as the ceph-csi driver. It
also refines the way we cancel orchestrations. We don't use breakpoints
anymore but send our self a SIGUP to reload our controller runtime
manager.
The reload will happen under different circonstances like:

* a new adminission controller secret is created/deleted/changed
* a CephCluster CR is edited

As mentioned earlier, the csi driver now has its own controller, just
like flex. It reacts to change in the operator config map for particular
ROOK_CSI_ fields.

A second new controller for the operator's general config has been
created, it manages:

* the logging level
* the ceph CLI command timeout
* the discovery daemon

The operator reacts much more rapidly to cancellation events by stopping
the manager's context and reloading it.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-09-17 16:57:12 +02:00
Sébastien Han 78ef8768c2 Merge pull request #8738 from leseb/yaml-parse
ceph: remove unnecessary package
2021-09-17 16:48:09 +02:00
Sébastien Han 68a4bc2d1b ceph: remove unnecessary package
We don't need to use github.com/ghodss/yaml since
"k8s.io/apimachinery/pkg/util/yaml" provides the same functionality and
we already import it.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-09-17 16:10:47 +02:00
Sébastien Han 32984f7297 Merge pull request #8746 from leseb/force-16.2.5
ci: force a particular ceph version
2021-09-17 16:09:12 +02:00
Travis Nielsen b3f5ec6dcf Merge pull request #8732 from leseb/cephfs-mirror-doc
doc: fix cephfs-mirror documentation
2021-09-17 07:54:41 -06:00
Sébastien Han ae291afb2f ci: force a particular ceph version
Let's force v16.2.5 since the CI is broken with 16.2.6. This gives us
time to continue to merge work and work on fixing deployments with
16.2.6 in parallel.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-09-17 15:28:48 +02:00
Sébastien Han fd28497cb4 docs: fix cephfs-mirror documentation
The steps to configure the peers are detailed in the CephFilesystem
section. Only the CephFilesystem is holding the peer configuration, not
the CephFilesystemMirror which only controls the bootstrap of the
daemon.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-09-17 09:50:13 +02:00
Travis Nielsen e2e3fc83fc Merge pull request #8673 from leseb/stale-bot
bot: change issue and pr stale days
2021-09-16 08:31:31 -06:00
Blaine Gardner 79e8cf0eea Merge pull request #8715 from BlaineEXE/prune-unused-crd-permission-in-clusterrole
ceph: remove unused crd permission from roles
2021-09-16 08:04:58 -06:00
Sébastien Han 875aec74cc bot: bump action to v4
Signed-off-by: Sébastien Han <seb@redhat.com>
2021-09-16 10:04:56 +02:00
Sébastien Han 796abd7805 bot: change issue and pr stale days
Let's be a bit more aggressive to ensure a consistent amount of
in-progress PRs and issues.
So now PR will go stale after 30 days and issues after 60 days.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-09-16 10:04:46 +02:00
Sébastien Han bcae365cb9 Merge pull request #8698 from sp98/fix-pdb-reconcile
ceph: reconcile osd pdb if allowed disruption is 0
2021-09-15 10:47:54 +02:00
Sébastien Han 1632bfaa5a Merge pull request #8711 from subhamkrai/dry-run-check
ci: dry-run is deprecated and replaced with --dry-run=client
2021-09-15 10:06:48 +02:00
Sébastien Han c4a6473fc8 Merge pull request #8435 from BlaineEXE/upgrade-doc-add-mirroring-changes
docs: ceph: add peer spec migration to upgrade doc
2021-09-15 09:26:12 +02:00
Travis Nielsen 7f3eebe578 Merge pull request #8695 from travisn/master-docs-latest
docs: Publish master docs to latest path
2021-09-14 14:27:56 -06:00
Blaine Gardner 7c511328e4 docs: update rbd mirror docs for block pool config
Remove legacy documentation for configuring RBD mirroring. While we
still support legacy mirroring configs, we want to encourage new users
to use the CephBlockPool configuration for mirroring.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-09-14 13:39:28 -06:00
Blaine Gardner 83c05324ce ceph: remove unused crd permission from roles
Remove unused ability to modify CRDs from Rook cluster roles. Rook (as
an operator) should not have the ability to modify CRDs used by the
components it controls.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-09-14 12:52:06 -06:00
subhamkrai 038031ddbd ci: dry-run is deprecated and replaced with --dry-run=client
--dry-run is deprecated and replaced with --dry-run=client

Signed-off-by: subhamkrai <srai@redhat.com>
2021-09-14 16:13:27 +05:30
Santosh Pillai 7480f6ba62 ceph: reconcile osd pdb if allowed disruption is 0
Rook checks for down OSDs by checking the `ReadyReplicas` count
in the OSD deployement. When an OSD pod goes into CBLO due to
disk failure, there is a delay before this `ReadyReplicas` count
becomes 0. The deplay is very small but may result in rook missing
OSD down event. As a result no blocking PDBs will be created and
only default PDB with `AllowedDisruptions` count as 0 is available.
This PR tries to solve this. The OSD pdb reconciler will be
reconciled again if `AllowedDisruptions` count in the main
PDB is 0.

Signed-off-by: Santosh Pillai <sapillai@redhat.com>
2021-09-14 15:56:59 +05:30
Travis Nielsen 235d5a384b Merge pull request #8693 from travisn/cleanup-docs
docs: Refactor documentation for ceph provider
2021-09-13 11:25:22 -06:00
Travis Nielsen ac6a6d60ba Merge pull request #8699 from subhamkrai/update-script
build: use pkg/operator/ceph/csi/spec.go for csi images
2021-09-13 10:42:27 -06:00
Travis Nielsen 6b7062eda5 docs: refactor documentation for ceph provider
With the nfs and cassandra providers moving to their own repo
we can simplify the docs a bit. Some obsolete documentation
is also removed.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-09-13 10:40:47 -06:00
Travis Nielsen 661ed66f53 Merge pull request #8694 from travisn/commit-prefixes
bot: Add more ceph commit prefixes
2021-09-13 10:36:15 -06:00
Travis Nielsen a32b11c572 bot: add more ceph commit prefixes
With the storage providers moved to their own repo,
we add more possible prefixes for commits to the
ceph operator, including the ceph daemons and csi
driver.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-09-13 09:29:34 -06:00
Travis Nielsen 99811e52e1 Merge pull request #8267 from lyind/master
ceph: fix lvm osd db device check
2021-09-13 09:07:13 -06:00
subhamkrai 284dbc0a0e build: use pkg/operator/ceph/csi/spec.go for csi images
it has happened more than once that the manifests do not
reflect the images so now reading from `pkg/operator/ceph/csi/spec.go`
as this what code uses.

Closes: https://github.com/rook/rook/issues/8687
Signed-off-by: subhamkrai <srai@redhat.com>
2021-09-13 17:16:52 +05:30
Jonas Zeiger 0e72a7c2bf ceph: fix lvm osd db device check
Signed-off-by: Jonas Zeiger <jonas.zeiger@talpidae.net>
2021-09-13 12:19:16 +02:00
Sébastien Han 1df2e9372e Merge pull request #8685 from BlaineEXE/emphaize-unit-tests-in-contributor-guides
docs: emphasize unit tests in development guide
2021-09-13 10:03:44 +02:00
Travis Nielsen fee7e82416 docs: publish master docs to latest path
Rename the master docs to latest. This will be easier
to understand for users who are new to the project.
The url will also contain latest, which will be more
clear to reference instead of the master path. This
also follows the pattern of the ceph docs site.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-09-10 17:55:14 -06:00
Blaine Gardner dc3c84ef27 docs: emphasize unit tests in development guide
Emphasize unit tests in the development guide, and provide guidelines to
help contributors create good unit tests.

Also clarify that Rook's CI will run integration tests and that users
aren't expected to run integration tests locally.

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-09-10 14:30:32 -06:00
Blaine Gardner 94eb4519a0 Merge pull request #8596 from subhamkrai/offline-installation
ci: image list for offline installation
2021-09-09 13:53:49 -06:00
Travis Nielsen 533cb6c07c Merge pull request #8674 from parth-gr/cluster-crd
docs: correct indentation for topologyKey
2021-09-09 12:46:11 -06:00
Travis Nielsen 0cd63aaf29 Merge pull request #8665 from travisn/roadmap-1.8
docs: Update ceph operator roadmap for v1.8
2021-09-09 12:34:24 -06:00
Travis Nielsen c5a55e6a88 docs: storage provider status mentions new repos
With the storage providers all moving to separate repos, we clarify
the status and location of each storage provider. Also, no need to
mention the deprecated storage providers anymore.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-09-09 12:23:48 -06:00
Travis Nielsen d93397ca55 docs: update ceph operator roadmap for v1.8
Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-09-09 12:23:47 -06:00