Commit Graph
52 Commits
Author SHA1 Message Date
Travis Nielsen 3beb625f08 ceph: update examples and operator to Ceph v15.2.8
The latest octopus release is now out with v15.2.8. We update the
operator base image and the examples to run with this version.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-12-17 18:21:15 -07:00
Sébastien Han ada6d6a59a Merge pull request #6687 from leseb/fix-6659
ceph: include csi by default in the csv
2020-12-03 09:56:42 +01:00
Travis Nielsen 0a35a08f2f ceph: update examples and base image to v15.2.7
With the release of the latest octopus v15.2.7 we update the base
of the operator image and set the examples to use the same release
to pick up the security and other bug fixes.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-12-01 12:05:39 -07:00
Sébastien Han 9a5421f53a ceph: include csi by default in the csv
It has been a couple of releases since we started deploying Rook along
with Ceph-CSI by default. So let's include Ceph-CSI natively in our CSV
generation.

Closes: https://github.com/rook/rook/issues/6659
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-11-23 12:00:29 +01:00
Travis Nielsen bf1d3888f4 ceph: factor out CRDs from the common.yaml and helm chart
The CRDs need to be installed and updated separately from the
rest of the manifests. Helm charts also do not have a way to update
CRDs, therefore, any updates to the CRD schema must be done separately
from the helm chart. Now the CRDs are created in a new crd.yaml that must
be created along with common.yaml and before creating the operator.

The helm chart still contains the CRDs for initial creation, though
the helm chart will never update or remove them.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-11-11 12:16:20 -07:00
Travis Nielsen a5b9fbc994 ceph: update base image and examples to v15.2.5
For the v1.5 release we use the latest version of ceph by default,
which is now v15.2.5

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-11-05 15:50:23 -07:00
Lalit Maganti c6aec79c4f ceph: add option to preserve filesystem on CRD deletion
Due to #6492, preservePoolsOnDelete is not useful at all for CephFS;
after the filesystem is deleted, the leftover pools cannot be
reassocaited with a newly created filesystem without wiping all
metadata. The only way we can actually preserve data is keeping around
the entire filesystem.

This commit implements a `preserveFilesystemOnDelete` option which work
similar to the existing pool preservation option but instead keeps the
whole CephFS while taking it down and removing all MDSes.

This commit also changes all documentation to refer to this new option
with the intent of essentially deprecating `preservePoolsOnDelete`. IMO,
keeping around `preservePoolsOnDelete` is actively harmful because it
lulls users into thinking their data will be safe but, in reality,
recovering from this situation is highly complex and has large potential
for data loss.

Signed-off-by: Lalit Maganti <lalitm@google.com>
2020-10-30 17:04:18 +00:00
Sébastien Han 65fb4819bc ceph: replace service account names properly in the CSV
The CSV generation needs to be patched with the correct service account names
for the correct RBAC to be generated.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-11 11:13:44 -06:00
Sébastien Han ec58092778 ceph: add missing crds in csv
The newly object store CRDs were missing from the CSV.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-08-11 15:00:49 +02:00
Travis Nielsen 772b7990db ceph: updated clusterroles applied in upgrade test
In the upgrade integration test we need to mirror what we expect
users to do during the upgrade by applying the new clusterroles.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-08-04 16:04:07 -06:00
Travis Nielsen dbae36b2bb ceph: update to the latest octopus release
Update the base operator image and cluster examples to use the latest
octopus release v15.2.4. Also cleanup some old examples and unit tests
that were still based on mimic.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-07-06 12:11:47 -06:00
Travis Nielsen 955dcb930e Merge pull request #5377 from alimaredia/wip-object-store-multisite
Foundation for Object Store Multisite CRs
2020-06-10 16:07:53 -06:00
Diego Abelenda 2ea06aba71 build: add OKD metadata for CSV generation
Add Ceph CSV metadata for OKD platform.
This will allow to have a CSV compatible with OKD as the CSV should be different than both OCP (Red Hat supported) and k8s (missing some security definitions).

Signed-off-by: Diego Abelenda <diego.abelenda@gmail.com>
2020-06-10 14:21:10 +02:00
Ali Maredia fc579f4520 ceph: initial commit for ceph rgw multisite resources
This commit contains CR implementations for:
CephObjectRealm
CephObjectZoneGroup
CephObjectZone

Also there are changes made to the objectstore
to add rgws in the object-store to zones and
zone groups in a multisite configuration and
the removal of the --default parameter for any
realms/zonegroups/zones that are created.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2020-06-09 16:28:53 -04:00
Diego Abelenda e3b51bf944 csv: Make csv generation work with operator-sdk 0.15.0 and later, remove support for previous versions.
Newer versions of operator-sdk (since 0.15.0, released Jan 2020) have a different command line to generate CSV. Make changes to the script generating the CSV so that it works with these new versions.
Use the newer manifest format to be compatible with bundles in the future.

Signed-off-by: Diego Abelenda <diego.abelenda@gmail.com>
2020-05-28 17:04:33 +02:00
Arun Kumar Mohan bb770bb0d1 Ceph: A minor fix to 'generate-rook-csv.sh' script
A square bracket check on <shell_command> return status
will not work in an 'if' condition.

Signed-off-by: Arun Kumar Mohan <arun.iiird@gmail.com>
2020-05-23 23:36:37 +05:30
Sébastien Han 52aa010f6c csv: add missing rbd mirror
Add rbd mirror to the CSV

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-05-13 13:53:18 +02:00
Sébastien Han 954b4e77df csv: add missing CephFilesystem
Somehow the CephFilesystem was not present so adding it.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-05-13 11:54:47 +02:00
Sébastien Han c4c873c27e csv: add external cluster script
We now include the newly created script for external cluster in the CSV.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-05-12 09:18:42 +02:00
Jared Watts 6e3921adfa docs: update rook mailing lists to new lists.cncf.io addresses
This commit updates the readme and docs with the new Rook mailing lists hosted
by the CNCF:

* cncf-rook-info@lists.cncf.io
* cncf-rook-security@lists.cncf.io
* cncf-rook-distributors-announce@lists.cncf.io

Signed-off-by: Jared Watts <jbw976@gmail.com>
2020-04-28 07:42:00 -07:00
Travis Nielsen 348690ea64 ceph: update defaults to the ceph v14.2.9 release
With the release of ceph v14.2.9 we set the default examples to this version.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-04-17 12:54:06 -06:00
Sébastien Han c1b8a7aa9e ceph: extract rbd-mirror to its own crd
Previously, the rbd-mirror daemon was integrated into the `CephCluster`
CRD. This wasn't really practical since we would have to wait for the
whole orchestration to be done to actually set it up. The same goes for
any CR update. Let's say you want to change the number of daemons, Rook
would go through mons, mgrs and osds until it get to rbd-mirror.
This triggers an undesired full orchestration.

With its own CRD this component just gains a lot more flexibility.

Closes: https://github.com/rook/rook/issues/5084
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-04-15 09:12:56 +02:00
Sébastien Han 14cb46ae39 ceph: bump to 14.2.8
Ceph 14.2.8 just got released so let's use it.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-03-11 19:32:48 +01:00
Travis Nielsen e35939b26c ceph: bump ceph version to v14.2.7
The ceph/ceph:v14.2.7 image is released so we can pick these fixes
up as the recommended version of ceph.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-02-20 11:06:40 -07:00
Rohan CJ a439197ebd Ceph: Generate CSV for v1.2.2
Signed-off-by: Rohan CJ <rohantmp@gmail.com>
2020-01-31 16:21:24 +05:30
Sébastien Han dec0c7d4b0 ceph: bump to 14.2.6
14.2.6 is released, let's use it!

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-01-15 11:02:44 +01:00
Swati Kale 946c6e2a64 olm: Metadata for creation of operand form for CephObjectStore
Signed-off-by: Swati Kale <swkale@redhat.com>
2019-12-12 14:06:11 -05:00
Sébastien Han 68fd4f4df9 rook: stop using ceph version with timestamp
With https://github.com/ceph/ceph-container/pull/1529, we now build
vX.X.X version so we don't need to have the timestamp. Also we will
automatically get the last changes from the OS/packages too more
frequently.

Closes: https://github.com/rook/rook/issues/4414
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-12-10 11:39:35 +01:00
Sébastien Han 0b4129c856 rook-ceph olm: add missing nfs crd example
When displaying the CRDs OLM looks into the alm-examples field in the
CSV file, the NFS CRD example was missing so let's add it.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-09-23 12:08:15 +02:00
Sébastien Han cf091d3773 Merge pull request #3928 from rohantmp/csvBump
Generate OLM clusterserviceversion v1.1.1
2019-09-23 11:46:55 +02:00
Rohan CJ e480aa8ddf Generate CSV v1.1.1
Signed-off-by: Rohan CJ <rohantmp@gmail.com>
2019-09-20 12:04:16 +05:30
Rohan CJ d332c6a654 Add CephNFS to CSV
Signed-off-by: Rohan CJ <rohantmp@gmail.com>
2019-09-19 19:08:12 +05:30
Sébastien Han bc6dcb9995 ceph: bump to v14.2.4
v14.2.4 just got released so let's use it.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-09-17 15:08:15 +02:00
Sébastien Han 3390a85404 ceph: bump to 14.2.3
Let's use the latest minor release of Ceph 14.2.3.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-09-04 23:14:28 +02:00
Kaushal M 77fc5e9c14 csv: Fix name SA name for CSI RBD provisioner
Signed-off-by: Kaushal M <kshlmster@gmail.com>
2019-08-29 14:24:45 +05:30
Travis Nielsen 524f315665 Merge pull request #3703 from davidvossel/csv-template-fix
Csv template fix
2019-08-27 08:43:29 -06:00
David Vossel 54f8eb7ee1 Fix rules to service account mapping in csv generation script
Signed-off-by: David Vossel <davidvossel@gmail.com>
2019-08-26 17:59:24 -04:00
Sébastien Han a42916eff0 ceph: use latest ceph images
The last image has disabled ephemeral repositories so it's now possible
for images older than 15 days to install packages without having an
  error from non-existing repositories.

Closes: https://github.com/rook/rook/issues/3662
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-08-26 23:50:55 +02:00
David Vossel 59ea31c7e0 Include csi cephfs and rbd in CSV template
Signed-off-by: David Vossel <davidvossel@gmail.com>
2019-08-23 10:22:53 -04:00
David Vossel 27828261f7 Add 'yq' yaml merger tool as optional rook-ceph dependency
Signed-off-by: David Vossel <davidvossel@gmail.com>
2019-08-20 13:39:39 -04:00
David Vossel be3389130c Add operator sdk as optional build dependency for rook-ceph
Signed-off-by: David Vossel <davidvossel@gmail.com>
2019-08-20 13:39:39 -04:00
David Vossel c13aff199b Add csv templates to rook-ceph container image
Signed-off-by: David Vossel <davidvossel@gmail.com>
2019-08-20 13:39:39 -04:00
David Vossel 2f9fd924d2 Add script to generate CSV templates for rook-ceph
Signed-off-by: David Vossel <davidvossel@gmail.com>
2019-08-20 13:39:39 -04:00
David Vossel a5a20e8181 Fix overwriting of CSV cluster permissions when ocp provider is in use
The OCP provider needs additional cluster permissions for
objects like SCC. The yq merge was clobbering all cluster
permissions when attempting to add the special OCP related
permissions.

Signed-off-by: David Vossel <davidvossel@gmail.com>
2019-08-20 13:39:39 -04:00
Sébastien Han 41d2953e7e ceph: use latest 14.2.2 code
14.2.2 is out and along with it numerous fixes so let's use it.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-07-22 15:58:25 +02:00
Poornima G 4ddef3e823 Change the ceph image to latest-nautlius-devel
Currently in cluster deploy, ceph image points to ceph/ceph:v14.2.1-20190430.
Changing this to use ceph/daemon-base:latest-nautilus-devel as its the latest nautilus.

Ceph nautilus has some changes in cephsfs mgr module, which is required by ceph-csi
canary image, without which the create/purge of RWX PVCs will fail. These changes
are not yet part of any released ceph version, i.e v14.2.1-20190430. Even in the
short future, we expect some changes to land in Nautilus after 14.2.2, hence
waiting for 14.2.2 release and updating to it, will not solve the issue.
Therefore using latest-nautilus-devel, which will always have the changes
required by ceph-csi. This is only a temperory change in the master, until
14.2.3 is released.

Signed-off-by: Poornima G <pgurusid@redhat.com>
2019-07-05 06:50:30 +00:00
Sébastien Han 93b2448619 ceph: refactor rgw bootstrap
This commit does multiple things:

* remove support for AllNodes where we would deploy one rgw per node on
all the nodes.
* a transition path is implemented in the code so that if someone has an
existing deployment, daemonsets will be removed and replaced by an
deployments.
* when using "instances", each rgw deployed has its own key which makes
Ceph reporting the exact number of rgw running, see:

```
[root@rook-ceph-operator-775cf575c5-bh4sr /]# ceph -s
  cluster:
    id:     611fcf39-0669-4864-9a12-debb35c0397a
    health: HEALTH_OK

  services:
    mon: 3 daemons, quorum a,b,c (age 12h)
    mgr: a(active, since 12h)
    osd: 3 osds: 3 up (since 12h), 3 in (since 12h)
    rgw: 3 daemons active (my.store.a, my.store.b, my.store.c)

  data:
    pools:   6 pools, 600 pgs
    objects: 235 objects, 3.8 KiB
    usage:   3.0 GiB used, 84 GiB / 87 GiB avail
    pgs:     600 active+clean
```

Closes: https://github.com/rook/rook/issues/2474, https://github.com/rook/rook/issues/2957 and https://github.com/rook/rook/issues/3245
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-06-14 17:55:15 +02:00
Travis Nielsen cea5fd8676 Merge pull request #3240 from invidian/nit
Fix inconsistency regarding csv-ceph Makefile target
2019-06-03 07:42:22 -06:00
Mateusz Gozdek 0daca0e647 cluster/olm/ceph/README.md: fix inconsistent references to Makefile target
0fc3775b99 added csv-ceph target to Makefile,
but README.md refers to non-existent 'csv' target. This comment aligns
it.

Signed-off-by: Mateusz Gozdek <mgozdekof@gmail.com>
2019-05-31 11:13:50 +02:00
Mateusz Gozdek fcba12a402 generate-rook-csv.sh: fix printed examples
0fc3775b99 added new Makefile target
'csv-ceph', but printed examples refers to non-existing target 'csv'.

This commit fixes this inconsistency.

Signed-off-by: Mateusz Gozdek <mgozdekof@gmail.com>
2019-05-31 11:08:36 +02:00