Commit Graph
696 Commits
Author SHA1 Message Date
Sébastien Han aed084e44c Merge pull request #5931 from aruniiird/mds_pools_optional_in_external_script
ceph: Allowing ceph filesystem argument to be optional
2020-08-03 16:09:32 +02:00
Arun Kumar Mohan cba605a930 ceph: provide storageclass-es if there are valid parameters
'ceph-rgw' storageclass will be provided only if 'rgw_endpoint' exists
'cephfs' storageclass will be provided only if ceph-fs and/or data-pool
parameters are valid.

Signed-off-by: Arun Kumar Mohan <amohan@redhat.com>
2020-07-31 11:13:36 +05:30
Arun Kumar Mohan 18b32023c5 ceph: allowing ceph filesystem argument to be optional
If we are unable to get or infer a default value for ceph filesystem
script won't be throwing an error.

Signed-off-by: Arun Kumar Mohan <amohan@redhat.com>
2020-07-31 11:13:31 +05:30
Travis Nielsen e0ea87a353 Merge pull request #5674 from thotz/quotaobc
ceph: adding support for quota in object bucket claims
2020-07-30 22:51:58 -06:00
Sébastien Han ef434e8f68 Merge pull request #5913 from Madhu-1/csi-del
ceph: update clusterrole of operator for csidrivers
2020-07-30 08:42:58 +02:00
Niels de Vos bb2b4096d1 ceph: do not warn about no redundancy in test cluster
In test environments the default pool size is set to 1, so there is no
redundancy. This causes recent Ceph versions to complain with
HEALTH_WARN as POOL_NO_REDUNDANCY get set.

By disabling the mon_warn_on_pool_no_redundancy option in ceph.conf, the
warning is not reported and the cluster is marked HEALTHY.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2020-07-29 13:25:12 -06:00
Madhu Rajanna 28f0471106 ceph: update clusterrole of operator for csidrivers
updated the clusterrole of the rook operator
to delete the csidrivers object when csi-drivers
are disabled, without the required access rook operator
cannot delete the csidrivers object.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-07-29 09:41:26 +05:30
Sébastien Han c2db463eb2 Merge pull request #5907 from aruniiird/rgw_endpoint_validations_optional
ceph: make 'rgw_endpoint' check/validation also optional
2020-07-28 08:42:52 +02:00
Jiffin Tony Thottan f4240cb31d ceph: add quota support for obc
Closes: #5274
Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2020-07-28 12:00:11 +05:30
Travis Nielsen 22ba4591f3 Merge pull request #5888 from Madhu-1/csi-v3.0.0
ceph: update ceph-csi to v3.0.0 release
2020-07-27 14:05:29 -06:00
Arun Kumar Mohan 59a3be6d75 ceph: make 'rgw_endpoint' check/validation also optional
As 'rgw_endpoint' argument itself is optional, making it's check / validation also optional

Signed-off-by: Arun Kumar Mohan <amohan@redhat.com>
2020-07-27 22:31:31 +05:30
Sébastien Han d5aee01ee3 Merge pull request #5901 from leseb/validate-prefix-rgw-pool
ceph: validate pools with prefix
2020-07-27 17:19:45 +02:00
Travis Nielsen d6b81c9151 Merge pull request #5899 from leseb/optinal-rgw
ceph: make rgw option on external script
2020-07-27 09:10:15 -06:00
Anmol Sachan a42616967d ceph: updated the PV count query for telemeter
Signed-off-by: Anmol Sachan <anmol13694@gmail.com>
2020-07-27 20:18:13 +05:30
Anmol Sachan f3eea6ebb7 ceph: added rules for PVC requested and used capacity for telemeter
This commit adds recording rules to monitor aggregated (requested and used) capacity of the PVCs for block and file type PVCs, via the telemeter.

Signed-off-by: Anmol Sachan <anmol13694@gmail.com>
2020-07-27 20:16:12 +05:30
Sébastien Han 5d02a29d76 Merge pull request #5900 from leseb/monitoring-rules-v15
ceph: add monitoring rules for octopus
2020-07-27 15:29:09 +02:00
Sébastien Han b35c065db5 ceph: validate pools with prefix
Now the rgw pool with a given prefix will also be checked by the script.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-07-27 14:55:08 +02:00
Sébastien Han 44cd526fff Merge pull request #5883 from leseb/rm-sc-external
ceph: remove storageclass-bucket-retain-external.yaml
2020-07-27 11:50:58 +02:00
Sébastien Han 6a643e9522 ceph: add monitoring rules for octopus
Add monitoring rules for octopus clusters.

Closes: https://github.com/rook/rook/issues/5897
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-07-27 10:16:49 +02:00
Madhu Rajanna 6aef231896 ceph: add pvc-clone.yaml for rbd
added pvc-clone.yaml for rbd pvc volume
cloning.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-07-27 13:46:39 +05:30
Madhu Rajanna cc3b4e6906 ceph: remove check for kubernetes version
as we are going to deploy snapshotter by
default we are going to remove the kubernetes
version check.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-07-27 13:45:56 +05:30
Madhu Rajanna 4a1198ee12 ceph: add RBAC for alpha snapshot
Added back the required RBAC to support
snapshot  Alpha version.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-07-27 13:42:32 +05:30
Sébastien Han faad0a45ac ceph: make rgw option on external script
Some clusters do not have rgws deployed so let's make it optional.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-07-27 10:06:31 +02:00
Madhu Rajanna 031e3145a5 ceph: update cephcsi to v3.0.0
update cephcsi to latest available release

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-07-24 10:21:59 +05:30
Alexander Trost 0795204b1d Merge pull request #5872 from cloudical-io/cassandra_update
cassandra: use latest 3.11.6 version in examples
2020-07-23 15:26:36 +02:00
Sébastien Han dcadf10f0c Merge pull request #5837 from leseb/external-connection
ceph: let the healthcheck set the status phase
2020-07-23 09:24:58 +02:00
Sébastien Han cf28b16b68 Merge pull request #5836 from subhamkrai/objectstore-liveness
ceph: ability to configure livenessprobe for cephobjectstore crd
2020-07-23 09:14:34 +02:00
Sébastien Han dc643bfca2 ceph: remove storageclass-bucket-retain-external.yaml
The new CephObjectStore code now has an external property and we won't
require the endpoint to be set manually anymore on the SC. The
lib-bucket code will detect it through the name of the object store.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-07-22 18:37:49 +02:00
Sébastien Han 17e9f1a890 ceph: remove unexisting function
Leftover from a previous patch, this function does not exist anymore.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-07-22 17:25:15 +02:00
Travis Nielsen 66d81230ac Merge pull request #5870 from Madhu-1/remove-metaflag
ceph: remove unwanted metadatastore and mountcache flag
2020-07-22 09:00:23 -06:00
Sébastien Han 8f4e37b80a Merge pull request #5452 from leseb/osd-wipe
ceph: enhancement disk sanitize options
2020-07-22 16:11:35 +02:00
Alexander Trost 29e51cb1e9 cassandra: use latest 3.11.6 version in examples
This also updates the cassandra version in the tests.
This is to provide safe and secure defaults to users running Cassandra.

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2020-07-22 13:18:43 +02:00
Sébastien Han 907c8bf85f Merge pull request #5719 from alimaredia/wip-object-store-multisite-enhancements
ceph: check for adding endpoints into zone group
2020-07-22 11:19:15 +02:00
Madhu Rajanna 73e1ee41c3 ceph: remove unwanted metadatastore and mountcache flag
metadatastore and mountcache are required for cephcsi v1.0.0

as rook doesnot used ceph-csi v1.+ version
we can remove this flag. Removing these flags doesnot
affect the functionality of anything.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2020-07-22 14:36:11 +05:30
Ali Maredia 9dd0ea894a ceph: documentation for pulling a realm for multisite
This commit adds design revisions, examples, and
documentation for object multisite.

Changes to the CephObjectRealm to pull a realm
from another cluster, and the zone for creating
pools are amongst the larger changes

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2020-07-21 16:46:18 -04:00
Ali Maredia 0f7e55780c ceph: add pool creation for ceph-object-zone
When zones are created the ceph RGWs inside the
those zones should be using pools with the zones
name not the object-store's name

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2020-07-21 13:30:41 -04:00
Ali Maredia 5d9c2f09a9 ceph: enable the realm pull on ceph-object-realm
This commit:
- adds the pull section on the CephObjectRealm spec
to enables realms to be pulled instead of created.

- creates the system user and generates the access
key and secret key for the user and zones in a realm.

- adds "omitempty" to fields in multisite CRs that
are not required

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2020-07-21 13:30:19 -04:00
Sébastien Han 10ed662bdb ceph: enhancement disk sanitize options
Now, we can not only cleanup monitor data, logs and crashes but the
disks too. As part of the cleanupPolicy CR spec, we have a new setting
called sanitizeDisk which holds more details:

* method: indicates if the entire disk should be sanitized or simply ceph's metadata.
Possible choices are 'complete' or 'quick' (default)
* dataSource: indicate where to get random bytes from to write on the disk.
Possible choices are 'zero' (default) or 'random'
Using random sources will consume entropy from the system and will take much more time then the zero source
* iteration: overwrite N times instead of the default (1). Takes an integer value

See the documentation for more details.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-07-21 14:07:11 +02:00
subhamkrai 23f0ac7f9c ceph: ability to configure livenessprobe for cephobjectstore crd
this commit allows us to disable livenessprobe for
cephobjectstore crd.

Signed-off-by: subhamkrai <subhamkumarrai03@gmail.com>
2020-07-20 22:53:32 +05:30
Travis Nielsen a1880e6589 Merge pull request #5849 from travisn/target-size-string
ceph: Pool parameters must be strings
2020-07-17 12:24:21 -06:00
Travis Nielsen 5be965c1c3 ceph: target_size_ratio must be a string instead of float
The pool parameters must be strings. In the pool examples now we add
quotes around the sample target_size_ratio to avoid deserialization
errors.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-07-17 11:16:00 -06:00
Anmol Sachan 6bf3aa9a9a ceph: added prometheus rule file for alerting on external cluster
Signed-off-by: Anmol Sachan <anmol13694@gmail.com>
2020-07-17 11:29:51 +02:00
Sébastien Han 34ccb84aa3 ceph: add external prometheus endpoint
We can now connect an external prometheus exporter to Rook to collect
metrics and generate alerts from Prometheus.
Just enable this in the CephCluster CR:

```
spec:
  external:
    enable: true
   monitoring:
    enabled: true
    rulesNamespace: rook-ceph
    externalMgrEndpoints:
    - ip: 192.168.39.182
```

Closes: https://github.com/rook/rook/issues/5516
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-07-17 11:29:48 +02:00
Travis Nielsen e74c7eaef8 ceph: refactor context and clusterInfo passed to the ceph commands
To provide more context for executing commands in a ceph cluster,
the full clusterInfo is now passed to the ceph execution commands.
All information about the cluster will now be available throughout
all the areas of the operator. The namespace, ceph credentials,
mon endpoints, and other info is a core part of that cluster info.

Arguments passed through the controllers are also simplified for
mons, mgr, osds, and other daemons where the parameters had
become too complex.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-07-16 15:54:54 -06:00
Travis Nielsen 631b13b906 ceph: refactor creds used by operator
The operator should only connect to ceph with a single set of creds.
In a converged cluster this will be the admin creds and in an external
cluster it will be lower-privileged creds. Independent clusters were
implemented with a separate set of creds. To simplify the code these
are now merged to a single set.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-07-16 15:54:42 -06:00
Sébastien Han 83e1ff102d ceph: add http dial to verify external endpoint
If there is a typo in the rgw endpoint, then the user will be notified
that the gateway is not accessible or does not return the 200 HTTP code.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-07-15 22:15:42 +02:00
Blaine Gardner f2bc23c33e Merge pull request #4916 from SUSE/drive-groups
Ceph: provision OSDs using Drive Groups
2020-07-14 18:08:45 -06:00
Travis Nielsen 3d3986ee02 Merge pull request #5785 from prksu/fix-nfs-on-openshift
nfs: fix nfs issue on openshift
2020-07-14 11:06:47 -06:00
Blaine Gardner 7117fc12b7 ceph: osd: add drive groups spec to cluster CR
Add the ability to provision Ceph OSDs with Drive Groups.
This adds Drive Groups to the CephCluster CRD, and it sets code
in place for propagating this config to the OSD provisioning pod.

Signed-off-by: Blaine Gardner <blaine.gardner@suse.com>
2020-07-14 09:43:03 -06:00
Ahmad Nurus S 1659687d37 nfs: fix nfs issue on openshift
Signed-off-by: Ahmad Nurus S <prksu.sh@gmail.com>
2020-07-14 18:11:39 +07:00