Commit Graph
7961 Commits
Author SHA1 Message Date
Jiffin Tony Thottan d909c309f3 ceph: update the backend path for transit engine
The backend has for trasnit secret in vault kms for RGW is changed from pacific

Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2021-05-27 22:48:21 +05:30
Henry Zhang ecf6bdcfae ceph: add build and tests for rook-ceph-cluster Helm chart
Adds rook-ceph-cluster chart to chart build, add tests.
Pulled out some common functionality between the Helm and non-Helm installers

Signed-off-by: Henry Zhang <me@henry.dev>
2021-05-27 01:08:27 -07:00
Henry Zhang b59858af38 ceph: implement CephCluster CRD Helm Chart
This manages a CephCluster CRD, and is designed to be deployed into its own namespace to manage a single Ceph cluster independent of the main Rook operator.

Additional functions:
- Ability to setup ServiceMonitor for the Prometheus operator

Signed-off-by: Henry Zhang <me@henry.dev>
2021-05-27 01:08:27 -07:00
Sébastien Han 74bae84bb7 Merge pull request #7976 from subhamkrai/configmap-log-level
ceph: change operator log level dynamically
2021-05-27 10:01:39 +02:00
subhamkrai 0d17dede9c ceph: change operator log level dynamically
earlier, to change the operator log level we need
to change the deployment which requires a restart
the operator pod.

Now, we are changing the log level dynamically
by reading the configmap. For, backward compatibility
we still load from env var.

Signed-off-by: subhamkrai <srai@redhat.com>
2021-05-27 12:40:50 +05:30
Satoru Takeuchi ca9aa1a11c ceph: parse json correctly
radosgw-admin may output logs before and after JSON when this command succeeds. We should
get rid of these logs before unmarshaling output. Although the logs before JSON were
treated in  PR7354, the logs after JSON weren't.

Signed-off-by: Satoru Takeuchi <satoru.takeuchi@gmail.com>
2021-05-27 04:46:13 +00:00
Blaine Gardner 3eb758a174 Merge pull request #7993 from BlaineEXE/update-ceph-images-to-v16.2.4
ceph: update references to v15.2.11 to v16.2.4
2021-05-26 14:21:27 -06:00
Blaine Gardner 285dad339b ceph: update references to v15.2.11 to v16.2.4
Ceph v16 will be the default in Rook v1.7. Update references in the
master branch from v15 (currently v15.2.11) to v16 (currently v16.2.4).

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-05-26 12:30:18 -06:00
Sébastien Han 5346500076 Merge pull request #6868 from Madhu-1/helm-lint
ceph: add github action for helm lint
2021-05-26 11:29:05 +02:00
Madhu Rajanna 3a3bfdefb4 ceph: add github action for helm lint
adding github action for helm lint to
catch the static check errors in helm
charts.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2021-05-26 14:27:59 +05:30
Travis Nielsen c929cb0536 Merge pull request #7985 from Madhu-1/vr-release-v0.1
ceph: pin volume replication to release-v0.1 branch
2021-05-25 09:25:25 -06:00
Travis Nielsen daf7182d31 Merge pull request #7986 from leseb/drop-mirror-site-name
ceph: remove '--site-name' arg when creating bootstrap peer token
2021-05-25 07:26:45 -06:00
Sébastien Han b13c494fec ceph: remove '--site-name' arg when creating bootstrap peer token
`rbd mirror pool peer bootstrap create` will use cluster fsid by default, so specifying --site-name shouldn't be needed at all.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-05-25 09:00:49 +02:00
Travis Nielsen e1b64e3624 Merge pull request #7945 from subhamkrai/bump-golang1.16
build: bump to golang version 1.16
2021-05-24 23:20:52 -06:00
Madhu Rajanna 95d1bb9184 ceph: pin volume replication to release-v0.1 branch
added volume replication operator release-v0.1
branch to the go.mod as we are doing enhancements to the
volume replicaiton CRDS. Once we have a release will
change this to release-v0.1 branch.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2021-05-25 10:37:05 +05:30
Travis Nielsen d3c18d001b Merge pull request #7974 from leseb/fix-7963
ceph: do not configure external metric endpoint is not present
2021-05-24 13:56:54 -06:00
Travis Nielsen da7dcacf74 Merge pull request #7930 from SerialVelocity/patch-1
Fix helm chart to allow multiple filesystems
2021-05-24 13:45:02 -06:00
Sébastien Han 846447e61f Merge pull request #7935 from leseb/update-peer-token-if-mon-change
ceph: rehydrate the bootstrap peer token secret on monitor changes
2021-05-24 16:40:48 +02:00
Sébastien Han db91fd8bc3 ceph: do not configure external metric endpoint is not present
If no endpoint are configured let's simply return.

Closes: https://github.com/rook/rook/issues/7963
Signed-off-by: Sébastien Han <seb@redhat.com>
2021-05-24 14:41:26 +02:00
Ben Grabham 25c3b868fd ceph: fix helm chart to allow multiple filesystems
Fix helm chart to allow multiple filesystems. This isn't required for Pacific but when upgrading from 1.5.x this is usually still set.

Signed-off-by: Ben Grabham <git@chillichef.com>
2021-05-22 13:36:43 +01:00
Travis Nielsen 2a9c81ec55 Merge pull request #7951 from BlaineEXE/scan-disks-in-init-container-for-raw-osds-on-node
ceph: scan raw OSDs on nodes in OSD init container
2021-05-20 13:01:32 -06:00
Blaine Gardner 8f7f24b1fc ceph: scan raw OSDs on nodes in OSD init container
The 'ceph-volume raw list' command used to list OSDs on nodes by the
rook-ceph-osd-prepare- jobs return user-friendly device names (e.g.,
/dev/sda) rather than persistent device names. Friendly device names
often change when systems reboot, and even persistent device names can
change under certain circumstances (e.g., a disk controller is replaced
with a different one). To prevent OSD Pods created for raw OSDs on
nodes from crashing repeatedly if the device it was created with is
renamed, scan the list of OSDs on the host with 'ceph-volume raw list'
to find the right OSD to activate in the OSD pod's OSD activation init
container.

Fixes #7918

Signed-off-by: Blaine Gardner <blaine.gardner@redhat.com>
2021-05-20 12:35:53 -06:00
Blaine Gardner 24d5eb7767 Merge pull request #7952 from synarete/partprobe-after-zapdevice
docs: call partprobe after zapping device
2021-05-20 10:42:06 -06:00
Sébastien Han c9f28b85cf Merge pull request #7948 from subhamkrai/nfs-action
nfs: add github action for NFS integration test
2021-05-20 17:37:04 +02:00
Sébastien Han ea97c62954 Merge pull request #7953 from leseb/fix-python-failure-prometheus
ci: wait a bit for the python script to succeed
2021-05-20 15:35:46 +02:00
Sébastien Han 003e2535b5 ci: wait a bit for the python script to succeed
We still see the CI failing with:

```
Traceback (most recent call last):
  File "/etc/ceph/create-external-cluster-resources.py", line 801, in <module>
    raise err
  File "/etc/ceph/create-external-cluster-resources.py", line 798, in <module>
    rjObj.main()
  File "/etc/ceph/create-external-cluster-resources.py", line 779, in main
    generated_output = self.gen_json_out()
  File "/etc/ceph/create-external-cluster-resources.py", line 613, in gen_json_out
    self._gen_output_map()
  File "/etc/ceph/create-external-cluster-resources.py", line 598, in _gen_output_map
    self.out_map['MONITORING_ENDPOINT_PORT'] = self.get_active_and_standby_mgrs()
  File "/etc/ceph/create-external-cluster-resources.py", line 389, in get_active_and_standby_mgrs
    self.endpoint_dial(monitoring_endpoint)
  File "/etc/ceph/create-external-cluster-resources.py", line 245, in endpoint_dial
    "unable to connect to endpoint: {}".format(endpoint_str))
__main__.ExecutionFailureException: unable to connect to endpoint: 172.17.0.7:9283
command terminated with exit code 1
```

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-05-20 09:44:49 +02:00
Shachar Sharon 4509958bab docs: call partprobe after zapping device
Play safe: after zapping devices, issue a call to 'partprobe' to inform
the OS on partition table changes. This may assists users who face
voodoo partition creation, as described in those ROOK issues:

https://github.com/rook/rook/issues/7734
https://github.com/rook/rook/issues/7940

Signed-off-by: Shachar Sharon <ssharon@redhat.com>
2021-05-20 10:00:01 +03:00
Sébastien Han dc0985c7f6 ceph: rehydrate the bootstrap peer token secret on monitor changes
If the monitors addresses change, we must update the peer secret with
the new addresses. For this, each time the configmap
"rook-ceph-mon-endpoints" is updated, we trigger a reconcile on the
CephBlockPool CRs, which will update the token secret.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-05-20 08:50:22 +02:00
subhamkrai a19a7f90e1 nfs: add github action for NFS integration test
this commit add github action for NFS
integration test.

Signed-off-by: subhamkrai <srai@redhat.com>
2021-05-20 10:53:14 +05:30
Travis Nielsen 162fd1b442 Merge pull request #7912 from travisn/consolidate-rookv1
build: Refactor to consolidate the rook.io/v1 package
2021-05-19 13:33:32 -06:00
Sébastien Han a34cb1977a Merge pull request #7949 from Madhu-1/mirror/fix-yaml
ceph: correct component in mirroring yaml
2021-05-19 17:13:42 +02:00
Madhu Rajanna 57abd19a12 ceph: correct component in mirroring yaml
corrected the component in mirroring yaml and added
appropriate mirroring related affinity example.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2021-05-19 20:03:49 +05:30
Travis Nielsen b37e620549 Merge pull request #7942 from subhamkrai/disable-fork-action
ci: restrict push image build action to run on fork
2021-05-19 07:55:30 -06:00
Travis Nielsen 4456a5ae99 Merge pull request #7910 from travisn/roadmap-1.7
docs: Update roadmap for v1.7
2021-05-19 07:08:47 -06:00
subhamkrai de96a14e31 ci: restrict push image build action to run on fork
this commit restrict push image build action to run on
fork repo.

Signed-off-by: subhamkrai <srai@redhat.com>
2021-05-19 13:37:35 +05:30
subhamkrai bf7b4609b1 build: bump to golang version 1.16
this commit bump to golang version 1.16.

Signed-off-by: subhamkrai <srai@redhat.com>
2021-05-19 13:35:20 +05:30
Sébastien Han cfcdcac56e Merge pull request #7222 from iamniting/events
ceph: generate cephCluster reconcile result as events
2021-05-19 08:50:42 +02:00
Travis Nielsen b0a63711f5 build: refactor to consolidate the rook.io/v1 package
The rook.io/v1 package was only an internal implementation detail and
does not have any CRDs that rely on it. The CRD deserialization should
handle the change in internal types without any issue. This separation
gives more flexibility for the storage providers to implement exactly
what is needed for their storage provider instead of forcing to use the
same types and risk affecting another storage provider.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-05-18 19:55:37 -06:00
Travis Nielsen 4f4fe918d0 Merge pull request #7933 from travisn/extensionsv1-doc
ceph: Updated dashboard ingress example for v1
2021-05-18 16:31:48 -06:00
Travis Nielsen 93c8b73df9 Merge pull request #7936 from travisn/revert-disable-push
Revert restriction to push image build action to run on fork as it also disabled master pushes
2021-05-18 12:09:42 -06:00
Travis Nielsen f61083bb2b Revert "ci: restrict push image build action to run on fork"
This reverts commit e0206c56d5.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-05-18 11:39:58 -06:00
Sébastien Han 0459a20173 ceph: stop using the namespace in the site's name
Removing the site's name helps us reducing the size of the rbd-mirror
socket path which under certain circumstances could exceed the system
limit.
Also, the namespace information is not that relevant, the cluster FSID
is.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-05-18 19:36:53 +02:00
Sébastien Han 2793750146 ceph: silence harmless errors when the operator is not initialized
If the ceph cli outputs an error with "error calling conf_read_file"
this means that the operator has not written its ceph configuration
file. Thus ceph cli commands will fail, so we can just ignore that since
the operator will soon write this file in its initialization sequence.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-05-18 19:35:07 +02:00
Travis Nielsen 142c3fd891 ceph: updated dashboard ingress example for v1
The ingress kind is found in apiversion networking.k8s.io/v1 since K8s
1.19. We now update the examples to use v1 instead of v1beta1.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-05-18 11:20:13 -06:00
Travis Nielsen c1818cb681 Merge pull request #7923 from subhamkrai/add-tag-master-build
ci: add missing tag in master push images
2021-05-18 11:10:27 -06:00
Travis Nielsen e46dc1cd17 Merge pull request #7928 from leseb/fix-7927
ci: retry when fetching online manifests
2021-05-18 10:52:47 -06:00
Sébastien Han f1f3416f49 ci: retry when fetching online manifests
We now retry up to 3 times if the manifest fails to be fetched online.

Closes: https://github.com/rook/rook/issues/7927
Signed-off-by: Sébastien Han <seb@redhat.com>
2021-05-18 17:22:12 +02:00
Travis Nielsen e214a5574f docs: update roadmap for v1.7
With the v1.6 release completed, we now update the roadmap
for v1.7.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2021-05-18 09:18:38 -06:00
Travis Nielsen bbf29dbe70 Merge pull request #7922 from leseb/doc-fix
doc: fix patch command
2021-05-18 07:41:48 -06:00
Nitin Goyal 25d2df4018 ceph: generate cephCluster reconcile result as events
Generate cephCluster reconcile result as an k8s event if it is not
already present on the cluster

Signed-off-by: Nitin Goyal <nigoyal@redhat.com>
2021-05-18 18:27:52 +05:30