Commit Graph
10240 Commits
Author SHA1 Message Date
travisn f97d3a8a0b build: avoid crd edits when building on mac
On mac development machines, the crds are being left in a
state of change with the description removed and the
OBC CRDs removed from crds.yaml and resources.yaml.
By skipping the related env vars, these resources
are no longer left unexpectedly modified.

Signed-off-by: travisn <tnielsen@redhat.com>
(cherry picked from commit 0bf117493d)
2023-09-15 16:50:19 +00:00
Travis Nielsen d8b736e58e Merge pull request #12910 from rook/mergify/bp/release-1.12/pr-12898
build: update s5cmd to version v2.2.1 (backport #12898)
2023-09-15 10:10:28 -06:00
Michael Adam a5f07a1543 build: update s5cmd to version v2.2.1
This is the latest available version.
The previously used version v2.0.0 was very outdated.

Fixes: #12883

Co-authored-by: subham rai subhamkrai <srai@redhat.com>
Signed-off-by: Michael Adam <obnox@samba.org>
Signed-off-by: Subham Rai subhamkrai <srai@redhat.com>
  signed-off-by: Travis Nielsen <tnielsen@redhat.com>
    Co-authored-by: Travis Nielsen <tnielsen@redhat.com>
(cherry picked from commit cef43e1155)
2023-09-15 15:17:41 +00:00
mergify[bot] c1d25e71e7 Merge pull request #12906 from rook/mergify/bp/release-1.12/pr-12895
mgr: Allow more than two mgrs (backport #12895)
2023-09-14 23:17:13 +00:00
Travis Nielsen 559f6605cc Merge pull request #12908 from travisn/release-1.12.4
build: Update the release version to v1.12.4
v1.12.4
2023-09-14 16:59:46 -06:00
travisn 3eb06d1f05 build: update the release version to v1.12.4
For the patch release update the docs and examples
to v1.12.4.

Signed-off-by: travisn <tnielsen@redhat.com>
2023-09-14 16:01:40 -06:00
travisn 19ffd749e0 mgr: allow more than two mgrs
While two mgrs is considered sufficient, more mgr daemons are
now allowed in case the admin wants even more fault tolerance
to the active mgr going down, in case multiple mgrs go down.
Up to five mgr pods will be allowed. All mgrs will be in
standby mode except one active mgr. All mgr pods have a sidecar
that will update their respective pod specs with the active
or passive label.

Signed-off-by: travisn <tnielsen@redhat.com>
(cherry picked from commit 66547d27be)
2023-09-14 21:03:43 +00:00
Travis Nielsen 41004d8d2f Merge pull request #12831 from rook/mergify/bp/release-1.12/pr-12791
core: restart ceph daemons when network updated (backport #12791)
2023-09-12 16:23:59 -06:00
Travis Nielsen 7e64b9c144 Merge pull request #12873 from rook/mergify/bp/release-1.12/pr-12872
helm: update docs/comments to reflect reef support (backport #12872)
2023-09-12 16:22:46 -06:00
Travis Nielsen 7468605992 Merge pull request #12893 from rook/mergify/bp/release-1.12/pr-12886
exporter: bind to all interfaces if IPv6 is enabled (backport #12886)
2023-09-12 16:19:49 -06:00
Matthew Penner 9744c97227 exporter: bind to all interfaces if IPv6 is enabled
Previously ceph-exporter would only bind to IPv4 interfaces. Now if the
CephCluster is configured with `dualStack: true` and/or `ipFamily: IPv6`
an additional flag (`--addrs ::`) will be added to the ceph-exporter
container to make it listen both IPv6 and IPv4 interfaces.

Signed-off-by: Matthew Penner <me@matthewp.io>
(cherry picked from commit d09a43df37)
2023-09-12 20:10:55 +00:00
mergify[bot] f8035e561f Merge pull request #12892 from rook/mergify/bp/release-1.12/pr-12884
object: unique username for OBC even when preceding OBC was retained (backport #12884)
2023-09-12 17:01:41 +00:00
Sebastian Hasler 38958ecce2 object: unique username for OBC even when preceding OBC was retained
For an OBC's name we cannot simply use the OBC's namespace and name,
because they can be reused, while the preceding bucket might be
retained by reclaimPolicy. (Commit 2733375ca4 also didn't solve
this issue, as it is an intra-cluster issue.) Therefore we instead
use the OBC's UID which should be unique within the cluster and
across clusters.

Signed-off-by: Sebastian Hasler <sebastian.hasler@stuvus.uni-stuttgart.de>
(cherry picked from commit 041fc1a71c)
2023-09-12 16:11:06 +00:00
Micah Nagel 60170feb83 helm: update docs to reflect reef support
some helm comments incorrectly indicate ceph v18 is not supported

Signed-off-by: Micah Nagel <micah.nagel@defenseunicorns.com>
(cherry picked from commit 0ff224d453)
2023-09-08 18:51:27 +00:00
Blaine Gardner 522b49bbd1 Merge pull request #12866 from rook/mergify/bp/release-1.12/pr-12778
multus: allow using NADs without inspectable CIDRs (backport #12778)
2023-09-07 15:07:40 -06:00
Blaine Gardner 8b72dfa020 multus: detect network CIDRs via canary
Change how Rook detects network CIDRs for Multus networks. The IPAM
configuration is only defined as an arbitrary string JSON blob with a
"type" field and nothing more. Rook's detection of CIDRs for whereabouts
had already grown out of date since the initial implementation.
Additionally, Rook did not support DHCP IPAM, which is a reasonable
choice for users. And more, Rook did not support CNI plugin chaining,
which further complicates NADs. Based on the CNI spec, network chaning
can result in any changes to network CIDRs from the first-given plugin.

All these problems make it more and more difficult for Rook to support
Multus by inspecting the NAD itself to predict network CIDRs. Instead,
it is better for Rook to treat the CNI process as a black box. To
preserve legacy functionality of auto-detecting networks and to make
that as robust as possible, change to a canary-style architecture like
that used for Ceph mons, from which Rook will detect the network CIDRs
if possible.

Also allow users to specify overrides for CIDR ranges. This allows Rook
to still support esoteric and unexpected NAD or network configurations
where a CIDR range is not detectable or where the range detected would
be incomplete. Because it may be impossible for Rook to understand the
network CIDRs wholistically while residing only on a portion of the
network, this feature should have been present from Multus's inception.

Improving CIDR auto-detection and allowing users to specify overrides
for auto-detected CIDRs rounds out Rook's Multus support for CephCluster
(core/RADOS) installations. No further architectural changes should be
needed for CephClusters as regards application of public/cluster network
CIDRs for Multus networks.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
(cherry picked from commit 3c43268d0a)
2023-09-07 19:43:17 +00:00
mergify[bot] c560c244e1 Merge pull request #12863 from rook/mergify/bp/release-1.12/pr-12844
Fix discover daemonset default value for discovery interval (backport #12844)
2023-09-07 16:07:56 +00:00
Louis Bailleul e65e7bac12 operator: config default interval value for discovery daemon
Correctly set discoveryInterval default value by passing defaultDiscoverInterval to k8sutil.GetValue
Allow to set ROOK_DISCOVER_DEVICES_INTERVAL env var through discoveryDaemonInterval helm value

Signed-off-by: Louis Bailleul <louis.bailleul@pgs.com>
(cherry picked from commit e56122cbce)
2023-09-07 09:12:46 -06:00
Travis Nielsen 00bf2ca893 Merge pull request #12864 from rook/mergify/bp/release-1.12/pr-12691
operator: move most of discover pod setting to cm (backport #12691)
2023-09-07 09:02:51 -06:00
subhamkrai 233e68ecbf operator: move most of discover pod setting to cm
It's better to move most of discover daemon setting
from env to configmap rook-ceph-operator-config.
Although, we are moving to configmap, we keep reading settings
from env but the priority will be configmap settings.

Signed-off-by: subhamkrai <srai@redhat.com>
(cherry picked from commit fb39580067)
2023-09-07 14:15:55 +00:00
Travis Nielsen 36f078f8f7 Merge pull request #12853 from travisn/toolbox-operator-image
build: Correct release version for toolbox based on operator in release-1.12 branch
2023-09-06 10:05:24 -06:00
mergify[bot] 5771c6dd7c Merge pull request #12854 from rook/mergify/bp/release-1.12/pr-12840
helm: move discovery daemon settings into the configmap (backport #12840)
2023-09-06 00:02:48 +00:00
Stephen Muth 54ed618eb0 helm: move discovery daemon settings into configmap
This allows the rook mgr module to check if the discovery daemon is enabled. The udev blacklist setting was also moved just to keep similar settings in the same place.

Signed-off-by: Stephen Muth <smuth4@gmail.com>
(cherry picked from commit 37d8de0993)
2023-09-05 23:19:52 +00:00
travisn 38f86864b9 build: correct release version for toolbox based on operator
The toolbox based on the operator image was added after the initial
release of v1.12.0, where the image tags from master were replaced
by hte release version. When the feature was backported,
the master tag remained. Now the version tag is set
as expected.

Signed-off-by: travisn <tnielsen@redhat.com>
2023-09-05 15:02:54 -06:00
mergify[bot] bf593820e0 Merge pull request #12851 from rook/mergify/bp/release-1.12/pr-12770
osd: replace existing OSDs to use new store (backport #12770)
2023-09-05 17:07:27 +00:00
Travis Nielsen f5da6ce08a Merge pull request #12835 from rook/mergify/bp/release-1.12/pr-12816
Simplify docs-check workflow by extracting functionality  (backport #12816)
2023-09-05 09:59:01 -06:00
sp98 ba91dec40f osd: replace existing OSDs to use new store
This follow up the #12507
- fixes replacing of encrypted OSDs.
- Updates OSD status at the end of reconcile

Signed-off-by: sp98 <sapillai@redhat.com>
(cherry picked from commit 11b8d10a5a)
2023-09-05 14:58:43 +00:00
Travis Nielsen a4114f1292 Merge pull request #12830 from rook/mergify/bp/release-1.12/pr-12487
csi: enable csi-addons-side when crds are deployed (backport #12487)
2023-09-05 08:33:34 -06:00
mergify[bot] f48756c535 Merge pull request #12836 from rook/mergify/bp/release-1.12/pr-12825
monitoring: set port for servicemonitor for ceph-exporter (backport #12825)
2023-09-01 18:53:56 +00:00
Divyansh Kamboj b17df46f5e monitoring: set port for servicemonitor for ceph-exporter
ceph-exporter's ServiceMonitor and Service CRD contain different port
name, which results in no metrics being collected by prometheus.

this commit makes GetCephMonitor configurable, which we use to set
consistent port names in ServiceMonitor and Service for ceph-exporter.

Signed-off-by: Divyansh Kamboj <dkamboj@redhat.com>
(cherry picked from commit 708dd29a97)
2023-09-01 17:59:33 +00:00
Michael Adam 172bc6f191 docs: mention make check-helm-docs and make docs in the contributing guide
Signed-off-by: Michael Adam <obnox@samba.org>
Co-authored-by: : Michael Adam <obnox@samba.org>
signed-off-by: Travis Nielsen <tnielsen@redhat.com>
Co-authored-by: Travis Nielsen <tnielsen@redhat.com>
(cherry picked from commit c8c97bb8a1)
2023-09-01 17:33:05 +00:00
Michael Adam e680f4e302 ci: simplify the docs-check workflow by extracting functionality
This simplifies the docs-check workflow definition by extracting  functionality
directly coded into the workflow file into new make targets 'check-docs'
and 'check-helm-docs' and replacing the code in the workflow file by the simple invocation of
new make targets. As a side effect, it makes it easily possible for a
developer to check locally if they forgot to commit any autogenerated
docs.

Signed-off-by: Michael Adam <obnox@samba.org>
(cherry picked from commit 04670d3f76)
2023-09-01 17:33:05 +00:00
subhamkrai 64fecc7564 core: restart ceph daemons when network updated
We need to restart all the ceph daemons whenever
cephCluster network settings are modified like
requiremsgr2, encryption and compression. This
required for Ceph to consider the new settings
it require new ceph daemons all over.

Signed-off-by: subhamkrai <srai@redhat.com>
(cherry picked from commit 29d2b6a071)
2023-09-01 14:43:26 +00:00
subhamkrai 0ad92bd4b8 csi: enable csi-addons-side when crds are deployed
when deploying csi, we'll check if csi-addons crds
are deployed we'll enable csi-addons sidecar by default.

Signed-off-by: subhamkrai <srai@redhat.com>
(cherry picked from commit a755ec156a)
2023-09-01 13:24:40 +00:00
Travis Nielsen ef5e71c164 Merge pull request #12828 from travisn/release-1.12.3
build: Update release version to v1.12.3
v1.12.3
2023-08-31 16:29:36 -06:00
travisn 715ea7730a build: update release version to v1.12.3
For the patch release update the examples and documents to
v1.12.3.

Signed-off-by: travisn <tnielsen@redhat.com>
2023-08-31 15:51:40 -06:00
Travis Nielsen 5b4235635a Merge pull request #12827 from rook/mergify/bp/release-1.12/pr-12804
object: avoid creating same bucket for two different OBC (backport #12804)
2023-08-31 15:50:09 -06:00
Travis Nielsen a95c612530 Merge pull request #12823 from rook/mergify/bp/release-1.12/pr-12811
external: change cluster_name to k8s_cluster_name (backport #12811)
2023-08-31 15:38:14 -06:00
Jiffin Tony Thottan b1e2826708 object: avoid creating same bucket for two different OBC
If bucket exists for Provision(), then check whether user in the OBC and
owner of bucket are same.

Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
(cherry picked from commit b39e813290)
2023-08-31 21:10:53 +00:00
parth-gr 63d9f8f41a external: change cluster_name to k8s_cluster_name
it was confusing if we are calling a ceph cluster name
or k8s cluster name, so re-named

Signed-off-by: parth-gr <paarora@redhat.com>
(cherry picked from commit 98c4567219)
2023-08-31 14:14:25 +00:00
Travis Nielsen 16c6d1f2a7 Merge pull request #12807 from rook/mergify/bp/release-1.12/pr-12748
ci: upgrade the kubernetes versions for ci (backport #12748)
2023-08-31 07:56:46 -06:00
Travis Nielsen 2a74bdfd24 Merge pull request #12810 from rook/mergify/bp/release-1.12/pr-12808
mon: typo in json tag of struct MonMap (backport #12808)
2023-08-30 08:54:03 -06:00
go-bai 808cdf9c57 mon: typo in json tag of struct MonMap
The json tag in struct MonMap had a spelling error where "json" was incorrectly splled as "josn". This commit corrects the spelling to "json".

Signed-off-by: go-bai <599500688@qq.com>
(cherry picked from commit f4cfa95768)
2023-08-29 14:07:52 +00:00
Travis Nielsen 00128c0cec Merge pull request #12806 from rook/mergify/bp/release-1.12/pr-12797
ceph: return valid CIDR ip (backport #12797)
2023-08-29 08:02:32 -06:00
subhamkrai 9858f214e9 ci: upgrade the kubernetes versions for ci
since, kubernetes v1.28.0 release upgrading the
latest k8s version to v.1.28.0 excepth objectSuite
tes.

Signed-off-by: subhamkrai <srai@redhat.com>
(cherry picked from commit 90d81e11b6)
2023-08-28 16:06:27 +00:00
mergify[bot] f742ee86bf Merge pull request #12805 from rook/mergify/bp/release-1.12/pr-12784
ci: enable tmate when in debug mode (backport #12784)
2023-08-28 15:30:57 +00:00
Madhu Rajanna c71d5714f3 core: return valid CIDR ip
we need to return a valid CIDR IP
to get it fenced properly, the previously
returned one was like `10.63.0.5:0/32` which
is not a valid CIDR, removing `:0` to look like
proper IP CIDR.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
(cherry picked from commit eb304a5073)
2023-08-28 14:35:32 +00:00
subhamkrai ddcb9efa9a ci: enable tmate when in debug mode
we don't want to wait for extra 10min once the ci passed,
so we'll add a check if `debug-ci` label is added or debug runner
is triggered from UI then only start tmate. Also, updaing the
development doc and rook test doc.

Signed-off-by: subhamkrai <srai@redhat.com>
(cherry picked from commit a223b6777b)
2023-08-28 14:32:18 +00:00
Travis Nielsen 71c151cca4 Merge pull request #12769 from rook/mergify/bp/release-1.12/pr-12724
csi: set ceph cluster as ControllerRef for holder ds (backport #12724)
2023-08-28 08:29:07 -06:00
Travis Nielsen 19ab9ff504 Merge pull request #12792 from rook/mergify/bp/release-1.12/pr-12788
build: update go version to 1.21 from 1.20 (backport #12788)
2023-08-28 08:28:24 -06:00