Commit Graph
13292 Commits
Author SHA1 Message Date
shay1760 d666f6e535 ci: remove extra space with 'network' commit title
removing extra space infront of 'network' commit tittle.

Signed-off-by: shay1760 <rahulkrrai0302@gmail.com>
2024-02-27 19:11:48 +05:30
subham rai 9816f2f5f5 Merge pull request #13820 from rook/dependabot/go_modules/go.uber.org/zap-1.27.0
build(deps): bump go.uber.org/zap from 1.26.0 to 1.27.0
2024-02-27 13:17:00 +05:30
dependabot[bot] e86a1f793f build(deps): bump go.uber.org/zap from 1.26.0 to 1.27.0
Bumps [go.uber.org/zap](https://github.com/uber-go/zap) from 1.26.0 to 1.27.0.
- [Release notes](https://github.com/uber-go/zap/releases)
- [Changelog](https://github.com/uber-go/zap/blob/master/CHANGELOG.md)
- [Commits](https://github.com/uber-go/zap/compare/v1.26.0...v1.27.0)

---
updated-dependencies:
- dependency-name: go.uber.org/zap
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-02-27 07:11:51 +00:00
subham rai 061506c1cc Merge pull request #13819 from rook/dependabot/go_modules/github-dependencies-89693179d6
build(deps): bump the github-dependencies group with 1 update
2024-02-27 12:40:32 +05:30
Travis Nielsen ae30130124 Merge pull request #13816 from uhthomas/13815
operator: use Linux container CPU quota
2024-02-26 09:48:13 -07:00
Thomas Way 97e3e69bf4 operator: use Linux container CPU quota
Go is not cgroup aware and by default will set GOMAXPROCS to the number
of available threads, regardless of whether it is within the allocated
quota. This behaviour causes high amount of CPU throttling and degraded
application performance.

Fixes: #13815

Signed-off-by: Thomas Way <thomas@6f.io>
2024-02-26 12:28:57 +00:00
dependabot[bot] 497139b6b5 build(deps): bump the github-dependencies group with 1 update
Bumps the github-dependencies group with 1 update: [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go).


Updates `github.com/aws/aws-sdk-go` from 1.50.20 to 1.50.25
- [Release notes](https://github.com/aws/aws-sdk-go/releases)
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.50.20...v1.50.25)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: github-dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-02-26 12:18:56 +00:00
subham rai 459604a3bd Merge pull request #13802 from microyahoo/nit
mds: fix incorrect comment on crd resource requirements
2024-02-22 12:48:16 +05:30
subham rai d1e3006560 Merge pull request #13801 from subhamkrai/disable-cephfs-fencing
csi: disable cephFs network Fencing temporarily
2024-02-22 12:12:22 +05:30
Liang Zheng 4e9e4c53d8 mds: fix incorrect comment on crd resource requirements
The MDS resource requirements had an incorrect comment of the RGW component.

Signed-off-by: Liang Zheng <zhengliang0901@gmail.com>
2024-02-22 10:23:06 +08:00
Travis Nielsen b9ba6eb371 Merge pull request #13803 from travisn/squid-roadmap
docs: Add squid and bucket DNS subdomains to roadmap
2024-02-21 13:32:46 -07:00
Travis Nielsen 26a545eb6e docs: add squid and dns subdomains to roadmap
For 1.14 release supporting squid is planned
as well as DNS subdomain style access to RGW
buckets.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2024-02-21 12:04:59 -07:00
subhamkrai bd4250f56e csi: remove cephFs networkFence code temporarily
cephFs fencing needs more testing and bug fixes to make
it in production. We tried multiple fixes but still it need
more work. So, removing the cephfs networkFence realted code
will rever this commit when we start working on this again.

Signed-off-by: subhamkrai <srai@redhat.com>
2024-02-21 21:56:37 +05:30
subhamkrai 0ace7cf8cf csi: check networkFence status before deleting
earlier, we were only checking the specs of networkFence to see if
unfencing is done before proceeding with deletion but we should also
check the status of networkFence before proceeding with deletion.

Signed-off-by: subhamkrai <srai@redhat.com>
2024-02-21 21:52:55 +05:30
sp98 6c8ba0136c doc: add support for using azure kms
Users on Microsoft Azure can make use of the Azure key
vault service rather than replying on any third party
service for KMS.

Signed-off-by: sp98 <sapillai@redhat.com>
2024-02-21 11:04:16 +05:30
Travis Nielsen f6509e10f6 Merge pull request #13794 from sp98/mon-pdb-unavailable-count
mon: set mon pdb max unavailable as 2 in case of 5 or more mons.
2024-02-20 12:28:33 -07:00
Blaine Gardner bd9577f43a Merge pull request #13793 from rkachach/fix_issue_crds_desc
manifest: reduce CRD size by removing some descriptions
2024-02-20 11:59:49 -07:00
Redouane Kachach 7a7b983628 manifest: adding a null check to PersistentVolumeClaim conversion
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2024-02-20 16:50:16 +01:00
sp98 a4866b4b06 mon: set mon pdb max unavailable as 2 in case of 5 or more mons
If the spec.mon.count is 5 or more, then create
mon pdbs with maxUnavailable count as 2. We can
afford to have more than 1 mons down while
draining the nodes in this case.

Signed-off-by: sp98 <sapillai@redhat.com>
2024-02-20 15:26:43 +05:30
Redouane KachachandBlaine Gardner bd7477ec61 manifest: reduce CRD size by removing some descriptions
Reduce CRD size by removing some descriptions for things that
(a) are long, (b) are repeated, and (c) are commong kubernetes types.

Remove the `Status` field from VolumeClaimTemplates (a.k.a. PVCs) in
types.go to remove all unnecessary status-related fields.

Use `yq` to go through generated `crds.yaml` to strip out descriptions
for well-known k8s types that are long and repeated where we can't
remove them from types.go. This is mostly placement descriptions and
volumeSource descriptions.

The overall `crds.yaml` file is reduced to less than 60% of its original
size.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
Co-authored-by: Blaine Gardner <blaine.gardner@ibm.com>
2024-02-20 10:08:44 +01:00
subham rai bcab869213 Merge pull request #13789 from subhamkrai/update-go-mod
build: update go mod files
2024-02-19 21:21:17 +05:30
Travis Nielsen a90091015b Merge pull request #13772 from travisn/crush-update-noop
pool: Skip crush rule update when not needed
2024-02-19 07:29:49 -07:00
subhamkrai dbe1c0988d build: update go mod files
updating go.mod and pkgs/apis/go.mod file with
latest updates.

Signed-off-by: subhamkrai <srai@redhat.com>
2024-02-19 18:15:09 +05:30
travisn 90bec31203 pool: skip crush rule update when not needed
The crush rule will be updated when the failure domain changes.
This update can be skipped when the expected crush rule is
already configured. Otherwise, the log has a confusing message
that makes it appear that the crush rule was updated
when in fact it was not.

Signed-off-by: travisn <tnielsen@redhat.com>
2024-02-16 12:31:38 -07:00
Blaine Gardner 6ce7b1f7d1 Merge pull request #13784 from BlaineEXE/stop-nightly-ci-on-forks
ci: stop nightly canary from running in forks
2024-02-16 12:20:07 -07:00
Blaine Gardner 9f98208914 ci: stop nightly canary from running in forks
Make sure the canary suites are only run from nightly CI in the
rook/rook project.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
2024-02-16 12:17:50 -07:00
Travis Nielsen da08206198 Merge pull request #13780 from timolow/patch-1
External: fix syntax error import-external-cluster.sh
2024-02-16 11:22:43 -07:00
Tim Olow 7dcffae3f7 external: update import-external-cluster.sh
Removed = that was preventing the import-external-cluster.sh script from
importing external ceph cluster into k8s.

Fixes https://github.com/rook/rook/issues/13679

Signed-off-by: Tim Olow <tim@eth0.com>
2024-02-16 15:50:51 +00:00
Travis Nielsen 04a5fd6ab5 Merge pull request #13744 from travisn/pool-application
pool: Allow setting the application on a pool
2024-02-15 09:55:35 -07:00
Travis Nielsen 73f22c38fb Merge pull request #13766 from travisn/pg-autoscaler-remove
mgr: Remove remaining pg_autoscaler examples
2024-02-15 07:49:48 -07:00
travisn 806608cdbc pool: allow setting the application on a pool
Rook has been setting the application automatically on all
pools to rbd for CephBlockPools, rook-ceph-rgw for
CephObjectStores, mgr on the built-in .mgr pool,
and nfs on the built-in .nfs pool.

The legacy pool device_health_metrics is long gone
from Pacific which is no longer supported, so we can
remove special handling for that pool in the upgrade
guide and in the code.

The application setting is now available on the pool spec
although it is not expected to commonly need to override
the default applications set by Rook.

The application for CephFilesystem pools is now being
set to cephfs, where it was previously blank.

Signed-off-by: travisn <tnielsen@redhat.com>
2024-02-14 16:53:25 -07:00
Travis Nielsen c2dc79c862 Merge pull request #13758 from travisn/roadmap-1.14
docs: Update roadmap for the 1.14 release
2024-02-14 16:46:36 -07:00
Travis Nielsen 8ec85dc463 Merge pull request #13768 from Madhu-1/fix-cephfs-fence
core: Continue processing PVs for network fencing when no node IPs found
2024-02-14 11:56:12 -07:00
Blaine Gardner 1f65d84a8e Merge pull request #13755 from BlaineEXE/ci-fix-nightly-ids
ci: allow canary jobs to have ids for nightly suite
2024-02-14 11:19:28 -07:00
travisn ef13dd3edc mgr: remove remaining pg_autoscaler examples
The pg_autoscaler is always enabled by ceph and cannot be disabled.
In a previous PR the pg_autoscaler config was removed from the main example.
Now the remaining config for the pg_autoscaler is removed as well.

Signed-off-by: travisn <tnielsen@redhat.com>
2024-02-14 11:13:29 -07:00
Blaine Gardner 3e76de7868 ci: allow canary jobs to have ids for nightly suite
For nightly jobs, canary tests are all running with the same job IDs,
making the last-run jobs cancel previous runs. Add a workflow-id
parameter to canary jobs that can be used to give each job in a canary
suite a unique job ID to prevent this.

Signed-off-by: Blaine Gardner <blaine.gardner@ibm.com>
2024-02-14 11:04:40 -07:00
Madhu Rajanna ca21bd9715 core: retry other pvc if active client not found
retry other cephfs/rbd pvc if there
are no active clients found on ceph cluster.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2024-02-14 19:01:46 +01:00
parth-gr adf40b1944 external: add support for rados namespace for rbd ec pools
currently addded the support for rados namesapce
for rbd ec pools upstream

closes: https://github.com/rook/rook/issues/13633

Signed-off-by: parth-gr <partharora1010@gmail.com>
2024-02-14 20:26:37 +05:30
Madhu Rajanna eb97390df2 core: use error wraping in fenceCephFSVolume
to keep the code consistent and to propogate
more details about error rook uses error wraping.
updating current code whereever its required to
wrap the details.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2024-02-14 11:04:50 +01:00
Madhu Rajanna 0e115c44bf core: fix cephfs pvc network fencing
The cephfs PVC might exist on the kubernetes
node object but due to some timing issues the
ip might not be visible on the ceph cluster or
the client might already got evicted or disconnected
from ceph cluster. In this case we will not be
able to get IP details for the subvolume and we dont
have any check for empty ip's in the code and rook
tries to create NetworkFence CR with empty Ip's
and the NetworkFence will get moved to the Failed state.
This PR adds the necessary check and logging to prevent
this one.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2024-02-14 11:04:43 +01:00
Travis Nielsen 64cf8f22e5 Merge pull request #13754 from rook/dependabot/go_modules/github-dependencies-991846f5e8
build(deps): bump the github-dependencies group with 2 updates
2024-02-13 16:46:36 -07:00
dependabot[bot] 650e71ac22 build(deps): bump the github-dependencies group with 2 updates
Bumps the github-dependencies group with 2 updates: [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go) and [github.com/hashicorp/vault/api](https://github.com/hashicorp/vault).

Updates `github.com/aws/aws-sdk-go` from 1.50.12 to 1.50.15
- [Release notes](https://github.com/aws/aws-sdk-go/releases)
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.50.12...v1.50.15)

Updates `github.com/hashicorp/vault/api` from 1.11.0 to 1.12.0
- [Release notes](https://github.com/hashicorp/vault/releases)
- [Changelog](https://github.com/hashicorp/vault/blob/main/CHANGELOG.md)
- [Commits](https://github.com/hashicorp/vault/compare/v1.11.0...v1.12.0)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: github-dependencies
- dependency-name: github.com/hashicorp/vault/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: github-dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-02-13 15:52:47 -07:00
Travis Nielsen 29b7bd9715 Merge pull request #13718 from subhamkrai/remove-namespace-from-networkFence
core: Delete networkFence CRs during cluster removal
2024-02-13 14:54:36 -07:00
travisn 21f68f6402 docs: update roadmap for the 1.14 release
Looking forward to the 1.14 release in April,
update the roadmap of planned feature work.
The features are not limited to this list,
it is just for context on what is currently
planned.

Signed-off-by: travisn <tnielsen@redhat.com>
2024-02-13 11:34:42 -07:00
Travis Nielsen 69b8b34551 Merge pull request #13759 from subhamkrai/update-min-k8s-version
ci: upgrade min k8s supported version to 1.24.17
2024-02-13 11:22:18 -07:00
subhamkrai 135307a4df ci: upgrade min k8s supported version to 1.24.17
upgrading minimum kubernetes supported version to v1.24.17
and also upgrading other kubernetes version to their latest
respective version.

Signed-off-by: subhamkrai <srai@redhat.com>
2024-02-13 22:11:44 +05:30
subhamkrai 5bff860380 core: remove namespace/ownerRef from networkFence
since networkFence is a cluster-based resource so that we don't need
the namespace and ownerReferences as it cause garbage-collector errors.
Also, now we create the networkFence with clusteUID label so when doing
cleanup we match the cephCluster uid and networkFence label clusterUID.

Signed-off-by: subhamkrai <srai@redhat.com>
2024-02-13 21:47:04 +05:30
Travis Nielsen 932400aeb8 Merge pull request #13741 from rkachach/fix_issue_13719
mgr: remove privileged security context from mgr sidecar container
2024-02-13 07:58:15 -07:00
Travis Nielsen 1a3d242cc6 Merge pull request #13693 from obnoxxx/disallow-legacy-and-provider
Disallow legacy hostNetwork  together with  non-default provider
2024-02-13 07:14:20 -07:00
subham rai e7969ff9ab Merge pull request #13613 from iPraveenParihar/fix/issue-13580
csi: update netNamespaceFilePath for all clusterIDs
2024-02-13 18:48:10 +05:30