forked from rook/rook
This reverts commitb7a564e929, reversing changes made to6996571b5c. Reverting: Linking ceph noout to a node taint. The taint is applied for reasons other than maintenance as well. This also needs a way to respect user-set noout. Need to revisit this with a better design. Signed-off-by: Rohan CJ <rohantmp@gmail.com>
4.8 KiB
4.8 KiB
Major Themes
Action Required
Notable Features
Minio Object Stores
- Now have an additional label named `objectstore` with the name of the Object Store, to allow better selection for Services.
- Use `Readiness` and `Liveness` probes.
- Updated automatically on Object Store CRD changes.
Ceph
- Ceph Nautilus (
v14) is now supported by Rook and is the default version deployed by the examples. - An operator restart is no longer needed to apply changes to the cluster in the following scenarios:
- When a node is added to the cluster, OSDs will be automatically configured if needed.
- When a device is attached to a storage node, OSDs will be automatically configured if needed.
- Any change to the CephCluster CR will trigger updates to the cluster.
- Upgrading the Ceph version will update all Ceph daemons (in v0.9, mds and rgw daemons were skipped)
- Ceph status is surfaced in the CephCluster CR and periodically updated by the operator (default is 60s). The interval can be configured with the
ROOK_CEPH_STATUS_CHECK_INTERVALenv var. - A
CephNFSCRD will start NFS daemon(s) for exporting CephFS volumes or RGW buckets. See the NFS documentation. - Selinux labeling for mounts can now be toggled with the ROOK_ENABLE_SELINUX_RELABELING environment variable.
- Recursive chown for mounts can now be toggled with the ROOK_ENABLE_FSGROUP environment variable.
- Added the dashboard
portconfiguration setting. - Added the dashboard
sslconfiguration setting. - Added Ceph CSI driver deployments on Kubernetes 1.13 and above.
- The number of mons can be increased automatically when new nodes come online. See the preferredCount setting in the cluster CRD documentation.
- New Kubernetes nodes or nodes which are not tainted
NoScheduleanymore get added automatically to the existing rook cluster ifuseAllNodesis set. Issue #2208 - Pod's logs can be written on the filesystem as of Ceph Nautilus 14.2.1 on demand (see common issues)
- Orchestration is automatically triggered when addition or removal of storage devices is detected. This should remove the requirement of restarting the operator to detect new devices.
rook-versionandceph-versionlabels are now applied to Ceph daemon Deployments, DaemonSets, Jobs, and StatefulSets. These identify the Rook version which last modified the resource and the Ceph version which Rook has detected in the pod(s) being run by the resource.
Breaking Changes
- Rook no longer supports Kubernetes
1.8and1.9. - Rook no longer supports running more than one monitor on the same node when
hostNetworkandallowMultiplePerNodearetrue. - Rook Operator switches from Extensions v1beta1 to use Apps v1 API for DaemonSet and Deployment.
Ceph
- The example operator and CRD yaml files have been refactored to simplify configuration. See the examples help topic for more details.
- The common resources are now factored into
common.yamlfromoperator.yamlandcluster.yaml. common.yaml: Creates the namespace, RBAC, CRD definitions, and other common operator and cluster resourcesoperator.yaml: Only contains the operator deploymentcluster.yaml: Only contains the cluster CRD- Multiple examples of the operator and CRDs are provided for common usage of the operator and CRDs.
- By default, a single namespace (
rook-ceph) is configured instead of two namespaces (rook-ceph-systemandrook-ceph). New and upgraded clusters can still be configured with the operator and cluster in two separate namespaces.
- The common resources are now factored into
- Rook will no longer create a directory-based osd in the
dataDirHostPathif no directories or devices are specified or if there are no disks on the host. - Containers in
mon,mgr,mds,rgw, andrbd-mirrorpods have been removed and/or changed names. - Config paths in
mon,mgr,mdsandrgwcontainers are now always under/etc/cephor/var/lib/cephand as close to Ceph's default path as possible regardless of thedataDirHostPathsetting. - The
rbd-mirrorpod labels now readrbd-mirrorinstead ofrbdmirrorfor consistency. - The operator will no longer remove osds from specified nodes when the node is tainted with automatic Kubernetes taints Osds can still be removed by more explicit methods. See the "Node Settings" section of the Ceph Cluster CRD documentation for full details.