diff --git a/Documentation/ceph-cluster-crd.md b/Documentation/ceph-cluster-crd.md index e8fedd384..3d7dfd4c9 100755 --- a/Documentation/ceph-cluster-crd.md +++ b/Documentation/ceph-cluster-crd.md @@ -340,6 +340,9 @@ Based on the configuration, the operator will do the following: \* Internal cluster traffic includes OSD heartbeats, data replication, and data recovery +Only OSD pods will have both Public and Cluster networks attached. The rest of the Ceph component pods and CSI pods will only have the Public network attached. +Rook Ceph Operator will not have any networks attached as it proxies the required commands via a sidecar container in the mgr pod. + In order to work, each selector value must match a `NetworkAttachmentDefinition` object name in Multus. For `multus` network provider, an already working cluster with Multus networking is required. Network attachment definition that later will be attached to the cluster needs to be created before the Cluster CRD. @@ -379,6 +382,10 @@ spec: * This format is required in order to use the NetworkAttachmentDefinition across namespaces. * In Openshift, to use a NetworkAttachmentDefinition (NAD) across namespaces, the NAD must be deployed in the `default` namespace. The NAD is then referenced with the namespace: `default/rook-public-nw` +#### Known issues with multus +When a CephFS/RBD volume is mounted in a Pod using cephcsi and then the CSI CephFS/RBD plugin is restarted or terminated (e.g. by restarting or deleting its DaemonSet), all operations on the volume become blocked, even after restarting the CSI pods. The only workaround is to restart the node where the cephcsi plugin pod was restarted. +This issue is tracked [here](https://github.com/rook/rook/issues/8085). + #### IPFamily Provide single-stack IPv4 or IPv6 protocol to assign corresponding addresses to pods and services. This field is optional. Possible inputs are IPv6 and IPv4. Empty value will be treated as IPv4. Kubernetes version should be at least v1.13 to run IPv6. Dual-stack is supported as of ceph Pacific.