Joshua Hoblitt
da07f0c476
When the OSD activate init container cannot match its configured device, it falls back to a bare 'ceph-volume raw list', which enumerates every block device on the node and opens each one to read bluestore labels. Opening a krbd device whose backing cluster is unhealthy can block in uninterruptible sleep; when that device's I/O depends on the OSD being activated, activation deadlocks. Build the fallback scan list explicitly with lsblk and exclude the network-backed device types that can hang when their backing storage is unavailable (rbd, nbd, drbd) along with zram (volatile RAM). Rook never provisions OSDs on any of these, so the fallback can never legitimately need to find an OSD on them. loop devices are kept, since OSDs on loop devices are supported for CI and local testing. Fail fast if the filtered list is empty rather than degenerating back to a full scan. Note this hardens only the rename-fallback path. The deadlock observed in CI (kernel hung tasks under 'ceph-volume raw activate' opening a stalled /dev/rbd0; actions runs 27325963851, 27333888237, and 27378983111, which reproduced it on this PR's own head) ultimately originates inside ceph-volume: 'raw activate' runs an unconditional LUKS2/TPM2 discovery sweep over all block devices even when given an explicit --device. That requires a ceph-volume fix; this change makes the Rook-controlled scan safe regardless of ceph version. Signed-off-by: Joshua Hoblitt <josh@hoblitt.com>
What is Rook?
Rook is an open source cloud-native storage orchestrator for Kubernetes, providing the platform, framework, and support for Ceph storage to natively integrate with Kubernetes.
Ceph is a distributed storage system that provides file, block and object storage and is deployed in large scale production clusters.
Rook automates deployment and management of Ceph to provide self-managing, self-scaling, and self-healing storage services. The Rook operator does this by building on Kubernetes resources to deploy, configure, provision, scale, upgrade, and monitor Ceph.
The status of the Ceph storage provider is Stable. Features and improvements will be planned for many future versions. Upgrades between versions are provided to ensure backward compatibility between releases.
Rook is hosted by the Cloud Native Computing Foundation (CNCF) as a graduated level project. If you are a company that wants to help shape the evolution of technologies that are container-packaged, dynamically-scheduled and microservices-oriented, consider joining the CNCF. For details about who's involved and how Rook plays a role, read the CNCF announcement.
Getting Started and Documentation
For installation, deployment, and administration, see our Documentation and QuickStart Guide.
Contributing
We welcome contributions. See Contributing to get started.
Report a Bug
For filing bugs, suggesting improvements, or requesting new features, please open an issue.
Reporting Security Vulnerabilities
If you find a vulnerability or a potential vulnerability in Rook please let us know immediately at cncf-rook-security@lists.cncf.io. We'll send a confirmation email to acknowledge your report, and we'll send an additional email when we've identified the issues positively or negatively.
For further details, please see the complete security release process.
Contact
Please use the following to reach members of the community:
- Slack: Join our slack channel
- GitHub: Start a discussion or open an issue
- Twitter: @rook_io
- Security topics: cncf-rook-security@lists.cncf.io
Community Meeting
A regular community meeting takes place the 2nd Tuesday of every month at 9:00 AM PT (Pacific Time). Convert to your local timezone.
Any changes to the meeting schedule will be added to the agenda doc and posted to Slack #announcements.
Anyone who wants to discuss the direction of the project, design and implementation reviews, or general questions with the broader community is welcome and encouraged to join.
- Meeting link: https://zoom.us/j/98052644520?pwd=K0R4RUZCc3NhQisyMnA5VlV2MVBhQT09
- Current agenda and past meeting notes
- Past meeting recordings
Official Releases
Official releases of Rook can be found on the releases page. Please note that it is strongly recommended that you use official releases of Rook, as unreleased versions from the master branch are subject to changes and incompatibilities that will not be supported in the official releases. Builds from the master branch can have functionality changed and even removed at any time without compatibility support and without prior notice.
Licensing
Rook is under the Apache 2.0 license.
