Commit Graph
7961 Commits
Author SHA1 Message Date
Sébastien Han aa8bf4c763 ceph: expose operator ceph base image
We now have a new env variable ROOK_CEPH_BASE_IMAGE_VERSION which
contains the ceph version on the operator image.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-16 15:13:40 +02:00
Sébastien Han d950f4f823 ci: add more debug
If we cannot get the bucket we need more debug information.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-16 10:19:01 +02:00
Sébastien Han 6c5c726d14 ceph: use octopus base image
Since 1.3 will support both Nautilus and Octopus, let's use Octopus for
the base image. Newer images have retro-compatibility with older Ceph
versions.

Closes: https://github.com/rook/rook/issues/1765
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-16 10:19:01 +02:00
Sébastien Han ad0da4cf76 Merge pull request #5655 from thotz/cleanupolm
build: add a seperate make command for cleaning olm files
2020-06-16 10:13:59 +02:00
Alexander Trost 1a072be677 core: fix info log for discovered devices
Fix the info log statement to log the discovered devices as their string
representation instead of pointers.
This changes the info log to only be the device names and the debug log
to be the whole disk struct as well.

Resolves #5625

Signed-off-by: Alexander Trost <galexrt@googlemail.com>
2020-06-16 09:37:33 +02:00
Jared Watts c0ed19aa4b Merge pull request #5567 from prksu/design-nfs-controller-runtime
design: nfs operator using controller-runtime
2020-06-15 12:05:49 -07:00
Jiffin Tony Thottan 51c98bf3a4 build: add a seperate make command for cleaning olm files
Currently olm will be removed as part of clean command, but it cleans up
all the dependent modules as well
Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2020-06-15 17:07:08 +05:30
Sébastien Han 3d8fd2ca5a Merge pull request #5630 from cybozu-go/add-osdpodspec-schedulername
ceph: add schedulerName property to storageClassDeviceSet
2020-06-15 10:25:57 +02:00
Sébastien Han 126dc45dc7 Merge pull request #5647 from travisn/doc-ssd-cleanup
docs: clean ssds with blkdiscard
2020-06-15 10:17:18 +02:00
UMEZAWA Takeshi 6085ff3223 ceph: add schedulerName property to storageClassDeviceSet
Support schdulerName to use another scheduler for OSD pod placement.

Closes: https://github.com/rook/rook/issues/5536
Signed-off-by: UMEZAWA Takeshi <takeshi-umezawa@cybozu.co.jp>
Signed-off-by: Masayuki Ishii <masa213f@gmail.com>
2020-06-12 11:53:28 +09:00
Travis Nielsen 899e8e547e docs: clean ssds with blkdiscard
blkdiscard is the better tool for cleaning SSDs instead
of dd.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-06-11 15:45:10 -06:00
Jared Watts 00ca9beb78 Merge pull request #5637 from aberfeldy/aberfeldy/master
nfs: changing the loglevel into INFO
2020-06-11 09:57:08 -07:00
Travis Nielsen b28db31a01 Merge pull request #5639 from travisn/volume-source-map
ceph: metadata pvcs use a map instead of index
2020-06-11 10:33:32 -06:00
Travis Nielsen 5a02de5621 ceph: metadata pvcs use a map instead of slice index
The volume sources for an OSD on PVC were relying on the ordering
of the volume sources slice. While this was working, it was causing
headaches and potential future developer error when being
interpreted incorrectly. The addition of the wal pvc device
would make the issue even more pronounced. Now each PVC used
for the OSD will be identified in a map by name such as data
 and metadata.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-06-11 08:58:53 -06:00
Sébastien Han 70cd4e0e4d Merge pull request #5509 from thotz/deleteuserorbucket
ceph: obc clean up resources incase of failure
2020-06-11 11:52:10 +02:00
Travis Nielsen 609d43d050 Merge pull request #5640 from binoue/fix-error-message
ceph: fix error message
2020-06-10 17:24:26 -06:00
binoue b52b59669f ceph: fix error message
This commit fixes an error message

Signed-off-by: binoue <banji-inoue@cybozu.co.jp>
2020-06-11 07:10:29 +09:00
Travis Nielsen 955dcb930e Merge pull request #5377 from alimaredia/wip-object-store-multisite
Foundation for Object Store Multisite CRs
2020-06-10 16:07:53 -06:00
Travis Nielsen e0ab3b2bbb Merge pull request #5616 from leseb/design-guidelines
docs: add design doc template
2020-06-10 11:18:25 -06:00
Sébastien Han db17533435 docs: add design doc template
Rook already has a design process in place when introducing new
functionality. The only missing thing is a clear template to bring
consistency in our design documents.

This is inspired and shrunk version of
https://github.com/openshift/enhancements/tree/master/guidelines to add
some guidelines when it comes to writing a design document.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-10 19:05:14 +02:00
Ahmad Nurus S f5f6484869 docs: design nfs operator using controller-runtime
This commit is adding a design to implement controller-runtime in nfs operator

Signed-off-by: Ahmad Nurus S <prksu.sh@gmail.com>
2020-06-10 23:41:15 +07:00
Andreas Feldmann 05cfbf3dda nfs: changing the loglevel into INFO
Signed-off-by: Andreas Feldmann <an.feldmann@googlemail.com>
2020-06-10 18:23:26 +02:00
Sébastien Han 04a4560900 Merge pull request #5622 from leseb/mgr-fixes
ceph: a couple of ceph-mgr fixes
2020-06-10 18:20:38 +02:00
Sébastien Han ee4d133cd2 Merge pull request #5634 from leseb/clean-olm-make
build: purge olm directory on clean
2020-06-10 17:14:46 +02:00
Sébastien Han 02dc1f0219 Merge pull request #5631 from RyuunoAelia/add-okd-support
build: add OKD metadata for CSV generation
2020-06-10 15:25:42 +02:00
Jiffin Tony Thottan 96e3d1529e ceph: remove unlinking user in revoke api for obc
UnlinkUser works if bucket owner is obc user, otherwise it result in mismatch.

Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2020-06-10 18:30:21 +05:30
Jiffin Tony Thottan c0e23e0e16 ceph: clean up resources incase of failure
When obc creation fails in Grant() or Provision() the resources such as rgw user or bucket
created while provisioning need to remove.

Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2020-06-10 18:30:16 +05:30
Jiffin Tony Thottan 07f5aa7a19 ceph: remove deleteCephUser() and deleteBucket()
Replacing deleteCephUser() and deleteBucket() with deleteOBCResource()
Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2020-06-10 18:30:12 +05:30
Jiffin Tony Thottan 9fccfb0e6f ceph: introduce new function for cleaning resources
Combining DeleteUser() and DeleteBucket() into single function
Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
2020-06-10 18:30:06 +05:30
Sébastien Han e936c97b50 build: purge olm directory on clean
When running `make clean` we also purge any existing OLM files.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-10 14:40:21 +02:00
Diego Abelenda 2ea06aba71 build: add OKD metadata for CSV generation
Add Ceph CSV metadata for OKD platform.
This will allow to have a CSV compatible with OKD as the CSV should be different than both OCP (Red Hat supported) and k8s (missing some security definitions).

Signed-off-by: Diego Abelenda <diego.abelenda@gmail.com>
2020-06-10 14:21:10 +02:00
Ali Maredia fc579f4520 ceph: initial commit for ceph rgw multisite resources
This commit contains CR implementations for:
CephObjectRealm
CephObjectZoneGroup
CephObjectZone

Also there are changes made to the objectstore
to add rgws in the object-store to zones and
zone groups in a multisite configuration and
the removal of the --default parameter for any
realms/zonegroups/zones that are created.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2020-06-09 16:28:53 -04:00
Sébastien Han 3d62996090 Merge pull request #5615 from leseb/ci-cleaver-2
ci: auto-detect storage provider
2020-06-09 16:11:53 +02:00
Sébastien Han 993af443a4 ceph: always turn on balancer on octopus
When running Octopus, we still need to turn on the balancer module. The
distinction is tricky, the module is "enabled" but it has to be "turned
on" and configured.

This was only working when the `pg_autoscaler` module was explicitly
listed in the CephCluster spec mgr section module section but not
automatically configured when running Octopus (the `pg_autoscaler`
module is already enabled).

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-09 15:42:15 +02:00
Sébastien Han 2749035315 ceph: do not activate crash module
The mgr crash module is always enabled so we don't need to run the
command again. It saves some orchestration time.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-09 15:37:04 +02:00
Sébastien Han 1c7ac716a7 Merge pull request #5613 from travisn/increase-osd-pvc-size
Increase OSD size when the template size increases
2020-06-09 09:26:32 +02:00
Sébastien Han 33a90a10d1 ci: more debug
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-08 22:49:25 -06:00
Travis Nielsen 282a2a3741 ceph: increase osd size when pvc template increases
When the PVC template increases in size for the storageClassDeviceSet
in the cluster CR, we need to increase the size of the PVC and restart
the OSD. The OSD is restarted by changing a variable on the pod spec
that indicates the desired size of the OSD.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-06-08 14:34:43 -06:00
Travis Nielsen daeb9b56b0 ceph: remove dead osd code
The completeProvisionSkipOSDStart function is no longer used.

Signed-off-by: Travis Nielsen <tnielsen@redhat.com>
2020-06-08 14:34:43 -06:00
Sébastien Han 887836586a Merge pull request #5595 from afflom/port-naming-work
Configurable Service Port Names
2020-06-08 12:57:01 +02:00
Sébastien Han 4e8f7e725d ci: auto-detect storage provider
If the PR follows our contribution guideline https://rook.io/docs/rook/master/development-flow.html#commit-structure
and then the PR title contains for example "ceph: add a feature", then
the CI will run the ceph storage integration tests.

Closes: https://github.com/rook/rook/issues/5612
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-08 11:24:54 +02:00
Sébastien Han 99e6277d9a docs: lint INSTALL.md file
Address linters comments and clarify some sections.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-08 10:50:50 +02:00
Alex Flom 9a4d535f09 ceph: hardcode service port and container port names
When integrating rook with istio, service port names need to be prefixed by their protocol.
Trying to fix this by removing static port names in favor of configurable names.

Closes: #5587

add protocol prefix to service port names, hardcoded as discussed. renamed container ports

Signed-off-by: Alex Flom <alexander.flom@gmail.com>
2020-06-06 21:58:23 -04:00
Sébastien Han 08167f9fef Merge pull request #4028 from leseb/cleaver-ci
ci: do not run when no code changes
2020-06-05 18:50:16 +02:00
Sébastien Han 01784a4b59 ci: do not run when no code changes
If no Golang files were modified we don't want to run the integration
test.

Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-05 18:04:19 +02:00
Sébastien Han be04b1ac33 Merge pull request #5607 from leseb/fix-5492
ceph: increase liveness probe start delay on OSD
2020-06-05 17:24:18 +02:00
Sébastien Han 8592caed58 Merge pull request #5606 from leseb/fix-5521
ceph: fix osd number detection on upgrade
2020-06-05 17:12:38 +02:00
Sébastien Han 1728e84115 Merge pull request #5603 from Madhu-1/csi-v2.1.2
ceph: update cephcsi to v2.1.2
2020-06-05 16:38:48 +02:00
Sébastien Han c8de7009de ceph: increase liveness probe start delay on OSD
When the cluster is loaded and we restart an OSD, it will need some time
to respond to socket calls, basically more to be ready.
Increasing the initialDelaySeconds of the liveness probe fixes that
issue. For OSD, it waits for 45 sec, where other daemons 10 sec.

Closes: https://github.com/rook/rook/issues/5492
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-05 15:53:49 +02:00
Sébastien Han 3c7a252862 ceph: fix osd number detection on upgrade
If the cluster has 3 OSDs, during the upgrade when the OSD restarts it
will temporarily disappear from the "ceph versions" list so we need a
more robust way to list the number of OSDs and always returns the total
number of OSDs.

Closes: https://github.com/rook/rook/issues/5521
Signed-off-by: Sébastien Han <seb@redhat.com>
2020-06-05 15:20:46 +02:00