cluster: reject writes only when data disk is degraded

[nvartolomei]

Background https://redpandadata.atlassian.net/browse/CORE-8349

Health monitor tracks only the data disk now as the only use of that state is for rejecting writes. Cache disk state is irrelevant at cluster level.

This was tested manually by creating a cluster with custom cache disk mountpoint and trying to produce to it.

Before this commit, producing would have failed with a full cache disk. After this commit, producing fails only if the data disk is full.

Backports Required

• none - not a bug fix
• none - this is a backport
• none - issue does not exist in previous branches
• none - papercut/not impactful enough to backport
• v24.3.x
• v24.2.x
• v24.1.x

Release Notes

Bug Fixes

• If a discrete disk is used for cloud storage cache Redpanda previously rejected writes if that disk (cache disk) was full (in degraded state). This is incorrect since the cache disk isn't in the way of writes. From now on, reject writes only if the data disk is full (in degraded state).

[vbotbuildovich]

non flaky failures in https://buildkite.com/redpanda/redpanda/builds/59241#01939393-73db-4935-87e8-9b193bc30f60:

"rptest.tests.full_disk_test.WriteRejectTest.test_refresh_disk_health"

non flaky failures in https://buildkite.com/redpanda/redpanda/builds/59251#01939471-a183-4f65-8f55-0d0b88888849:

"rptest.tests.archive_retention_test.CloudArchiveRetentionTest.test_delete.cloud_storage_type=CloudStorageType.ABS.retention_type=retention.ms"

[vbotbuildovich]

Retry command for Build#59241

please wait until all jobs are finished before running the slash command

/ci-repeat 1
tests/rptest/tests/full_disk_test.py::WriteRejectTest.test_refresh_disk_health

[vbotbuildovich]

the below tests from https://buildkite.com/redpanda/redpanda/builds/59251#01939417-d322-4b6a-b8f3-30c4e837a917 have failed and will be retried

gtest_raft_rpunit

[vbotbuildovich]

Retry command for Build#59251

please wait until all jobs are finished before running the slash command

/ci-repeat 1
tests/rptest/tests/archive_retention_test.py::CloudArchiveRetentionTest.test_delete@{"cloud_storage_type":2,"retention_type":"retention.ms"}

[dotnwat]

makes sense to me!

[nvartolomei]

/ci-repeat 1
tests/rptest/tests/archive_retention_test.py::CloudArchiveRetentionTest.test_delete@{"cloud_storage_type":2,"retention_type":"retention.ms"}

[nvartolomei]

/ci-repeat 1
skip-redpanda-builds

[vbotbuildovich]

/backport v24.3.x

[vbotbuildovich]

/backport v24.2.x

[vbotbuildovich]

/backport v24.1.x