[BUG]: Resiliency Module

[OA72280]

Bug Description

The podmon module is tainting all nodes as unscheduleable when the PowerFlex API gateway becomes detached (un-reachable).

When the API gateway comes back to availability, the Podmon module does not remove the taints from the workers.

Logs

N/A

Screenshots

N/A

Additional Environment Information

N/A

Steps to Reproduce

N/A

Expected Behavior

Once API gateway is available podmon should remove taints from workers.

CSM Driver(s)

1.5.0

Installation Type

Operator

Container Storage Modules Enabled

Resiliency

Container Orchestrator

N/A

Operating System

N/A

[csmbot]

@OA72280: Thank you for submitting this issue!

The issue is currently awaiting triage. Please make sure you have given us as much context as possible.

If the maintainers determine this is a relevant issue, they will remove the needs-triage label and respond appropriately.

---

We want your feedback! If you have any questions or suggestions regarding our contributing process/workflow, please reach out to us at [email protected].

[atye]

Hi @OA72280. Could you provide the logs from the driver installation? At least, we need the logs from the driver and podmon containers from each pod. You may email them to me directly rather than attaching them here.

[atye]

Per internal conversation, logs are not available due to logs being rolled.

[alikdell]

@OA72280 Are there taints still with nodes? If so, current logs should clearly state why Resiliency is not able to remove taints. When Resiliency fails to remove taints, it writes clear logs why so.