Unable to scale up the number of nodes and/or replica

[bharti16n]

The operator is installed using helm. Operator version: v0.0.61

Issue: Whenever I am trying to scale up the number of nodes of replicas, the valkey container is not getting into ready status.

The unusual thing is the error is related to Reconciler but every time some different kind of things are reported in operator manager pod-

Following are the errors which I encountered -

2026-02-02T13:24:49.233502149+01:00 2026-02-02T12:24:49Z ERROR Reconciler error {"controller": "valkey", "controllerGroup": "hyperspike.io", "controllerKind": "Valkey", "Valkey": {"name":"test-val","namespace":"valkey-test"}, "namespace": "valkey-test", "name": "test-val", "reconcileID": "72f27f0e-18b8-4763-b95f-7b5429558521", "error": "Slot 8192 is already busy"}
2026-02-03T07:05:08.399280122+01:00 2026-02-03T06:05:08Z ERROR Reconciler error {"controller": "valkey", "controllerGroup": "hyperspike.io", "controllerKind": "Valkey", "Valkey": {"name":"test-val","namespace":"valkey-test"}, "namespace": "valkey-test", "name": "test-val", "reconcileID": "56c5600d-00e6-450c-90d8-e23c88295015", "error": "Unknown node c1f361c9addfd38376b128e3f6cc6217b6601daf"}
2026-02-03T07:10:14.891528989+01:00 2026-02-03T06:10:14Z ERROR Reconciler error {"controller": "valkey", "controllerGroup": "hyperspike.io", "controllerKind": "Valkey", "Valkey": {"name":"test-val","namespace":"valkey-test"}, "namespace": "valkey-test", "name": "test-val", "reconcileID": "1aa89bed-f5ac-4f69-ba89-24375cb78039", "error": "panic: runtime error: index out of range [0] with length 0 [recovered]"}
2026-02-03T08:15:09.342000109+01:00 2026-02-03T07:15:09Z ERROR Reconciler error {"controller": "valkey", "controllerGroup": "hyperspike.io", "controllerKind": "Valkey", "Valkey": {"name":"test-val","namespace":"valkey-test"}, "namespace": "valkey-test", "name": "test-val", "reconcileID": "c3bdd061-34ba-478b-91ae-bb629436936c", "error": "panic: runtime error: invalid memory address or nil pointer dereference [recovered]"}
2026-02-03T08:30:40.032784269+01:00 2026-02-03T07:30:40Z ERROR Reconciler error {"controller": "valkey", "controllerGroup": "hyperspike.io", "controllerKind": "Valkey", "Valkey": {"name":"test-val","namespace":"valkey-test"}, "namespace": "valkey-test", "name": "test-val", "reconcileID": "e0f0d0c3-f0c6-47f9-9e8a-50183a32d3d7", "error": "To set a master the node must be empty and without assigned slots."}
2026-02-03T08:33:00.958923728+01:00 2026-02-03T07:33:00Z ERROR Reconciler error {"controller": "valkey", "controllerGroup": "hyperspike.io", "controllerKind": "Valkey", "Valkey": {"name":"test-val","namespace":"valkey-test"}, "namespace": "valkey-test", "name": "test-val", "reconcileID": "049a4eea-1bd3-4b16-b2c6-5d4527eecfbe", "error": "Unknown node fae8e1ec3b5b938af60b716e85e098b3820aa49d"}
2026-02-03T08:41:28.744699740+01:00 2026-02-03T07:41:28Z ERROR Reconciler error {"controller": "valkey", "controllerGroup": "hyperspike.io", "controllerKind": "Valkey", "Valkey": {"name":"test-val","namespace":"valkey-test"}, "namespace": "valkey-test", "name": "test-val", "reconcileID": "584c5b30-6939-4ace-86dc-0142a18231c3", "error": "I can only replicate a master, not a replica."}
2026-02-03T08:44:19.790400840+01:00 2026-02-03T07:44:19Z ERROR Reconciler error {"controller": "valkey", "controllerGroup": "hyperspike.io", "controllerKind": "Valkey", "Valkey": {"name":"test-val","namespace":"valkey-test"}, "namespace": "valkey-test", "name": "test-val", "reconcileID": "572413e7-511f-4068-8d2c-b8e560a203e8", "error": "EOF"}
2026-02-03T09:17:47.104436626+01:00 2026-02-03T08:17:47Z ERROR Reconciler error {"controller": "valkey", "controllerGroup": "hyperspike.io", "controllerKind": "Valkey", "Valkey": {"name":"test-val","namespace":"valkey-test"}, "namespace": "valkey-test", "name": "test-val", "reconcileID": "21c1e0c5-6e3c-4941-ac19-8083f354fd0a", "error": "Unknown node 7df1d30c96e3c6de2f60ee92ea1f4c180cbdf780"}
2026-02-03T09:24:10.394838741+01:00 2026-02-03T08:24:10Z ERROR Reconciler error {"controller": "valkey", "controllerGroup": "hyperspike.io", "controllerKind": "Valkey", "Valkey": {"name":"test-val","namespace":"valkey-test"}, "namespace": "valkey-test", "name": "test-val", "reconcileID": "e397c0dc-055d-4070-8c96-5aa9e88be57c", "error": "Unknown node 57a6398f0ace29913f5a53a45900000e24680cce"}
2026-02-06T09:35:34.846783805+01:00 2026-02-06T08:35:34Z ERROR Reconciler error {"controller": "valkey", "controllerGroup": "hyperspike.io", "controllerKind": "Valkey", "Valkey": {"name":"test-val","namespace":"valkey-test"}, "namespace": "valkey-test", "name": "test-val", "reconcileID": "20904f49-88d4-4171-a69c-eacda1486535", "error": "Unknown node d863c8bfdda6cfc98b935155db59ab65af880189"}
2026-02-06T09:35:35.045023329+01:00 2026-02-06T08:35:35Z ERROR Reconciler error {"controller": "valkey", "controllerGroup": "hyperspike.io", "controllerKind": "Valkey", "Valkey": {"name":"test-val","namespace":"valkey-test"}, "namespace": "valkey-test", "name": "test-val", "reconcileID": "ecdb3f49-8ff1-4009-bf32-f245c0268a2d", "error": "Unknown node 1a72e44ea1d4e41d3d118dff217bb2cf49ae5b25"}
2026-02-06T09:40:29.874274251+01:00 2026-02-06T08:40:29Z ERROR Reconciler error {"controller": "valkey", "controllerGroup": "hyperspike.io", "controllerKind": "Valkey", "Valkey": {"name":"test-val","namespace":"valkey-test"}, "namespace": "valkey-test", "name": "test-val", "reconcileID": "32ef9888-155d-4d77-95ab-74b05bba6e61", "error": "Unknown node "}
2026-02-06T09:49:29.425895049+01:00 2026-02-06T08:49:29Z ERROR Reconciler error {"controller": "valkey", "controllerGroup": "hyperspike.io", "controllerKind": "Valkey", "Valkey": {"name":"test-val","namespace":"valkey-test"}, "namespace": "valkey-test", "name": "test-val", "reconcileID": "0bee5288-d8eb-45b2-9ba7-78145ec529cb", "error": "read tcp 10.42.52.83:59272->10.42.30.149:6379: read: connection reset by peer"}

The issue is there even when just increasing the number of replicas for running node and also while increasing the number of nodes.