Unable to configure Redis Sentinel or Redis Cluster with official Helm, standalone Redis works fine #543
Comments
|
Sorry for the delay! I edited your description to make it a little easier to read by adding collapsibles and syntax highlighting. If you're trying to use redis cluster vs stand alone, the seeds param you specified should be correct according to docs.nextcloud.com/server/29: <?php
$CONFIG = array (
'memcache.distributed' => '\OC\Memcache\Redis',
'memcache.locking' => '\OC\Memcache\Redis',
'redis.cluster' => array(
'seeds' => array(
'redis-cluster-headless:6379'
),
'password' => getenv('REDIS_HOST_PASSWORD'),
),
);I don't use redis cluster, but if I'm understanding correctly, the seed should be the name of the redis service right? - which should be whatever this is: https://github.com/bitnami/charts/blob/1a5338daf534b712823a407b409f7b71b9ddb294/bitnami/redis-cluster/templates/redis-svc.yaml#L9 - which should be whatever your helm release name is for the redis cluster helm chart release, or the Some minor follow up questions:
If others in the community have better information or suggestions here, please feel free to chime in, as I haven't been using redis lately. |
jessebot
added
help wanted
|
To be honest I long gave up on this but in case we manage to figure it out:
1. Yep, deleting the persistent storage each time.
2. Confirmed the service name many a time.
…-------- Original Message --------
On 9/06/24 22:14, JesseBot wrote:
Sorry for the delay! I edited your description to make it a little easier to read by adding collapsibles and syntax highlighting.
If you're trying to use redis cluster vs stand alone, the seeds param you specified should be correct according to [docs.nextcloud.com/server/29](https://docs.nextcloud.com/server/29/developer_manual/how_to/index.html#redis-cluster):
<?php
$
CONFIG
=
array
(
'memcache.distributed'
=>
'\OC\Memcache\Redis'
,
'memcache.locking'
=>
'\OC\Memcache\Redis'
,
'redis.cluster'
=>
array
(
'seeds'
=>
array
(
'redis-cluster-headless:6379'
),
'password'
=> getenv(
'REDIS_HOST_PASSWORD'
),
),
);
I don't use redis cluster, but if I'm understanding correctly, the seed should be the name of the redis service right? - which should be whatever this is: https://github.com/bitnami/charts/blob/1a5338daf534b712823a407b409f7b71b9ddb294/bitnami/redis-cluster/templates/redis-svc.yaml#L9 - which should be whatever your helm release name is for the redis cluster helm chart release, or the fullnameOverride parameter value for that chart.
Some minor follow up questions:
-
Are you doing a fresh install of nextcloud in between testing different redis installations? I ask because I noticed you have persistence enabled in your values.yaml. If not, can you try a fresh install without persistence while also using a fresh install of redis-cluster?
-
Can you verify the name of the redis service when using bitnami's redis-cluster chart?
If others in the community have better information or suggestions here, please feel free to chime in, as I haven't been using redis lately.
—
Reply to this email directly, [view it on GitHub](#543 (comment)), or [unsubscribe](https://github.com/notifications/unsubscribe-auth/ADUNCRQ2LX47VD6IECOLGD3ZGQTG3AVCNFSM6AAAAABEOZFGGCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNJWGQZDONRVGE).
You are receiving this because you authored the thread.Message ID: ***@***.***>
|
Describe your Issue
Using the official Helm chart I am able to configure Redis in standalone mode with the following values:
values.yamlWhen when I setup Redis with sentinel using the Bitnami Redis helm chart and the following values in the redis.config.php section:
(only host and port changes)
I get the following errors in the logs and I am usually unable to see any files in the webUI, or unable to login:
click me for logs
{ "reqId": "u8DnzkBqQMKciPMlK8MJ", "level": 0, "time": "2023-12-26T07:51:16+00:00", "remoteAddr": "192.168.50.191", "user": "username", "app": "webdav", "method": "GET", "url": "/remote.php/dav/files/username/Shared%20Pictures/Unedited/DSC_5844.JPG", "message": "\"Shared Pictures/Unedited/DSC_5844.JPG\" is locked, existing lock on file: none", "userAgent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:121.0) Gecko/20100101 Firefox/121.0", "version": "28.0.1.1", "exception": { "Exception": "OCA\\DAV\\Connector\\Sabre\\Exception\\FileLocked", "Message": "\"Shared Pictures/Unedited/DSC_5844.JPG\" is locked, existing lock on file: none", "Code": 0, "Trace": [ { "file": "/var/www/html/apps/dav/lib/Connector/Sabre/File.php", "line": 501, "function": "convertToSabreException", "class": "OCA\\DAV\\Connector\\Sabre\\File", "type": "->", "args": [ [ "OCP\\Lock\\LockedException" ] ] }, { "file": "/var/www/html/3rdparty/sabre/dav/lib/DAV/CorePlugin.php", "line": 85, "function": "get", "class": "OCA\\DAV\\Connector\\Sabre\\File", "type": "->", "args": [] }, { "file": "/var/www/html/3rdparty/sabre/event/lib/WildcardEmitterTrait.php", "line": 89, "function": "httpGet", "class": "Sabre\\DAV\\CorePlugin", "type": "->", "args": [ [ "Sabre\\HTTP\\Request" ], [ "Sabre\\HTTP\\Response" ] ] }, { "file": "/var/www/html/3rdparty/sabre/dav/lib/DAV/Server.php", "line": 472, "function": "emit", "class": "Sabre\\DAV\\Server", "type": "->", "args": [ "method:GET", [ [ "Sabre\\HTTP\\Request" ], [ "Sabre\\HTTP\\Response" ] ] ] }, { "file": "/var/www/html/3rdparty/sabre/dav/lib/DAV/Server.php", "line": 253, "function": "invokeMethod", "class": "Sabre\\DAV\\Server", "type": "->", "args": [ [ "Sabre\\HTTP\\Request" ], [ "Sabre\\HTTP\\Response" ] ] }, { "file": "/var/www/html/3rdparty/sabre/dav/lib/DAV/Server.php", "line": 321, "function": "start", "class": "Sabre\\DAV\\Server", "type": "->", "args": [] }, { "file": "/var/www/html/apps/dav/lib/Server.php", "line": 370, "function": "exec", "class": "Sabre\\DAV\\Server", "type": "->", "args": [] }, { "file": "/var/www/html/apps/dav/appinfo/v2/remote.php", "line": 35, "function": "exec", "class": "OCA\\DAV\\Server", "type": "->", "args": [] }, { "file": "/var/www/html/remote.php", "line": 172, "args": [ "/var/www/html/apps/dav/appinfo/v2/remote.php" ], "function": "require_once" } ], "File": "/var/www/html/apps/dav/lib/Connector/Sabre/File.php", "Line": 752, "Previous": { "Exception": "OCP\\Lock\\LockedException", "Message": "\"Shared Pictures/Unedited/DSC_5844.JPG\" is locked, existing lock on file: none", "Code": 0, "Trace": [ { "file": "/var/www/html/lib/private/Files/View.php", "line": 2048, "function": "lockPath", "class": "OC\\Files\\View", "type": "->", "args": [ "/Shared Pictures/Unedited/DSC_5844.JPG", 1, false ] }, { "file": "/var/www/html/lib/private/Files/View.php", "line": 1141, "function": "lockFile", "class": "OC\\Files\\View", "type": "->", "args": [ "/Shared Pictures/Unedited/DSC_5844.JPG", 1 ] }, { "file": "/var/www/html/lib/private/Files/View.php", "line": 987, "function": "basicOperation", "class": "OC\\Files\\View", "type": "->", "args": [ "fopen", "/Shared Pictures/Unedited/DSC_5844.JPG", [ "read" ], "r" ] }, { "file": "/var/www/html/apps/dav/lib/Connector/Sabre/File.php", "line": 499, "function": "fopen", "class": "OC\\Files\\View", "type": "->", "args": [ "Shared Pictures/Unedited/DSC_5844.JPG", "r" ] }, { "file": "/var/www/html/3rdparty/sabre/dav/lib/DAV/CorePlugin.php", "line": 85, "function": "get", "class": "OCA\\DAV\\Connector\\Sabre\\File", "type": "->", "args": [] }, { "file": "/var/www/html/3rdparty/sabre/event/lib/WildcardEmitterTrait.php", "line": 89, "function": "httpGet", "class": "Sabre\\DAV\\CorePlugin", "type": "->", "args": [ [ "Sabre\\HTTP\\Request" ], [ "Sabre\\HTTP\\Response" ] ] }, { "file": "/var/www/html/3rdparty/sabre/dav/lib/DAV/Server.php", "line": 472, "function": "emit", "class": "Sabre\\DAV\\Server", "type": "->", "args": [ "method:GET", [ [ "Sabre\\HTTP\\Request" ], [ "Sabre\\HTTP\\Response" ] ] ] }, { "file": "/var/www/html/3rdparty/sabre/dav/lib/DAV/Server.php", "line": 253, "function": "invokeMethod", "class": "Sabre\\DAV\\Server", "type": "->", "args": [ [ "Sabre\\HTTP\\Request" ], [ "Sabre\\HTTP\\Response" ] ] }, { "file": "/var/www/html/3rdparty/sabre/dav/lib/DAV/Server.php", "line": 321, "function": "start", "class": "Sabre\\DAV\\Server", "type": "->", "args": [] }, { "file": "/var/www/html/apps/dav/lib/Server.php", "line": 370, "function": "exec", "class": "Sabre\\DAV\\Server", "type": "->", "args": [] }, { "file": "/var/www/html/apps/dav/appinfo/v2/remote.php", "line": 35, "function": "exec", "class": "OCA\\DAV\\Server", "type": "->", "args": [] }, { "file": "/var/www/html/remote.php", "line": 172, "args": [ "/var/www/html/apps/dav/appinfo/v2/remote.php" ], "function": "require_once" } ], "File": "/var/www/html/lib/private/Files/View.php", "Line": 1943, "Previous": { "Exception": "OCP\\Lock\\LockedException", "Message": "\"files/39b1b1dd24f88308dadb938d2a7907e9\"(\"Unedited/DSC_5844.JPG\") is locked, existing lock on file: none", "Code": 0, "Trace": [ { "file": "/var/www/html/lib/private/Files/Storage/Wrapper/Wrapper.php", "line": 607, "function": "acquireLock", "class": "OC\\Files\\Storage\\Common", "type": "->", "args": [ "Unedited/DSC_5844.JPG", 1, [ "OC\\Lock\\MemcacheLockingProvider" ] ] }, { "file": "/var/www/html/lib/private/Files/Storage/Wrapper/Wrapper.php", "line": 607, "function": "acquireLock", "class": "OC\\Files\\Storage\\Wrapper\\Wrapper", "type": "->", "args": [ "Unedited/DSC_5844.JPG", 1, [ "OC\\Lock\\MemcacheLockingProvider" ] ] }, { "file": "/var/www/html/lib/private/Files/View.php", "line": 1935, "function": "acquireLock", "class": "OC\\Files\\Storage\\Wrapper\\Wrapper", "type": "->", "args": [ "Unedited/DSC_5844.JPG", 1, [ "OC\\Lock\\MemcacheLockingProvider" ] ] }, { "file": "/var/www/html/lib/private/Files/View.php", "line": 2048, "function": "lockPath", "class": "OC\\Files\\View", "type": "->", "args": [ "/Shared Pictures/Unedited/DSC_5844.JPG", 1, false ] }, { "file": "/var/www/html/lib/private/Files/View.php", "line": 1141, "function": "lockFile", "class": "OC\\Files\\View", "type": "->", "args": [ "/Shared Pictures/Unedited/DSC_5844.JPG", 1 ] }, { "file": "/var/www/html/lib/private/Files/View.php", "line": 987, "function": "basicOperation", "class": "OC\\Files\\View", "type": "->", "args": [ "fopen", "/Shared Pictures/Unedited/DSC_5844.JPG", [ "read" ], "r" ] }, { "file": "/var/www/html/apps/dav/lib/Connector/Sabre/File.php", "line": 499, "function": "fopen", "class": "OC\\Files\\View", "type": "->", "args": [ "Shared Pictures/Unedited/DSC_5844.JPG", "r" ] }, { "file": "/var/www/html/3rdparty/sabre/dav/lib/DAV/CorePlugin.php", "line": 85, "function": "get", "class": "OCA\\DAV\\Connector\\Sabre\\File", "type": "->", "args": [] }, { "file": "/var/www/html/3rdparty/sabre/event/lib/WildcardEmitterTrait.php", "line": 89, "function": "httpGet", "class": "Sabre\\DAV\\CorePlugin", "type": "->", "args": [ [ "Sabre\\HTTP\\Request" ], [ "Sabre\\HTTP\\Response" ] ] }, { "file": "/var/www/html/3rdparty/sabre/dav/lib/DAV/Server.php", "line": 472, "function": "emit", "class": "Sabre\\DAV\\Server", "type": "->", "args": [ "method:GET", [ [ "Sabre\\HTTP\\Request" ], [ "Sabre\\HTTP\\Response" ] ] ] }, { "file": "/var/www/html/3rdparty/sabre/dav/lib/DAV/Server.php", "line": 253, "function": "invokeMethod", "class": "Sabre\\DAV\\Server", "type": "->", "args": [ [ "Sabre\\HTTP\\Request" ], [ "Sabre\\HTTP\\Response" ] ] }, { "file": "/var/www/html/3rdparty/sabre/dav/lib/DAV/Server.php", "line": 321, "function": "start", "class": "Sabre\\DAV\\Server", "type": "->", "args": [] }, { "file": "/var/www/html/apps/dav/lib/Server.php", "line": 370, "function": "exec", "class": "Sabre\\DAV\\Server", "type": "->", "args": [] }, { "file": "/var/www/html/apps/dav/appinfo/v2/remote.php", "line": 35, "function": "exec", "class": "OCA\\DAV\\Server", "type": "->", "args": [] }, { "file": "/var/www/html/remote.php", "line": 172, "args": [ "/var/www/html/apps/dav/appinfo/v2/remote.php" ], "function": "require_once" } ], "File": "/var/www/html/lib/private/Files/Storage/Common.php", "Line": 767, "Previous": { "Exception": "OCP\\Lock\\LockedException", "Message": "\"files/39b1b1dd24f88308dadb938d2a7907e9\"(\"local::/shared/Pictures/::Unedited/DSC_5844.JPG\") is locked, existing lock on file: none", "Code": 0, "Trace": [ { "file": "/var/www/html/lib/private/Files/Storage/Common.php", "line": 765, "function": "acquireLock", "class": "OC\\Lock\\MemcacheLockingProvider", "type": "->", "args": [ "files/39b1b1dd24f88308dadb938d2a7907e9", 1, "local::/shared/Pictures/::Unedited/DSC_5844.JPG" ] }, { "file": "/var/www/html/lib/private/Files/Storage/Wrapper/Wrapper.php", "line": 607, "function": "acquireLock", "class": "OC\\Files\\Storage\\Common", "type": "->", "args": [ "Unedited/DSC_5844.JPG", 1, [ "OC\\Lock\\MemcacheLockingProvider" ] ] }, { "file": "/var/www/html/lib/private/Files/Storage/Wrapper/Wrapper.php", "line": 607, "function": "acquireLock", "class": "OC\\Files\\Storage\\Wrapper\\Wrapper", "type": "->", "args": [ "Unedited/DSC_5844.JPG", 1, [ "OC\\Lock\\MemcacheLockingProvider" ] ] }, { "file": "/var/www/html/lib/private/Files/View.php", "line": 1935, "function": "acquireLock", "class": "OC\\Files\\Storage\\Wrapper\\Wrapper", "type": "->", "args": [ "Unedited/DSC_5844.JPG", 1, [ "OC\\Lock\\MemcacheLockingProvider" ] ] }, { "file": "/var/www/html/lib/private/Files/View.php", "line": 2048, "function": "lockPath", "class": "OC\\Files\\View", "type": "->", "args": [ "/Shared Pictures/Unedited/DSC_5844.JPG", 1, false ] }, { "file": "/var/www/html/lib/private/Files/View.php", "line": 1141, "function": "lockFile", "class": "OC\\Files\\View", "type": "->", "args": [ "/Shared Pictures/Unedited/DSC_5844.JPG", 1 ] }, { "file": "/var/www/html/lib/private/Files/View.php", "line": 987, "function": "basicOperation", "class": "OC\\Files\\View", "type": "->", "args": [ "fopen", "/Shared Pictures/Unedited/DSC_5844.JPG", [ "read" ], "r" ] }, { "file": "/var/www/html/apps/dav/lib/Connector/Sabre/File.php", "line": 499, "function": "fopen", "class": "OC\\Files\\View", "type": "->", "args": [ "Shared Pictures/Unedited/DSC_5844.JPG", "r" ] }, { "file": "/var/www/html/3rdparty/sabre/dav/lib/DAV/CorePlugin.php", "line": 85, "function": "get", "class": "OCA\\DAV\\Connector\\Sabre\\File", "type": "->", "args": [] }, { "file": "/var/www/html/3rdparty/sabre/event/lib/WildcardEmitterTrait.php", "line": 89, "function": "httpGet", "class": "Sabre\\DAV\\CorePlugin", "type": "->", "args": [ [ "Sabre\\HTTP\\Request" ], [ "Sabre\\HTTP\\Response" ] ] }, { "file": "/var/www/html/3rdparty/sabre/dav/lib/DAV/Server.php", "line": 472, "function": "emit", "class": "Sabre\\DAV\\Server", "type": "->", "args": [ "method:GET", [ [ "Sabre\\HTTP\\Request" ], [ "Sabre\\HTTP\\Response" ] ] ] }, { "file": "/var/www/html/3rdparty/sabre/dav/lib/DAV/Server.php", "line": 253, "function": "invokeMethod", "class": "Sabre\\DAV\\Server", "type": "->", "args": [ [ "Sabre\\HTTP\\Request" ], [ "Sabre\\HTTP\\Response" ] ] }, { "file": "/var/www/html/3rdparty/sabre/dav/lib/DAV/Server.php", "line": 321, "function": "start", "class": "Sabre\\DAV\\Server", "type": "->", "args": [] }, { "file": "/var/www/html/apps/dav/lib/Server.php", "line": 370, "function": "exec", "class": "Sabre\\DAV\\Server", "type": "->", "args": [] }, { "file": "/var/www/html/apps/dav/appinfo/v2/remote.php", "line": 35, "function": "exec", "class": "OCA\\DAV\\Server", "type": "->", "args": [] }, { "file": "/var/www/html/remote.php", "line": 172, "args": [ "/var/www/html/apps/dav/appinfo/v2/remote.php" ], "function": "require_once" } ], "File": "/var/www/html/lib/private/Lock/MemcacheLockingProvider.php", "Line": 62 } } }, "message": "\"Shared Pictures/Unedited/DSC_5844.JPG\" is locked, existing lock on file: none", "exception": {}, "CustomMessage": "\"Shared Pictures/Unedited/DSC_5844.JPG\" is locked, existing lock on file: none" } }And when I spin up bitnami's redis cluster chart and change the redis.config.php to the following:
(I have aslo tried
redis-cluster:6379for the seed, I get the same result)I get the following errors in the logs and an internal system error on loading the webui:
click me for more logs
{ "reqId": "XN0dcqwWLpLXe7Dt2RId", "level": 3, "time": "2023-12-26T07:58:56+00:00", "remoteAddr": "192.168.50.191", "user": "--", "app": "core", "method": "GET", "url": "/favicon.ico", "message": "Exception thrown: RedisClusterException", "userAgent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:121.0) Gecko/20100101 Firefox/121.0", "version": "28.0.1.1", "exception": { "Exception": "RedisClusterException", "Message": "Couldn't map cluster keyspace using any provided seed", "Code": 0, "Trace": [ { "file": "/var/www/html/lib/private/RedisFactory.php", "line": 88, "function": "__construct", "class": "RedisCluster", "type": "->", "args": [ "*** sensitive parameters replaced ***" ] }, { "file": "/var/www/html/lib/private/RedisFactory.php", "line": 158, "function": "create", "class": "OC\\RedisFactory", "type": "->", "args": [ "*** sensitive parameters replaced ***" ] }, { "file": "/var/www/html/lib/private/Memcache/Redis.php", "line": 66, "function": "getInstance", "class": "OC\\RedisFactory", "type": "->", "args": [] }, { "file": "/var/www/html/lib/private/Memcache/Redis.php", "line": 72, "function": "getCache", "class": "OC\\Memcache\\Redis", "type": "->", "args": [] }, { "file": "/var/www/html/lib/private/URLGenerator.php", "line": 203, "function": "get", "class": "OC\\Memcache\\Redis", "type": "->", "args": [ "core-favicon.ico" ] }, { "file": "/var/www/html/lib/private/legacy/template/functions.php", "line": 249, "function": "imagePath", "class": "OC\\URLGenerator", "type": "->", "args": [ "core", "favicon.ico" ] }, { "file": "/var/www/html/core/templates/layout.guest.php", "line": 20, "function": "image_path", "args": [ "core", "favicon.ico" ] }, { "file": "/var/www/html/lib/private/Template/Base.php", "line": 180, "args": [ "/var/www/html/core/templates/layout.guest.php" ], "function": "include" }, { "file": "/var/www/html/lib/private/Template/Base.php", "line": 150, "function": "load", "class": "OC\\Template\\Base", "type": "->", "args": [ "/var/www/html/core/templates/layout.guest.php", "*** sensitive parameters replaced ***" ] }, { "file": "/var/www/html/lib/private/legacy/OC_Template.php", "line": 139, "function": "fetchPage", "class": "OC\\Template\\Base", "type": "->", "args": [ "*** sensitive parameters replaced ***" ] }, { "file": "/var/www/html/lib/private/legacy/OC_Template.php", "line": 170, "function": "fetchPage", "class": "OC_Template", "type": "->", "args": [ "*** sensitive parameters replaced ***" ] }, { "file": "/var/www/html/lib/private/Template/Base.php", "line": 132, "function": "fetchPage", "class": "OC_Template", "type": "->", "args": [] }, { "file": "/var/www/html/lib/private/legacy/OC_Template.php", "line": 291, "function": "printPage", "class": "OC\\Template\\Base", "type": "->", "args": [] }, { "file": "/var/www/html/index.php", "line": 104, "function": "printExceptionErrorPage", "class": "OC_Template", "type": "::", "args": [ [ "RedisClusterException" ], 500 ] } ], "File": "/var/www/html/lib/private/RedisFactory.php", "Line": 88, "CustomMessage": "Exception thrown: RedisClusterException" } }Indicating it can't see any of the redis nodes at all.
Logs and Errors
As above
Describe your Environment
K3s on Ubuntu
Helm Version (or App that manages helm): k3s and fluxio
Helm Chart Version: 4.latest
values.yaml:Included above
The text was updated successfully, but these errors were encountered: