Problems connecting to Redis Cluster deployed in Kubernetes

[nmartini2]

Hi

I've create a Rate Limiter using Bucket4j where i want to store my buckets in a Redis DB.
But I am having problems connecting to the Redis Cluster DB.

When i use RedisClient like this:

   @Value("${spring.data.redis.host}")
    private String redisHost;
 
   @Value("${spring.data.redis.password}")
    private String redisPassword;

    @Value("${spring.data.redis.ssl.enabled}")
    private boolean ssl;

    public RedisClient connectBasic() {
        logger.info("Attempting to connect to Redis host: {} with port: {}", redisHost, redisPort);

        RedisURI uri = RedisURI.builder()
                .withHost(redisHost)
                .withPort(redisPort)
                .withPassword(redisPassword.toCharArray())
                .withTimeout(Duration.ofSeconds(30))
                .withSsl(ssl)
                .withVerifyPeer(false)
                .build();

        logger.info("RedisURI={}", uri);

        RedisClient redisClient = RedisClient.create(uri);

        return redisClient;

    @Bean
    public LettuceBasedProxyManager<String> proxyManager() {
        logger.info("proxyManager called");
        try {
            RedisClient redisClient = connectBasic();

            logger.info("Establishing connection to Redis cluster...");
            StatefulRedisConnection<String, byte[]> redisConnection =
                    redisClient.connect(RedisCodec.of(StringCodec.UTF8, ByteArrayCodec.INSTANCE));

            logger.info("Successfully established connection to Redis cluster");
            return Bucket4jLettuce.casBasedBuilder(redisConnection)
                    .expirationAfterWrite(ExpirationAfterWriteStrategy.basedOnTimeForRefillingBucketUpToMax(
                            ofMinutes(afterBucketRefill)))
                    .build();
        } catch (Exception e) {
            logger.error("Error while creating lettuceBasedProxyManager", e);
            throw new RuntimeException("Failed to initialize Redis cluster connection", e);
        }

spring.data.redis.client-type=lettuce
spring.data.redis.host=redis-leader.redis-ratelimiter.svc.cluster.local
spring.data.redis.port=6379
spring.data.redis.password=<path:secret/data/env/redis/redis-ratelimiter/redis#password>
spring.data.redis.ssl.enabled=true
spring.data.redis.timeout=10000

My application connects to the Redis Cluster DB, but im receiving the following error sometimes, not all the time:

`2","level":"ERROR","level_value":40000,"stack_trace":"io.lettuce.core.RedisCommandExecutionException: MOVED 1197 redis-leader-0:6379\n\tat`

Im thinking the reason for it giving me the MOVED error is because i connecting to a Redis Cluster using RedisClient and not RedisClusterClient?

I've then changed my code to create a RedisClusterClient object, like this:

@Configuration
public class RedisConfig {

    private static final Logger logger = LoggerFactory.getLogger(RedisConfig.class);

    @Value("${spring.data.redis.cluster.nodes}")
    private List<String> redisNodes;

    @Value("${spring.data.redis.password}")
    private String redisPassword;

    @Value("${spring.data.redis.ssl.enabled}")
    private boolean ssl;

    @Value("${redis.ratelimiter.bucket.ttl.after.bucket.refill.in.minutes}")
    private long afterBucketRefill;

    @Bean
    public RedisClusterClient connectBasic() {
        logger.info("Attempting to connect to RedisNodes: {}", redisNodes);

        List<RedisURI> redisURIs = new ArrayList<>();
        for (String redisNode : redisNodes) {
            String[] parts = redisNode.split(":");
            RedisURI redisURI = RedisURI.Builder
                    .redis(parts[0], Integer.parseInt(parts[1]))
                    .withPassword(redisPassword.toCharArray())
                    .withTimeout(Duration.ofSeconds(30))
                    .withSsl(ssl)
                    .withVerifyPeer(false)
                    .build();
            logger.info("RedisURI={}", redisURI);
            redisURIs.add(redisURI);
        }

        logger.info("RedisURIs={}", redisURIs);
        RedisClusterClient redisClusterClient = RedisClusterClient.create(redisURIs);

        ClusterTopologyRefreshOptions topologyRefreshOptions = ClusterTopologyRefreshOptions.builder()
                .enablePeriodicRefresh(Duration.ofSeconds(30))
                .enableAllAdaptiveRefreshTriggers()
                .build();

        redisClusterClient.setOptions(ClusterClientOptions.builder()
                .topologyRefreshOptions(topologyRefreshOptions)
                .autoReconnect(true)
                .maxRedirects(5)
                .validateClusterNodeMembership(false)
                .build());

        return redisClusterClient;
    }

    @Bean
    public LettuceBasedProxyManager<String> proxyManager() {
        logger.info("proxyManager called");
        try {
            RedisClusterClient redisClient = connectBasic();

            logger.info("Establishing connection to Redis cluster...");
            StatefulRedisClusterConnection<String, byte[]> redisConnection =
                    redisClient.connect(RedisCodec.of(StringCodec.UTF8, ByteArrayCodec.INSTANCE));

            logger.info("Successfully established connection to Redis cluster");
            return Bucket4jLettuce.casBasedBuilder(redisConnection)
                    .expirationAfterWrite(ExpirationAfterWriteStrategy.basedOnTimeForRefillingBucketUpToMax(
                            ofMinutes(afterBucketRefill)))
                    .build();
        } catch (Exception e) {
            logger.error("Error while creating lettuceBasedProxyManager", e);
            throw new RuntimeException("Failed to initialize Redis cluster connection", e);
        }
    }
}

With my application.properties file looking like this:

spring.data.redis.client-type=lettuce
spring.data.redis.cluster.nodes=redis-leader-0.redis-leader-headless.redis-ratelimiter.svc.cluster.local:6379,redis-leader-1.redis-leader-headless.redis-ratelimiter.svc.cluster.local:6379,redis-leader-2.redis-leader-headless.redis-ratelimiter.svc.cluster.local:6379
spring.data.redis.password=<path:secret/data/env/redis/redis-ratelimiter/redis#password>
spring.data.redis.ssl.enabled=true

But then im getting the following errors:

22
{"@timestamp":"2025-01-17T10:13:08.272715513+01:00","@version":"1","message":"proxyManager called","logger_name":"dk.dxc.websupport.ratelimiter.config.RedisConfig","thread_name":"restartedMain","level":"INFO","level_value":20000}
21
{"@timestamp":"2025-01-17T10:13:08.273355467+01:00","@version":"1","message":"Attempting to connect to RedisNodes: [redis-leader.redis-ratelimiter.svc.cluster.local:6379]","logger_name":"dk.dxc.websupport.ratelimiter.config.RedisConfig","thread_name":"restartedMain","level":"INFO","level_value":20000}
20
{"@timestamp":"2025-01-17T10:13:08.30069787+01:00","@version":"1","message":"RedisURI=rediss://****************@redis-leader.redis-ratelimiter.svc.cluster.local:6379?verifyPeer=NONE&timeout=30s","logger_name":"dk.dxc.websupport.ratelimiter.config.RedisConfig","thread_name":"restartedMain","level":"INFO","level_value":20000}
19
{"@timestamp":"2025-01-17T10:13:08.303937579+01:00","@version":"1","message":"RedisURIs=[rediss://****************@redis-leader.redis-ratelimiter.svc.cluster.local:6379?verifyPeer=NONE&timeout=30s]","logger_name":"dk.dxc.websupport.ratelimiter.config.RedisConfig","thread_name":"restartedMain","level":"INFO","level_value":20000}
18
{"@timestamp":"2025-01-17T10:13:08.788325338+01:00","@version":"1","message":"Establishing connection to Redis cluster...","logger_name":"dk.dxc.websupport.ratelimiter.config.RedisConfig","thread_name":"restartedMain","level":"INFO","level_value":20000}
17
{"@timestamp":"2025-01-17T10:13:10.96271413+01:00","@version":"1","message":"Unable to connect to [redis-follower-2/<unresolved>:6379]: redis-follower-2: Name does not resolve","logger_name":"io.lettuce.core.cluster.topology.DefaultClusterTopologyRefresh","thread_name":"lettuce-nioEventLoop-4-4","level":"WARN","level_value":30000}
16
{"@timestamp":"2025-01-17T10:13:10.965588513+01:00","@version":"1","message":"Unable to connect to [redis-follower-0/<unresolved>:6379]: redis-follower-0: Name does not resolve","logger_name":"io.lettuce.core.cluster.topology.DefaultClusterTopologyRefresh","thread_name":"lettuce-nioEventLoop-4-2","level":"WARN","level_value":30000}
15
{"@timestamp":"2025-01-17T10:13:10.966957924+01:00","@version":"1","message":"Unable to connect to [redis-follower-1/<unresolved>:6379]: redis-follower-1: Name does not resolve","logger_name":"io.lettuce.core.cluster.topology.DefaultClusterTopologyRefresh","thread_name":"lettuce-nioEventLoop-4-3","level":"WARN","level_value":30000}
14
{"@timestamp":"2025-01-17T10:13:10.969267453+01:00","@version":"1","message":"Unable to connect to [redis-leader-2/<unresolved>:6379]: redis-leader-2: Name does not resolve","logger_name":"io.lettuce.core.cluster.topology.DefaultClusterTopologyRefresh","thread_name":"lettuce-nioEventLoop-4-1","level":"WARN","level_value":30000}
13
{"@timestamp":"2025-01-17T10:13:10.976947404+01:00","@version":"1","message":"Unable to connect to [redis-leader-0/<unresolved>:6379]: redis-leader-0: Name does not resolve","logger_name":"io.lettuce.core.cluster.topology.DefaultClusterTopologyRefresh","thread_name":"lettuce-nioEventLoop-4-5","level":"WARN","level_value":30000}
12
{"@timestamp":"2025-01-17T10:13:10.989344024+01:00","@version":"1","message":"Unable to connect to [redis-leader-1/<unresolved>:6379]: redis-leader-1: Name does not resolve","logger_name":"io.lettuce.core.cluster.topology.DefaultClusterTopologyRefresh","thread_name":"lettuce-nioEventLoop-4-6","level":"WARN","level_value":30000}
11
{"@timestamp":"2025-01-17T10:13:11.239938985+01:00","@version":"1","message":"redis-leader-0","logger_name":"io.lettuce.core.cluster.RedisClusterClient","thread_name":"restartedMain","level":"WARN","level_value":30000}
10
{"@timestamp":"2025-01-17T10:13:11.243942878+01:00","@version":"1","message":"redis-leader-2","logger_name":"io.lettuce.core.cluster.RedisClusterClient","thread_name":"lettuce-nioEventLoop-4-3","level":"WARN","level_value":30000}
9
{"@timestamp":"2025-01-17T10:13:11.248412111+01:00","@version":"1","message":"redis-follower-1","logger_name":"io.lettuce.core.cluster.RedisClusterClient","thread_name":"lettuce-nioEventLoop-4-4","level":"WARN","level_value":30000}
8
{"@timestamp":"2025-01-17T10:13:11.250842699+01:00","@version":"1","message":"redis-follower-2","logger_name":"io.lettuce.core.cluster.RedisClusterClient","thread_name":"lettuce-nioEventLoop-4-5","level":"WARN","level_value":30000}
7
{"@timestamp":"2025-01-17T10:13:11.252845637+01:00","@version":"1","message":"redis-leader-1","logger_name":"io.lettuce.core.cluster.RedisClusterClient","thread_name":"lettuce-nioEventLoop-4-6","level":"WARN","level_value":30000}
6
{"@timestamp":"2025-01-17T10:13:11.256708492+01:00","@version":"1","message":"redis-follower-0","logger_name":"io.lettuce.core.cluster.RedisClusterClient","thread_name":"lettuce-nioEventLoop-4-1","level":"WARN","level_value":30000}
5
{"@timestamp":"2025-01-17T10:13:11.257414276+01:00","@version":"1","message":"Error while creating lettuceBasedProxyManager","logger_name":"dk.dxc.websupport.ratelimiter.config.RedisConfig","thread_name":"restartedMain","level":"ERROR","level_value":40000,"stack_trace":"io.lettuce.core.RedisConnectionException: Unable to connect\n\tat io.lettuce.core.RedisConnectionException.create(RedisConnectionException.java:79)\n\tat io.lettuce.core.AbstractRedisClient.getConnection(AbstractRedisClient.java:376)\n\tat io.lettuce.core.cluster.RedisClusterClient.connect(RedisClusterClient.java:408)\n\tat dk.dxc.websupport.ratelimiter.config.RedisConfig.proxyManager(RedisConfig.java:87)\n\tat dk.dxc.websupport.ratelimiter.config.RedisConfig$$SpringCGLIB$$0.CGLIB$proxyManager$1(<generated>)\n\tat dk.dxc.websupport.ratelimiter.config.RedisConfig$$SpringCGLIB$$FastClass$$1.invoke(<generated>)\n\tat org.springframework.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:258)\n\tat org.springframework.context.annotation.ConfigurationClassEnhancer$BeanMethodInterceptor.intercept(ConfigurationClassEnhancer.java:348)\n\tat dk.dxc.websupport.ratelimiter.config.RedisConfig$$SpringCGLIB$$0.proxyManager(<generated>)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)\n\tat java.base/java.lang.reflect.Method.invoke(Unknown Source)\n\tat org.springframework.beans.factory.support.SimpleInstantiationStrategy.lambda$instantiate$0(SimpleInstantiationStrategy.java:171)\n\tat org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiateWithFactoryMethod(SimpleInstantiationStrategy.java:88)\n\tat org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:168)\n\tat org.springframework.beans.factory.support.ConstructorResolver.instantiate(ConstructorResolver.java:653)\n\tat org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:489)\n\tat org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1351)\n\tat org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1181)\n\tat org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:563)\n\tat org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:523)\n\tat org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:336)\n\tat org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:288)\n\tat org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:334)\n\tat org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)\n\tat org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1568)\n\tat org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1514)\n\tat org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:913)\n\tat org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:791)\n\tat org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:240)\n\tat org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1371)\n\tat org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1208)\n\tat org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:563)\n\tat org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:523)\n\tat org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:336)\n\tat org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:288)\n\tat org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:334)\n\tat org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)\n\tat org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1568)\n\tat org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1514)\n\tat org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:913)\n\tat org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:791)\n\tat org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:240)\n\tat org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1371)\n\tat org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1208)\n\tat org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:563)\n\tat org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:523)\n\tat org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:336)\n\tat org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:288)\n\tat org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:334)\n\tat org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)\n\tat org.springframework.beans.factory.support.DefaultListableBeanFactory.instantiateSingleton(DefaultListableBeanFactory.java:1122)\n\tat org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingleton(DefaultListableBeanFactory.java:1093)\n\tat org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:1030)\n\tat org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:987)\n\tat org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:627)\n\tat org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:146)\n\tat org.springframework.boot.SpringApplication.refresh(SpringApplication.java:752)\n\tat org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:439)\n\tat org.springframework.boot.SpringApplication.run(SpringApplication.java:318)\n\tat org.springframework.boot.SpringApplication.run(SpringApplication.java:1361)\n\tat org.springframework.boot.SpringApplication.run(SpringApplication.java:1350)\n\tat dk.dxc.websupport.ratelimiter.RateLimiterApiApplication.main(RateLimiterApiApplication.java:10)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)\n\tat java.base/java.lang.reflect.Method.invoke(Unknown Source)\n\tat org.springframework.boot.devtools.restart.RestartLauncher.run(RestartLauncher.java:50)\nCaused by: java.net.UnknownHostException: redis-follower-0\n\tat java.base/java.net.InetAddress$CachedAddresses.get(Unknown Source)\n\tat java.base/java.net.InetAddress.getAllByName0(Unknown Source)\n\tat java.base/java.net.InetAddress.getAllByName(Unknown Source)\n\tat java.base/java.net.InetAddress.getAllByName(Unknown Source)\n\tat java.base/java.net.InetAddress.getByName(Unknown Source)\n\tat io.netty.util.internal.SocketUtils$8.run(SocketUtils.java:156)\n\tat io.netty.util.internal.SocketUtils$8.run(SocketUtils.java:153)\n\tat java.base/java.security.AccessController.doPrivileged(Unknown Source)\n\tat io.netty.util.internal.SocketUtils.addressByName(SocketUtils.java:153)\n\tat io.netty.resolver.DefaultNameResolver.doResolve(DefaultNameResolver.java:41)\n\tat io.netty.resolver.SimpleNameResolver.resolve(SimpleNameResolver.java:61)\n\tat io.netty.resolver.SimpleNameResolver.resolve(SimpleNameResolver.java:53)\n\tat io.netty.resolver.InetSocketAddressResolver.doResolve(InetSocketAddressResolver.java:55)\n\tat io.netty.resolver.InetSocketAddressResolver.doResolve(InetSocketAddressResolver.java:31)\n\tat io.netty.resolver.AbstractAddressResolver.resolve(AbstractAddressResolver.java:106)\n\tat io.netty.bootstrap.Bootstrap.doResolveAndConnect0(Bootstrap.java:220)\n\tat io.netty.bootstrap.Bootstrap.access$000(Bootstrap.java:47)\n\tat io.netty.bootstrap.Bootstrap$1.operationComplete(Bootstrap.java:189)\n\tat io.netty.bootstrap.Bootstrap$1.operationComplete(Bootstrap.java:175)\n\tat io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590)\n\tat io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557)\n\tat io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492)\n\tat io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636)\n\tat io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625)\n\tat io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105)\n\tat io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84)\n\tat io.netty.channel.AbstractChannel$AbstractUnsafe.safeSetSuccess(AbstractChannel.java:988)\n\tat io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:515)\n\tat io.netty.channel.AbstractChannel$AbstractUnsafe.access$200(AbstractChannel.java:428)\n\tat io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:485)\n\tat io.netty.util.concurrent.AbstractEventExecutor.runTask(AbstractEventExecutor.java:173)\n\tat io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:166)\n\tat io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472)\n\tat io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:569)\n\tat io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997)\n\tat io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)\n\tat io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)\n\tat java.base/java.lang.Thread.run(Unknown Source)\n"}
4
{"@timestamp":"2025-01-17T10:13:11.277838914+01:00","@version":"1","message":"Exception encountered during context initialization - cancelling refresh attempt: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'rateLimitController' defined in file [/app/classes/dk/dxc/websupport/ratelimiter/controller/RateLimitController.class]: Unsatisfied dependency expressed through constructor parameter 0: Error creating bean with name 'bucketConfigurationService' defined in file [/app/classes/dk/dxc/websupport/ratelimiter/service/BucketConfigurationService.class]: Unsatisfied dependency expressed through constructor parameter 0: Error creating bean with name 'proxyManager' defined in class path resource [dk/dxc/websupport/ratelimiter/config/RedisConfig.class]: Failed to instantiate [io.github.bucket4j.redis.lettuce.cas.LettuceBasedProxyManager]: Factory method 'proxyManager' threw exception with message: Failed to initialize Redis cluster connection","logger_name":"org.springframework.boot.web.servlet.context.AnnotationConfigServletWebServerApplicationContext","thread_name":"restartedMain","level":"WARN","level_value":30000}
3

Im not sure what im doing wrong.

If you need more logs or have questions about the setup, ask and i'll try and provide answers.

They are both in the same K8s cluster.
They are running in their own namespace (application is using namespace: rest, redis cluster db is using namespace: redis-ratelimiter)
I've tried using both the service URL, pods url, spring.data.redis.host & spring.data.redis.port, spring.data.redis.cluster.nodes.
I've tried using both lettuce-core 6.4.1.RELEASE and the newest 6.5.2.RELEASE

Maybe the problem lies in the Bucket4j Library?

[tishun]

Im thinking the reason for it giving me the MOVED error is because i connecting to a Redis Cluster using RedisClient and not RedisClusterClient?

Correct. The RedisClient is not cluster aware, so might run into such (and other) issues when connecting to a cluster.

{"@timestamp":"2025-01-17T10:13:10.96271413+01:00","@Version":"1","message":"Unable to connect to [redis-follower-2/:6379]: redis-follower-2: Name does not resolve","logger_name":"io.lettuce.core.cluster.topology.DefaultClusterTopologyRefresh","thread_name":"lettuce-nioEventLoop-4-4","level":"WARN","level_value":30000}

Im not sure what im doing wrong.

I think there is an issue with your networking setup. The driver attempts to access the redis-follower-2 (among others) domain name and is unable to.

Have in mind that the topology refresh depends on the data in the Redis server, that could be seen as a result to running the CLUSTER SLOTS command. Check for discrepancies there.

I have a hunch that redis-leader-0.redis-leader-headless.redis-ratelimiter.svc.cluster.local is used to connect (successfully) to the server and then redis-leader-2 is provided by CLUSTER SLOTS as part of the topology, but the driver cannot resolve it.

[nmartini2]

Yeah i'm also thinking its something in the setup, maybe it could be related to the announce-ip in the redis.conf?

I'll have the person that set it up, take a look at it again.

The weird thing is, we have the exact same setup for .Net application and the team using it haven't reported any issues.

Thanks for your help :)

[tishun]

Yeah i'm also thinking its something in the setup, maybe it could be related to the announce-ip in the redis.conf?

Quite likely. To be fair it's hard to deduce what exactly is wrong in the setup, but the obvious problem is the RedisConnectionException: Unable to connect and thenjava.net.UnknownHostException: redis-follower-0

This is the problem that causes the application to fail during initialization and a good starting point to debug the issue.

The weird thing is, we have the exact same setup for .Net application and the team using it haven't reported any issues.

Could be related to the way the .Net driver is handling domain name resolution. You can try and verify that in the logs.

[nmartini2]

Thanks, I appreciate you for trying to help.