Skip to main content

kubeswarm Task Queue - Redis Streams for Agent Task Dispatch

kubeswarm uses a task queue to dispatch work to agent pods on Kubernetes. Redis Streams is the default and recommended backend.

Built-in: Redis Streams​

Redis Streams is the default and recommended backend. The Helm chart includes a bundled Redis instance.

helm install kubeswarm kubeswarm/kubeswarm \
  --set redis.enabled=true          # default

Each agent gets a dedicated Redis stream. Tasks are distributed across replicas using Redis consumer groups.

Custom queue (gRPC plugin)​

For environments that require NATS, SQS, or other backends, deploy a gRPC service implementing the TaskQueue proto contract:

spec:
  plugins:
    queue:
      address: nats-adapter.svc:50052

When set, the agent ignores TASK_QUEUE_URL and routes all queue operations through the gRPC adapter.

See gRPC Plugins for the full protocol spec.

External Redis​

To use your own Redis instead of the bundled one:

helm install kubeswarm kubeswarm/kubeswarm \
  --set redis.enabled=false \
  --set taskQueueURL=redis://my-redis.svc:6379