How to migrate from Liftbridge to Kafka¶
From some moment Liftbridge service didn't go well in production and become abandoned as a project, so we decided to switch main queue to Kafka
Tower settings:¶
-
Uncheck all
liftbridgeandnatsservices, they won't be needed anymore. -
Decide how many kafka node will be in your cluster. Possible amount: 1, 3, 5. 1 is a minimum cluster.
-
Check
kafkaservices on needed nodes. FillKafka Cluster Idif you want, and make sure it's the same on each node. Fill JVM memory limit, 1Gb will be enough for small installation. -
Please be sure that you use
consulfor your settings management(It happens when you have "consul://consul/noc," inConfig Load Preference Pathin main pageENVinTower), otherwise you need to add settings to your local config file in/opt/noc/etc/settings.yml:
redpanda:
addresses: kafka
msgstream:
client_class: noc.core.msgstream.redpanda.RedPandaClient
-
Deploy
-
After success, you can delete old services from system
systemctl stop liftbridge
systemctl stop nats-server
systemctl disable liftbridge
systemctl disable nats-server
rm -rf /var/lib/liftbridge/*