I have kafka and zookeeper running using docker-compose from (Docker Hub) official site, and also a memgraph instance 1.6.0. Before doing anything with memgraph I have created a dummy topic test by entering into kafka container and running:
kafka-topics.sh --create --topic test --bootstrap-server localhost:9092
and confirmed it with:
kafka-topics.sh --describe --topic test --bootstrap-server localhost:9092
which confirms that I have created everything successfully
After that i have used simple transformation script shown in just to run it end to end, and transformation script was loaded successfully. But when I try to create stream using:
CREATE STREAM testStream TOPICS test TRANSFORM transformations.transform_test;
I get the following error:
Client received exception: Failed to initialize Kafka consumer testStream : Local: Broker transport failure
and I am not sure why that is.
I am not sure where to debug the error, is the problem between communication with memgraph and kafka or something else?
Just run this in docker-compose file:
And then create a dummy transformation script from memgraph tutorials, and try to create topic test, and just create stream with already given command.
I just wanted to have stream to continue the process…
Linux manjaro 5.9.16-1-MANJARO #1 SMP PREEMPT Mon Dec 21 22:00:46 UTC 2020 x86_64 GNU/Linux