Skip to main content

Kafka Node

What it does​

Publishes messages to a Kafka topic for asynchronous processing by downstream consumers.

Inputs/config​

  • Kafka credential/cluster reference.
  • Topic name and message payload.
  • Optional key, partition, and headers.

Outputs/branches​

  • Typically no matched_output.
  • Continues on default edge after publish attempt.
  • Failure details are exposed in output/error fields.

Example usage snippet​

{
  "id": "n_kafka",
  "type": "kafka_node",
  "config": {
    "topic": "orders.events",
    "key": "{{input.orderId}}",
    "message": "{{input}}"
  }
}

Common pitfalls​

  • Assuming exactly-once delivery without idempotent producer strategy.
  • Publishing messages without schema/version discipline.
  • Ignoring broker/ACL errors and missing downstream compensations.