Plug-in (Function & Smart Service)Free

kafka-tools

by Appian Corporation

Description

Kafka Tools provides the following functionality that allows publishing to and consuming from topics on Kafka Servers.

Smart Services

  • Publish To Kafka
  • Consume From Kafka
  • Consume From Kafka JWT Auth Grant

In order to process the messages consumed from Kafka, it is recommended to use the Transaction Manager application. The models designed to process messages will be configured an assigned through the transaction manager job types. See documentation for Transaction Manager: https://community.appian.com/b/appmarket/posts/transaction-manager

Features

Please refer to the README for additional details

Release notes

New Features:

  • New Smart Service Consume From Kafka JWT Auth Grant. This Smart Service implements a Kafka Consumer that authenticates using the OAuth 2.0 JWT Bearer Authorization Grant as defined in RFC 7523.

Bug Fixes:

  • Ensure connection rollback upon encountering exception
Version history (18)

1.7.0

New Features:

  • New Smart Service Consume From Kafka JWT Auth Grant. This Smart Service implements a Kafka Consumer that authenticates using the OAuth 2.0 JWT Bearer Authorization Grant as defined in RFC 7523.

Bug Fixes:

  • Ensure connection rollback upon encountering exception

1.6.0

avroSchemaRegistryUrl: URL for the API endpoint for AVRO schema registry. If certificate is needed, it must be contained in truststore and keystore configuration. If specified, all topics configured to decode (consume) must be in AVRO format (no mixing of topics formats). To receive mixed format topics, 2 PM nodes needs to be configured - one for String based topics and one for Avro based topics.

1.5.2

Support a new parameter scope on both Smart Services to enable OAuth with IdPs that require a scope parameter to be provided (e.g. EntraID).
Updated kafka-clients library.

1.4.3

Upgraded kafka-clients library

1.4.2

Upgraded json-path library

1.4.1

Adds support for consuming from multiple topics

1.4.0

Adds support for setting the Key and Partition when Publishing to Kafka

1.3.2

Updated jackson core and jackson databind libraries

1.3.1

Updated snappy java and jackson databind libraries

1.3.0

Updated API usage and license file

1.2.1

Updated the snappy java library.

1.2.0

Added new authorization feature (OAUTHBEARER) and the ability to reset the offset.

1.0.6

Security Updates: Updated kafka and json-smart libraries

1.0.5

Security Updates

1.0.4

Added support for reading compressed messages with Snappy.

1.0.3

Security Updates

1.0.2

Security Updates

1.0.1

  • Fixed defect with resource bundle

Resources